00010000:00010000:0.0:1746155618.063498:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f2fd8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2949119) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15378 expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.063546:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f2fd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2949119) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15378 expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.063564:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f2fd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2949119) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15378 expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155618.063572:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef03b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125054080:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155618.063616:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155618.066547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.068999:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.071931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.146260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.155712:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.155746:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.193689:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1962:x1830976125183872:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23804us (23999us total) trans 0 rc 806912/806912 00000100:00100000:0.0:1746155618.193695:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7014 00002000:00100000:0.0:1746155618.193700:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1855487) req@ffff88009366e680 x1830976125183872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:689/0 lens 488/440 e 0 to 0 dl 1746155629 ref 1 fl Complete:/200/0 rc 806912/806912 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155618.193706:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366e680 with x1830976125183872 ext(1048576->1855487) 00002000:00010000:0.0:1746155618.193709:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366e680 00000100:00100000:0.0:1746155618.196932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.198924:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10707 00000100:00100000:0.0:1746155618.198936:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:31409:x1830976125184640:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155618.198966:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155618.198982:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125000/0x844e5faceb5f3017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1539b expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.199068:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124000/0x844e5faceb5f301e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199078:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124000/0x844e5faceb5f301e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199087:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124000/0x844e5faceb5f301e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199099:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f3025 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199104:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f3025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199108:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f3025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199222:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f302c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199230:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f302c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199235:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f302c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155618.199242:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155618.199314:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124000/0x844e5faceb5f301e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199328:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124000/0x844e5faceb5f301e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199333:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124000/0x844e5faceb5f301e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199338:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a124000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155618.199341:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124000/0x844e5faceb5f301e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199346:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124000/0x844e5faceb5f301e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199355:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155618.199358:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155618.199361:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124000/0x844e5faceb5f301e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.199365:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124000/0x844e5faceb5f301e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.202017:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f3025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.202028:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f3025 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.202034:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f3025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.202039:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a124200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155618.202042:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f3025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.202057:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f3025 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.202068:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51200) 00010000:00010000:0.0:1746155618.202070:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155618.202073:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f3025 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.202077:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f3025 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.202135:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125000/0x844e5faceb5f3017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1539b expref: 298 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.202145:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f302c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1539b expref: 297 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.202151:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155618.202152:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155618.202154:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a125200, rc 0) 00000100:00100000:0.0:1746155618.202211:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:31409:x1830976125184640:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3278us (5285us total) trans 8589944777 rc 0/0 00000100:00100000:0.0:1746155618.202218:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10707 00000100:00100000:0.0:1746155618.202902:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125184896 00000100:00100000:0.0:1746155618.202908:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125184896 00000100:00100000:0.0:1746155618.203290:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10708 00000100:00100000:0.0:1746155618.203296:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:31408:x1830976125184896:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155618.203312:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155618.203327:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124800/0x844e5faceb5f303a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f153a2 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.203455:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124400/0x844e5faceb5f3041 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203464:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124400/0x844e5faceb5f3041 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203471:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124400/0x844e5faceb5f3041 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203480:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124600/0x844e5faceb5f3048 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203484:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124600/0x844e5faceb5f3048 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203488:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124600/0x844e5faceb5f3048 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203583:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f304f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203591:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f304f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203596:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f304f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155618.203603:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155618.203672:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124400/0x844e5faceb5f3041 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203677:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124400/0x844e5faceb5f3041 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203685:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124400/0x844e5faceb5f3041 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203689:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a124400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155618.203691:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124400/0x844e5faceb5f3041 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203695:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124400/0x844e5faceb5f3041 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203703:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155618.203705:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155618.203719:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124400/0x844e5faceb5f3041 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203723:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124400/0x844e5faceb5f3041 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203731:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124600/0x844e5faceb5f3048 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203736:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124600/0x844e5faceb5f3048 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203740:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124600/0x844e5faceb5f3048 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203744:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a124600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155618.203745:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124600/0x844e5faceb5f3048 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203749:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124600/0x844e5faceb5f3048 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203760:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51a00) 00010000:00010000:0.0:1746155618.203762:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155618.203764:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124600/0x844e5faceb5f3048 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203767:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124600/0x844e5faceb5f3048 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.203790:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124800/0x844e5faceb5f303a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f153a2 expref: 19 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.203797:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f304f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f153a2 expref: 18 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.203802:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155618.203803:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155618.203805:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a125400, rc 0) 00000100:00100000:0.0:1746155618.203830:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:31408:x1830976125184896:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 533us (1479us total) trans 8589944778 rc 0/0 00000100:00100000:0.0:1746155618.203835:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10708 00000100:00100000:0.0:1746155618.203878:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.205890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.205956:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.206905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.215445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.235959:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.255872:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125185920 00000100:00100000:0.0:1746155618.255881:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125185920 00010000:00010000:0.0:1746155618.255922:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a76f200/0x844e5faceb5f2fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15371 expref: 11 pid: 1625 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746155618.255959:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7633 00000100:00100000:0.0:1746155618.255967:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976125185920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.255979:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.255996:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a76f200/0x844e5faceb5f2fd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15371 expref: 11 pid: 1625 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.256006:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a76f200/0x844e5faceb5f2fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15371 expref: 11 pid: 1625 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.256024:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a76f200/0x844e5faceb5f2fd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15371 expref: 11 pid: 1625 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.256050:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155618.256052:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155618.256059:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbeba00/0x844e5faceb5f306b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f153b7 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.256065:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbeba00/0x844e5faceb5f306b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f153b7 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.256092:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbeba00/0x844e5faceb5f306b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f153b7 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155618.256102:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f8d1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125054848:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155618.256191:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155618.258921:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.259954:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125186432 00000100:00100000:0.0:1746155618.259958:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125186432 00002000:00100000:0.0:1746155618.259981:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88008e26d880 x1830976125186432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:689/0 lens 488/0 e 0 to 0 dl 1746155629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155618.259990:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26d880 with x1830976125186432 ext(2097152->3145727) 00002000:00010000:0.0:1746155618.259993:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26d880 00000100:00100000:0.0:1746155618.260007:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7016 00000100:00100000:0.0:1746155618.260013:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976125186432:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155618.272883:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976125186432:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12860us (12979us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155618.272894:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7016 00002000:00100000:0.0:1746155618.272904:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88008e26d880 x1830976125186432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:689/0 lens 488/440 e 0 to 0 dl 1746155629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155618.272912:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26d880 with x1830976125186432 ext(2097152->3145727) 00002000:00010000:0.0:1746155618.272917:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26d880 00000100:00100000:0.0:1746155618.273904:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.273972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.277135:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125186944 00000100:00100000:0.0:1746155618.277142:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125186944 00000100:00100000:0.0:1746155618.277593:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 699 00000100:00100000:0.0:1746155618.277599:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976125186944:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.277608:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.277631:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135363a00/0x844e5faceb5f3087 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f153be expref: 22 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.277643:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155618.277647:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.277662:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976125186944:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 63us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.277667:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 699 00000100:00100000:0.0:1746155618.277702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.281256:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.282546:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.282585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.287000:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.287388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.289013:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125187328 00000100:00100000:0.0:1746155618.289020:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125187328 00002000:00100000:0.0:1746155618.289049:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->2949119) req@ffff880130898380 x1830976125187328/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:689/0 lens 488/0 e 0 to 0 dl 1746155629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155618.289057:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898380 with x1830976125187328 ext(2097152->2949119) 00010000:00010000:0.0:1746155618.289062:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f2fd8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2949119) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15378 expref: 13 pid: 10591 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.289073:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f2fd8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2949119) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15378 expref: 13 pid: 10591 timeout: 847 lvb_type: 0 00002000:00010000:0.0:1746155618.289078:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130898380 00000100:00100000:0.0:1746155618.289862:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1130 00000100:00100000:0.0:1746155618.289884:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976125187328:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155618.295178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.298486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.298565:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.302561:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.302835:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125188480 00000100:00100000:0.0:1746155618.302842:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125188480 00002000:00100000:0.0:1746155618.302873:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1855488->2097151) req@ffff88009f8d3b80 x1830976125188480/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:689/0 lens 488/0 e 0 to 0 dl 1746155629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155618.302881:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d3b80 with x1830976125188480 ext(1855488->2097151) 00010000:00010000:0.0:1746155618.302888:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f2fca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1536a expref: 15 pid: 10591 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.302900:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f2fca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1536a expref: 15 pid: 10591 timeout: 847 lvb_type: 0 00002000:00010000:0.0:1746155618.302907:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f8d3b80 00000100:00100000:0.0:1746155618.302922:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1131 00000100:00100000:0.0:1746155618.302928:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976125188480:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155618.307411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.308906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.312951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.312982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.313013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.313594:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7638 00000100:00100000:0.0:1746155618.313600:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976125189120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.313614:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.313627:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f2fca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1536a expref: 17 pid: 10591 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.313634:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f2fca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1536a expref: 17 pid: 10591 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.313643:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f2fca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1536a expref: 17 pid: 10591 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.313653:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155618.313654:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155618.313657:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb400/0x844e5faceb5f30bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f153ef expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.313663:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb400/0x844e5faceb5f30bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f153ef expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.313678:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb400/0x844e5faceb5f30bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f153ef expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155618.313685:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f8d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125056384:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155618.313707:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155618.321357:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f8d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125056384:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155618.321367:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.321382:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976125189120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7783us (8369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.321396:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7638 00000100:00100000:0.0:1746155618.327783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.327863:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.332969:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.333018:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.335359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.340077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.343798:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.346937:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.348582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.356924:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.356957:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.357211:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7021 00000100:00100000:0.0:1746155618.357219:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125191296:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155618.357465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.360925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.368200:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.371584:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.371645:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.374987:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.375118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.376035:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.376065:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.378641:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.382241:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.382290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.384053:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.387684:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.390968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.395026:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.395095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.399023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.399050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.399074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.399319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.399371:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.399488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.404564:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.406655:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.406675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.406685:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.406695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.406718:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.406729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.406740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.406758:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.407589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.407609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.407624:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.407641:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.407651:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125196160 00000100:00100000:0.0:1746155618.407654:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125196160 00010000:00010000:0.0:1746155618.407664:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6cd400/0x844e5faceb5f3105 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15420 expref: 12 pid: 8437 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746155618.407689:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125196544 00000100:00100000:0.0:1746155618.407691:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125196544 00010000:00010000:0.0:1746155618.407698:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c70200/0x844e5faceb5f2fc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15363 expref: 17 pid: 10591 timeout: 847 lvb_type: 1 00000100:00100000:0.0:1746155618.407705:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125197824 00000100:00100000:0.0:1746155618.407707:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125197824 00010000:00010000:0.0:1746155618.407714:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094c84200/0x844e5faceb5f2f5a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1531d expref: 15 pid: 1625 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746155618.407721:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125196032 00000100:00100000:0.0:1746155618.407723:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125196032 00010000:00010000:0.0:1746155618.407729:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135362800/0x844e5faceb5f30cd lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1884159) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f153fd expref: 29 pid: 20200 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746155618.407737:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7648 00000100:00100000:0.0:1746155618.407742:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125196160:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.407748:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.407756:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f6cd400/0x844e5faceb5f3105 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15420 expref: 12 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746155618.407762:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f6cd400/0x844e5faceb5f3105 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15420 expref: 12 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746155618.407772:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6cd400/0x844e5faceb5f3105 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15420 expref: 12 pid: 8437 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746155618.407792:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.407807:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125196160:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 64us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.407812:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7648 00000100:00100000:0.0:1746155618.407823:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7649 00000100:00100000:0.0:1746155618.407833:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976125196544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.407839:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.407846:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c70200/0x844e5faceb5f2fc3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15363 expref: 17 pid: 10591 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746155618.407853:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c70200/0x844e5faceb5f2fc3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15363 expref: 17 pid: 10591 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746155618.407862:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c70200/0x844e5faceb5f2fc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15363 expref: 17 pid: 10591 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746155618.407869:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.407880:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976125196544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 53us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.407885:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7649 00000100:00100000:0.0:1746155618.407894:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7650 00000100:00100000:0.0:1746155618.407898:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976125197824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.407903:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.407916:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094c84200/0x844e5faceb5f2f5a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1531d expref: 15 pid: 1625 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.407926:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094c84200/0x844e5faceb5f2f5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1531d expref: 15 pid: 1625 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.407937:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.407950:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976125197824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 52us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.407955:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7650 00000100:00100000:0.0:1746155618.409375:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.409420:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.409440:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.409466:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.415255:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.415304:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.422359:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.422398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.422428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.422439:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.422458:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.425521:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125198592:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9792us (10159us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155618.425531:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1138 00002000:00100000:0.0:1746155618.425540:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012b6c1880 x1830976125198592/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:689/0 lens 488/440 e 0 to 0 dl 1746155629 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155618.425548:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c1880 with x1830976125198592 ext(1048576->2097151) 00010000:00010000:0.0:1746155618.425556:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009450d200/0x844e5faceb5f30db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1540b expref: 14 pid: 8438 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.425636:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009450d200/0x844e5faceb5f30db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1540b expref: 14 pid: 8438 timeout: 847 lvb_type: 0 00002000:00010000:0.0:1746155618.425642:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b6c1880 00000100:00100000:0.0:1746155618.426093:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125199616 00000100:00100000:0.0:1746155618.426099:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125199616 00002000:00100000:0.0:1746155618.426121:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (5079040->5083135) req@ffff88012cdec380 x1830976125199616/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:689/0 lens 488/0 e 0 to 0 dl 1746155629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155618.426137:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec380 with x1830976125199616 ext(5079040->5083135) 00002000:00010000:0.0:1746155618.426140:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdec380 00000100:00100000:0.0:1746155618.426159:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7024 00000100:00100000:0.0:1746155618.426165:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976125199616:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155618.426284:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976125199616:12345-192.168.202.51@tcp:3:cat.0 Request processed in 118us (263us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155618.426289:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7024 00002000:00100000:0.0:1746155618.426293:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (5079040->5083135) req@ffff88012cdec380 x1830976125199616/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:689/0 lens 488/4536 e 0 to 0 dl 1746155629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155618.426300:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec380 with x1830976125199616 ext(5079040->5083135) 00002000:00010000:0.0:1746155618.426302:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdec380 00000100:00100000:0.0:1746155618.431183:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.431217:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.431242:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.431268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.431562:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.434793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.434852:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.436405:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.442188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.442211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.442231:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125201024 00000100:00100000:0.0:1746155618.442237:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125201024 00010000:00010000:0.0:1746155618.442260:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5647800/0x844e5faceb5f2fb5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1535c expref: 297 pid: 14234 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746155618.442286:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125200896 00000100:00100000:0.0:1746155618.442288:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125200896 00010000:00010000:0.0:1746155618.442295:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f304f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f153a2 expref: 21 pid: 14234 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746155618.442307:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7658 00000100:00100000:0.0:1746155618.442312:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1962:x1830976125201024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.442323:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.442327:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5647800/0x844e5faceb5f2fb5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1535c expref: 297 pid: 14234 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.442335:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5647800/0x844e5faceb5f2fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1535c expref: 297 pid: 14234 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.442351:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155618.442355:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095243800/0x844e5faceb5f3201 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155618.442378:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.442407:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1962:x1830976125201024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 95us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.442416:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7658 00000100:00100000:0.0:1746155618.442447:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7659 00000100:00100000:0.0:1746155618.442451:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976125200896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.442456:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.442460:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f304f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f153a2 expref: 21 pid: 14234 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.442466:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f304f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f153a2 expref: 21 pid: 14234 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.442474:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155618.442477:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095243800/0x844e5faceb5f3201 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155618.442481:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.442490:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976125200896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 39us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.442494:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7659 00000100:00100000:0.0:1746155618.442540:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.442548:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125201152 00000100:00100000:0.0:1746155618.442550:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125201152 00010000:00010000:0.0:1746155618.442557:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8da600/0x844e5faceb5f2f30 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15301 expref: 21 pid: 14234 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746155618.442576:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7660 00000100:00100000:0.0:1746155618.442580:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976125201152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.442585:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.442587:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8da600/0x844e5faceb5f2f30 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15301 expref: 21 pid: 14234 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.442593:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b8da600/0x844e5faceb5f2f30 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15301 expref: 21 pid: 14234 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.442601:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155618.442603:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095243800/0x844e5faceb5f3201 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155618.442607:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.442618:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976125201152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 37us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.442793:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7660 00000100:00100000:0.0:1746155618.443184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.443197:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.444261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.444291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.446894:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125202816 00000100:00100000:0.0:1746155618.446899:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125202816 00000100:00100000:0.0:1746155618.446922:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10715 00000100:00100000:0.0:1746155618.446927:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:31419:x1830976125202816:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155618.446943:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155618.446957:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f000/0x844e5faceb5f3208 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f154d6 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.447020:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76fe00/0x844e5faceb5f320f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.447029:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76fe00/0x844e5faceb5f320f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.447036:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76fe00/0x844e5faceb5f320f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.447045:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ee00/0x844e5faceb5f3216 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.447050:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ee00/0x844e5faceb5f3216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.447054:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ee00/0x844e5faceb5f3216 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155618.447616:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7028 00000100:00100000:0.0:1746155618.447622:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976125202432:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155618.466426:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125202944 00000100:00100000:0.0:1746155618.466434:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125202944 00000100:00100000:0.0:1746155618.466464:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10716 00000100:00100000:0.0:1746155618.466471:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:31413:x1830976125202944:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155618.466484:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155618.466696:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093603000/0x844e5faceb5f321d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f154dd expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.466742:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095243800/0x844e5faceb5f3201 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155618.466755:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093603000/0x844e5faceb5f321d lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154dd expref: 20 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.466768:0:19870:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880095243800/0x844e5faceb5f3201 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155618.466779:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093603000/0x844e5faceb5f321d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154dd expref: 20 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.466789:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155618.466792:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155618.466794:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880093603000/0x844e5faceb5f321d lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154dd expref: 20 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.466800:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093603000, rc 0) 00000100:00100000:0.0:1746155618.466832:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:31413:x1830976125202944:12345-192.168.202.51@tcp:101:cat.0 Request processed in 361us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.466838:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10716 00000100:00100000:0.0:1746155618.474957:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125060992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 540us (1490us total) trans 21474841213 rc 0/0 00000100:00100000:0.0:1746155618.475277:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15084 00000100:00100000:0.0:1746155618.475288:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15092 00000100:00100000:0.0:1746155618.475292:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125062528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155618.475365:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+15:3295:x1830976125062528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (1760us total) trans 17179873863 rc 0/0 00000100:00100000:0.0:1746155618.475369:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15092 00000004:00080000:0.0:1746155618.476798:0:14277:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 90 done 00000100:00100000:0.0:1746155618.478758:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.484808:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.484845:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.484878:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.484892:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.484905:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.484960:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.484995:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15095 00000100:00100000:0.0:1746155618.485008:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125203584:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155618.485022:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155618.485036:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093603e00/0x844e5faceb5f3247 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f154f2 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.485053:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155618.485054:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155618.485060:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093603e00/0x844e5faceb5f3247 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154f2 expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155618.485072:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093603e00/0x844e5faceb5f3247 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154f2 expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155618.485080:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093603e00, rc 0) 00000100:00100000:0.0:1746155618.485251:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094868700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125203584:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 250us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.485256:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15095 00000100:00100000:0.0:1746155618.491909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.491948:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.492010:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.511336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.515223:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.529729:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.574888:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.581200:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.581261:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.581281:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125206144 00000100:00100000:0.0:1746155618.581286:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125206144 00010000:00010000:0.0:1746155618.581312:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bddac00/0x844e5faceb5f322b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154e4 expref: 8 pid: 20364 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746155618.581341:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125206016 00000100:00100000:0.0:1746155618.581343:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125206016 00010000:00010000:0.0:1746155618.581352:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f3240 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154eb expref: 9 pid: 14234 timeout: 847 lvb_type: 0 00000100:00100000:0.0:1746155618.581363:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7665 00000100:00100000:0.0:1746155618.581369:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125206144:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.581380:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.581384:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009bddac00/0x844e5faceb5f322b lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154e4 expref: 9 pid: 20364 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.581393:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009bddac00/0x844e5faceb5f322b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154e4 expref: 9 pid: 20364 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.581410:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155618.581414:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040800/0x844e5faceb5f327f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.581426:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040800/0x844e5faceb5f327f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.581431:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.581461:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125206144:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 92us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.581467:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7665 00000100:00100000:0.0:1746155618.581500:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7666 00000100:00100000:0.0:1746155618.581522:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125206016:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.581528:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.581532:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f3240 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154eb expref: 8 pid: 14234 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.581540:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f3240 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154eb expref: 8 pid: 14234 timeout: 847 lvb_type: 0 00010000:00010000:0.0:1746155618.581549:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155618.581551:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040800/0x844e5faceb5f327f lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.581558:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040800/0x844e5faceb5f327f lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.581563:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040800/0x844e5faceb5f327f lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.581576:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.581589:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125206016:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 68us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.581600:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7666 00000100:00100000:0.0:1746155618.606136:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.606215:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125063168 00000100:00100000:0.0:1746155618.606220:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125063168 00000100:00100000:0.0:1746155618.606242:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125063680 00000100:00100000:0.0:1746155618.606244:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125063680 00000100:00100000:0.0:1746155618.606252:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125063552 00000100:00100000:0.0:1746155618.606254:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125063552 00000100:00100000:0.0:1746155618.606263:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125064064 00000100:00100000:0.0:1746155618.606264:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125064064 00000100:00100000:0.0:1746155618.606272:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125063296 00000100:00100000:0.0:1746155618.606273:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125063296 00000100:00100000:0.0:1746155618.606281:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125063808 00000100:00100000:0.0:1746155618.606283:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125063808 00000100:00100000:0.0:1746155618.606290:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125063424 00000100:00100000:0.0:1746155618.606292:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125063424 00000100:00100000:0.0:1746155618.606299:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15102 00000100:00100000:0.0:1746155618.606305:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3298:x1830976125063168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155618.606417:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15105 00000100:00100000:0.0:1746155618.606421:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3298:x1830976125064064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155618.606496:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3298:x1830976125064064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (275us total) trans 17179873869 rc 0/0 00000100:00100000:0.0:1746155618.606518:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15105 00000100:00100000:0.0:1746155618.606528:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15107 00000100:00100000:0.0:1746155618.606532:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976125063808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155618.606542:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15108 00000100:00100000:0.0:1746155618.606545:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976125063424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155618.606617:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:0.0:1746155618.606620:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155618 -> 1746155618 00002000:00010000:0.0:1746155618.606621:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155618 -> 1746155618 00002000:00010000:0.0:1746155618.606622:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155618 -> 1746155618 00002000:00010000:0.0:1746155618.606624:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5907 -> 5907 00000100:00100000:0.0:1746155618.606641:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3295:x1830976125063424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (352us total) trans 17179873871 rc 0/0 00000100:00100000:0.0:1746155618.606645:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15108 00000100:00100000:0.0:1746155618.606666:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125206400 00000100:00100000:0.0:1746155618.606668:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125206400 00000100:00100000:0.0:1746155618.606683:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10720 00000100:00100000:0.0:1746155618.606687:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:31422:x1830976125206400:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155618.606699:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155618.606708:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5f3286 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1552a expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.606770:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f328d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.606778:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f328d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.606785:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f328d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.606795:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f3294 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.606800:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f3294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.606810:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f3294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.606882:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046800/0x844e5faceb5f329b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.606889:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046800/0x844e5faceb5f329b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.606894:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046800/0x844e5faceb5f329b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155618.606901:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155618.606976:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046800/0x844e5faceb5f329b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.606982:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046800/0x844e5faceb5f329b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.606987:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046800/0x844e5faceb5f329b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.606992:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c046800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155618.606995:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046800/0x844e5faceb5f329b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607000:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046800/0x844e5faceb5f329b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607008:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155618.607010:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155618.607013:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046800/0x844e5faceb5f329b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607024:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046800/0x844e5faceb5f329b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607033:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f328d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607038:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f328d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607041:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f328d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607045:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c047000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155618.607047:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f328d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607051:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f328d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607057:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155618.607059:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155618.607061:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f328d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607066:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f328d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607073:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f3294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607077:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f3294 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607080:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f3294 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607087:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c047a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155618.607089:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f3294 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607093:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f3294 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607099:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51700) 00010000:00010000:0.0:1746155618.607100:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155618.607102:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f3294 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607106:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f3294 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.607142:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5f3286 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1552a expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.607148:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046400/0x844e5faceb5f3286 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1552a expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.607155:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c046400, rc 0) 00000100:00100000:0.0:1746155618.607175:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:31422:x1830976125206400:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 487us (1051us total) trans 8589944790 rc 301/301 00000100:00100000:0.0:1746155618.607181:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10720 00000100:00100000:0.0:1746155618.607289:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976125063808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 756us (1024us total) trans 17179873875 rc 0/0 00000100:00100000:0.0:1746155618.607294:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15107 00000100:00100000:0.0:1746155618.609178:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15118 00000100:00100000:0.0:1746155618.609189:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976125065088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155618.609478:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+23:3298:x1830976125065088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 289us (1562us total) trans 21474841222 rc 0/0 00000100:00100000:0.0:1746155618.609483:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15118 00000100:00100000:0.0:1746155618.627544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.627571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.630208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.638192:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.639917:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125207424 00000100:00100000:0.0:1746155618.639921:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125207424 00000100:00100000:0.0:1746155618.639948:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10721 00000100:00100000:0.0:1746155618.639954:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:31422:x1830976125207424:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155618.639972:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155618.639988:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44ec00/0x844e5faceb5f32b0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1553f expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.640034:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44ec00/0x844e5faceb5f32b0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1553f expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.640046:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44ec00/0x844e5faceb5f32b0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1553f expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.640061:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155618.640063:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155618.640066:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b44ec00, rc 0) 00000100:00100000:0.0:1746155618.640103:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:31422:x1830976125207424:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 149us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.640118:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10721 00000100:00100000:0.0:1746155618.642174:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.644889:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.644911:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.645461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.646299:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7671 00000100:00100000:0.0:1746155618.646305:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125207808:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.646312:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.646329:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5256e00/0x844e5faceb5f324e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154f9 expref: 9 pid: 4461 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746155618.646337:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5256e00/0x844e5faceb5f324e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154f9 expref: 9 pid: 4461 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746155618.646355:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5256e00/0x844e5faceb5f324e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154f9 expref: 9 pid: 4461 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746155618.646369:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.646384:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125207808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 80us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.646389:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7671 00000100:00100000:0.0:1746155618.646403:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7672 00000100:00100000:0.0:1746155618.646407:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976125207936:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.646412:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.646419:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e86d200/0x844e5faceb5f31b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15490 expref: 18 pid: 18270 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746155618.646433:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e86d200/0x844e5faceb5f31b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15490 expref: 18 pid: 18270 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746155618.646441:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e86d200/0x844e5faceb5f31b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15490 expref: 18 pid: 18270 timeout: 847 lvb_type: 1 00010000:00010000:0.0:1746155618.646449:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.646462:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976125207936:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 55us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.646467:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7672 00000100:00100000:0.0:1746155618.655681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.659876:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.660046:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125208960 00000100:00100000:0.0:1746155618.660048:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125208960 00000100:00100000:0.0:1746155618.660077:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10723 00000100:00100000:0.0:1746155618.660082:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:31428:x1830976125208960:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155618.660090:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155618.660107:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f400/0x844e5faceb5f32e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15554 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.660193:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5f32ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.660202:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5f32ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.660212:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5f32ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.660226:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44e200/0x844e5faceb5f32f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.660230:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44e200/0x844e5faceb5f32f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.660234:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44e200/0x844e5faceb5f32f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.660312:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5647800/0x844e5faceb5f32fd lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.660319:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5647800/0x844e5faceb5f32fd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.660324:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5647800/0x844e5faceb5f32fd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155618.660331:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155618.660393:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5647800/0x844e5faceb5f32fd lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.660399:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5647800/0x844e5faceb5f32fd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.660404:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5647800/0x844e5faceb5f32fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.660408:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5647800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155618.661111:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5647800/0x844e5faceb5f32fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661119:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5647800/0x844e5faceb5f32fd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661142:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155618.661144:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155618.661147:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5647800/0x844e5faceb5f32fd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661152:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5647800/0x844e5faceb5f32fd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661174:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5f32ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661179:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5f32ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661183:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5f32ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661187:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b44f000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155618.661189:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5f32ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661194:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5f32ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661200:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155618.661201:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155618.661203:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5f32ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661208:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44f000/0x844e5faceb5f32ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661303:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44e200/0x844e5faceb5f32f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661312:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44e200/0x844e5faceb5f32f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661317:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44e200/0x844e5faceb5f32f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661320:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b44e200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155618.661322:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44e200/0x844e5faceb5f32f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661326:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44e200/0x844e5faceb5f32f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661332:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51f00) 00010000:00010000:0.0:1746155618.661334:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155618.661336:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44e200/0x844e5faceb5f32f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155618.661340:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44e200/0x844e5faceb5f32f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155618.661416:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.665460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.665856:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.668302:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.670923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.670953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.671309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.671839:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15124 00000100:00100000:0.0:1746155618.671845:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976125210368:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155618.671858:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155618.671865:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1dc00/0x844e5faceb5f3335 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15577 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155618.671873:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155618.671875:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155618.671880:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1dc00/0x844e5faceb5f3335 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15577 expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155618.671891:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1dc00/0x844e5faceb5f3335 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15577 expref: 27 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155618.671898:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1dc00, rc 0) 00000100:00100000:0.0:1746155618.671918:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976125210368:12345-192.168.202.51@tcp:101:cat.0 Request processed in 73us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.671923:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15124 00000100:00100000:0.0:1746155618.673764:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.676082:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.679739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.690360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.690399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.690968:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7036 00000100:00100000:0.0:1746155618.690975:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125211264:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155618.705578:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.705627:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.709067:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.710945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.715465:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.729806:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.736686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.740447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.740483:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.740563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.762196:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.762225:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.762244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.763244:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a885180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1962:x1830976125212928:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21291us (22758us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155618.763251:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7039 00002000:00100000:0.0:1746155618.763256:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009a885180 x1830976125212928/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:689/0 lens 488/440 e 0 to 0 dl 1746155629 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155618.763262:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a885180 with x1830976125212928 ext(1048576->2097151) 00002000:00010000:0.0:1746155618.763265:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a885180 00000100:00100000:0.0:1746155618.794471:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.794545:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.794571:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.794637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.794658:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125214720 00000100:00100000:0.0:1746155618.794660:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125214720 00002000:00100000:0.0:1746155618.794674:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012b6c1180 x1830976125214720/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:689/0 lens 488/0 e 0 to 0 dl 1746155629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155618.794682:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c1180 with x1830976125214720 ext(2097152->3145727) 00002000:00010000:0.0:1746155618.794684:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b6c1180 00000100:00100000:0.0:1746155618.794703:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7046 00000100:00100000:0.0:1746155618.794706:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976125214848:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155618.814530:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.816543:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.816608:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125215488 00000100:00100000:0.0:1746155618.816611:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125215488 00002000:00100000:0.0:1746155618.816627:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012b6c1c00 x1830976125215488/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:689/0 lens 488/0 e 0 to 0 dl 1746155629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155618.816634:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c1c00 with x1830976125215488 ext(3145728->4194303) 00002000:00010000:0.0:1746155618.816637:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b6c1c00 00000100:00100000:0.0:1746155618.816659:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7049 00000100:00100000:0.0:1746155618.816664:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976125215488:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155618.817025:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.817050:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.823549:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.835736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.846367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.848166:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.882459:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.887210:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.900574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.900800:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125217664 00000100:00100000:0.0:1746155618.900808:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125217664 00010000:00010000:0.0:1746155618.900838:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c71600/0x844e5faceb5f3351 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15593 expref: 20 pid: 29728 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746155618.900873:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125217792 00000100:00100000:0.0:1746155618.900876:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125217792 00010000:00010000:0.0:1746155618.900887:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f334a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1558c expref: 14 pid: 29728 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746155618.900902:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7677 00000100:00100000:0.0:1746155618.900907:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976125217792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.900913:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.900922:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f334a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1558c expref: 14 pid: 29728 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746155618.900940:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f334a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1558c expref: 14 pid: 29728 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746155618.901098:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f334a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1558c expref: 14 pid: 29728 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746155618.901885:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.904609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.908004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.913815:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.931811:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.939942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.939989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.940028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.940171:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125218944 00000100:00100000:0.0:1746155618.940174:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125218944 00010000:00010000:0.0:1746155618.940257:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130e0b000/0x844e5faceb5f31ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5079040->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15482 expref: 26 pid: 19959 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746155618.940280:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7678 00000100:00100000:0.0:1746155618.940287:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125218816:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155618.940298:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155618.940314:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6041600/0x844e5faceb5f3263 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1550e expref: 7 pid: 8438 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746155618.940323:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6041600/0x844e5faceb5f3263 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1550e expref: 7 pid: 8438 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746155618.940342:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6041600/0x844e5faceb5f3263 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1550e expref: 7 pid: 8438 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746155618.940398:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155618.940429:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1960:x1830976125218816:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 143us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155618.940435:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7678 00000100:00100000:0.0:1746155618.946497:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125219328 00000100:00100000:0.0:1746155618.946525:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125219328 00002000:00100000:0.0:1746155618.946575:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3325952->3330047) req@ffff8800a6062680 x1830976125219328/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:689/0 lens 488/0 e 0 to 0 dl 1746155629 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155618.946586:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6062680 with x1830976125219328 ext(3325952->3330047) 00002000:00010000:0.0:1746155618.946590:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6062680 00000100:00100000:0.0:1746155618.946618:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7056 00000100:00100000:0.0:1746155618.946625:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976125219328:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155618.946761:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976125219328:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 137us (680us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155618.946767:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7056 00002000:00100000:0.0:1746155618.946774:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3325952->3330047) req@ffff8800a6062680 x1830976125219328/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:689/0 lens 488/4536 e 0 to 0 dl 1746155629 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155618.946781:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6062680 with x1830976125219328 ext(3325952->3330047) 00002000:00010000:0.0:1746155618.946784:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6062680 00000100:00100000:0.0:1746155618.952044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.954743:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.985470:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.990821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155618.993257:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.001877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.019899:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.025757:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.041052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.048082:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.048759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.063090:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125221376:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14029us (15007us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155619.063102:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7059 00002000:00100000:0.0:1746155619.063112:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a01d0e00 x1830976125221376/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:690/0 lens 488/440 e 0 to 0 dl 1746155630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155619.063141:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d0e00 with x1830976125221376 ext(2097152->3145727) 00002000:00010000:0.0:1746155619.063146:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d0e00 00000100:00100000:0.0:1746155619.087039:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.089838:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.099990:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:0.0:1746155619.103741:0:29728:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime: 1746155618 -> 1746155619 00000100:00100000:0.0:1746155619.114378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.145065:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.149813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.151551:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.154158:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1144 00000100:00100000:0.0:1746155619.154168:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976125223424:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155619.169351:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.171663:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.174450:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125069312:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155619.174463:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155619.174568:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976125223808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2784us (2906us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155619.174575:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7683 00000100:00100000:0.0:1746155619.176546:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.176845:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.185666:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.193195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.205270:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.211373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.222813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.233255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.242664:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.252613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.262130:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125226880 00000100:00100000:0.0:1746155619.262135:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125226880 00000100:00100000:0.0:1746155619.273060:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.275139:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.275952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.277144:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.283556:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.288438:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.293767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.298137:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.300666:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.302812:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.302845:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.304708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.313055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.314034:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.314875:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.319889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.337309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.347979:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.362919:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.372453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.372491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.372560:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.372601:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125230336 00000100:00100000:0.0:1746155619.372608:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125230336 00002000:00100000:0.0:1746155619.372644:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f8d2680 x1830976125230336/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:690/0 lens 488/0 e 0 to 0 dl 1746155630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155619.372652:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d2680 with x1830976125230336 ext(2097152->3145727) 00002000:00010000:0.0:1746155619.372656:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d2680 00000100:00100000:0.0:1746155619.372671:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125230592 00000100:00100000:0.0:1746155619.372673:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125230592 00002000:00100000:0.0:1746155619.372684:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f8d1500 x1830976125230592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:690/0 lens 488/0 e 0 to 0 dl 1746155630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155619.372690:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d1500 with x1830976125230592 ext(3145728->4194303) 00002000:00010000:0.0:1746155619.372692:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f8d1500 00000100:00100000:0.0:1746155619.372714:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125230848 00000100:00100000:0.0:1746155619.372717:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125230848 00002000:00100000:0.0:1746155619.372728:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f8d0e00 x1830976125230848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:690/0 lens 488/0 e 0 to 0 dl 1746155630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155619.372733:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f8d0e00 with x1830976125230848 ext(3145728->4194303) 00002000:00010000:0.0:1746155619.372736:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f8d0e00 00000100:00100000:0.0:1746155619.372746:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7073 00000100:00100000:0.0:1746155619.372752:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976125230336:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155619.403768:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.424049:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.424092:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.438662:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.439737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.440032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.440732:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.440755:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.440769:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125233152 00000100:00100000:0.0:1746155619.440772:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125233152 00002000:00100000:0.0:1746155619.440785:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff880099efc050 x1830976125233152/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:690/0 lens 488/0 e 0 to 0 dl 1746155630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155619.440792:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099efc050 with x1830976125233152 ext(3145728->4194303) 00002000:00010000:0.0:1746155619.440794:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099efc050 00000100:00100000:0.0:1746155619.440803:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7079 00000100:00100000:0.0:1746155619.440807:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1963:x1830976125232896:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155619.470475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.472759:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.472836:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.473956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.473970:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125233536 00000100:00100000:0.0:1746155619.473973:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125233536 00010000:00010000:0.0:1746155619.473988:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5f31f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154ba expref: 16 pid: 8437 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746155619.474009:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125233792 00000100:00100000:0.0:1746155619.474011:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125233792 00010000:00010000:0.0:1746155619.474020:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f3255 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15500 expref: 7 pid: 29728 timeout: 848 lvb_type: 1 00000100:00100000:0.0:1746155619.474032:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7693 00000100:00100000:0.0:1746155619.474037:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125233536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155619.474044:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155619.474068:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5f31f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154ba expref: 16 pid: 8437 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746155619.474437:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5f31f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154ba expref: 16 pid: 8437 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746155619.474452:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5b9ca00/0x844e5faceb5f31f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f154ba expref: 16 pid: 8437 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746155619.474467:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155619.474494:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976125233536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 456us (1736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155619.474499:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7693 00000100:00100000:0.0:1746155619.475449:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.481787:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.483184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.486935:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.489459:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.490825:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.490881:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.491673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.492347:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7696 00000100:00100000:0.0:1746155619.492353:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976125235712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155619.492361:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155619.492372:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc8e00/0x844e5faceb5f34af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1562d expref: 28 pid: 18270 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746155619.492388:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc8e00/0x844e5faceb5f34af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1562d expref: 28 pid: 18270 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746155619.492433:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5cc8e00/0x844e5faceb5f34af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1562d expref: 28 pid: 18270 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746155619.492447:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155619.492448:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155619.492453:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880134a51a00/0x844e5faceb5f353b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2985984->3145727] (req 2985984->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15665 expref: 25 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155619.492460:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880134a51a00/0x844e5faceb5f353b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2985984->3145727] (req 2985984->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15665 expref: 25 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155619.492490:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880134a51a00/0x844e5faceb5f353b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2985984->3145727] (req 2985984->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15665 expref: 25 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155619.492520:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe92680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125072128:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155619.492559:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155619.494620:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.496835:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.500188:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.501360:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.501517:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.508551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.515847:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.518759:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.542163:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.569354:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.582104:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.582157:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.582643:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15160 00000100:00100000:0.0:1746155619.582650:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976125239552:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155619.582661:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155619.582668:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fca1800/0x844e5faceb5f35b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f156c0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155619.582757:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125073152:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155619.583367:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155619.590671:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.594369:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.599912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.608195:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.619012:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.623767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.623936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.624153:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125240832 00000100:00100000:0.0:1746155619.624156:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125240832 00010000:00010000:0.0:1746155619.624174:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ce00/0x844e5faceb5f3312 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1555b expref: 306 pid: 14234 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746155619.624201:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7701 00000100:00100000:0.0:1746155619.624207:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:1960:x1830976125240832:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155619.624223:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155619.624228:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ce00/0x844e5faceb5f3312 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1555b expref: 306 pid: 14234 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746155619.624236:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ce00/0x844e5faceb5f3312 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1555b expref: 306 pid: 14234 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746155619.624250:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9ce00/0x844e5faceb5f3312 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1555b expref: 306 pid: 14234 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746155619.624265:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155619.625586:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26be00/0x844e5faceb5f35c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155619.625597:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26be00/0x844e5faceb5f35c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155619.625601:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155619.625640:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+305:1960:x1830976125240832:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1432us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155619.625717:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7701 00000100:00100000:0.0:1746155619.626193:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125240704 00000100:00100000:0.0:1746155619.626198:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125240704 00010000:00010000:0.0:1746155619.626213:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f088000/0x844e5faceb5f3320 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15562 expref: 21 pid: 20364 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746155619.626317:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7702 00000100:00100000:0.0:1746155619.626323:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976125240704:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155619.626330:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155619.626340:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f088000/0x844e5faceb5f3320 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15562 expref: 21 pid: 20364 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746155619.626348:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f088000/0x844e5faceb5f3320 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15562 expref: 21 pid: 20364 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746155619.626362:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f088000/0x844e5faceb5f3320 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15562 expref: 21 pid: 20364 timeout: 848 lvb_type: 0 00010000:00010000:0.0:1746155619.626371:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155619.626374:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26be00/0x844e5faceb5f35c7 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155619.626379:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26be00/0x844e5faceb5f35c7 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155619.626384:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26be00/0x844e5faceb5f35c7 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155619.627278:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155619.632128:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.640199:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.643634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.643666:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.643724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.644522:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7091 00000100:00100000:0.0:1746155619.644528:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125242112:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155619.656579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.659438:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125242112:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14908us (15711us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155619.659453:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7091 00002000:00100000:0.0:1746155619.659461:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f0b3b80 x1830976125242112/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:690/0 lens 488/440 e 0 to 0 dl 1746155630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155619.659469:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0b3b80 with x1830976125242112 ext(3145728->4194303) 00002000:00010000:0.0:1746155619.659473:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0b3b80 00000100:00100000:0.0:1746155619.662631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.663041:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.663355:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.664333:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.672811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.674648:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.687221:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.699074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.703577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.713184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.718577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.722802:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.727726:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.730922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.741729:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.741779:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.746406:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.748518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.749274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.749478:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7709 00000100:00100000:0.0:1746155619.749485:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125245184:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155619.749620:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155619.749629:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1dc00/0x844e5faceb5f3335 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15577 expref: 28 pid: 8436 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746155619.749637:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1dc00/0x844e5faceb5f3335 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15577 expref: 28 pid: 8436 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746155619.749647:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1dc00/0x844e5faceb5f3335 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15577 expref: 28 pid: 8436 timeout: 848 lvb_type: 1 00010000:00010000:0.0:1746155619.749663:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155619.749665:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155619.749670:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4d9600/0x844e5faceb5f3653 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1571b expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155619.749677:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4d9600/0x844e5faceb5f3653 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1571b expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155619.749701:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4d9600/0x844e5faceb5f3653 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1597440->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1571b expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155619.749711:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f8d1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125075328:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155619.749752:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155619.751525:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.751563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.751587:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.751663:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.751696:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.752566:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7097 00000100:00100000:0.0:1746155619.752573:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1963:x1830976125245696:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155619.758000:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.767550:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125246848 00000100:00100000:0.0:1746155619.767554:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125246848 00010000:00010000:0.0:1746155619.767574:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6cc000/0x844e5faceb5f3438 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f155ee expref: 23 pid: 29728 timeout: 848 lvb_type: 0 00000100:00100000:0.0:1746155619.768960:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7711 00000100:00100000:0.0:1746155619.768975:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125246848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155619.784413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.784465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.785995:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.787382:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.790015:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.791127:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.807435:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.807487:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.808068:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15177 00000100:00100000:0.0:1746155619.808073:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1962:x1830976125248896:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155619.808079:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155619.808085:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df40600/0x844e5faceb5f3684 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1574c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155619.808099:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012df40600/0x844e5faceb5f3684 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1574c expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155619.808127:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df40600/0x844e5faceb5f3684 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1574c expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155619.808145:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df40600, rc 0) 00000100:00100000:0.0:1746155619.808164:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f8d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1962:x1830976125248896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 91us (676us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155619.808169:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15177 00000100:00100000:0.0:1746155619.815546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.855704:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.855742:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125249536 00000100:00100000:0.0:1746155619.855749:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125249536 00000100:00100000:0.0:1746155619.856729:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 191 00000100:00100000:0.0:1746155619.856736:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:1963:x1830976125249664:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:0.0:1746155619.856775:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:1963:x1830976125249664:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 39us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155619.856780:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 191 00000100:00100000:0.0:1746155619.856791:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10740 00000100:00100000:0.0:1746155619.856795:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f8d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+305:31485:x1830976125249536:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155619.856803:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155619.856816:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df40a00/0x844e5faceb5f368b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15753 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155619.856896:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df40000/0x844e5faceb5f3692 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155619.856917:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df40000/0x844e5faceb5f3692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155619.856927:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df40000/0x844e5faceb5f3692 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155619.856944:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df40e00/0x844e5faceb5f3699 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155619.856949:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df40e00/0x844e5faceb5f3699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155619.856954:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df40e00/0x844e5faceb5f3699 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155619.857042:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df41000/0x844e5faceb5f36a0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155619.857051:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df41000/0x844e5faceb5f36a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155619.857056:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df41000/0x844e5faceb5f36a0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155619.857066:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000100:00100000:0.0:1746155619.864609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.868440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.868469:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.868532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.873218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.876474:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.888442:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.893892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.919660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.923437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.923633:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.924549:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125251456 00000100:00100000:0.0:1746155619.924554:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125251456 00000100:00100000:0.0:1746155619.924578:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125251712 00000100:00100000:0.0:1746155619.924580:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125251712 00000100:00100000:0.0:1746155619.929058:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.929082:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125251840 00000100:00100000:0.0:1746155619.929086:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125251840 00002000:00100000:0.0:1746155619.929108:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1388543) req@ffff88012fe8f480 x1830976125251840/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:690/0 lens 488/0 e 0 to 0 dl 1746155630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155619.929126:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8f480 with x1830976125251840 ext(1048576->1388543) 00010000:00010000:0.0:1746155619.929132:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd17a00/0x844e5faceb5f365a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15722 expref: 18 pid: 29728 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746155619.929140:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd17a00/0x844e5faceb5f365a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1388543) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15722 expref: 18 pid: 29728 timeout: 849 lvb_type: 0 00002000:00010000:0.0:1746155619.929146:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012fe8f480 00000100:00100000:0.0:1746155619.929163:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1152 00000100:00100000:0.0:1746155619.929169:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976125251840:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155619.935439:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.937974:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.940010:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.940978:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.951616:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.952096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.955541:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125253120 00000100:00100000:0.0:1746155619.955549:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125253120 00000100:00100000:0.0:1746155619.955596:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125253376 00000100:00100000:0.0:1746155619.955601:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125253376 00000100:00100000:0.0:1746155619.955635:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15183 00000100:00100000:0.0:1746155619.955644:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:31490:x1830976125253632:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155619.955662:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155619.955679:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df41600/0x844e5faceb5f3733 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f157bc expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155619.955708:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fe5ec00/0x844e5faceb5f36c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1576f expref: 29 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155619.955716:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155619.955717:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155619.955721:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012df41600/0x844e5faceb5f3733 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [110592->176127] (req 110592->176127) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f157bc expref: 29 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155619.955763:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fe5ec00/0x844e5faceb5f36c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1576f expref: 29 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155619.955775:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fe5ec00/0x844e5faceb5f36c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1576f expref: 29 pid: 18270 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746155619.955787:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125077504:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155619.955861:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155619.955930:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.955954:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125252992 00000100:00100000:0.0:1746155619.955958:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125252992 00000100:00100000:0.0:1746155619.955987:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15187 00000100:00100000:0.0:1746155619.955994:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1963:x1830976125252992:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155619.956003:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155619.956011:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df41200/0x844e5faceb5f3741 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15799 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155619.956022:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155619.956024:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155619.956029:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df41200/0x844e5faceb5f3741 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15799 expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155619.956039:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df41200/0x844e5faceb5f3741 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15799 expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155619.956046:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df41200, rc 0) 00000100:00100000:0.0:1746155619.956066:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976125252992:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 73us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155619.956072:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15187 00000100:00100000:0.0:1746155619.956162:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.956173:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125253248 00000100:00100000:0.0:1746155619.956176:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125253248 00000100:00100000:0.0:1746155619.956190:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15188 00000100:00100000:0.0:1746155619.956194:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1963:x1830976125253248:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155619.956200:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155619.956206:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df40e00/0x844e5faceb5f374f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f157a7 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155619.956232:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125077632:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155619.956251:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155619.956289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.956300:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125253504 00000100:00100000:0.0:1746155619.956302:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125253504 00000100:00100000:0.0:1746155619.956323:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15189 00000100:00100000:0.0:1746155619.956327:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976125253504:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155619.956332:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155619.956338:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df40200/0x844e5faceb5f375d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f157b5 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155619.956347:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155619.956348:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155619.956352:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df40200/0x844e5faceb5f375d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f157b5 expref: 9 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155619.956360:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df40200/0x844e5faceb5f375d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f157b5 expref: 9 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155619.956366:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df40200, rc 0) 00000100:00100000:0.0:1746155619.956379:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976125253504:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 52us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155619.956384:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15189 00000100:00100000:0.0:1746155619.959855:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125254144 00000100:00100000:0.0:1746155619.959863:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125254144 00002000:00100000:0.0:1746155619.959893:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800a6060380 x1830976125254144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:690/0 lens 488/0 e 0 to 0 dl 1746155630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155619.959905:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060380 with x1830976125254144 ext(1048576->2097151) 00002000:00010000:0.0:1746155619.959907:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6060380 00000100:00100000:0.0:1746155619.959919:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125254272 00000100:00100000:0.0:1746155619.959921:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125254272 00002000:00100000:0.0:1746155619.959931:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a6061c00 x1830976125254272/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:690/0 lens 488/0 e 0 to 0 dl 1746155630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155619.959937:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6061c00 with x1830976125254272 ext(1048576->2097151) 00002000:00010000:0.0:1746155619.959939:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6061c00 00000100:00100000:0.0:1746155619.972679:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125254144:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12729us (12851us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155619.972688:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7104 00002000:00100000:0.0:1746155619.972699:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800a6060380 x1830976125254144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:690/0 lens 488/440 e 0 to 0 dl 1746155630 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155619.972706:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060380 with x1830976125254144 ext(1048576->2097151) 00002000:00010000:0.0:1746155619.972711:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6060380 00000100:00100000:0.0:1746155619.981090:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.981217:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.982688:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125255296 00000100:00100000:0.0:1746155619.982694:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125255296 00002000:00100000:0.0:1746155619.982724:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (110592->114687) req@ffff8800a6062a00 x1830976125255296/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:690/0 lens 488/0 e 0 to 0 dl 1746155630 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155619.982732:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6062a00 with x1830976125255296 ext(110592->114687) 00002000:00010000:0.0:1746155619.982736:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6062a00 00000100:00100000:0.0:1746155619.982757:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7107 00000100:00100000:0.0:1746155619.982776:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976125255296:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155619.982921:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976125255296:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 145us (317us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155619.982927:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7107 00002000:00100000:0.0:1746155619.982934:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (110592->114687) req@ffff8800a6062a00 x1830976125255296/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:690/0 lens 488/4536 e 0 to 0 dl 1746155630 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155619.982940:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6062a00 with x1830976125255296 ext(110592->114687) 00002000:00010000:0.0:1746155619.982943:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6062a00 00000100:00100000:0.0:1746155619.989849:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.989896:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.991408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155619.996986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.002692:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.011952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.011988:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.012023:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.018827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155620.019288:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155620.024484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.028043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.034715:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.036606:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155620.037055:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155620.045633:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.054768:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.060896:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.067843:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.075003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.075173:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.075491:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15200 00000100:00100000:0.0:1746155620.075500:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976125259136:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155620.075531:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155620.075545:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df41400/0x844e5faceb5f37fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15825 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155620.075584:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125078912:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155620.075639:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155620.084724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.084755:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.088418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.088463:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.110274:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.115942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.133152:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.139010:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.150970:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.151686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155620.153001:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26ac00/0x844e5faceb5f3828 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155620.153008:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26ac00/0x844e5faceb5f3828 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155620.153022:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155620.153141:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26bc00/0x844e5faceb5f3821 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1584f expref: 313 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.153384:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26ac00/0x844e5faceb5f3828 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1584f expref: 312 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.153390:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155620.153392:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155620.153394:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e26ac00, rc 0) 00000100:00100000:0.0:1746155620.153566:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:31498:x1830976125260928:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 13292us (14556us total) trans 8589944835 rc 0/0 00000100:00100000:0.0:1746155620.153571:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10748 00000100:00100000:0.0:1746155620.158899:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.158946:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.165052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.165105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.166305:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7114 00000100:00100000:0.0:1746155620.166312:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976125262080:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155620.166412:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976125262080:12345-192.168.202.51@tcp:3:cat.0 Request processed in 100us (1306us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155620.166417:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7114 00002000:00100000:0.0:1746155620.166422:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e3:0x0] (1191936->1196031) req@ffff8800a01d2d80 x1830976125262080/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:691/0 lens 488/4536 e 0 to 0 dl 1746155631 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155620.166428:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d2d80 with x1830976125262080 ext(1191936->1196031) 00002000:00010000:0.0:1746155620.166431:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d2d80 00000100:00100000:0.0:1746155620.173133:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.181456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.201009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.201090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.204475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.206125:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.209080:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.210221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.242994:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.248048:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.248936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.252239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.256773:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.265274:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125081216:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155620.265291:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155620.265330:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976125265024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3016us (3127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155620.265338:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7732 00000100:00100000:0.0:1746155620.267255:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.312688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.313087:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.313150:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15214 00000100:00100000:0.0:1746155620.313155:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1962:x1830976125265408:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155620.313174:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155620.313182:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe21c00/0x844e5faceb5f386e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15887 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155620.313220:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef01180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125081344:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155620.315695:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155620.327614:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.342826:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.344900:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1962:x1830976125265792:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17051us (17291us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155620.344907:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7118 00002000:00100000:0.0:1746155620.344914:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88012ef02d80 x1830976125265792/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:691/0 lens 488/440 e 0 to 0 dl 1746155631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155620.344922:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ef02d80 with x1830976125265792 ext(0->1048575) 00002000:00010000:0.0:1746155620.344925:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ef02d80 00000100:00100000:0.0:1746155620.355669:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.358182:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.374271:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.374340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.377409:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.408216:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.409085:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.411942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.415803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.421808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.427240:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.438967:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.441741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.444274:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.448566:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.448684:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.451524:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.455075:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.456737:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125269120 00000100:00100000:0.0:1746155620.456741:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125269120 00000100:00100000:0.0:1746155620.456771:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10750 00000100:00100000:0.0:1746155620.456777:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:31513:x1830976125269120:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155620.456796:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155620.456808:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df40200/0x844e5faceb5f38bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f158b8 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155620.462592:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.468212:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125270144 00000100:00100000:0.0:1746155620.468218:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125270144 00002000:00100000:0.0:1746155620.468251:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a62a1f80 x1830976125270144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:691/0 lens 488/0 e 0 to 0 dl 1746155631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155620.468259:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a1f80 with x1830976125270144 ext(2097152->3145727) 00002000:00010000:0.0:1746155620.468263:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a1f80 00000100:00100000:0.0:1746155620.468294:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7123 00000100:00100000:0.0:1746155620.468301:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976125270144:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155620.476886:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.482059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.482147:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.482182:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.482205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.493674:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.500161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.505063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.512145:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.513585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.522779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.527581:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.531958:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.533348:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.537319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.539159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.547803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.547840:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.547872:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.547892:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125273216 00000100:00100000:0.0:1746155620.547898:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125273216 00002000:00100000:0.0:1746155620.547932:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88012fef1500 x1830976125273216/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:691/0 lens 488/0 e 0 to 0 dl 1746155631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155620.547941:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef1500 with x1830976125273216 ext(1048576->2097151) 00002000:00010000:0.0:1746155620.547945:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef1500 00000100:00100000:0.0:1746155620.547970:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125273472 00000100:00100000:0.0:1746155620.547972:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125273472 00002000:00100000:0.0:1746155620.547983:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012fef3b80 x1830976125273472/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:691/0 lens 488/0 e 0 to 0 dl 1746155631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155620.547989:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef3b80 with x1830976125273472 ext(1048576->2097151) 00002000:00010000:0.0:1746155620.547992:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef3b80 00000100:00100000:0.0:1746155620.548002:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7127 00000100:00100000:0.0:1746155620.548007:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1961:x1830976125273216:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155620.554549:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.555287:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125084544:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155620.555302:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155620.558210:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1961:x1830976125273216:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10198us (10364us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155620.558217:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7127 00002000:00100000:0.0:1746155620.558222:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88012fef1500 x1830976125273216/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:691/0 lens 488/440 e 0 to 0 dl 1746155631 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155620.558228:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef1500 with x1830976125273216 ext(1048576->2097151) 00002000:00010000:0.0:1746155620.558231:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef1500 00000100:00100000:0.0:1746155620.565167:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.587183:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.587301:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.595229:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.595267:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.601242:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.607713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.607748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.607760:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.607791:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.607811:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125275392 00000100:00100000:0.0:1746155620.607817:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125275392 00002000:00100000:0.0:1746155620.607849:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009b880700 x1830976125275392/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:691/0 lens 488/0 e 0 to 0 dl 1746155631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155620.607858:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880700 with x1830976125275392 ext(2097152->3145727) 00002000:00010000:0.0:1746155620.607864:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b880700 00000100:00100000:0.0:1746155620.607878:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125276032 00000100:00100000:0.0:1746155620.607884:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125276032 00002000:00100000:0.0:1746155620.607897:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009b880e00 x1830976125276032/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:691/0 lens 488/0 e 0 to 0 dl 1746155631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155620.607903:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880e00 with x1830976125276032 ext(3145728->4194303) 00002000:00010000:0.0:1746155620.607906:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b880e00 00000100:00100000:0.0:1746155620.607913:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125275904 00000100:00100000:0.0:1746155620.607915:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125275904 00002000:00100000:0.0:1746155620.607924:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009b882680 x1830976125275904/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:691/0 lens 488/0 e 0 to 0 dl 1746155631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155620.607929:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882680 with x1830976125275904 ext(2097152->3145727) 00002000:00010000:0.0:1746155620.607931:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b882680 00000100:00100000:0.0:1746155620.607941:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7132 00000100:00100000:0.0:1746155620.607946:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976125275392:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155620.636124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.645215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.645258:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.660935:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125084928:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155620.660956:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155620.660985:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976125276416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 15040us (15726us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155620.660993:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7747 00000100:00100000:0.0:1746155620.661593:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.668361:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.670718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.680443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.709213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.725819:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125278208 00000100:00100000:0.0:1746155620.725827:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125278208 00010000:00010000:0.0:1746155620.725857:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa85e00/0x844e5faceb5f38ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f158aa expref: 37 pid: 18270 timeout: 849 lvb_type: 0 00000100:00100000:0.0:1746155620.725885:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7748 00000100:00100000:0.0:1746155620.725891:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1962:x1830976125278208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155620.725903:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155620.725921:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa85e00/0x844e5faceb5f38ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f158aa expref: 37 pid: 18270 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746155620.725931:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa85e00/0x844e5faceb5f38ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f158aa expref: 37 pid: 18270 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746155620.725950:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa85e00/0x844e5faceb5f38ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f158aa expref: 37 pid: 18270 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746155620.725974:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155620.726005:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976125278208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 115us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155620.726011:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7748 00000100:00100000:0.0:1746155620.730371:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.730424:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.742998:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.752592:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.758034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.763233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.766650:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.780000:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.784376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.786924:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.790321:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.790384:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.790404:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.790423:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.790598:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.790734:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.801032:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.804215:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.807604:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.812111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.816307:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.816339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.816848:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.817634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.818423:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.818707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.826190:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125282816 00000100:00100000:0.0:1746155620.826193:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125282816 00002000:00100000:0.0:1746155620.826219:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e1:0x0] (794624->843775) req@ffff88009c212d80 x1830976125282816/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:691/0 lens 488/0 e 0 to 0 dl 1746155631 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155620.826227:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212d80 with x1830976125282816 ext(794624->843775) 00010000:00010000:0.0:1746155620.826232:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e257e00/0x844e5faceb5f3955 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->843775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1591a expref: 35 pid: 4461 timeout: 849 lvb_type: 0 00010000:00010000:0.0:1746155620.826252:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e257e00/0x844e5faceb5f3955 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 794624->843775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1591a expref: 35 pid: 4461 timeout: 849 lvb_type: 0 00002000:00010000:0.0:1746155620.826258:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c212d80 00000100:00100000:0.0:1746155620.826273:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1165 00000100:00100000:0.0:1746155620.826277:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1962:x1830976125282816:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155620.828526:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125283712 00000100:00100000:0.0:1746155620.828529:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125283712 00010000:00010000:0.0:1746155620.828542:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fe5e000/0x844e5faceb5f38e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f158c6 expref: 29 pid: 8436 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746155620.828554:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125282688 00000100:00100000:0.0:1746155620.828556:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125282688 00010000:00010000:0.0:1746155620.828564:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008e257c00/0x844e5faceb5f39a2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15952 expref: 9 pid: 29728 timeout: 849 lvb_type: 1 00000100:00100000:0.0:1746155620.828574:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7761 00000100:00100000:0.0:1746155620.828579:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1961:x1830976125283712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155620.829471:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155620.829483:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fe5e000/0x844e5faceb5f38e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f158c6 expref: 31 pid: 8436 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746155620.829490:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fe5e000/0x844e5faceb5f38e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f158c6 expref: 31 pid: 8436 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746155620.829526:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fe5e000/0x844e5faceb5f38e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f158c6 expref: 31 pid: 8436 timeout: 849 lvb_type: 1 00010000:00010000:0.0:1746155620.829535:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155620.829540:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155620.829542:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6bdc00/0x844e5faceb5f3a12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.829548:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6bdc00/0x844e5faceb5f3a12 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.829562:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155620.829575:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1961:x1830976125283712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 997us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155620.829584:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7761 00010000:00010000:0.0:1746155620.834425:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5ae9400/0x844e5faceb5f39fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.834433:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5ae9400/0x844e5faceb5f39fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.834460:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5ae9400/0x844e5faceb5f39fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.834466:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5ae9400/0x844e5faceb5f39fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.834484:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5ae9400/0x844e5faceb5f39fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.834488:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5ae9400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155620.834491:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5ae9400/0x844e5faceb5f39fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.834497:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5ae9400/0x844e5faceb5f39fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.834529:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5ae9400/0x844e5faceb5f39fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.834535:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5ae9400/0x844e5faceb5f39fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155620.834587:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1963:x1830976125281792:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 16591us (18245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155620.834594:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15244 00000100:00100000:0.0:1746155620.845224:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.849986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.855854:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125284608 00000100:00100000:0.0:1746155620.855867:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125284608 00000100:00100000:0.0:1746155620.855902:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10756 00000100:00100000:0.0:1746155620.855909:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:31524:x1830976125284608:12345-192.168.202.51@tcp:36:mirror_io.0 00010000:00010000:0.0:1746155620.855957:0:14234:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155620.855978:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6bd600/0x844e5faceb5f39ef lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15983 expref: 14 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.855993:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155620.855996:0:14234:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155620.856018:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c11a00/0x844e5faceb5f3a20 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155620.856028:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040800/0x844e5faceb5f327f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15523 expref: 34 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.856033:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44ec00/0x844e5faceb5f32b0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1553f expref: 311 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.856039:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26a400/0x844e5faceb5f35f1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f156dc expref: 34 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.856044:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df41000/0x844e5faceb5f36a0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15753 expref: 311 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.856049:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c11a00/0x844e5faceb5f3a20 lrc: 7/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155620.856071:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012df41000/0x844e5faceb5f36a0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15753 expref: 311 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.856080:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df41000/0x844e5faceb5f36a0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15753 expref: 311 pid: 14234 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746155620.856111:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f701880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125088512:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155620.856172:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26a400/0x844e5faceb5f35f1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f156dc expref: 34 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.856179:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26a400/0x844e5faceb5f35f1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f156dc expref: 34 pid: 14234 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746155620.856186:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f702a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125088640:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155620.856203:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44ec00/0x844e5faceb5f32b0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1553f expref: 311 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.856209:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b44ec00/0x844e5faceb5f32b0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1553f expref: 311 pid: 20364 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746155620.856215:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f701c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125088768:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155620.856227:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040800/0x844e5faceb5f327f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15523 expref: 34 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.856232:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040800/0x844e5faceb5f327f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15523 expref: 34 pid: 14234 timeout: 850 lvb_type: 0 00000100:00100000:0.0:1746155620.856238:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f700700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125088896:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155620.856247:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155620.859585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.862208:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.862272:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.862400:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155620.889384:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155620.889473:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.889770:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125089920 00000100:00100000:0.0:1746155620.889773:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125089920 00000100:00100000:0.0:1746155620.889790:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15264 00000100:00100000:0.0:1746155620.889794:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+30:3297:x1830976125089920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155620.890121:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a385850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3297:x1830976125089920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 326us (560us total) trans 17179873897 rc 0/0 00000100:00100000:0.0:1746155620.890127:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15264 00000100:00100000:0.0:1746155620.896406:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125285376 00000100:00100000:0.0:1746155620.896414:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125285376 00000100:00100000:0.0:1746155620.896461:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10758 00000100:00100000:0.0:1746155620.896469:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:31524:x1830976125285376:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155620.896485:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155620.896521:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c10c00/0x844e5faceb5f3a2e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15991 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155620.896591:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c10600/0x844e5faceb5f3a35 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155620.896603:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c10600/0x844e5faceb5f3a35 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155620.896611:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5c10600/0x844e5faceb5f3a35 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155620.896631:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:0.0:1746155620.896635:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1746155620.898557:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.898590:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.898603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.898615:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.898627:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.898680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155620.930802:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746155620.930820:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125091200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746155620.930870:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155621.859743:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3298:1830976125091456:0@lo:400:kworker.0 00000100:00100000:0.0:1746155621.861526:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155621.861549:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125091968:0@lo:400:kworker.0 00000100:00100000:0.0:1746155621.861569:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155621.861592:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125091840 00000100:00100000:0.0:1746155621.861595:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125091840 00000100:00100000:0.0:1746155621.861615:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125091968 00000100:00100000:0.0:1746155621.861617:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125091968 00000100:00100000:0.0:1746155621.861629:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1746155621.861633:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3298:x1830976125091968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746155621.861658:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3298:x1830976125091968:12345-0@lo:400:kworker.0 Request processed in 24us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155621.861663:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1746155621.861702:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125091968:0@lo:400:kworker.0 00000100:00100000:0.0:1746155621.861714:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3298:1830976125091456:0@lo:400:kworker.0 00000100:00100000:0.0:1746155621.863120:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125091712 00000100:00100000:0.0:1746155621.863124:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125091712 00000100:00100000:0.0:1746155621.863171:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1746155621.863176:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830976125091712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746155621.863961:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830976125091712:12345-0@lo:400:kworker.0 Request processed in 784us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155621.863968:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1746155621.913635:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155621.914862:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155621.918933:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155621.920545:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155621.921119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155621.921144:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155621.921162:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125287168 00000100:00100000:0.0:1746155621.921167:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125287168 00000100:00100000:0.0:1746155621.921198:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125287424 00000100:00100000:0.0:1746155621.921200:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125287424 00000100:00100000:0.0:1746155621.921213:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125287680 00000100:00100000:0.0:1746155621.921214:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125287680 00000100:00100000:0.0:1746155621.921229:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7144 00000100:00100000:0.0:1746155621.921236:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125287168:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:0.0:1746155621.921258:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a6041800/0x844e5faceb5f3a7b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155621.921269:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155621.921271:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155621.921274:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6041800/0x844e5faceb5f3a7b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155621.921283:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6041800/0x844e5faceb5f3a7b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155621.922246:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7145 00000100:00100000:0.0:1746155621.922252:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125287424:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:0.0:1746155621.926633:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c10e00/0x844e5faceb5f3a89 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155621.926651:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155621.926652:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155621.926657:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c10e00/0x844e5faceb5f3a89 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155621.926668:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c10e00/0x844e5faceb5f3a89 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155621.985748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155621.987198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155621.989037:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.006942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.006993:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155622.007376:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155622.012201:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.013075:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.016329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.016359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.016382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.016393:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.016413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.016435:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125290496 00000100:00100000:0.0:1746155622.016440:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125290496 00000100:00100000:0.0:1746155622.016466:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125290752 00000100:00100000:0.0:1746155622.016467:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125290752 00000100:00100000:0.0:1746155622.016476:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125291008 00000100:00100000:0.0:1746155622.016478:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125291008 00000100:00100000:0.0:1746155622.016485:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125290624 00000100:00100000:0.0:1746155622.016486:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125290624 00000100:00100000:0.0:1746155622.016494:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125290880 00000100:00100000:0.0:1746155622.016496:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125290880 00000100:00100000:0.0:1746155622.016522:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15278 00000100:00100000:0.0:1746155622.016527:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1963:x1830976125290496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155622.016538:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155622.016548:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c11200/0x844e5faceb5f3b1c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15a01 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.016562:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155622.016564:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155622.016570:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c11200/0x844e5faceb5f3b1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a01 expref: 38 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155622.016581:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c11200/0x844e5faceb5f3b1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a01 expref: 38 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155622.016589:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c11200, rc 0) 00000100:00100000:0.0:1746155622.017429:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976125290496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 900us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.017435:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15278 00000100:00100000:0.0:1746155622.020914:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125092224:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155622.021698:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125092352:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155622.021707:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125092480:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155622.021741:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26b400/0x844e5faceb5f3aeb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155622.022193:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26b400/0x844e5faceb5f3aeb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155622.022198:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26b400/0x844e5faceb5f3aeb lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155622.022212:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155622.022310:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd17400/0x844e5faceb5f3ae4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f159d0 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.022323:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e26b400/0x844e5faceb5f3aeb lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f159d0 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.022328:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155622.022330:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155622.022332:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e26b400, rc 0) 00000100:00100000:0.0:1746155622.022583:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:31534:x1830976125289600:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 10163us (10387us total) trans 8589944852 rc 0/0 00000100:00100000:0.0:1746155622.022589:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10761 00000100:00100000:0.0:1746155622.023128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.023161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.038634:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.038668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.039394:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.039424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.039446:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125292032 00000100:00100000:0.0:1746155622.039452:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125292032 00002000:00100000:0.0:1746155622.039486:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880131494380 x1830976125292032/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.039495:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494380 with x1830976125292032 ext(0->1048575) 00002000:00010000:0.0:1746155622.039500:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494380 00000100:00100000:0.0:1746155622.039541:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125292288 00000100:00100000:0.0:1746155622.039544:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125292288 00002000:00100000:0.0:1746155622.039556:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009b881500 x1830976125292288/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.039562:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881500 with x1830976125292288 ext(1048576->2097151) 00002000:00010000:0.0:1746155622.039565:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b881500 00000100:00100000:0.0:1746155622.039572:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125292416 00000100:00100000:0.0:1746155622.040463:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125292416 00002000:00100000:0.0:1746155622.040479:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009b882a00 x1830976125292416/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.040486:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882a00 with x1830976125292416 ext(1048576->2097151) 00002000:00010000:0.0:1746155622.040489:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b882a00 00000100:00100000:0.0:1746155622.040520:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7151 00000100:00100000:0.0:1746155622.040526:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1963:x1830976125292800:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155622.047360:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.056785:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125293184 00000100:00100000:0.0:1746155622.056793:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125293184 00002000:00100000:0.0:1746155622.056828:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009fe93b80 x1830976125293184/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.056846:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe93b80 with x1830976125293184 ext(1048576->2097151) 00002000:00010000:0.0:1746155622.056850:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fe93b80 00000100:00100000:0.0:1746155622.056871:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125293568 00000100:00100000:0.0:1746155622.056874:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125293568 00002000:00100000:0.0:1746155622.056889:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fe90a80 x1830976125293568/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.056895:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe90a80 with x1830976125293568 ext(0->1048575) 00002000:00010000:0.0:1746155622.056898:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe90a80 00000100:00100000:0.0:1746155622.056911:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7153 00000100:00100000:0.0:1746155622.056918:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976125293312:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155622.058238:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7155 00000100:00100000:0.0:1746155622.058245:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1962:x1830976125293568:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155622.081131:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1963:x1830976125292800:12345-192.168.202.51@tcp:3:cat.0 Request processed in 40596us (41697us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155622.081142:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7151 00002000:00100000:0.0:1746155622.081153:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009b881880 x1830976125292800/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/440 e 0 to 0 dl 1746155633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.081162:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881880 with x1830976125292800 ext(1048576->2097151) 00002000:00010000:0.0:1746155622.081166:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881880 00000100:00100000:0.0:1746155622.089939:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976125293312:12345-192.168.202.51@tcp:3:cat.0 Request processed in 33014us (42578us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155622.089948:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7153 00002000:00100000:0.0:1746155622.089962:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009b881c00 x1830976125293312/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/440 e 0 to 0 dl 1746155633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.089970:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881c00 with x1830976125293312 ext(1048576->2097151) 00002000:00010000:0.0:1746155622.089974:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b881c00 00000100:00100000:0.0:1746155622.090024:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.090039:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125294464 00000100:00100000:0.0:1746155622.090044:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125294464 00000100:00100000:0.0:1746155622.090066:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10765 00000100:00100000:0.0:1746155622.090071:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:31536:x1830976125294464:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155622.090082:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155622.090108:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a094a400/0x844e5faceb5f3b69 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15a40 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.090146:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c1da00/0x844e5faceb5f3b62 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155622.090153:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a094a400/0x844e5faceb5f3b69 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a40 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.090165:0:20364:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880093c1da00/0x844e5faceb5f3b62 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155622.090173:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a094a400/0x844e5faceb5f3b69 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a40 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.090183:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155622.090185:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155622.090187:0:20364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a094a400/0x844e5faceb5f3b69 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a40 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.090196:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a094a400, rc 0) 00000100:00100000:0.0:1746155622.090209:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:31536:x1830976125294464:12345-192.168.202.51@tcp:101:cat.0 Request processed in 138us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.090213:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10765 00000100:00100000:0.0:1746155622.111480:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1962:x1830976125293568:12345-192.168.202.51@tcp:3:cat.0 Request processed in 53230us (57326us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155622.111490:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7155 00002000:00100000:0.0:1746155622.111498:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fe90a80 x1830976125293568/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/440 e 0 to 0 dl 1746155633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.111526:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fe90a80 with x1830976125293568 ext(0->1048575) 00002000:00010000:0.0:1746155622.111530:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fe90a80 00000100:00100000:0.0:1746155622.116028:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125294592 00000100:00100000:0.0:1746155622.116035:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125294592 00000100:00100000:0.0:1746155622.116071:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10766 00000100:00100000:0.0:1746155622.116076:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:31537:x1830976125294592:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155622.116088:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155622.116113:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a094b400/0x844e5faceb5f3b70 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15a47 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.116154:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a094b400/0x844e5faceb5f3b70 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a47 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.116161:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a094b400/0x844e5faceb5f3b70 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a47 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.116177:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155622.116179:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155622.116182:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a094a400/0x844e5faceb5f3b69 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a40 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.116185:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a094b400, rc 0) 00000100:00100000:0.0:1746155622.116225:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:31537:x1830976125294592:12345-192.168.202.51@tcp:101:cat.0 Request processed in 149us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.116228:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10766 00000100:00100000:0.0:1746155622.118519:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125092992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155622.118539:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155622.118622:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125093504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155622.118636:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155622.118736:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125094272:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155622.118751:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155622.118757:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125094784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155622.118768:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155622.118773:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746155622.118777:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125093120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155622.118788:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155622.118793:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125093632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155622.118802:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155622.118808:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125094400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155622.118827:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155622.118832:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125094912:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155622.118841:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155622.118856:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125094272 00000100:00100000:0.0:1746155622.118858:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125094272 00000100:00100000:0.0:1746155622.118871:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125094784 00000100:00100000:0.0:1746155622.118873:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125094784 00000100:00100000:0.0:1746155622.118877:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125093120 00000100:00100000:0.0:1746155622.118879:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125093120 00000100:00100000:0.0:1746155622.118884:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125093632 00000100:00100000:0.0:1746155622.118886:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125093632 00000100:00100000:0.0:1746155622.118891:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125094400 00000100:00100000:0.0:1746155622.118892:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125094400 00000100:00100000:0.0:1746155622.118898:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125094912 00000100:00100000:0.0:1746155622.118899:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125094912 00000100:00100000:0.0:1746155622.118906:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15285 00000100:00100000:0.0:1746155622.118911:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3296:x1830976125093376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155622.118988:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:0.0:1746155622.118990:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155622.118992:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155622.118993:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155622.118995:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155622.119011:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3296:x1830976125093376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (608us total) trans 21474841244 rc 0/0 00000100:00100000:0.0:1746155622.119016:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15285 00000100:00100000:0.0:1746155622.119025:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15288 00000100:00100000:0.0:1746155622.119029:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3297:x1830976125092992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155622.119087:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155622.119105:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155620 -> 1746155620 00002000:00010000:0.0:1746155622.119107:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155620 -> 1746155620 00002000:00010000:0.0:1746155622.119108:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155620 -> 1746155620 00002000:00010000:0.0:1746155622.119110:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155622.119128:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3297:x1830976125092992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (588us total) trans 21474841246 rc 0/0 00000100:00100000:0.0:1746155622.119132:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15288 00000100:00100000:0.0:1746155622.119141:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15290 00000100:00100000:0.0:1746155622.119145:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976125094272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155622.119225:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155622.119227:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155620 -> 1746155620 00002000:00010000:0.0:1746155622.119229:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155620 -> 1746155620 00002000:00010000:0.0:1746155622.119230:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155620 -> 1746155620 00002000:00010000:0.0:1746155622.119232:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155622.119248:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3297:x1830976125094272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (496us total) trans 17179873899 rc 0/0 00000100:00100000:0.0:1746155622.120519:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15290 00000100:00100000:0.0:1746155622.120532:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15292 00000100:00100000:0.0:1746155622.120538:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+36:3297:x1830976125093120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155622.120572:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15294 00000100:00100000:0.0:1746155622.120576:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976125094400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155622.120642:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:0.0:1746155622.120644:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155621 -> 1746155621 00002000:00010000:0.0:1746155622.120646:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155620 -> 1746155620 00002000:00010000:0.0:1746155622.120648:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155621 -> 1746155621 00002000:00010000:0.0:1746155622.120655:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5907 -> 5907 00000100:00100000:0.0:1746155622.120676:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3297:x1830976125094400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (1847us total) trans 17179873901 rc 0/0 00000100:00100000:0.0:1746155622.120681:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15294 00000100:00100000:0.0:1746155622.120732:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3296:x1830976125093248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1801us (2300us total) trans 21474841249 rc 0/0 00000100:00100000:0.0:1746155622.120737:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15286 00000004:00080000:0.0:1746155622.120767:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c210a80/2, rc 0, transno 21474841248 00000100:00100000:0.0:1746155622.120771:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125093632:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155622.120778:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f8d0a80/2, rc 0, transno 17179873901 00000100:00100000:0.0:1746155622.120786:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f8d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125094400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155622.120794:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f8d1500/2, rc 0, transno 17179873902 00000100:00100000:0.0:1746155622.120796:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f8d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125094912:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155622.120802:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943e9f80/2, rc 0, transno 17179873899 00000100:00100000:0.0:1746155622.120804:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125094272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155622.120810:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f8d2d80/2, rc 0, transno 17179873900 00000100:00100000:0.0:1746155622.120812:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f8d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125094784:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155622.120818:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f701500/2, rc 0, transno 21474841246 00000100:00100000:0.0:1746155622.120821:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125092992:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155622.120826:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c213b80/2, rc 0, transno 21474841247 00000100:00100000:0.0:1746155622.120829:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125093504:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155622.120884:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155622.120887:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155621 -> 1746155621 00002000:00010000:0.0:1746155622.120888:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155619 -> 1746155619 00002000:00010000:0.0:1746155622.120894:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155621 -> 1746155621 00002000:00010000:0.0:1746155622.120896:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155622.120917:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3297:x1830976125093120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 380us (2128us total) trans 21474841250 rc 0/0 00000100:00100000:0.0:1746155622.120923:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15292 00000100:00100000:0.0:1746155622.120931:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125094656 00000100:00100000:0.0:1746155622.120934:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125094656 00000100:00100000:0.0:1746155622.120944:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15297 00000100:00100000:0.0:1746155622.120948:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3295:x1830976125095040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155622.120969:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15298 00000100:00100000:0.0:1746155622.120973:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+39:3295:x1830976125094144:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155622.121041:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746155622.121043:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155621 -> 1746155621 00002000:00010000:0.0:1746155622.121045:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155620 -> 1746155620 00002000:00010000:0.0:1746155622.121046:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155621 -> 1746155621 00002000:00010000:0.0:1746155622.121048:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155622.121067:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3295:x1830976125094144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (208us total) trans 17179873904 rc 0/0 00000100:00100000:0.0:1746155622.121071:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15298 00000004:00080000:0.0:1746155622.121103:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f701180/2, rc 0, transno 21474841250 00000100:00100000:0.0:1746155622.121106:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125093120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155622.121172:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976125095040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 223us (345us total) trans 17179873906 rc 0/0 00000100:00100000:0.0:1746155622.121176:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15297 00000100:00100000:0.0:1746155622.128445:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.132116:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.138821:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.142486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.142597:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.150876:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.150921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155622.153445:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155622.161186:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125095680:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155622.161195:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125095808:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155622.161211:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155622.161232:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125295872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10108us (10362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.161239:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7778 00000100:00100000:0.0:1746155622.164781:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.169471:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.171292:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.175359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.181920:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.181949:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.181979:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.181999:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125298304 00000100:00100000:0.0:1746155622.182005:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125298304 00010000:00010000:0.0:1746155622.182033:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ffb4800/0x844e5faceb5f3a5f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f159b4 expref: 8 pid: 20200 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746155622.182054:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125298176 00000100:00100000:0.0:1746155622.182056:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125298176 00010000:00010000:0.0:1746155622.182065:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130597400/0x844e5faceb5f3b00 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f159f3 expref: 34 pid: 29728 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746155622.182098:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125298432 00000100:00100000:0.0:1746155622.182100:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125298432 00010000:00010000:0.0:1746155622.182110:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093c1d000/0x844e5faceb5f3b2a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a1d expref: 42 pid: 18270 timeout: 851 lvb_type: 1 00000100:00100000:0.0:1746155622.182124:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7779 00000100:00100000:0.0:1746155622.182130:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976125298304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155622.182140:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155622.182160:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ffb4800/0x844e5faceb5f3a5f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f159b4 expref: 8 pid: 20200 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746155622.182169:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ffb4800/0x844e5faceb5f3a5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f159b4 expref: 8 pid: 20200 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746155622.182190:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155622.182223:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976125298304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 93us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.182229:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7779 00000100:00100000:0.0:1746155622.182242:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7780 00000100:00100000:0.0:1746155622.182246:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1961:x1830976125298176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155622.182252:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155622.182259:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130597400/0x844e5faceb5f3b00 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f159f3 expref: 34 pid: 29728 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746155622.182275:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130597400/0x844e5faceb5f3b00 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f159f3 expref: 34 pid: 29728 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746155622.182285:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155622.182298:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1961:x1830976125298176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.182303:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7780 00000100:00100000:0.0:1746155622.182312:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7781 00000100:00100000:0.0:1746155622.182316:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125298432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155622.182321:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155622.182328:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093c1d000/0x844e5faceb5f3b2a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a1d expref: 42 pid: 18270 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746155622.182335:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093c1d000/0x844e5faceb5f3b2a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a1d expref: 42 pid: 18270 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746155622.182345:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155622.182347:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155622.182352:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c11600/0x844e5faceb5f3b85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a5c expref: 42 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.182358:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c11600/0x844e5faceb5f3b85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a5c expref: 42 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.182381:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c11600/0x844e5faceb5f3b85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4648959) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a5c expref: 42 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155622.182397:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125096320:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155622.182444:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155622.182719:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1960:x1830976125297152:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12580us (13294us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155622.182726:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7162 00002000:00100000:0.0:1746155622.182732:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009c28fb80 x1830976125297152/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/440 e 0 to 0 dl 1746155633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.182740:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28fb80 with x1830976125297152 ext(1048576->2097151) 00002000:00010000:0.0:1746155622.182743:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28fb80 00000100:00100000:0.0:1746155622.200285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.200326:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.203872:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.205293:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.211084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.215589:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.217500:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125299712 00000100:00100000:0.0:1746155622.217516:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125299712 00000100:00100000:0.0:1746155622.217544:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15307 00000100:00100000:0.0:1746155622.217550:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:31537:x1830976125299712:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155622.217558:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155622.217569:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b44fc00/0x844e5faceb5f3ba1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15a78 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.217584:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5c11000/0x844e5faceb5f3b7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2252800->2605055] (req 2252800->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a55 expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.217596:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9000/0x844e5faceb5f3b77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2605056->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a4e expref: 30 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.217600:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746155622.217601:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746155622.217603:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b44fc00/0x844e5faceb5f3ba1 lrc: 5/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a78 expref: 30 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.217617:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9000/0x844e5faceb5f3b77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2605056->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a4e expref: 30 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.217623:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9000/0x844e5faceb5f3b77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2605056->18446744073709551615] (req 3846144->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a4e expref: 30 pid: 29728 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746155622.217629:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125096832:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155622.217687:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5c11000/0x844e5faceb5f3b7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2252800->2605055] (req 2252800->2605055) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a55 expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.217694:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5c11000/0x844e5faceb5f3b7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2252800->2605055] (req 2252800->2605055) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a55 expref: 23 pid: 10591 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746155622.217701:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125096960:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155622.217719:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155622.222498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.222539:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.222582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.238300:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.254496:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125300992 00000100:00100000:0.0:1746155622.254520:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125300992 00002000:00100000:0.0:1746155622.254547:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012fef0a80 x1830976125300992/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.254556:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef0a80 with x1830976125300992 ext(2097152->3145727) 00002000:00010000:0.0:1746155622.254560:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef0a80 00000100:00100000:0.0:1746155622.254580:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7169 00000100:00100000:0.0:1746155622.254587:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1961:x1830976125300992:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155622.261035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.268811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.270303:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.270337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.278712:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.280244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.281300:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.302804:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.311373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.315481:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.316929:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.437309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.454478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.455076:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.455127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.455470:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7787 00000100:00100000:0.0:1746155622.455476:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976125304448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155622.455490:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155622.456631:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093c1d200/0x844e5faceb5f3b31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a08 expref: 32 pid: 18270 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746155622.456641:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093c1d200/0x844e5faceb5f3b31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a08 expref: 32 pid: 18270 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746155622.456652:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c1d200/0x844e5faceb5f3b31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a08 expref: 32 pid: 18270 timeout: 851 lvb_type: 1 00010000:00010000:0.0:1746155622.456678:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155622.456702:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976125304448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1226us (1574us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.456707:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7787 00000100:00100000:0.0:1746155622.461831:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.473147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.480456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.480494:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.482913:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.492499:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.498315:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.510536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.519114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.520496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.529740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.536223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.542751:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.543066:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.549285:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.561589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.564286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.569639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.569669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.570131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.572130:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.575667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.576283:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.576354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.584706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.589909:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.590823:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.595082:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125309696 00000100:00100000:0.0:1746155622.595097:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125309696 00002000:00100000:0.0:1746155622.595130:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1556480->2097151) req@ffff88012fe8ed80 x1830976125309696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.595138:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8ed80 with x1830976125309696 ext(1556480->2097151) 00002000:00010000:0.0:1746155622.595143:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fe8ed80 00000100:00100000:0.0:1746155622.596430:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7184 00000100:00100000:0.0:1746155622.596442:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976125309696:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155622.614466:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125309696:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18025us (19823us total) trans 0 rc 540672/540672 00000100:00100000:0.0:1746155622.614473:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7184 00002000:00100000:0.0:1746155622.614478:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1556480->2097151) req@ffff88012fe8ed80 x1830976125309696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/440 e 0 to 0 dl 1746155633 ref 1 fl Complete:/200/0 rc 540672/540672 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.614493:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8ed80 with x1830976125309696 ext(1556480->2097151) 00002000:00010000:0.0:1746155622.614496:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fe8ed80 00000100:00100000:0.0:1746155622.622287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.622753:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.636547:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.642791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.643271:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125099776:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155622.643286:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125099904:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155622.643305:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155622.643340:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976125310208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6654us (6798us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.643349:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7795 00000100:00100000:0.0:1746155622.643385:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125310464 00000100:00100000:0.0:1746155622.643389:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125310464 00002000:00100000:0.0:1746155622.643421:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880095268380 x1830976125310464/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.643430:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095268380 with x1830976125310464 ext(1048576->2097151) 00002000:00010000:0.0:1746155622.643434:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095268380 00000100:00100000:0.0:1746155622.643448:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7185 00000100:00100000:0.0:1746155622.643454:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976125310464:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155622.659036:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125310720 00000100:00100000:0.0:1746155622.659046:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125310720 00002000:00100000:0.0:1746155622.659084:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88012fe8d180 x1830976125310720/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.659114:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8d180 with x1830976125310720 ext(1048576->2097151) 00002000:00010000:0.0:1746155622.659120:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fe8d180 00000100:00100000:0.0:1746155622.659143:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7186 00000100:00100000:0.0:1746155622.659151:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1961:x1830976125310720:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155622.664700:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976125310464:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21239us (21908us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155622.664710:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7185 00002000:00100000:0.0:1746155622.664720:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880095268380 x1830976125310464/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/440 e 0 to 0 dl 1746155633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.664729:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095268380 with x1830976125310464 ext(1048576->2097151) 00002000:00010000:0.0:1746155622.664734:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095268380 00000100:00100000:0.0:1746155622.678224:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.705729:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.705755:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125311104 00000100:00100000:0.0:1746155622.705763:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125311104 00000100:00100000:0.0:1746155622.705811:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15322 00000100:00100000:0.0:1746155622.705818:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:31553:x1830976125311104:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155622.705832:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155622.705847:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a094a000/0x844e5faceb5f3c96 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15afd expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.705871:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094443200/0x844e5faceb5f3c03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15aa2 expref: 31 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.705891:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155622.705892:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155622.705895:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a094a000/0x844e5faceb5f3c96 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15afd expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.705918:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094443200/0x844e5faceb5f3c03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15aa2 expref: 31 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.705929:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094443200/0x844e5faceb5f3c03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15aa2 expref: 31 pid: 10591 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746155622.705939:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125100288:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155622.706005:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155622.706036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.709380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.709458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.709498:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125100288:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155622.709537:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a094a000/0x844e5faceb5f3c96 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15afd expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.709553:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a094a000, rc 0) 00000100:00100000:0.0:1746155622.709593:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:31553:x1830976125311104:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3775us (3871us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.709600:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15322 00000100:00100000:0.0:1746155622.709628:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125311360 00000100:00100000:0.0:1746155622.709637:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125311360 00002000:00100000:0.0:1746155622.709665:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1556479) req@ffff880095268000 x1830976125311360/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.709672:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095268000 with x1830976125311360 ext(1048576->1556479) 00010000:00010000:0.0:1746155622.709677:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094443200/0x844e5faceb5f3c03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15aa2 expref: 32 pid: 10591 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746155622.709686:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094443200/0x844e5faceb5f3c03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1556479) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15aa2 expref: 32 pid: 10591 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746155622.709691:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095268000 00000100:00100000:0.0:1746155622.709706:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125311488 00000100:00100000:0.0:1746155622.709708:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125311488 00002000:00100000:0.0:1746155622.709721:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (3678208->4194303) req@ffff880095269880 x1830976125311488/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.709728:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269880 with x1830976125311488 ext(3678208->4194303) 00010000:00010000:0.0:1746155622.709733:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094442a00/0x844e5faceb5f3c0a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15aa9 expref: 32 pid: 10591 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746155622.709740:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094442a00/0x844e5faceb5f3c0a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15aa9 expref: 32 pid: 10591 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746155622.709746:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095269880 00000100:00100000:0.0:1746155622.709757:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1172 00000100:00100000:0.0:1746155622.709762:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976125311360:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155622.710177:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1173 00000100:00100000:0.0:1746155622.710183:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125311488:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155622.742217:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1960:x1830976125311488:12345-192.168.202.51@tcp:4:cat.0 Request processed in 32026us (32751us total) trans 17179873909 rc 0/0 00000100:00100000:0.0:1746155622.742228:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1173 00002000:00100000:0.0:1746155622.742238:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3678208->4194303) req@ffff880095269880 x1830976125311488/t17179873909(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/448 e 0 to 0 dl 1746155633 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.742247:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269880 with x1830976125311488 ext(3678208->4194303) 00010000:00010000:0.0:1746155622.742255:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094442a00/0x844e5faceb5f3c0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15aa9 expref: 34 pid: 10591 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746155622.742267:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094442a00/0x844e5faceb5f3c0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15aa9 expref: 34 pid: 10591 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746155622.742275:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095269880 00000100:00100000:0.0:1746155622.744194:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.744210:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125311616 00000100:00100000:0.0:1746155622.744215:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125311616 00010000:00010000:0.0:1746155622.744238:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094442a00/0x844e5faceb5f3c0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15aa9 expref: 34 pid: 10591 timeout: 851 lvb_type: 0 00000100:00100000:0.0:1746155622.744257:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7796 00000100:00100000:0.0:1746155622.744262:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1962:x1830976125311616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155622.744272:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155622.744286:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094442a00/0x844e5faceb5f3c0a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15aa9 expref: 34 pid: 10591 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746155622.744298:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094442a00/0x844e5faceb5f3c0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15aa9 expref: 34 pid: 10591 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746155622.744314:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094442a00/0x844e5faceb5f3c0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3678208->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15aa9 expref: 34 pid: 10591 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746155622.744329:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155622.744331:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155622.744336:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094442c00/0x844e5faceb5f3c9d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b04 expref: 39 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.744342:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094442c00/0x844e5faceb5f3c9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b04 expref: 39 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.744366:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094442c00/0x844e5faceb5f3c9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b04 expref: 39 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155622.744375:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125100544:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155622.744430:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155622.746885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.749414:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125100544:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155622.749426:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155622.749445:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1962:x1830976125311616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5183us (5258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.749452:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7796 00000100:00100000:0.0:1746155622.798157:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.798601:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976125312640:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28659us (28964us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155622.798609:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7188 00002000:00100000:0.0:1746155622.798617:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88012ef02680 x1830976125312640/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/440 e 0 to 0 dl 1746155633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.798637:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ef02680 with x1830976125312640 ext(1048576->2097151) 00002000:00010000:0.0:1746155622.798641:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012ef02680 00000100:00100000:0.0:1746155622.812145:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.812167:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125312896 00000100:00100000:0.0:1746155622.812173:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125312896 00002000:00100000:0.0:1746155622.812203:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3653631) req@ffff88009526b800 x1830976125312896/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.812212:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526b800 with x1830976125312896 ext(3145728->3653631) 00010000:00010000:0.0:1746155622.812220:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009354f200/0x844e5faceb5f3c11 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ab0 expref: 26 pid: 29728 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746155622.812232:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009354f200/0x844e5faceb5f3c11 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ab0 expref: 26 pid: 29728 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746155622.812238:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009526b800 00000100:00100000:0.0:1746155622.812262:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1174 00000100:00100000:0.0:1746155622.812268:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976125312896:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155622.826687:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.842894:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1960:x1830976125312896:12345-192.168.202.51@tcp:4:cat.0 Request processed in 30617us (30744us total) trans 21474841255 rc 0/0 00000100:00100000:0.0:1746155622.842906:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1174 00002000:00100000:0.0:1746155622.842916:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3653631) req@ffff88009526b800 x1830976125312896/t21474841255(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/448 e 0 to 0 dl 1746155633 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.842924:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526b800 with x1830976125312896 ext(3145728->3653631) 00010000:00010000:0.0:1746155622.842933:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009354f200/0x844e5faceb5f3c11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ab0 expref: 28 pid: 29728 timeout: 851 lvb_type: 0 00010000:00010000:0.0:1746155622.842946:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009354f200/0x844e5faceb5f3c11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ab0 expref: 28 pid: 29728 timeout: 851 lvb_type: 0 00002000:00010000:0.0:1746155622.842953:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009526b800 00000100:00100000:0.0:1746155622.853812:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125313920 00000100:00100000:0.0:1746155622.853821:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125313920 00002000:00100000:0.0:1746155622.853857:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012fe8e300 x1830976125313920/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.853866:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8e300 with x1830976125313920 ext(2097152->3145727) 00002000:00010000:0.0:1746155622.853871:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fe8e300 00000100:00100000:0.0:1746155622.853888:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7189 00000100:00100000:0.0:1746155622.853894:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1960:x1830976125313920:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155622.863191:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fe8c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125100928:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155622.863207:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155622.863245:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976125314048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9111us (9188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.863255:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7798 00000100:00100000:0.0:1746155622.876648:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.876672:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.876685:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.876722:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125314304 00000100:00100000:0.0:1746155622.876729:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125314304 00002000:00100000:0.0:1746155622.876764:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a06ed180 x1830976125314304/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.876773:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06ed180 with x1830976125314304 ext(2097152->3145727) 00002000:00010000:0.0:1746155622.876778:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a06ed180 00000100:00100000:0.0:1746155622.876792:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125314560 00000100:00100000:0.0:1746155622.876794:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125314560 00002000:00100000:0.0:1746155622.876805:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a06ed880 x1830976125314560/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.876811:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06ed880 with x1830976125314560 ext(3145728->4194303) 00002000:00010000:0.0:1746155622.876814:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a06ed880 00000100:00100000:0.0:1746155622.876826:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7190 00000100:00100000:0.0:1746155622.876832:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976125314304:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155622.877389:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7192 00000100:00100000:0.0:1746155622.877397:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125314816:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155622.882851:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1960:x1830976125313920:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28950us (29160us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155622.882861:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7189 00002000:00100000:0.0:1746155622.882870:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012fe8e300 x1830976125313920/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/440 e 0 to 0 dl 1746155633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.882883:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8e300 with x1830976125313920 ext(2097152->3145727) 00002000:00010000:0.0:1746155622.882888:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fe8e300 00000100:00100000:0.0:1746155622.901316:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125314816:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23918us (24627us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155622.901325:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7192 00002000:00100000:0.0:1746155622.901333:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a06edc00 x1830976125314816/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/440 e 0 to 0 dl 1746155633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.901341:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06edc00 with x1830976125314816 ext(3145728->4194303) 00002000:00010000:0.0:1746155622.901345:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a06edc00 00000100:00100000:0.0:1746155622.903641:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976125314304:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26804us (26995us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155622.903649:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7190 00002000:00100000:0.0:1746155622.903658:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a06ed180 x1830976125314304/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:693/0 lens 488/440 e 0 to 0 dl 1746155633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.903666:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06ed180 with x1830976125314304 ext(2097152->3145727) 00010000:00010000:0.0:1746155622.903674:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094442400/0x844e5faceb5f3cc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b12 expref: 14 pid: 8436 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746155622.903684:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094442400/0x844e5faceb5f3cc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b12 expref: 14 pid: 8436 timeout: 852 lvb_type: 0 00002000:00010000:0.0:1746155622.903690:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a06ed180 00000100:00100000:0.0:1746155622.911895:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.912444:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.912464:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125315328 00000100:00100000:0.0:1746155622.912469:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125315328 00010000:00010000:0.0:1746155622.912493:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130597800/0x844e5faceb5f3b0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f159ec expref: 34 pid: 29728 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746155622.913009:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125315456 00000100:00100000:0.0:1746155622.913012:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125315456 00010000:00010000:0.0:1746155622.913024:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093c1d400/0x844e5faceb5f3b38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a16 expref: 41 pid: 18270 timeout: 852 lvb_type: 1 00000100:00100000:0.0:1746155622.913038:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7799 00000100:00100000:0.0:1746155622.913044:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1963:x1830976125315328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155622.913052:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155622.913070:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130597800/0x844e5faceb5f3b0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f159ec expref: 34 pid: 29728 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746155622.913079:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130597800/0x844e5faceb5f3b0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f159ec expref: 34 pid: 29728 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746155622.913107:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130597800/0x844e5faceb5f3b0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f159ec expref: 34 pid: 29728 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746155622.913117:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155622.913134:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1963:x1830976125315328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 92us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.913139:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7799 00000100:00100000:0.0:1746155622.913151:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7800 00000100:00100000:0.0:1746155622.913156:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1963:x1830976125315456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155622.913161:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155622.913167:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093c1d400/0x844e5faceb5f3b38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a16 expref: 41 pid: 18270 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746155622.913174:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093c1d400/0x844e5faceb5f3b38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a16 expref: 41 pid: 18270 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746155622.913183:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c1d400/0x844e5faceb5f3b38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a16 expref: 41 pid: 18270 timeout: 852 lvb_type: 1 00010000:00010000:0.0:1746155622.913190:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155622.913201:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1963:x1830976125315456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 45us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.913205:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7800 00000100:00100000:0.0:1746155622.925551:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.925573:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.925585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.925607:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.925626:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125315968 00000100:00100000:0.0:1746155622.925646:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125315968 00002000:00100000:0.0:1746155622.925744:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012b6c3480 x1830976125315968/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.925753:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c3480 with x1830976125315968 ext(2097152->3145727) 00010000:00010000:0.0:1746155622.925762:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a06fb400/0x844e5faceb5f3cf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b27 expref: 11 pid: 29728 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746155622.925780:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a06fb400/0x844e5faceb5f3cf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b27 expref: 11 pid: 29728 timeout: 852 lvb_type: 0 00002000:00010000:0.0:1746155622.925786:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b6c3480 00000100:00100000:0.0:1746155622.925801:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125316480 00000100:00100000:0.0:1746155622.925803:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125316480 00002000:00100000:0.0:1746155622.925815:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88012b6c2a00 x1830976125316480/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.925822:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c2a00 with x1830976125316480 ext(3145728->4194303) 00010000:00010000:0.0:1746155622.925826:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a06fb400/0x844e5faceb5f3cf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b27 expref: 12 pid: 29728 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746155622.925833:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a06fb400/0x844e5faceb5f3cf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b27 expref: 12 pid: 29728 timeout: 852 lvb_type: 0 00002000:00010000:0.0:1746155622.925839:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b6c2a00 00000100:00100000:0.0:1746155622.925864:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1175 00000100:00100000:0.0:1746155622.925870:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125315968:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155622.933353:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125316992 00000100:00100000:0.0:1746155622.933360:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125316992 00000100:00100000:0.0:1746155622.933403:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15330 00000100:00100000:0.0:1746155622.933410:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:31556:x1830976125316992:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155622.933425:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155622.933439:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5f3d14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15b43 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.933461:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094442c00/0x844e5faceb5f3c9d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b04 expref: 41 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.933468:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c11c00/0x844e5faceb5f3cf1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b20 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.933473:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155622.933474:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155622.933478:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5f3d14 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->2854911] (req 2097152->2854911) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b43 expref: 41 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.933514:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c11c00/0x844e5faceb5f3cf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b20 expref: 34 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.933525:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c11c00/0x844e5faceb5f3cf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b20 expref: 34 pid: 8436 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746155622.933538:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125101824:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155622.933590:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094442c00/0x844e5faceb5f3c9d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b04 expref: 41 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.933597:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094442c00/0x844e5faceb5f3c9d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b04 expref: 41 pid: 8436 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746155622.933605:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125101952:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155622.934330:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155622.940905:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125101824:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155622.940918:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125101952:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155622.940942:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5f3d14 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->2854911] (req 2097152->2854911) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b43 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.940960:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d582600, rc 0) 00000100:00100000:0.0:1746155622.941013:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:31556:x1830976125316992:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7602us (7755us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155622.941020:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15330 00000100:00100000:0.0:1746155622.944620:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.956385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.959593:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125316480:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 33696us (33998us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155622.959603:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1177 00002000:00100000:0.0:1746155622.959613:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88012b6c2a00 x1830976125316480/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/440 e 0 to 0 dl 1746155633 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.959621:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c2a00 with x1830976125316480 ext(3145728->4194303) 00010000:00010000:0.0:1746155622.959629:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a06fb400/0x844e5faceb5f3cf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b27 expref: 11 pid: 29728 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746155622.959640:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a06fb400/0x844e5faceb5f3cf8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b27 expref: 11 pid: 29728 timeout: 852 lvb_type: 0 00002000:00010000:0.0:1746155622.959645:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b6c2a00 00000100:00100000:0.0:1746155622.964373:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.964408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.964442:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.966357:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.966376:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125317760 00000100:00100000:0.0:1746155622.966379:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125317760 00010000:00010000:0.0:1746155622.966397:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c11c00/0x844e5faceb5f3cf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b20 expref: 8 pid: 8436 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746155622.966413:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7804 00000100:00100000:0.0:1746155622.966418:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976125317760:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155622.966427:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155622.966443:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c11c00/0x844e5faceb5f3cf1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b20 expref: 8 pid: 8436 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746155622.966451:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c11c00/0x844e5faceb5f3cf1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b20 expref: 8 pid: 8436 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746155622.966466:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c11c00/0x844e5faceb5f3cf1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b20 expref: 8 pid: 8436 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746155622.966477:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155622.966479:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155622.966484:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5f3d14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2854911) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b43 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.966491:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5f3d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2854911) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b43 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155622.966536:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d582600/0x844e5faceb5f3d14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2854911) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b43 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155622.966547:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125102080:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155622.966582:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155622.968484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.974499:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125318144 00000100:00100000:0.0:1746155622.974528:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125318144 00002000:00100000:0.0:1746155622.974554:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012ef00a80 x1830976125318144/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/0 e 0 to 0 dl 1746155633 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.974563:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ef00a80 with x1830976125318144 ext(3145728->4194303) 00002000:00010000:0.0:1746155622.974567:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ef00a80 00000100:00100000:0.0:1746155622.974579:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7194 00000100:00100000:0.0:1746155622.974586:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1962:x1830976125318144:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155622.979844:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.984803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.985284:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155622.985589:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7198 00000100:00100000:0.0:1746155622.985595:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976125319296:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155622.987667:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1962:x1830976125318144:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13076us (13609us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155622.987677:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7194 00002000:00100000:0.0:1746155622.987684:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012ef00a80 x1830976125318144/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:693/0 lens 488/440 e 0 to 0 dl 1746155633 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155622.987692:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ef00a80 with x1830976125318144 ext(3145728->4194303) 00002000:00010000:0.0:1746155622.987696:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ef00a80 00000100:00100000:0.0:1746155622.989376:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.000429:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.005921:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.005961:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.005996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.013996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.014848:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.019939:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.020152:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.030938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.042784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.042827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.042863:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.042903:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15344 00000100:00100000:0.0:1746155623.042912:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976125321344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155623.042934:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155623.046353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.046386:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.046423:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.054653:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.069773:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.077098:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.079799:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.088263:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.088294:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.088306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.088316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.088340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155623.090175:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155623.093847:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.104754:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.112656:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.115822:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.118320:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.120813:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.121139:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.121154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.121356:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.123634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.130582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.140767:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125104768:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155623.140778:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125104896:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155623.140785:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125105024:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155623.140806:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009a462a00/0x844e5faceb5f3e33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155623.140825:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125326464 00000100:00100000:0.0:1746155623.140829:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125326464 00002000:00100000:0.0:1746155623.140855:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2424832->2809855) req@ffff88009526aa00 x1830976125326464/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:694/0 lens 488/0 e 0 to 0 dl 1746155634 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155623.140869:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526aa00 with x1830976125326464 ext(2424832->2809855) 00010000:00010000:0.0:1746155623.140874:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a06fb000/0x844e5faceb5f3cff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2424832->3145727] (req 2424832->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b2e expref: 9 pid: 29728 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746155623.140882:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a06fb000/0x844e5faceb5f3cff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2424832->3145727] (req 2424832->2809855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15b2e expref: 9 pid: 29728 timeout: 852 lvb_type: 0 00002000:00010000:0.0:1746155623.140887:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009526aa00 00000100:00100000:0.0:1746155623.142546:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1180 00000100:00100000:0.0:1746155623.142555:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976125326464:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155623.144902:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.162924:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155623.163252:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009a462a00/0x844e5faceb5f3e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155623.163262:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a462a00/0x844e5faceb5f3e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155623.163280:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009a462a00/0x844e5faceb5f3e33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155623.163286:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a462a00/0x844e5faceb5f3e33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155623.163292:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a462a00/0x844e5faceb5f3e33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155623.163299:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a462a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155623.163302:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a462a00/0x844e5faceb5f3e33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155623.163308:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a462a00/0x844e5faceb5f3e33 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155623.163318:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a462a00/0x844e5faceb5f3e33 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155623.163323:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a462a00/0x844e5faceb5f3e33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155623.166150:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1960:x1830976125324800:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 42374us (42509us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155623.166161:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15360 00000100:00100000:0.0:1746155623.173615:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.178663:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.184562:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125328128 00000100:00100000:0.0:1746155623.184565:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125328128 00010000:00010000:0.0:1746155623.184578:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c1da00/0x844e5faceb5f3b62 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a39 expref: 18 pid: 19870 timeout: 852 lvb_type: 0 00000100:00100000:0.0:1746155623.184594:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7825 00000100:00100000:0.0:1746155623.184599:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976125327744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155623.184606:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155623.184610:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094442200/0x844e5faceb5f3bcb lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a8d expref: 18 pid: 19870 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746155623.184617:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094442200/0x844e5faceb5f3bcb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a8d expref: 18 pid: 19870 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746155623.184638:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094442200/0x844e5faceb5f3bcb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15a8d expref: 18 pid: 19870 timeout: 852 lvb_type: 0 00010000:00010000:0.0:1746155623.184660:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155623.184663:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046000/0x844e5faceb5f3e3a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155623.184668:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155623.184690:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976125327744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 91us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155623.184696:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7825 00000100:00100000:0.0:1746155623.224963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.224982:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125328256 00000100:00100000:0.0:1746155623.224986:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125328256 00000100:00100000:0.0:1746155623.225012:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10778 00000100:00100000:0.0:1746155623.225018:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:31563:x1830976125328256:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155623.225033:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155623.225043:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f279800/0x844e5faceb5f3e41 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15c0e expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155623.225096:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f279800/0x844e5faceb5f3e41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15c0e expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155623.225109:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f279800/0x844e5faceb5f3e41 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15c0e expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155623.225124:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155623.225126:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155623.225127:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f279800, rc 0) 00000100:00100000:0.0:1746155623.225156:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:31563:x1830976125328256:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 138us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155623.225161:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10778 00000100:00100000:0.0:1746155623.233275:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.233302:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.233324:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.233858:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.233921:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155623.238104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.248927:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.250743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155624.251844:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155624.252952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.257029:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.257085:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.258453:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7205 00000100:00100000:0.0:1746155624.258464:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125330432:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:0.0:1746155624.258480:0:25391:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a125e00/0x844e5faceb5f3e9c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155624.258492:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155624.258494:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155624.258496:0:25391:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a125e00/0x844e5faceb5f3e9c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155624.258522:0:25391:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a125e00/0x844e5faceb5f3e9c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155624.305908:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155624.306097:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155624.307847:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.310264:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.337680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.337724:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155624.340240:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155624.347094:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.347756:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.353219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.353793:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.354867:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.355534:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.355546:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125333760 00000100:00100000:0.0:1746155624.355549:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125333760 00010000:00010000:0.0:1746155624.355563:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9dc00/0x844e5faceb5f3e4f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15c15 expref: 10 pid: 20364 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746155624.355725:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.355785:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.355803:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.355815:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.355828:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.355857:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.355872:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125333376 00000100:00100000:0.0:1746155624.355875:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125333376 00000100:00100000:0.0:1746155624.355895:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125333888 00000100:00100000:0.0:1746155624.355897:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125333888 00000100:00100000:0.0:1746155624.363174:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.363864:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.366056:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.370732:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.370778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.373313:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.373366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.373419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.373457:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.383263:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.385295:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125336192 00000100:00100000:0.0:1746155624.385301:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125336192 00002000:00100000:0.0:1746155624.385331:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88012ef01c00 x1830976125336192/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:695/0 lens 488/0 e 0 to 0 dl 1746155635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155624.385341:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ef01c00 with x1830976125336192 ext(0->1048575) 00002000:00010000:0.0:1746155624.385345:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ef01c00 00000100:00100000:0.0:1746155624.385368:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125336320 00000100:00100000:0.0:1746155624.385371:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125336320 00002000:00100000:0.0:1746155624.385382:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009c28df80 x1830976125336320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:695/0 lens 488/0 e 0 to 0 dl 1746155635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155624.385393:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28df80 with x1830976125336320 ext(1048576->2097151) 00002000:00010000:0.0:1746155624.385396:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28df80 00000100:00100000:0.0:1746155624.385406:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7209 00000100:00100000:0.0:1746155624.385412:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976125336192:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155624.388805:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125108608:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155624.389560:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f279800/0x844e5faceb5f3e41 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15c0e expref: 8 pid: 19870 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746155624.389586:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125108736:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155624.389605:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f3f98 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155624.389611:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f3f98 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155624.389615:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f3f98 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000040:00080000:0.0:1746155624.390099:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3344, 88 off281168 00000004:00080000:0.0:1746155624.390110:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753539606850ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155624.390136:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3375, 88 off284160 00000004:00080000:0.0:1746155624.390140:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753539637120ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155624.390181:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3376, 88 off284248 00000004:00080000:0.0:1746155624.390184:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753539681388ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155624.390195:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3345, 88 off281256 00000004:00080000:0.0:1746155624.390198:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753539694776ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155624.390204:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3346, 88 off281344 00000004:00080000:0.0:1746155624.390206:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753539703380ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155624.390212:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3377, 88 off284336 00000004:00080000:0.0:1746155624.390214:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753539711056ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155624.390223:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3378, 88 off284424 00000004:00080000:0.0:1746155624.390225:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753539722203ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155624.390233:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3379, 88 off284512 00000004:00080000:0.0:1746155624.390235:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753539731915ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155624.390243:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3347, 88 off281432 00000004:00080000:0.0:1746155624.390245:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753539742120ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155624.390250:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3380, 88 off284600 00000004:00080000:0.0:1746155624.390252:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753539749358ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155624.390260:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3348, 88 off281520 00000004:00080000:0.0:1746155624.390262:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753539759558ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155624.390268:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3381, 88 off284688 00000004:00080000:0.0:1746155624.390270:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753539767183ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155624.390279:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3349, 88 off281608 00000004:00080000:0.0:1746155624.390281:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753539778495ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155624.390287:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3350, 88 off281696 00000004:00080000:0.0:1746155624.390289:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753539786430ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155624.390295:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3351, 88 off281784 00000004:00080000:0.0:1746155624.390298:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753539794582ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155624.390303:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3352, 88 off281872 00000004:00080000:0.0:1746155624.390306:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 753539802886ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155624.390312:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3382, 88 off284776 00000004:00080000:0.0:1746155624.390314:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 753539810786ns, next at 716011101328ns, rc = 0 00000100:00100000:0.0:1746155624.412605:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.429899:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125337856:12345-192.168.202.51@tcp:3:cat.0 Request processed in 33777us (34335us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155624.429910:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7215 00002000:00100000:0.0:1746155624.429921:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88008e26dc00 x1830976125337856/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:695/0 lens 488/440 e 0 to 0 dl 1746155635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155624.429929:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26dc00 with x1830976125337856 ext(1048576->2097151) 00002000:00010000:0.0:1746155624.429934:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26dc00 00000100:00100000:0.0:1746155624.436979:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125110144 00000100:00100000:0.0:1746155624.436982:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125110144 00000100:00100000:0.0:1746155624.437003:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125110272 00000100:00100000:0.0:1746155624.437005:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125110272 00000100:00100000:0.0:1746155624.437015:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125110784 00000100:00100000:0.0:1746155624.437017:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125110784 00000100:00100000:0.0:1746155624.437040:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15405 00000100:00100000:0.0:1746155624.437045:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3296:x1830976125110144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155624.437148:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155624.437150:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155623 -> 1746155623 00002000:00010000:0.0:1746155624.437152:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155620 -> 1746155620 00002000:00010000:0.0:1746155624.437153:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155622 -> 1746155622 00002000:00010000:0.0:1746155624.437155:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155624.437185:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+17:3296:x1830976125110144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (246us total) trans 21474841265 rc 0/0 00000100:00100000:0.0:1746155624.437191:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15405 00000100:00100000:0.0:1746155624.443589:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.461485:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.464740:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125339264 00000100:00100000:0.0:1746155624.464748:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125339264 00000100:00100000:0.0:1746155624.464789:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15413 00000100:00100000:0.0:1746155624.464796:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:31570:x1830976125339264:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155624.464811:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155624.464829:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a124200/0x844e5faceb5f3fad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15cd9 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155624.464851:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8e00/0x844e5faceb5f3e79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15c3f expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155624.464859:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b8dbc00/0x844e5faceb5f3f83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15cbd expref: 13 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155624.464865:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132b0f200/0x844e5faceb5f3f36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15c85 expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155624.464870:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155624.464872:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155624.464875:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a124200/0x844e5faceb5f3fad lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3862528->4186111] (req 3862528->4186111) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15cd9 expref: 18 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155624.464897:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132b0f200/0x844e5faceb5f3f36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15c85 expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155624.464906:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132b0f200/0x844e5faceb5f3f36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15c85 expref: 18 pid: 8438 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746155624.464916:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca95c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125111168:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155624.466008:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b8dbc00/0x844e5faceb5f3f83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15cbd expref: 13 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155624.466027:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b8dbc00/0x844e5faceb5f3f83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15cbd expref: 13 pid: 8438 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746155624.466036:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca95f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125111296:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155624.466064:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8e00/0x844e5faceb5f3e79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15c3f expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155624.466079:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8e00/0x844e5faceb5f3e79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15c3f expref: 8 pid: 19959 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746155624.466088:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125111424:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155624.466104:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155624.471625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.471656:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.479937:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.483480:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.491696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.497478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.497540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.497568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.497603:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.497616:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125341312 00000100:00100000:0.0:1746155624.497619:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125341312 00000100:00100000:0.0:1746155624.497642:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4514 00000100:00100000:0.0:1746155624.497646:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:31570:x1830976125341312:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155624.497857:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:31570:x1830976125341312:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 209us (252us total) trans 8589944880 rc 0/0 00000100:00100000:0.0:1746155624.497863:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4514 00000100:00100000:0.0:1746155624.503255:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.503882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.503921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.503940:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125341568 00000100:00100000:0.0:1746155624.503945:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125341568 00010000:00010000:0.0:1746155624.505889:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd4d200/0x844e5faceb5f3f2f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15c7e expref: 26 pid: 1625 timeout: 853 lvb_type: 1 00000100:00100000:0.0:1746155624.509484:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125340928:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 11783us (11939us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155624.509492:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7222 00002000:00100000:0.0:1746155624.509499:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009ca97100 x1830976125340928/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:695/0 lens 488/440 e 0 to 0 dl 1746155635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155624.509529:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97100 with x1830976125340928 ext(1048576->2097151) 00002000:00010000:0.0:1746155624.509533:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca97100 00000100:00100000:0.0:1746155624.513592:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.521826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.521865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.521936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.525892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.526408:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125342976 00000100:00100000:0.0:1746155624.526412:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125342976 00002000:00100000:0.0:1746155624.526430:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (2334720->3145727) req@ffff88009018a680 x1830976125342976/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:695/0 lens 488/0 e 0 to 0 dl 1746155635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155624.526437:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018a680 with x1830976125342976 ext(2334720->3145727) 00010000:00010000:0.0:1746155624.526440:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090980600/0x844e5faceb5f3fb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ce0 expref: 8 pid: 29728 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746155624.526448:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090980600/0x844e5faceb5f3fb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ce0 expref: 8 pid: 29728 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746155624.526453:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009018a680 00000100:00100000:0.0:1746155624.526473:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1182 00000100:00100000:0.0:1746155624.526478:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976125342976:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155624.530051:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.539266:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125342976:12345-192.168.202.51@tcp:4:cat.0 Request processed in 12780us (12911us total) trans 17179873930 rc 0/0 00000100:00100000:0.0:1746155624.539276:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1182 00002000:00100000:0.0:1746155624.539285:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (2334720->3145727) req@ffff88009018a680 x1830976125342976/t17179873930(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:695/0 lens 488/448 e 0 to 0 dl 1746155635 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155624.539293:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018a680 with x1830976125342976 ext(2334720->3145727) 00010000:00010000:0.0:1746155624.539302:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090980600/0x844e5faceb5f3fb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ce0 expref: 10 pid: 29728 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746155624.539312:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090980600/0x844e5faceb5f3fb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2334720->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ce0 expref: 10 pid: 29728 timeout: 853 lvb_type: 0 00002000:00010000:0.0:1746155624.539324:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009018a680 00000100:00100000:0.0:1746155624.542723:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.545229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.548268:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.548300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.548343:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.561095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.571429:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.574059:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125345152 00000100:00100000:0.0:1746155624.574064:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125345152 00002000:00100000:0.0:1746155624.574097:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012bdf5180 x1830976125345152/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:695/0 lens 488/0 e 0 to 0 dl 1746155635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155624.574105:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5180 with x1830976125345152 ext(2097152->3145727) 00002000:00010000:0.0:1746155624.574108:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf5180 00000100:00100000:0.0:1746155624.574119:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125345408 00000100:00100000:0.0:1746155624.574121:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125345408 00002000:00100000:0.0:1746155624.574129:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88012bdf5c00 x1830976125345408/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:695/0 lens 488/0 e 0 to 0 dl 1746155635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155624.574136:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5c00 with x1830976125345408 ext(3145728->4194303) 00002000:00010000:0.0:1746155624.574138:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf5c00 00000100:00100000:0.0:1746155624.574146:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125345664 00000100:00100000:0.0:1746155624.574147:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125345664 00002000:00100000:0.0:1746155624.574156:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800912c0a80 x1830976125345664/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:695/0 lens 488/0 e 0 to 0 dl 1746155635 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155624.574162:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800912c0a80 with x1830976125345664 ext(3145728->4194303) 00002000:00010000:0.0:1746155624.574165:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800912c0a80 00000100:00100000:0.0:1746155624.574173:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7229 00000100:00100000:0.0:1746155624.574178:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976125345152:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155624.597092:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.604272:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.604435:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.616059:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.617111:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125346176:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12105us (12845us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155624.617117:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7232 00002000:00100000:0.0:1746155624.617122:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009fc50700 x1830976125346176/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:695/0 lens 488/440 e 0 to 0 dl 1746155635 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155624.617128:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc50700 with x1830976125346176 ext(3145728->4194303) 00002000:00010000:0.0:1746155624.617131:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc50700 00000100:00100000:0.0:1746155624.628128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.640951:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.721424:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.756264:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.768457:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.779119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.803329:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.813827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.813912:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.813933:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125348480 00000100:00100000:0.0:1746155624.813939:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125348480 00010000:00010000:0.0:1746155624.813968:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940bf000/0x844e5faceb5f4016 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d11 expref: 13 pid: 27374 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746155624.813989:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125348608 00000100:00100000:0.0:1746155624.813991:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125348608 00010000:00010000:0.0:1746155624.813999:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800940bf400/0x844e5faceb5f3ff3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d0a expref: 291 pid: 27374 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746155624.814025:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7845 00000100:00100000:0.0:1746155624.814032:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976125348480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155624.814043:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155624.814048:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940bf000/0x844e5faceb5f4016 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d11 expref: 13 pid: 27374 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746155624.814057:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940bf000/0x844e5faceb5f4016 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d11 expref: 13 pid: 27374 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746155624.814084:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155624.814088:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f402b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155624.814094:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f402b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155624.814099:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155624.814135:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976125348480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 103us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155624.814141:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7845 00000100:00100000:0.0:1746155624.814153:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7846 00000100:00100000:0.0:1746155624.814158:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1961:x1830976125348608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155624.814164:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155624.814168:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800940bf400/0x844e5faceb5f3ff3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d0a expref: 291 pid: 27374 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746155624.814175:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800940bf400/0x844e5faceb5f3ff3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d0a expref: 291 pid: 27374 timeout: 853 lvb_type: 0 00010000:00010000:0.0:1746155624.814184:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155624.814187:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f402b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155624.814193:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f402b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155624.814198:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f402b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155624.814212:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155624.814225:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1961:x1830976125348608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 67us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155624.814230:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7846 00000100:00100000:0.0:1746155624.822608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.829900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.837233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.837263:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.837285:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.838835:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125349504 00000100:00100000:0.0:1746155624.838838:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125349504 00000100:00100000:0.0:1746155624.838860:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15421 00000100:00100000:0.0:1746155624.838865:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:31591:x1830976125349504:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155624.838876:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155624.838888:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a237400/0x844e5faceb5f4040 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15d26 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155624.838903:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a626f400/0x844e5faceb5f3fbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15cee expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155624.838909:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800940bee00/0x844e5faceb5f3fd7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d03 expref: 11 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155624.838914:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155624.838915:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155624.838917:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a237400/0x844e5faceb5f4040 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2854912->3084287] (req 2854912->3084287) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d26 expref: 11 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155624.838933:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800940bee00/0x844e5faceb5f3fd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d03 expref: 11 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155624.838941:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800940bee00/0x844e5faceb5f3fd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d03 expref: 11 pid: 29728 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746155624.838950:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125113856:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155624.839228:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a626f400/0x844e5faceb5f3fbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15cee expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155624.839236:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a626f400/0x844e5faceb5f3fbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15cee expref: 23 pid: 20796 timeout: 853 lvb_type: 0 00000100:00100000:0.0:1746155624.839248:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125113984:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155624.839264:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155624.842748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.842810:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.843991:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.844027:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.846321:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.849665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.855454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.857739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.859314:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.863673:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.866594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.867816:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.867905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.878021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.886680:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.895809:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.938446:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.941208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.944419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.944461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.948285:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.949414:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.949456:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.950406:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.952808:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.955350:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.961633:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.964317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.964536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.967605:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.968958:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.972998:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.973671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.974099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.974229:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.974256:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.974276:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.975134:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.976730:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.976781:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.979988:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.981399:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.986220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.986238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.986260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.986274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.986282:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125357312 00000100:00100000:0.0:1746155624.986284:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125357312 00010000:00010000:0.0:1746155624.986295:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c047000/0x844e5faceb5f3e6b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15c31 expref: 8 pid: 4461 timeout: 854 lvb_type: 1 00000100:00100000:0.0:1746155624.986305:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7863 00000100:00100000:0.0:1746155624.986309:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125357056:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155624.986314:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155624.986319:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f3f75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ca8 expref: 14 pid: 9235 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746155624.986640:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f3f75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ca8 expref: 12 pid: 9235 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746155624.986738:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f3f75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ca8 expref: 12 pid: 9235 timeout: 854 lvb_type: 1 00010000:00010000:0.0:1746155624.986757:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155624.986772:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125357056:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 461us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155624.986944:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7863 00000100:00100000:0.0:1746155624.991232:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976125356288:12345-192.168.202.51@tcp:4:cat.0 Request processed in 13844us (14503us total) trans 21474841275 rc 0/0 00000100:00100000:0.0:1746155624.991238:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1185 00002000:00100000:0.0:1746155624.991242:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1458176->2056191) req@ffff8800a0ac4a80 x1830976125356288/t21474841275(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:695/0 lens 488/448 e 0 to 0 dl 1746155635 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155624.991249:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac4a80 with x1830976125356288 ext(1458176->2056191) 00010000:00010000:0.0:1746155624.991253:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093480c00/0x844e5faceb5f4039 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d1f expref: 17 pid: 20796 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746155624.991259:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093480c00/0x844e5faceb5f4039 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->2056191) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d1f expref: 17 pid: 20796 timeout: 854 lvb_type: 0 00002000:00010000:0.0:1746155624.991268:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0ac4a80 00000100:00100000:0.0:1746155624.993720:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155624.996371:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125358080 00000100:00100000:0.0:1746155624.996377:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125358080 00010000:00010000:0.0:1746155624.996403:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a237400/0x844e5faceb5f4040 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2854912->3084287) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d26 expref: 10 pid: 20796 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746155624.996437:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7868 00000100:00100000:0.0:1746155624.996444:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125358080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155624.996456:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155624.996473:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a237400/0x844e5faceb5f4040 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2854912->3084287) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d26 expref: 10 pid: 20796 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746155624.996484:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a237400/0x844e5faceb5f4040 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2854912->3084287) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d26 expref: 10 pid: 20796 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746155624.996520:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a237400/0x844e5faceb5f4040 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2854912->3084287) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d26 expref: 10 pid: 20796 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746155624.996573:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155624.996575:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155624.996578:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093e16000/0x844e5faceb5f410b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155624.996586:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093e16000/0x844e5faceb5f410b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155624.996688:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155624.996719:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125358080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 275us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155624.996725:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7868 00000100:00100000:0.0:1746155625.002376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.002446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.005681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.005716:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.005772:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.014011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.028757:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125117696 00000100:00100000:0.0:1746155625.028762:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125117696 00000100:00100000:0.0:1746155625.028781:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125118208 00000100:00100000:0.0:1746155625.028783:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125118208 00000100:00100000:0.0:1746155625.028795:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125118720 00000100:00100000:0.0:1746155625.028797:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125118720 00000100:00100000:0.0:1746155625.028806:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125119232 00000100:00100000:0.0:1746155625.028808:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125119232 00000100:00100000:0.0:1746155625.028816:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125117824 00000100:00100000:0.0:1746155625.028818:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125117824 00000100:00100000:0.0:1746155625.028823:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125118336 00000100:00100000:0.0:1746155625.028824:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125118336 00000100:00100000:0.0:1746155625.028830:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125118848 00000100:00100000:0.0:1746155625.028831:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125118848 00000100:00100000:0.0:1746155625.028837:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125119360 00000100:00100000:0.0:1746155625.028838:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125119360 00000100:00100000:0.0:1746155625.028851:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15443 00000100:00100000:0.0:1746155625.028857:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3295:x1830976125118208:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155625.028940:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:0.0:1746155625.028943:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155625.028945:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155625.028946:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155625.028948:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155625.028969:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3295:x1830976125118208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (259us total) trans 21474841281 rc 0/0 00000100:00100000:0.0:1746155625.028974:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15443 00000100:00100000:0.0:1746155625.028984:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15445 00000100:00100000:0.0:1746155625.028988:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3295:x1830976125119232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155625.029456:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3295:x1830976125119232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 467us (708us total) trans 17179873935 rc 0/0 00000100:00100000:0.0:1746155625.029462:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15445 00000100:00100000:0.0:1746155625.029999:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125118976 00000100:00100000:0.0:1746155625.030002:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125118976 00000100:00100000:0.0:1746155625.030038:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125119488 00000100:00100000:0.0:1746155625.030040:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125119488 00000100:00100000:0.0:1746155625.030113:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15451 00000100:00100000:0.0:1746155625.030119:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800912c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976125119488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155625.030204:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3297:x1830976125119488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (566us total) trans 17179873937 rc 0/0 00000100:00100000:0.0:1746155625.030209:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15451 00000100:00100000:0.0:1746155625.032168:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125359360 00000100:00100000:0.0:1746155625.032172:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125359360 00000100:00100000:0.0:1746155625.032206:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10799 00000100:00100000:0.0:1746155625.032212:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:31597:x1830976125359360:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155625.032227:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155625.032240:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1ddc800/0x844e5faceb5f4135 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15d9d expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.032326:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1ddc800/0x844e5faceb5f4135 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d9d expref: 9 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.032338:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1ddc800/0x844e5faceb5f4135 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15d9d expref: 9 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.032353:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155625.032355:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155625.032358:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1ddc800, rc 0) 00000100:00100000:0.0:1746155625.032399:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:31597:x1830976125359360:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 186us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.032403:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10799 00000100:00100000:0.0:1746155625.034990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.037435:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.039703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.041019:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7246 00000100:00100000:0.0:1746155625.041027:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976125360512:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155625.052698:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976125360512:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11665us (11856us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155625.052709:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7246 00002000:00100000:0.0:1746155625.052718:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009c28e300 x1830976125360512/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:696/0 lens 488/440 e 0 to 0 dl 1746155636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155625.052727:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28e300 with x1830976125360512 ext(2097152->3145727) 00002000:00010000:0.0:1746155625.052731:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28e300 00000100:00100000:0.0:1746155625.065436:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.065470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.065490:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.065577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.065763:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15456 00000100:00100000:0.0:1746155625.065771:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976125361152:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155625.065778:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155625.065786:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a27d000/0x844e5faceb5f4143 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15dab expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155625.065799:0:9235:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x68143869, atime: 0x68143869, ctime: 0x68143869, blocks: 0x81f 00010000:00010000:0.0:1746155625.065807:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.065808:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.065811:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a27d000/0x844e5faceb5f4143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15dab expref: 19 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.065820:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a27d000/0x844e5faceb5f4143 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15dab expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.065827:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a27d000, rc 0) 00000100:00100000:0.0:1746155625.065841:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976125361152:12345-192.168.202.51@tcp:101:cat.0 Request processed in 73us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.065846:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15456 00000100:00100000:0.0:1746155625.068865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.093730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.094175:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.107282:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.111749:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.111834:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.137330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.154028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.158518:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.158534:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.158544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.158556:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.158567:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.158872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.158918:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125364096 00000100:00100000:0.0:1746155625.158921:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125364096 00000100:00100000:0.0:1746155625.158943:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15479 00000100:00100000:0.0:1746155625.158948:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125363712:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155625.158954:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155625.158960:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e123600/0x844e5faceb5f41f9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15dff expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.158971:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.158972:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.158975:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e123600/0x844e5faceb5f41f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15dff expref: 17 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.158985:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e123600/0x844e5faceb5f41f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15dff expref: 17 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.158992:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e123600, rc 0) 00000100:00100000:0.0:1746155625.159179:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125363712:12345-192.168.202.51@tcp:101:cat.0 Request processed in 229us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.159184:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15479 00000100:00100000:0.0:1746155625.159195:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15480 00000100:00100000:0.0:1746155625.159200:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125363968:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155625.159205:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155625.159212:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e123400/0x844e5faceb5f4200 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15e0d expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.159221:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.159222:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.159226:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e123400/0x844e5faceb5f4200 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e0d expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.159233:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e123400/0x844e5faceb5f4200 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e0d expref: 13 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.159240:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e123400, rc 0) 00000100:00100000:0.0:1746155625.159254:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1961:x1830976125363968:12345-192.168.202.51@tcp:101:cat.0 Request processed in 54us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.159259:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15480 00000100:00100000:0.0:1746155625.161430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.163318:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.165638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.169950:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.169983:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.170007:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.170033:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.170076:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125365120 00000100:00100000:0.0:1746155625.170083:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125365120 00002000:00100000:0.0:1746155625.170116:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a3fc7800 x1830976125365120/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:696/0 lens 488/0 e 0 to 0 dl 1746155636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155625.170123:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc7800 with x1830976125365120 ext(1048576->2097151) 00002000:00010000:0.0:1746155625.170127:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc7800 00000100:00100000:0.0:1746155625.170140:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125365376 00000100:00100000:0.0:1746155625.170142:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125365376 00002000:00100000:0.0:1746155625.170153:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff8800a3fc6a00 x1830976125365376/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:696/0 lens 488/0 e 0 to 0 dl 1746155636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155625.170159:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc6a00 with x1830976125365376 ext(0->1048575) 00002000:00010000:0.0:1746155625.170161:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc6a00 00000100:00100000:0.0:1746155625.170169:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7250 00000100:00100000:0.0:1746155625.170174:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976125365120:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155625.196261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.196351:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.209540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.214805:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.215034:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.221854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.223108:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.224798:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:0.0:1746155625.230544:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime: 1746155623 -> 1746155625 00000100:00100000:0.0:1746155625.230559:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ed5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125122944:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155625.230577:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b407d800/0x844e5faceb5f423f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e29 expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.230585:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b407d800/0x844e5faceb5f423f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e29 expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.230597:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b407d800, rc 0) 00000100:00100000:0.0:1746155625.232164:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976125367424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8184us (9055us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155625.232171:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15484 00000100:00100000:0.0:1746155625.236414:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ed7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125123072:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155625.236431:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b407dc00/0x844e5faceb5f4246 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e30 expref: 16 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.236440:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b407dc00, rc 0) 00000100:00100000:0.0:1746155625.236472:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:31608:x1830976125367808:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6288us (6409us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.236478:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15485 00000100:00100000:0.0:1746155625.238152:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.241759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.246036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.246084:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.246105:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.246126:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.246154:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.249023:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7260 00000100:00100000:0.0:1746155625.249043:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125369728:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155625.260268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.286083:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.294225:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.294769:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.302409:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.307813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.307856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.308006:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7263 00000100:00100000:0.0:1746155625.308015:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1962:x1830976125371264:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155625.313197:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.343489:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125371904 00000100:00100000:0.0:1746155625.343493:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125371904 00002000:00100000:0.0:1746155625.343531:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880093ed4e00 x1830976125371904/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:696/0 lens 488/0 e 0 to 0 dl 1746155636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155625.343539:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ed4e00 with x1830976125371904 ext(4194304->5083135) 00002000:00010000:0.0:1746155625.343543:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ed4e00 00000100:00100000:0.0:1746155625.343563:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7265 00000100:00100000:0.0:1746155625.343568:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1963:x1830976125371904:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155625.359044:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125372160 00000100:00100000:0.0:1746155625.359052:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125372160 00002000:00100000:0.0:1746155625.359100:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880093ed7800 x1830976125372160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:696/0 lens 488/0 e 0 to 0 dl 1746155636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155625.359109:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ed7800 with x1830976125372160 ext(2097152->3145727) 00002000:00010000:0.0:1746155625.359113:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093ed7800 00000100:00100000:0.0:1746155625.359127:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125372672 00000100:00100000:0.0:1746155625.359130:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125372672 00002000:00100000:0.0:1746155625.359142:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880093ed7480 x1830976125372672/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:696/0 lens 488/0 e 0 to 0 dl 1746155636 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155625.359149:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093ed7480 with x1830976125372672 ext(3145728->4194303) 00002000:00010000:0.0:1746155625.359152:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093ed7480 00000100:00100000:0.0:1746155625.359162:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7267 00000100:00100000:0.0:1746155625.359167:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976125372416:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155625.376481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.379351:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.382881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.384137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.394236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.431780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.441998:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.445245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.445286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.448644:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.453866:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.457600:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.499418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.502744:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.503138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.509463:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.517486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.573300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.584987:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.605197:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.610276:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.610324:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.628867:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.628907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.638573:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.644586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.644617:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125377792 00000100:00100000:0.0:1746155625.644624:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125377792 00000100:00100000:0.0:1746155625.644657:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4529 00000100:00100000:0.0:1746155625.644664:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:31629:x1830976125377792:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:0.0:1746155625.644893:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:31629:x1830976125377792:12345-192.168.202.51@tcp:35:cat.0 Request processed in 229us (312us total) trans 8589944911 rc 0/0 00000100:00100000:0.0:1746155625.644899:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4529 00000100:00100000:0.0:1746155625.647257:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.648323:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.658939:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.663583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.667178:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.667215:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.674706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.674747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.677310:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.683789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.683873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.683896:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.687918:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125380224 00000100:00100000:0.0:1746155625.687922:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125380224 00000100:00100000:0.0:1746155625.687951:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15498 00000100:00100000:0.0:1746155625.687957:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:31623:x1830976125380224:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155625.687964:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155625.687970:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5f4381 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15ebc expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.687981:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155625.687985:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6bc400/0x844e5faceb5f437a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15eb5 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.687990:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746155625.687992:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5f4381 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->1417215] (req 1048576->1417215) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ebc expref: 14 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.688010:0:19959:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6bc400/0x844e5faceb5f437a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15eb5 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.688018:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b038e00/0x844e5faceb5f4381 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->1417215] (req 1048576->1417215) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ebc expref: 14 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.688026:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b038e00, rc 0) 00000100:00100000:0.0:1746155625.688043:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:31623:x1830976125380224:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 87us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.688048:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15498 00000100:00080000:0.0:1746155625.696149:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155625.698400:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125380992 00000100:00100000:0.0:1746155625.698403:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125380992 00000100:00100000:0.0:1746155625.698421:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125381120 00000100:00100000:0.0:1746155625.698424:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125381120 00000100:00100000:0.0:1746155625.698445:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15503 00000100:00100000:0.0:1746155625.698454:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125380992:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155625.698464:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155625.698475:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b038600/0x844e5faceb5f43a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15edf expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.698490:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.698491:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.698497:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b038600/0x844e5faceb5f43a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15edf expref: 9 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.698538:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b038600/0x844e5faceb5f43a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15edf expref: 9 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.698547:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b038600, rc 0) 00000100:00100000:0.0:1746155625.698575:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125380992:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 122us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.698581:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15503 00000100:00100000:0.0:1746155625.698598:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15504 00000100:00100000:0.0:1746155625.698605:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125381120:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155625.698612:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155625.698621:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b039800/0x844e5faceb5f43ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15ee6 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.698633:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.698634:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.698640:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b039800/0x844e5faceb5f43ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ee6 expref: 11 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.698650:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b039800/0x844e5faceb5f43ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ee6 expref: 11 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.698657:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b039800, rc 0) 00000100:00100000:0.0:1746155625.698685:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a384050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125381120:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 80us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.698690:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15504 00000100:00100000:0.0:1746155625.707884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.722727:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976125381504:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13358us (14846us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155625.722735:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7277 00002000:00100000:0.0:1746155625.722741:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88012b6c0a80 x1830976125381504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:696/0 lens 488/440 e 0 to 0 dl 1746155636 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155625.722749:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c0a80 with x1830976125381504 ext(1048576->2097151) 00002000:00010000:0.0:1746155625.722752:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c0a80 00000100:00100000:0.0:1746155625.724231:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.724456:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.724861:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7890 00000100:00100000:0.0:1746155625.724872:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125382016:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155625.724882:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155625.724889:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c400/0x844e5faceb5f4349 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ea0 expref: 9 pid: 27374 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746155625.724898:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c400/0x844e5faceb5f4349 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ea0 expref: 9 pid: 27374 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746155625.724913:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c400/0x844e5faceb5f4349 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ea0 expref: 9 pid: 27374 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746155625.724930:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155625.724934:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8000/0x844e5faceb5f43b9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155625.724942:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8000/0x844e5faceb5f43b9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155625.724947:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8000/0x844e5faceb5f43b9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155625.724967:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155625.725002:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125382016:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 133us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.725008:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7890 00000100:00100000:0.0:1746155625.733278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.733339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.734398:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.742492:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976125382528:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7863us (8094us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155625.742499:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1194 00002000:00100000:0.0:1746155625.742523:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012b6c3800 x1830976125382528/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:696/0 lens 488/440 e 0 to 0 dl 1746155636 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155625.742532:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c3800 with x1830976125382528 ext(1048576->2097151) 00010000:00010000:0.0:1746155625.742538:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6bc400/0x844e5faceb5f437a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15eb5 expref: 13 pid: 10591 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746155625.742548:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6bc400/0x844e5faceb5f437a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15eb5 expref: 13 pid: 10591 timeout: 854 lvb_type: 0 00002000:00010000:0.0:1746155625.742554:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b6c3800 00000100:00100000:0.0:1746155625.753382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.753701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.753715:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125383296 00000100:00100000:0.0:1746155625.753718:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125383296 00010000:00010000:0.0:1746155625.753736:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8c00/0x844e5faceb5f431f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e8b expref: 19 pid: 10591 timeout: 854 lvb_type: 0 00000100:00100000:0.0:1746155625.753753:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7892 00000100:00100000:0.0:1746155625.753758:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976125383296:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155625.753766:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155625.753782:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8c00/0x844e5faceb5f431f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e8b expref: 19 pid: 10591 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746155625.753791:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8c00/0x844e5faceb5f431f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e8b expref: 19 pid: 10591 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746155625.753807:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8c00/0x844e5faceb5f431f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1843200->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e8b expref: 19 pid: 10591 timeout: 854 lvb_type: 0 00010000:00010000:0.0:1746155625.753827:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.753829:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.753835:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f6bdc00/0x844e5faceb5f43c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ef4 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.753843:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6bdc00/0x844e5faceb5f43c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ef4 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.753868:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f6bdc00/0x844e5faceb5f43c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ef4 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155625.753878:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125127552:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155625.755021:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155625.755052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.755153:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.763730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.763792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.764066:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.773007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.783326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.783960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.784029:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.784719:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15510 00000100:00100000:0.0:1746155625.784729:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976125385216:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155625.784736:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155625.784745:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a20bc00/0x844e5faceb5f4406 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15f25 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.784757:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.784759:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.784765:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a20bc00/0x844e5faceb5f4406 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15f25 expref: 20 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.784776:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a20bc00/0x844e5faceb5f4406 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15f25 expref: 20 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.784784:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a20bc00, rc 0) 00000100:00100000:0.0:1746155625.785081:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976125385216:12345-192.168.202.51@tcp:101:cat.0 Request processed in 355us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.785087:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15510 00000100:00100000:0.0:1746155625.787431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.788766:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.790071:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1196 00000100:00100000:0.0:1746155625.790082:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976125385472:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155625.798113:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125385728 00000100:00100000:0.0:1746155625.798120:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125385728 00000100:00100000:0.0:1746155625.798290:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15513 00000100:00100000:0.0:1746155625.798298:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1962:x1830976125385728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155625.798311:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155625.798324:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b18d400/0x844e5faceb5f441b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15f3a expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155625.798361:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b880380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125128064:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155625.799952:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155625.800352:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.805937:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.807786:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155625.871663:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136ac9800/0x844e5faceb5f4262 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e4c expref: 22 pid: 19959 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746155625.871689:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125128320:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155625.871702:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b039800/0x844e5faceb5f43ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15ee6 expref: 7 pid: 19959 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746155625.871709:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125128448:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155625.871717:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125128576:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155625.871738:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5fab000/0x844e5faceb5f4422 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2408448->3145727] (req 2408448->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15f41 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.871747:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fab000, rc 0) 00000100:00100000:0.0:1746155625.871768:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:31631:x1830976125386496:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6248us (8120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.871774:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15514 00000100:00100000:0.0:1746155625.871813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.874984:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.886074:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.894282:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.894339:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.894373:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.894401:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125387392 00000100:00100000:0.0:1746155625.894407:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125387392 00010000:00010000:0.0:1746155625.894433:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b038600/0x844e5faceb5f43a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15edf expref: 7 pid: 19959 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746155625.894449:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125387520 00000100:00100000:0.0:1746155625.894450:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125387520 00010000:00010000:0.0:1746155625.894457:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e86d400/0x844e5faceb5f4254 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e3e expref: 13 pid: 19959 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746155625.894466:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125387648 00000100:00100000:0.0:1746155625.894468:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125387648 00010000:00010000:0.0:1746155625.894474:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136ac8600/0x844e5faceb5f425b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e45 expref: 29 pid: 19959 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746155625.894484:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7898 00000100:00100000:0.0:1746155625.894489:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125387392:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155625.894497:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155625.894538:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b038600/0x844e5faceb5f43a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15edf expref: 7 pid: 19959 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746155625.894548:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b038600/0x844e5faceb5f43a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15edf expref: 7 pid: 19959 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746155625.894567:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b038600/0x844e5faceb5f43a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15edf expref: 7 pid: 19959 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746155625.894582:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155625.894609:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1960:x1830976125387392:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 120us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.894614:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7898 00000100:00100000:0.0:1746155625.894629:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7899 00000100:00100000:0.0:1746155625.894633:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976125387520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155625.894638:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155625.894644:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e86d400/0x844e5faceb5f4254 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e3e expref: 13 pid: 19959 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155625.894651:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e86d400/0x844e5faceb5f4254 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e3e expref: 13 pid: 19959 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155625.894660:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e86d400/0x844e5faceb5f4254 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e3e expref: 13 pid: 19959 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155625.894668:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155625.894679:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976125387520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 46us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.894684:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7899 00000100:00100000:0.0:1746155625.894693:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7900 00000100:00100000:0.0:1746155625.894698:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976125387648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155625.894703:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155625.894708:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136ac8600/0x844e5faceb5f425b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e45 expref: 29 pid: 19959 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155625.894717:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136ac8600/0x844e5faceb5f425b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e45 expref: 29 pid: 19959 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155625.894726:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136ac8600/0x844e5faceb5f425b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e45 expref: 29 pid: 19959 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155625.894734:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.894735:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155625.894740:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5faac00/0x844e5faceb5f4429 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15f48 expref: 28 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.894746:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5faac00/0x844e5faceb5f4429 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15f48 expref: 28 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155625.894769:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5faac00/0x844e5faceb5f4429 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3432447) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15f48 expref: 28 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155625.894779:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f701180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125129216:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155625.894822:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155625.895546:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.898587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.906344:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.927317:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.935148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.936533:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.937840:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.939148:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125129984 00000100:00100000:0.0:1746155625.939152:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125129984 00000100:00100000:0.0:1746155625.939313:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1746155625.939320:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3297:x1830976125129984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746155625.939340:0:8440:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 546504704 pending 11927552 free 3849322496 avail 3847225344 00000100:00100000:0.0:1746155625.939375:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+41:3297:x1830976125129984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.939381:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1746155625.939390:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1746155625.939395:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3297:x1830976125130112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746155625.939409:0:8440:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 517668864 pending 17039360 free 3850371072 avail 3848273920 00000100:00100000:0.0:1746155625.939426:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3297:x1830976125130112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155625.939430:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1746155625.943109:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.943143:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.943166:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.943205:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.948537:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.954968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.957251:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.959614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.960089:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.962434:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.962459:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.962477:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.962493:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125391872 00000100:00100000:0.0:1746155625.962496:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125391872 00000100:00100000:0.0:1746155625.962536:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125392256 00000100:00100000:0.0:1746155625.962538:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125392256 00000100:00100000:0.0:1746155625.962552:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15523 00000100:00100000:0.0:1746155625.962557:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125391872:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155625.962567:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155625.962577:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009520c800/0x844e5faceb5f44bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15f95 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155625.962743:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125130880:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155625.962761:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155625.962774:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15526 00000100:00100000:0.0:1746155625.962780:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125392128:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155625.962786:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155625.962792:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009520d000/0x844e5faceb5f44d1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15fa3 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155625.962811:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125131136:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155625.962827:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155625.965569:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125131136:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155625.965587:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009520d000/0x844e5faceb5f44d1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15fa3 expref: 16 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.965596:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009520d000/0x844e5faceb5f44d1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15fa3 expref: 16 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155625.965619:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009520d000, rc 0) 00000100:00100000:0.0:1746155625.965637:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976125392128:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2857us (3159us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155625.965643:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15526 00000100:00100000:0.0:1746155625.965787:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.969160:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.969618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.969679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.973942:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.975425:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125393408 00000100:00100000:0.0:1746155625.975429:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125393408 00000100:00100000:0.0:1746155625.975467:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4536 00000100:00100000:0.0:1746155625.975473:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:31639:x1830976125393408:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155625.975642:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:31639:x1830976125393408:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 169us (397us total) trans 8589944923 rc 0/0 00000100:00100000:0.0:1746155625.975647:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4536 00000100:00100000:0.0:1746155625.981306:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.983255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.986980:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.990426:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.992898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155625.998723:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.008324:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.012727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.016437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.021171:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.030086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.031661:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.033458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.033485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.033587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.033649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.033666:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125395968 00000100:00100000:0.0:1746155626.033671:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125395968 00000100:00100000:0.0:1746155626.033696:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15531 00000100:00100000:0.0:1746155626.033702:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:31646:x1830976125395968:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155626.033715:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155626.033726:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a462800/0x844e5faceb5f4502 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f15fd4 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.033740:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.033742:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.033746:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a462800/0x844e5faceb5f4502 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15fd4 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.033756:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a462800/0x844e5faceb5f4502 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15fd4 expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.033764:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a462800, rc 0) 00000100:00100000:0.0:1746155626.033794:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:31646:x1830976125395968:12345-192.168.202.51@tcp:101:cat.0 Request processed in 91us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.033799:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15531 00000100:00100000:0.0:1746155626.033858:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7910 00000100:00100000:0.0:1746155626.033864:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1963:x1830976125395712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155626.033871:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155626.033875:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e301600/0x844e5faceb5f4445 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15f4f expref: 22 pid: 27374 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.033883:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e301600/0x844e5faceb5f4445 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15f4f expref: 22 pid: 27374 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.034079:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e301600/0x844e5faceb5f4445 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15f4f expref: 22 pid: 27374 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.034104:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155626.034107:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0800/0x844e5faceb5f44fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155626.034113:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0800/0x844e5faceb5f44fb lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155626.034117:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155626.034165:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976125395712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 299us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.034171:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7910 00000100:00100000:0.0:1746155626.039052:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.042113:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.042147:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.042164:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125396480 00000100:00100000:0.0:1746155626.042171:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125396480 00002000:00100000:0.0:1746155626.042200:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800943e9f80 x1830976125396480/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:697/0 lens 488/0 e 0 to 0 dl 1746155637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155626.042209:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943e9f80 with x1830976125396480 ext(3145728->4194303) 00002000:00010000:0.0:1746155626.042213:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943e9f80 00000100:00100000:0.0:1746155626.042230:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7294 00000100:00100000:0.0:1746155626.042236:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125396480:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155626.043187:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.043200:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125396992 00000100:00100000:0.0:1746155626.043203:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125396992 00002000:00100000:0.0:1746155626.043219:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800943e9880 x1830976125396992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:697/0 lens 488/0 e 0 to 0 dl 1746155637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155626.043226:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800943e9880 with x1830976125396992 ext(2097152->3145727) 00002000:00010000:0.0:1746155626.043229:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800943e9880 00000100:00100000:0.0:1746155626.043241:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7296 00000100:00100000:0.0:1746155626.043247:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976125396992:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155626.045006:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.046630:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.062605:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.062675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.065340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.065396:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.071702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.071748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.073230:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.076932:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.081688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.082496:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.100253:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.162792:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.165901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155626.165969:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155626.167238:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.169214:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.171256:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.175273:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.179756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.180065:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7917 00000100:00100000:0.0:1746155626.180075:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1963:x1830976125400704:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155626.180085:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155626.180106:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d427000/0x844e5faceb5f4510 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15fdb expref: 22 pid: 1625 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746155626.180115:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d427000/0x844e5faceb5f4510 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15fdb expref: 22 pid: 1625 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746155626.180131:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d427000/0x844e5faceb5f4510 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15fdb expref: 22 pid: 1625 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746155626.180157:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155626.180191:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976125400704:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 116us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.180198:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7917 00000100:00100000:0.0:1746155626.182807:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.189609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.222973:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.229101:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.235824:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.238953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.244090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.307445:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.308720:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.309971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.313101:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125134592:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155626.313117:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbea200/0x844e5faceb5f4564 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16021 expref: 23 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155626.313125:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbea200/0x844e5faceb5f4564 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16021 expref: 23 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155626.313150:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbea200, rc 0) 00000100:00100000:0.0:1746155626.313171:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1963:x1830976125402240:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4131us (4451us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155626.313176:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15541 00000100:00100000:0.0:1746155626.316701:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.316745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.321827:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125134848:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155626.321853:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b54b5200/0x844e5faceb5f4572 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1602f expref: 23 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.321868:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b54b5200, rc 0) 00000100:00100000:0.0:1746155626.321904:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:31664:x1830976125402752:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3625us (5157us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.321910:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15543 00000100:00100000:0.0:1746155626.329742:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.329764:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125403008 00000100:00100000:0.0:1746155626.329770:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125403008 00000100:00100000:0.0:1746155626.330115:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15544 00000100:00100000:0.0:1746155626.330124:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:31663:x1830976125403008:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155626.330135:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155626.330146:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffab200/0x844e5faceb5f4579 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16036 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.330168:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a27de00/0x844e5faceb5f454f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1600c expref: 22 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.330174:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155626.330176:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155626.330179:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffab200/0x844e5faceb5f4579 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16036 expref: 25 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.330203:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a27de00/0x844e5faceb5f454f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1600c expref: 22 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.330212:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a27de00/0x844e5faceb5f454f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1540095) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1600c expref: 22 pid: 20200 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746155626.330223:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125134976:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155626.330283:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155626.332270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.333688:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.341562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.344375:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.354948:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976125403520:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12983us (13385us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155626.354960:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7308 00002000:00100000:0.0:1746155626.354969:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009c211880 x1830976125403520/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:697/0 lens 488/440 e 0 to 0 dl 1746155637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155626.354978:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211880 with x1830976125403520 ext(1048576->2097151) 00002000:00010000:0.0:1746155626.354983:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c211880 00000100:00100000:0.0:1746155626.355172:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125403904 00000100:00100000:0.0:1746155626.355178:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125403904 00002000:00100000:0.0:1746155626.355209:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a3fc5180 x1830976125403904/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:697/0 lens 488/0 e 0 to 0 dl 1746155637 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155626.355215:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5180 with x1830976125403904 ext(1048576->2097151) 00002000:00010000:0.0:1746155626.355219:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc5180 00000100:00100000:0.0:1746155626.355234:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7309 00000100:00100000:0.0:1746155626.355241:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125403904:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155626.378219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.388425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.397682:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.423110:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1961:x1830976125404800:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23495us (23646us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155626.423121:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7312 00002000:00100000:0.0:1746155626.423130:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a6063800 x1830976125404800/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:697/0 lens 488/440 e 0 to 0 dl 1746155637 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155626.423138:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6063800 with x1830976125404800 ext(1048576->2097151) 00002000:00010000:0.0:1746155626.423143:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6063800 00000100:00100000:0.0:1746155626.425084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.434915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.435194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.435820:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca97800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125135360:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155626.435938:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fc11200/0x844e5faceb5f4587 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1613824->2097151] (req 1613824->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16044 expref: 26 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.435953:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc11200, rc 0) 00000100:00100000:0.0:1746155626.438841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.441612:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.441630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.442254:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.442756:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.449952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.456227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.456973:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.461005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.463760:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.464063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.464269:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.464976:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7315 00000100:00100000:0.0:1746155626.464984:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976125407232:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155626.471789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.489874:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.489967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.495454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.495497:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.500490:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.500542:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.557186:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.562911:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.565747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.571649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.578118:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125409536 00000100:00100000:0.0:1746155626.578122:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125409536 00010000:00010000:0.0:1746155626.578137:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b407da00/0x844e5faceb5f44d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15fb1 expref: 17 pid: 8438 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746155626.578167:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7928 00000100:00100000:0.0:1746155626.578175:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125409536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155626.578181:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155626.578190:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b407da00/0x844e5faceb5f44d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15fb1 expref: 17 pid: 8438 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.578198:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b407da00/0x844e5faceb5f44d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15fb1 expref: 17 pid: 8438 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.578208:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b407da00/0x844e5faceb5f44d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15fb1 expref: 17 pid: 8438 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.578232:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.578234:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.578243:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffaa400/0x844e5faceb5f45e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f160a6 expref: 16 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.578261:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffaa400/0x844e5faceb5f45e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f160a6 expref: 16 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.578280:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ffaa400/0x844e5faceb5f45e9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4591615) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f160a6 expref: 16 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155626.578288:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125138048:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155626.578318:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155626.583182:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.584670:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.584719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.601592:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.602158:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.606979:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.610742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.619540:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.624963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.629625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.638892:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.638977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.639497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.642334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.642585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.648826:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.654828:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.658694:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca97800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125139328:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155626.658713:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155626.658762:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1962:x1830976125412480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3759us (3940us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.658770:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7932 00000100:00100000:0.0:1746155626.664331:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.664368:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.664555:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.687823:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.719639:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.725157:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.725232:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.727609:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.727649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.731286:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.731320:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.731729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.733565:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15571 00000100:00100000:0.0:1746155626.733573:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125414912:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155626.733580:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155626.733586:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef0400/0x844e5faceb5f4652 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f160fa expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.733597:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.733598:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.733605:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef0400/0x844e5faceb5f4652 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f160fa expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155626.733627:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef0400/0x844e5faceb5f4652 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f160fa expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155626.733636:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef0400, rc 0) 00000100:00100000:0.0:1746155626.733655:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125414912:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 85us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.733660:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15571 00000100:00100000:0.0:1746155626.740996:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.744793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155626.745119:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a465200/0x844e5faceb5f4667 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155626.745125:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a465200/0x844e5faceb5f4667 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155626.745139:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155626.745240:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a465400/0x844e5faceb5f4660 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16108 expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.745262:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a465200/0x844e5faceb5f4667 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16108 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.745268:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155626.745270:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155626.745272:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a465200, rc 0) 00000100:00100000:0.0:1746155626.745299:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:31680:x1830976125415296:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3463us (4311us total) trans 8589944928 rc 0/0 00000100:00100000:0.0:1746155626.745308:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10823 00000100:00100000:0.0:1746155626.747179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.749499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155626.750019:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a464a00/0x844e5faceb5f467c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155626.750024:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a464a00/0x844e5faceb5f467c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155626.750067:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:0.0:1746155626.750071:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155626.750084:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a464a00/0x844e5faceb5f467c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155626.750108:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a465c00/0x844e5faceb5f4675 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1610f expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.750121:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a464a00/0x844e5faceb5f467c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1610f expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.750127:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155626.750130:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155626.750132:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a464a00, rc 0) 00000100:00100000:0.0:1746155626.750168:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:31680:x1830976125415552:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2872us (2992us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.750174:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10824 00000100:00100000:0.0:1746155626.753204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.753606:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.753674:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.754282:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15575 00000100:00100000:0.0:1746155626.754291:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125415936:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155626.754297:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155626.754303:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef0000/0x844e5faceb5f4691 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1611d expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155626.754323:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125140608:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155626.754589:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155626.755646:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125140608:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155626.755666:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef0000/0x844e5faceb5f4691 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1611d expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155626.755677:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef0000/0x844e5faceb5f4691 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1611d expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155626.755849:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef0000, rc 0) 00000100:00100000:0.0:1746155626.755919:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125415936:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1631us (2245us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155626.755924:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15575 00000100:00100000:0.0:1746155626.758149:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.760895:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.760930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.761430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.762393:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.762437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.762458:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.765536:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.765567:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.765589:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.768714:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125141248:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155626.768732:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a465000/0x844e5faceb5f46c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155626.769744:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.773797:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.774294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.774744:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.774765:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.774777:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125417856 00000100:00100000:0.0:1746155626.774779:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125417856 00010000:00010000:0.0:1746155626.774793:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093a1e000/0x844e5faceb5f413c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15da4 expref: 31 pid: 19959 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746155626.774806:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125418112 00000100:00100000:0.0:1746155626.774808:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125418112 00010000:00010000:0.0:1746155626.774816:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef0400/0x844e5faceb5f4652 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f160fa expref: 9 pid: 20200 timeout: 855 lvb_type: 1 00000100:00100000:0.0:1746155626.774825:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125418368 00000100:00100000:0.0:1746155626.774827:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125418368 00010000:00010000:0.0:1746155626.774834:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc10400/0x844e5faceb5f460c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f160c9 expref: 32 pid: 1625 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746155626.774842:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7941 00000100:00100000:0.0:1746155626.774851:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976125417856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155626.774857:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155626.774866:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093a1e000/0x844e5faceb5f413c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15da4 expref: 32 pid: 19959 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746155626.774874:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093a1e000/0x844e5faceb5f413c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15da4 expref: 32 pid: 19959 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746155626.774885:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a1e000/0x844e5faceb5f413c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15da4 expref: 32 pid: 19959 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746155626.774895:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.774897:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.774899:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffab800/0x844e5faceb5f46ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.774905:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffab800/0x844e5faceb5f46ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.774917:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155626.774933:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976125417856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.774938:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7941 00000100:00100000:0.0:1746155626.774948:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7942 00000100:00100000:0.0:1746155626.774953:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125418112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155626.774958:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155626.774965:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef0400/0x844e5faceb5f4652 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f160fa expref: 9 pid: 20200 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746155626.774977:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef0400/0x844e5faceb5f4652 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f160fa expref: 9 pid: 20200 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746155626.774987:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef0400/0x844e5faceb5f4652 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f160fa expref: 9 pid: 20200 timeout: 855 lvb_type: 1 00010000:00010000:0.0:1746155626.774994:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155626.775004:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125418112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.775008:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7942 00000100:00100000:0.0:1746155626.775033:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7943 00000100:00100000:0.0:1746155626.775037:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976125418368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155626.775042:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155626.775047:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc10400/0x844e5faceb5f460c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f160c9 expref: 31 pid: 1625 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.775068:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc10400/0x844e5faceb5f460c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f160c9 expref: 31 pid: 1625 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.775078:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc10400/0x844e5faceb5f460c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f160c9 expref: 31 pid: 1625 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.775084:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.775086:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.775088:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ffaaa00/0x844e5faceb5f46c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.775094:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ffaaa00/0x844e5faceb5f46c9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.775106:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155626.775119:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976125418368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 81us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.775123:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7943 00000100:00100000:0.0:1746155626.783231:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.783812:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155626.784303:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a465000/0x844e5faceb5f46c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.784310:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a465000/0x844e5faceb5f46c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.784323:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a465000/0x844e5faceb5f46c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.784329:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a465000/0x844e5faceb5f46c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.784333:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a465000/0x844e5faceb5f46c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.784338:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a465000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155626.784340:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a465000/0x844e5faceb5f46c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.784346:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a465000/0x844e5faceb5f46c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.784355:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a465000/0x844e5faceb5f46c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.784360:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a465000/0x844e5faceb5f46c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155626.784393:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+5:1962:x1830976125416832:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 21948us (22001us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.784399:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15579 00000100:00100000:0.0:1746155626.785877:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.793035:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7948 00000100:00100000:0.0:1746155626.793045:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1960:x1830976125419136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155626.793062:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155626.793067:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009374ca00/0x844e5faceb5f4311 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e84 expref: 301 pid: 20364 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.793077:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009374ca00/0x844e5faceb5f4311 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e84 expref: 301 pid: 20364 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.793090:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374ca00/0x844e5faceb5f4311 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15e84 expref: 301 pid: 20364 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.793098:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155626.793102:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a464200/0x844e5faceb5f46d7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155626.793107:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155626.793123:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1960:x1830976125419136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 82us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.793130:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7948 00000100:00100000:0.0:1746155626.793805:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125419776 00000100:00100000:0.0:1746155626.793809:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125419776 00010000:00010000:0.0:1746155626.793822:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc5ae00/0x844e5faceb5f41a5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15dce expref: 300 pid: 19870 timeout: 855 lvb_type: 0 00000100:00100000:0.0:1746155626.793837:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7950 00000100:00100000:0.0:1746155626.793842:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1960:x1830976125419776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155626.793849:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155626.793852:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc5ae00/0x844e5faceb5f41a5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15dce expref: 300 pid: 19870 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.793858:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc5ae00/0x844e5faceb5f41a5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15dce expref: 300 pid: 19870 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.793869:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc5ae00/0x844e5faceb5f41a5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f15dce expref: 300 pid: 19870 timeout: 855 lvb_type: 0 00010000:00010000:0.0:1746155626.793877:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155626.793880:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a464200/0x844e5faceb5f46d7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155626.793885:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155626.793916:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1960:x1830976125419776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 73us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.793921:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7950 00000100:00100000:0.0:1746155626.794862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.818888:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125142784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155626.819479:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125142912 00000100:00100000:0.0:1746155626.819482:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125142912 00000100:00100000:0.0:1746155626.819495:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15583 00000100:00100000:0.0:1746155626.819499:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+42:3295:x1830976125143168:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746155626.819613:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746155626.819615:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1746155626.819704:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:0.0:1746155626.819707:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155626.819709:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155626.819710:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155626.819712:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155626.819731:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+43:3295:x1830976125143168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 231us (624us total) trans 21474841305 rc 0/0 00000100:00100000:0.0:1746155626.819736:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15583 00000100:00100000:0.0:1746155626.819745:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15587 00000100:00100000:0.0:1746155626.819749:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3298:x1830976125144576:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155626.819816:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3298:x1830976125144576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (617us total) trans 17179873958 rc 0/0 00000100:00100000:0.0:1746155626.819823:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15587 00000100:00100000:0.0:1746155626.819830:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15589 00000100:00100000:0.0:1746155626.819834:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3298:x1830976125144448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155626.821723:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3298:x1830976125144448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1888us (2485us total) trans 17179873960 rc 0/0 00000100:00100000:0.0:1746155626.821728:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15589 00000100:00100000:0.0:1746155626.821752:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155626.821771:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125143296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155626.821789:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155626.821804:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125143296 00000100:00100000:0.0:1746155626.821806:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125143296 00000100:00100000:0.0:1746155626.821817:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15597 00000100:00100000:0.0:1746155626.821821:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3296:x1830976125143296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155626.822222:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3296:x1830976125143296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 400us (432us total) trans 21474841312 rc 0/0 00000100:00100000:0.0:1746155626.822227:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15597 00000004:00080000:0.0:1746155626.822246:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0b1500/2, rc 0, transno 21474841311 00000100:00100000:0.0:1746155626.822249:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125142784:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155626.822254:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f703100/2, rc 0, transno 21474841312 00000100:00100000:0.0:1746155626.822256:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125143296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155626.823762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.828229:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125420160 00000100:00100000:0.0:1746155626.828236:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125420160 00000100:00100000:0.0:1746155626.828272:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10828 00000100:00100000:0.0:1746155626.828279:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:31680:x1830976125420160:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155626.828294:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155626.828311:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a464200/0x844e5faceb5f46e5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16139 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.828379:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a465200/0x844e5faceb5f46ec lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155626.828390:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a465200/0x844e5faceb5f46ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155626.828399:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a465200/0x844e5faceb5f46ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155626.828421:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:0.0:1746155626.828424:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155626.828437:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a465200/0x844e5faceb5f46ec lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155626.828455:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a464200/0x844e5faceb5f46e5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16139 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.828466:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a465200/0x844e5faceb5f46ec lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16139 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.828472:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155626.828475:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155626.828477:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a465200, rc 0) 00000100:00100000:0.0:1746155626.828544:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:31680:x1830976125420160:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 264us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.828549:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10828 00000100:00100000:0.0:1746155626.831277:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.831357:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.832574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.832603:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.832631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.833158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.841977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.849890:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.850774:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.850804:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.851075:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.851373:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.852141:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.852172:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.852196:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125421824 00000100:00100000:0.0:1746155626.852199:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125421824 00000100:00100000:0.0:1746155626.852345:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125422208 00000100:00100000:0.0:1746155626.852348:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125422208 00000100:00100000:0.0:1746155626.852366:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125422464 00000100:00100000:0.0:1746155626.852368:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125422464 00000100:00100000:0.0:1746155626.852378:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125422080 00000100:00100000:0.0:1746155626.852380:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125422080 00000100:00100000:0.0:1746155626.852391:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125422336 00000100:00100000:0.0:1746155626.852392:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125422336 00000100:00100000:0.0:1746155626.852403:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7331 00000100:00100000:0.0:1746155626.852408:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125421824:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155626.852932:0:31250:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a465400/0x844e5faceb5f472b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.853228:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.853231:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.853235:0:31250:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a465400/0x844e5faceb5f472b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.853251:0:31250:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a465400/0x844e5faceb5f472b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.858342:0:31253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0643800/0x844e5faceb5f471d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.858355:0:31253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0643800/0x844e5faceb5f471d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.858361:0:31253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0643800/0x844e5faceb5f471d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.858366:0:31253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0643800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155626.858370:0:31253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0643800/0x844e5faceb5f471d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.858375:0:31253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0643800/0x844e5faceb5f471d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.858390:0:31253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0643800/0x844e5faceb5f471d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.858395:0:31253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0643800/0x844e5faceb5f471d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155626.858487:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125421184:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 16257us (16514us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155626.858499:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7329 00000100:00100000:0.0:1746155626.866627:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3296:1830976125144832:0@lo:400:kworker.0 00000100:00100000:0.0:1746155626.867138:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155626.867311:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125145344:0@lo:400:kworker.0 00000100:00100000:0.0:1746155626.867331:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155626.868489:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3296:1830976125144832:0@lo:400:kworker.0 00000100:00100000:0.0:1746155626.868499:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125145344:0@lo:400:kworker.0 00010000:00010000:0.0:1746155626.874197:0:31250:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a465400/0x844e5faceb5f472b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.874210:0:31250:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a465400/0x844e5faceb5f472b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.874217:0:31250:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a465400/0x844e5faceb5f472b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.874222:0:31250:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a465400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155626.874225:0:31250:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a465400/0x844e5faceb5f472b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.874231:0:31250:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a465400/0x844e5faceb5f472b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.874253:0:31250:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a465400/0x844e5faceb5f472b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.874263:0:31250:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a465400/0x844e5faceb5f472b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155626.874352:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125421824:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 21938us (23542us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155626.874361:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7331 00000100:00100000:0.0:1746155626.915212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.923291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.924532:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.924602:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.925728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.926090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.926127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.926140:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125423488 00000100:00100000:0.0:1746155626.926142:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125423488 00000100:00100000:0.0:1746155626.926157:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15606 00000100:00100000:0.0:1746155626.926652:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125423104:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:0.0:1746155626.926717:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155626.926719:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155626.926721:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155626.926723:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155626 -> 1746155627 00002000:00010000:0.0:1746155626.926724:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155626.930857:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.933133:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.955784:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125145984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155626.955803:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155626.955816:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125146496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155626.955834:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125145728 00000100:00100000:0.0:1746155626.955839:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125145728 00000100:00100000:0.0:1746155626.955864:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125145984 00000100:00100000:0.0:1746155626.955865:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125145984 00000100:00100000:0.0:1746155626.955875:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125146240 00000100:00100000:0.0:1746155626.955876:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125146240 00000100:00100000:0.0:1746155626.955886:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15611 00000100:00100000:0.0:1746155626.955892:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3298:x1830976125145728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155626.956031:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746155626.956034:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155626.956035:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155626.956037:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155626.956039:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:0.0:1746155626.956076:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+55:3298:x1830976125145728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 184us (310us total) trans 17179873969 rc 0/0 00000100:00100000:0.0:1746155626.956082:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15611 00000100:00100000:0.0:1746155626.956094:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125147136 00000100:00100000:0.0:1746155626.956096:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125147136 00000100:00100000:0.0:1746155626.956104:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125147648 00000100:00100000:0.0:1746155626.956106:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125147648 00000100:00100000:0.0:1746155626.956111:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125147264 00000100:00100000:0.0:1746155626.956112:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125147264 00000100:00100000:0.0:1746155626.956120:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15614 00000100:00100000:0.0:1746155626.956123:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+54:3298:x1830976125146112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155626.956199:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+56:3298:x1830976125146112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (347us total) trans 17179873970 rc 0/0 00000100:00100000:0.0:1746155626.956207:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15614 00000100:00100000:0.0:1746155626.956217:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15616 00000100:00100000:0.0:1746155626.956222:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3297:x1830976125147136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155626.956318:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976125147136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (302us total) trans 21474841316 rc 0/0 00000100:00100000:0.0:1746155626.956323:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15616 00000100:00100000:0.0:1746155626.956331:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15617 00000100:00100000:0.0:1746155626.956335:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3297:x1830976125147648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155626.956401:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976125147648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (361us total) trans 21474841317 rc 0/0 00000100:00100000:0.0:1746155626.956405:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15617 00000100:00100000:0.0:1746155626.956414:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15618 00000100:00100000:0.0:1746155626.956417:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3297:x1830976125146752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155626.956473:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155626.956475:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155626.956477:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155626.956478:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155626.956480:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155626.956494:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976125146752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (415us total) trans 21474841318 rc 0/0 00000100:00100000:0.0:1746155626.956499:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15618 00000100:00100000:0.0:1746155626.956525:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15619 00000100:00100000:0.0:1746155626.956530:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3297:x1830976125147264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155626.956588:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:0.0:1746155626.956591:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155626.956592:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155626.956594:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155626.956596:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155626.956610:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976125147264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (515us total) trans 21474841319 rc 0/0 00000100:00100000:0.0:1746155626.956614:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15619 00000100:00100000:0.0:1746155626.956627:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155626.956640:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125147008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155626.956653:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155626.956658:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125147520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155626.956668:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155626.956675:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746155626.956678:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125145856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155626.956689:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155626.956694:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125146368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155626.956704:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155626.956708:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125146880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155626.956718:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155626.956723:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125147392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155626.956733:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155626.956785:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125146496 00000100:00100000:0.0:1746155626.956788:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125146496 00000100:00100000:0.0:1746155626.956797:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125147008 00000100:00100000:0.0:1746155626.956799:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125147008 00000100:00100000:0.0:1746155626.956803:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125147520 00000100:00100000:0.0:1746155626.956805:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125147520 00000100:00100000:0.0:1746155626.956810:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125145856 00000100:00100000:0.0:1746155626.956811:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125145856 00000100:00100000:0.0:1746155626.956815:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125146368 00000100:00100000:0.0:1746155626.956817:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125146368 00000100:00100000:0.0:1746155626.956822:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125146880 00000100:00100000:0.0:1746155626.956823:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125146880 00000100:00100000:0.0:1746155626.956828:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125147392 00000100:00100000:0.0:1746155626.956830:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125147392 00000100:00100000:0.0:1746155626.956836:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15620 00000100:00100000:0.0:1746155626.956840:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976125146496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155626.956919:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3296:x1830976125146496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (289us total) trans 17179873972 rc 0/0 00000100:00100000:0.0:1746155626.956924:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15620 00000100:00100000:0.0:1746155626.956933:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15621 00000100:00100000:0.0:1746155626.956938:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3296:x1830976125147008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155626.957005:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155626.957007:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155626.957008:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155626.957010:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155626.957012:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155626.957029:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3296:x1830976125147008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (374us total) trans 21474841320 rc 0/0 00000100:00100000:0.0:1746155626.957034:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15621 00000100:00100000:0.0:1746155626.957042:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15624 00000100:00100000:0.0:1746155626.957047:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976125146368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155626.957133:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3296:x1830976125146368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (428us total) trans 17179873975 rc 0/0 00000100:00100000:0.0:1746155626.957141:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15624 00000100:00100000:0.0:1746155626.957151:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15626 00000100:00100000:0.0:1746155626.957156:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3296:x1830976125147392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155626.957221:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3296:x1830976125147392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (486us total) trans 21474841322 rc 0/0 00000100:00100000:0.0:1746155626.957225:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15626 00000004:00080000:0.0:1746155626.957245:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b6c1180/2, rc 0, transno 17179873973 00000100:00100000:0.0:1746155626.957249:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125145856:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155626.957255:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ed180/2, rc 0, transno 17179873975 00000100:00100000:0.0:1746155626.957258:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125146368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155626.957263:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc7480/2, rc 0, transno 21474841321 00000100:00100000:0.0:1746155626.957265:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125146880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155626.957272:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0b0a80/2, rc 0, transno 21474841322 00000100:00100000:0.0:1746155626.957274:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125147392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155626.957278:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc5c00/2, rc 0, transno 21474841320 00000100:00100000:0.0:1746155626.957281:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125147008:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155626.957287:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ec380/2, rc 0, transno 17179873974 00000100:00100000:0.0:1746155626.957289:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125145984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155626.957295:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ef100/2, rc 0, transno 17179873972 00000100:00100000:0.0:1746155626.957297:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125146496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155626.957339:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0b2300/2, rc 0, transno 21474841323 00000100:00100000:0.0:1746155626.957341:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125147520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155626.962733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.964622:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.978892:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.978946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.981700:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.981989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.984237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.984279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.984348:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15628 00000100:00100000:0.0:1746155626.984358:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:31694:x1830976125425536:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155626.984370:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155626.984383:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e123200/0x844e5faceb5f47c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1618d expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.984399:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.984400:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155626.984407:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e123200/0x844e5faceb5f47c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1618d expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.984431:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012e123200/0x844e5faceb5f47c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1618d expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.984449:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e123200, rc 0) 00000100:00100000:0.0:1746155626.984479:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:31694:x1830976125425536:12345-192.168.202.51@tcp:101:cat.0 Request processed in 125us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.984484:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15628 00000100:00100000:0.0:1746155626.987557:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155626.988097:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125147904:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155626.988106:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125148032:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155626.988128:0:19870:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0643a00/0x844e5faceb5f47da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000100:00100000:0.0:1746155626.988331:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125426304 00000100:00100000:0.0:1746155626.988335:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125426304 00010000:00010000:0.0:1746155626.988353:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f641800/0x844e5faceb5f4786 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16178 expref: 10 pid: 27374 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746155626.988370:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125426432 00000100:00100000:0.0:1746155626.988372:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125426432 00010000:00010000:0.0:1746155626.988382:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f47a2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16171 expref: 291 pid: 19870 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746155626.988396:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7954 00000100:00100000:0.0:1746155626.988402:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1962:x1830976125426432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155626.988409:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155626.988413:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f47a2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16171 expref: 291 pid: 19870 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746155626.988432:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f47a2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16171 expref: 291 pid: 19870 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746155626.988683:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f47a2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16171 expref: 291 pid: 19870 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746155626.988705:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155626.988708:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0643a00/0x844e5faceb5f47da lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155626.988714:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0643a00/0x844e5faceb5f47da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155626.988719:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0643a00/0x844e5faceb5f47da lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155626.988734:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155626.988750:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1962:x1830976125426432:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 348us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155626.988755:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7954 00010000:00010000:0.0:1746155626.988771:0:19870:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0643a00/0x844e5faceb5f47da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155626.988776:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0643a00/0x844e5faceb5f47da lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:0.0:1746155626.988788:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155626.988887:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0642600/0x844e5faceb5f47d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16194 expref: 291 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.988900:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0643a00/0x844e5faceb5f47da lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16194 expref: 290 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155626.988905:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155626.988907:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155626.988909:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0643a00, rc 0) 00000100:00100000:0.0:1746155626.988931:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800943e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:31689:x1830976125425920:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2585us (2887us total) trans 8589944939 rc 0/0 00000100:00100000:0.0:1746155626.988940:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10834 00000100:00100000:0.0:1746155626.996663:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.009705:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.016649:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.016700:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.025399:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125427328 00000100:00100000:0.0:1746155627.025408:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125427328 00000100:00100000:0.0:1746155627.025475:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10835 00000100:00100000:0.0:1746155627.025486:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800943e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:31693:x1830976125427328:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155627.034365:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.044655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.044709:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155627.045760:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffab000/0x844e5faceb5f4804 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f161b0 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.045798:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffaba00/0x844e5faceb5f480b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155627.045807:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eac00/0x844e5faceb5f4763 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1616a expref: 7 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.045814:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f641e00/0x844e5faceb5f47f6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f161a9 expref: 290 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.045819:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffaba00/0x844e5faceb5f480b lrc: 5/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155627.045841:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f641e00/0x844e5faceb5f47f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f161a9 expref: 290 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.045851:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f641e00/0x844e5faceb5f47f6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f161a9 expref: 290 pid: 19870 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746155627.045861:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125148160:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155627.046199:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eac00/0x844e5faceb5f4763 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1616a expref: 7 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.046207:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01eac00/0x844e5faceb5f4763 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1616a expref: 7 pid: 19870 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746155627.046215:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125148288:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155627.046238:0:19870:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155627.046701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.047132:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.047794:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.048301:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.048826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155627.049044:0:19870:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffaba00/0x844e5faceb5f480b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155627.049060:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ffaba00/0x844e5faceb5f480b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 19870 initiator: MDT0 00000100:00100000:0.0:1746155627.066535:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125148672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155627.066555:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125148800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155627.066817:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125150464 00000100:00100000:0.0:1746155627.066820:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125150464 00000100:00100000:0.0:1746155627.068345:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15640 00000100:00100000:0.0:1746155627.068351:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+62:3297:x1830976125150464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.068444:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:3297:x1830976125150464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (1888us total) trans 17179873981 rc 0/0 00000100:00100000:0.0:1746155627.068449:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15640 00000100:00100000:0.0:1746155627.068467:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155627.068581:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125149312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155627.068600:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155627.068610:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125149824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.068622:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155627.068631:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125150336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.068642:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155627.068736:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155627.068748:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800943ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125149184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155627.068764:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155627.068770:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125149696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.068783:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155627.068789:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125150208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.068815:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155627.068843:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943eaa00/2, rc 0, transno 21474841328 00000100:00100000:0.0:1746155627.068847:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125148800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155627.068857:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15644 00000100:00100000:0.0:1746155627.068862:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+66:3296:x1830976125149824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155627.068930:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155627.068933:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155627.068934:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155627.068936:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155627.068938:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155627.068954:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3296:x1830976125149824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (330us total) trans 17179873982 rc 0/0 00000100:00100000:0.0:1746155627.068959:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15644 00000100:00100000:0.0:1746155627.068967:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15647 00000100:00100000:0.0:1746155627.068972:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+60:3295:x1830976125149184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155627.069030:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:0.0:1746155627.069032:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155627.069034:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155627.069035:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155627.069037:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155627.069064:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+61:3295:x1830976125149184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (299us total) trans 21474841331 rc 0/0 00000100:00100000:0.0:1746155627.069069:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15647 00000004:00080000:0.0:1746155627.069087:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943ead80/2, rc 0, transno 21474841329 00000100:00100000:0.0:1746155627.069090:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125149312:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155627.069097:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe90700/2, rc 0, transno 17179873982 00000100:00100000:0.0:1746155627.069104:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125149824:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155627.069109:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ed6680/2, rc 0, transno 17179873983 00000100:00100000:0.0:1746155627.069112:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ed6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125150336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.069148:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125150720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.069163:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155627.069176:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943eb480/2, rc 0, transno 21474841330 00000100:00100000:0.0:1746155627.069178:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125148672:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155627.069183:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800943ea300/2, rc 0, transno 21474841331 00000100:00100000:0.0:1746155627.069185:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800943ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125149184:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155627.069190:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe92300/2, rc 0, transno 17179873984 00000100:00100000:0.0:1746155627.069192:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125149696:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155627.069197:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880093ed5c00/2, rc 0, transno 17179873985 00000100:00100000:0.0:1746155627.069199:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093ed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125150208:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155627.069633:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131497b80/2, rc 0, transno 17179873986 00000100:00100000:0.0:1746155627.069637:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125150720:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.071791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.071839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.072856:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.097042:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125151616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.097076:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155627.097088:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125152128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.097100:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155627.097111:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746155627.097115:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125151744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.097128:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155627.097145:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125151744 00000100:00100000:0.0:1746155627.097148:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125151744 00000100:00100000:0.0:1746155627.097166:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15653 00000100:00100000:0.0:1746155627.097171:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3295:x1830976125152128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.097250:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+74:3295:x1830976125152128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (148us total) trans 17179873989 rc 0/0 00000100:00100000:0.0:1746155627.097749:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15653 00000100:00100000:0.0:1746155627.097758:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125151872 00000100:00100000:0.0:1746155627.097760:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125151872 00000100:00100000:0.0:1746155627.097769:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125152384 00000100:00100000:0.0:1746155627.097770:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125152384 00000100:00100000:0.0:1746155627.097777:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125152896 00000100:00100000:0.0:1746155627.097779:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125152896 00000100:00100000:0.0:1746155627.097784:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125151488 00000100:00100000:0.0:1746155627.097785:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125151488 00000100:00100000:0.0:1746155627.097792:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125152000 00000100:00100000:0.0:1746155627.097793:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125152000 00000100:00100000:0.0:1746155627.097799:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125152512 00000100:00100000:0.0:1746155627.097800:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125152512 00000100:00100000:0.0:1746155627.097808:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15655 00000100:00100000:0.0:1746155627.097812:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3297:x1830976125151872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.097886:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3297:x1830976125151872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (502us total) trans 17179873991 rc 0/0 00000100:00100000:0.0:1746155627.097891:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15655 00000100:00100000:0.0:1746155627.097900:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15658 00000100:00100000:0.0:1746155627.097905:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+75:3297:x1830976125151488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155627.097960:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:0.0:1746155627.097962:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155627.097964:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155627.097965:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155627.097967:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:0.0:1746155627.097981:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3297:x1830976125151488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (527us total) trans 17179873992 rc 0/0 00000100:00100000:0.0:1746155627.097985:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15658 00000100:00100000:0.0:1746155627.097995:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15661 00000100:00100000:0.0:1746155627.098000:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+64:3297:x1830976125153024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155627.098088:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+66:3297:x1830976125153024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (584us total) trans 21474841335 rc 0/0 00000100:00100000:0.0:1746155627.098093:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15661 00000100:00100000:0.0:1746155627.098315:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125152256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155627.098335:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155627.098346:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125152768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155627.098359:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155627.098379:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131495180/2, rc 0, transno 17179873987 00000100:00100000:0.0:1746155627.098385:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125151232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.098391:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746155627.098395:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125152640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155627.098408:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155627.098896:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125153152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155627.098914:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155627.098929:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb6ad80/2, rc 0, transno 21474841336 00000100:00100000:0.0:1746155627.098932:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125152256:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155627.098994:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125429248 00000100:00100000:0.0:1746155627.098996:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125429248 00000100:00100000:0.0:1746155627.099011:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125429376 00000100:00100000:0.0:1746155627.099013:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125429376 00000100:00100000:0.0:1746155627.099024:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4543 00000100:00100000:0.0:1746155627.099028:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:31694:x1830976125429248:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:0.0:1746155627.099103:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:31694:x1830976125429248:12345-192.168.202.51@tcp:49:cat.0 Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.099109:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4543 00000004:00080000:0.0:1746155627.099133:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094086d80/2, rc 0, transno 17179873990 00000100:00100000:0.0:1746155627.099136:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125151744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155627.099142:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131497100/2, rc 0, transno 17179873988 00000100:00100000:0.0:1746155627.099145:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125151616:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155627.099150:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094085f80/2, rc 0, transno 17179873989 00000100:00100000:0.0:1746155627.099152:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125152128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.099179:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746155627.099182:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800912c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125153280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155627.099198:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746155627.099231:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155627.099233:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155627.099234:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155627.099236:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155627 -> 1746155627 00002000:00010000:0.0:1746155627.099238:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155627.099260:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+69:3297:x1830976125152512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1285us (1773us total) trans 21474841334 rc 0/0 00000100:00100000:0.0:1746155627.099265:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15660 00000100:00100000:0.0:1746155627.101478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.103570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.104959:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125430016 00000100:00100000:0.0:1746155627.104963:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125430016 00002000:00100000:0.0:1746155627.104989:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88012f1f1c00 x1830976125430016/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:698/0 lens 488/0 e 0 to 0 dl 1746155638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.105003:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1c00 with x1830976125430016 ext(1048576->2097151) 00002000:00010000:0.0:1746155627.105007:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f1c00 00000100:00100000:0.0:1746155627.105019:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7341 00000100:00100000:0.0:1746155627.105024:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976125430016:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155627.111114:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125430912 00000100:00100000:0.0:1746155627.111119:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125430912 00002000:00100000:0.0:1746155627.111148:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009fac6300 x1830976125430912/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:698/0 lens 488/0 e 0 to 0 dl 1746155638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.111156:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6300 with x1830976125430912 ext(1048576->2097151) 00002000:00010000:0.0:1746155627.111159:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fac6300 00000100:00100000:0.0:1746155627.111185:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7342 00000100:00100000:0.0:1746155627.111191:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125430912:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155627.117344:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.118813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.119326:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125430912:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8135us (8398us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155627.119333:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7342 00002000:00100000:0.0:1746155627.119340:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009fac6300 x1830976125430912/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:698/0 lens 488/440 e 0 to 0 dl 1746155638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.119353:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6300 with x1830976125430912 ext(1048576->2097151) 00002000:00010000:0.0:1746155627.119357:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fac6300 00000100:00100000:0.0:1746155627.122178:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.123678:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.123705:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.123727:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.123743:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.123763:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.123787:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125432320 00000100:00100000:0.0:1746155627.123790:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125432320 00010000:00010000:0.0:1746155627.123804:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01eae00/0x844e5faceb5f46fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16147 expref: 11 pid: 20796 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746155627.124464:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7964 00000100:00100000:0.0:1746155627.124471:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125432320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155627.124478:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155627.124487:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a01eae00/0x844e5faceb5f46fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16147 expref: 11 pid: 20796 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.124495:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a01eae00/0x844e5faceb5f46fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16147 expref: 11 pid: 20796 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.124974:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01eae00/0x844e5faceb5f46fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16147 expref: 11 pid: 20796 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.124991:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.124993:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.125101:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135582600/0x844e5faceb5f4858 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f161fd expref: 30 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.125108:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135582600/0x844e5faceb5f4858 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f161fd expref: 30 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.125134:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135582600/0x844e5faceb5f4858 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f161fd expref: 30 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155627.125144:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125154816:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155627.125174:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155627.130629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.131105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.131142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.131199:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7346 00000100:00100000:0.0:1746155627.131206:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976125432960:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155627.131410:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976125432960:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 204us (787us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155627.131414:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7346 00002000:00100000:0.0:1746155627.131418:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (4616192->4620287) req@ffff88013089a680 x1830976125432960/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:698/0 lens 488/4536 e 0 to 0 dl 1746155638 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.131423:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089a680 with x1830976125432960 ext(4616192->4620287) 00002000:00010000:0.0:1746155627.131425:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013089a680 00000100:00100000:0.0:1746155627.136567:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.143780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.143828:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.152066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.161367:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.161398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.182311:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.182365:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.190120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.200062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.203105:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.203972:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.204079:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.204346:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.204360:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125436672 00000100:00100000:0.0:1746155627.204363:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125436672 00000100:00100000:0.0:1746155627.204390:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15681 00000100:00100000:0.0:1746155627.204396:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976125436672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155627.204403:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.204410:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a065a800/0x844e5faceb5f489e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16243 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155627.204433:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125155968:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155627.204454:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155627.207585:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125155840:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155627.207601:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3f67c00/0x844e5faceb5f4890 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1623c expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.207610:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3f67c00/0x844e5faceb5f4890 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1623c expref: 33 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.207628:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3f67c00, rc 0) 00000100:00100000:0.0:1746155627.207647:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976125436544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3299us (3675us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155627.207653:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15679 00000100:00100000:0.0:1746155627.212953:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.213042:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.222032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.222722:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.222756:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.227522:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.228331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.228354:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125437952 00000100:00100000:0.0:1746155627.228360:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125437952 00000100:00100000:0.0:1746155627.228397:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125438208 00000100:00100000:0.0:1746155627.228399:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125438208 00000100:00100000:0.0:1746155627.228412:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15682 00000100:00100000:0.0:1746155627.228419:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976125437952:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155627.228433:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.228447:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3f66600/0x844e5faceb5f48a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1624a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155627.228488:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cded180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125156224:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155627.228568:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155627.228599:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.228613:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125438080 00000100:00100000:0.0:1746155627.228615:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125438080 00000100:00100000:0.0:1746155627.228640:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15683 00000100:00100000:0.0:1746155627.228645:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1962:x1830976125438208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155627.228652:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.228660:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4cc200/0x844e5faceb5f48ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16258 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.228671:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.228672:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.228678:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4cc200/0x844e5faceb5f48ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16258 expref: 30 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.228689:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4cc200/0x844e5faceb5f48ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16258 expref: 30 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.228698:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4cc200, rc 0) 00000100:00100000:0.0:1746155627.228717:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1962:x1830976125438208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 71us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.228722:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15683 00000100:00100000:0.0:1746155627.228734:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15684 00000100:00100000:0.0:1746155627.228739:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1962:x1830976125438080:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155627.228743:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.228749:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4cc400/0x844e5faceb5f48b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16251 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155627.228768:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125156352:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155627.228785:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155627.235773:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125156352:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155627.235800:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4cc400/0x844e5faceb5f48b3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16251 expref: 30 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.235813:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4cc400/0x844e5faceb5f48b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16251 expref: 30 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.236188:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4cc400, rc 0) 00000100:00100000:0.0:1746155627.236251:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1962:x1830976125438080:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7511us (7651us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155627.236498:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15684 00000100:00100000:0.0:1746155627.244234:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.244338:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.255201:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.257326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.263828:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.266987:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.287418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.294385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.300382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.300413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.300435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.304392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.310767:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.310793:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.310828:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.314138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155627.314330:0:14232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a889400/0x844e5faceb5f4931 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:0.0:1746155627.314339:0:14232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a889400/0x844e5faceb5f4931 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00000004:00200000:0.0:1746155627.314355:0:14232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155627.314525:0:14232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a889200/0x844e5faceb5f492a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1629e expref: 9 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.314551:0:14232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a889400/0x844e5faceb5f4931 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1629e expref: 8 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.314558:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155627.314561:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155627.314563:0:14232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a889400, rc 0) 00000100:00100000:0.0:1746155627.314594:0:14232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:31701:x1830976125440640:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3707us (4099us total) trans 8589944946 rc 0/0 00000100:00100000:0.0:1746155627.314601:0:14232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10844 00000100:00100000:0.0:1746155627.315322:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.317569:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.329121:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.336203:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.339903:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.340385:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.340445:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.340546:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.340584:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.340607:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.346945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.347011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.347449:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.349316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.349379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.350316:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.350620:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.350632:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.350642:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125444736 00000100:00100000:0.0:1746155627.350644:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125444736 00010000:00010000:0.0:1746155627.350656:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136ab2000/0x844e5faceb5f47fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f161b7 expref: 29 pid: 10591 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746155627.350750:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7977 00000100:00100000:0.0:1746155627.350757:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976125444352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155627.350764:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155627.350773:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a01ebc00/0x844e5faceb5f485f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16204 expref: 36 pid: 8437 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746155627.351093:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a01ebc00/0x844e5faceb5f485f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16204 expref: 36 pid: 8437 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746155627.351104:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01ebc00/0x844e5faceb5f485f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16204 expref: 36 pid: 8437 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746155627.351121:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.351123:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.351127:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5f497e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.351139:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53e1200/0x844e5faceb5f497e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.351158:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155627.351171:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976125444352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 415us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.351176:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7977 00000100:00100000:0.0:1746155627.351198:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.351227:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.351236:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125444992 00000100:00100000:0.0:1746155627.351239:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125444992 00010000:00010000:0.0:1746155627.351249:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffabe00/0x844e5faceb5f470f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1614e expref: 14 pid: 18270 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746155627.351264:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7982 00000100:00100000:0.0:1746155627.351269:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125444992:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155627.351275:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155627.351282:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ffabe00/0x844e5faceb5f470f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1614e expref: 14 pid: 18270 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.351289:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ffabe00/0x844e5faceb5f470f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1614e expref: 14 pid: 18270 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.351299:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ffabe00/0x844e5faceb5f470f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1614e expref: 14 pid: 18270 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.351489:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.351491:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.351493:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a464200/0x844e5faceb5f498c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.351499:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a464200/0x844e5faceb5f498c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.351523:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155627.351534:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125444992:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 266us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.351538:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7982 00000100:00100000:0.0:1746155627.360520:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976125444480:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 8659us (9302us total) trans 21474841341 rc 0/0 00000100:00100000:0.0:1746155627.360527:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1216 00002000:00100000:0.0:1746155627.360532:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1069055) req@ffff88009366c380 x1830976125444480/t21474841341(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:698/0 lens 488/448 e 0 to 0 dl 1746155638 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.360539:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366c380 with x1830976125444480 ext(1048576->1069055) 00010000:00010000:0.0:1746155627.360545:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135582600/0x844e5faceb5f4858 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f161fd expref: 31 pid: 8436 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746155627.360553:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135582600/0x844e5faceb5f4858 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f161fd expref: 31 pid: 8436 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746155627.360558:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009366c380 00000100:00100000:0.0:1746155627.365609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.365674:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.366862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.367372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.370343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.370379:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.375078:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.382675:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.393156:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.393196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.393224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.393600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.393837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.394639:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15705 00000100:00100000:0.0:1746155627.394647:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976125447424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155627.394652:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.394659:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4cc800/0x844e5faceb5f4a03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f162eb expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155627.394669:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e3:0x0] initial LVB size: 2097152, mtime: 0x6814386b, atime: 0x6814386b, ctime: 0x6814386b, blocks: 0x821 00010000:00010000:0.0:1746155627.394675:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.394676:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.394680:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4cc800/0x844e5faceb5f4a03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f162eb expref: 21 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.394687:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4cc800/0x844e5faceb5f4a03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f162eb expref: 21 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.394698:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4cc800, rc 0) 00000100:00100000:0.0:1746155627.394709:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1961:x1830976125447424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 66us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.394721:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15705 00000100:00100000:0.0:1746155627.394813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.401366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.405462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.405483:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.405496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.405527:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.415791:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.422136:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.422168:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.422193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.422216:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.422234:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125449344 00000100:00100000:0.0:1746155627.422241:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125449344 00000100:00100000:0.0:1746155627.422270:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125449472 00000100:00100000:0.0:1746155627.422272:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125449472 00000100:00100000:0.0:1746155627.422282:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125449600 00000100:00100000:0.0:1746155627.422284:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125449600 00000100:00100000:0.0:1746155627.422293:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125449728 00000100:00100000:0.0:1746155627.422295:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125449728 00000100:00100000:0.0:1746155627.422308:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15707 00000100:00100000:0.0:1746155627.422314:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976125449344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155627.422327:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.422343:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f641000/0x844e5faceb5f4a34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16307 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.422361:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.422363:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.422370:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f641000/0x844e5faceb5f4a34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16307 expref: 35 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.422383:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f641000/0x844e5faceb5f4a34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16307 expref: 35 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.422392:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f641000, rc 0) 00000100:00100000:0.0:1746155627.422409:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976125449344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 96us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.422414:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15707 00000100:00100000:0.0:1746155627.422427:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15709 00000100:00100000:0.0:1746155627.422433:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976125449600:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155627.422438:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.422444:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f641400/0x844e5faceb5f4a42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16315 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.422452:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.422454:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.422457:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f641400/0x844e5faceb5f4a42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16315 expref: 33 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.422467:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f641400/0x844e5faceb5f4a42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16315 expref: 33 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.422477:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f641400, rc 0) 00000100:00100000:0.0:1746155627.422492:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976125449600:12345-192.168.202.51@tcp:101:cat.0 Request processed in 59us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.422496:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15709 00000100:00100000:0.0:1746155627.422523:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15710 00000100:00100000:0.0:1746155627.422528:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976125449728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155627.422533:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.422539:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fc10400/0x844e5faceb5f4a49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1631c expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.422547:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.422548:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.422552:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc10400/0x844e5faceb5f4a49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1631c expref: 35 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.422559:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fc10400/0x844e5faceb5f4a49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1631c expref: 35 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.422565:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fc10400, rc 0) 00000100:00100000:0.0:1746155627.422577:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a382c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976125449728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 49us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.422581:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15710 00000100:00100000:0.0:1746155627.427486:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.427544:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.437820:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.438275:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.438341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.438419:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.458740:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.458776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.458802:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.458815:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.461978:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976125450240:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23015us (24164us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155627.461985:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7364 00002000:00100000:0.0:1746155627.461991:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88012dc08a80 x1830976125450240/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:698/0 lens 488/440 e 0 to 0 dl 1746155638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.461997:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc08a80 with x1830976125450240 ext(0->1048575) 00002000:00010000:0.0:1746155627.462000:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc08a80 00000100:00100000:0.0:1746155627.483321:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125451776:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23358us (24500us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155627.483329:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7370 00002000:00100000:0.0:1746155627.483335:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88012dc0b800 x1830976125451776/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:698/0 lens 488/440 e 0 to 0 dl 1746155638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.483342:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc0b800 with x1830976125451776 ext(3145728->4194303) 00002000:00010000:0.0:1746155627.483346:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc0b800 00000100:00100000:0.0:1746155627.497277:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.497319:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.497362:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.498003:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7374 00000100:00100000:0.0:1746155627.498013:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976125452672:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155627.499148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.499828:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125452800 00000100:00100000:0.0:1746155627.499833:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125452800 00002000:00100000:0.0:1746155627.501183:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f3ed880 x1830976125452800/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:698/0 lens 488/0 e 0 to 0 dl 1746155638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.501193:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ed880 with x1830976125452800 ext(3145728->4194303) 00002000:00010000:0.0:1746155627.501197:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ed880 00000100:00100000:0.0:1746155627.501331:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7375 00000100:00100000:0.0:1746155627.501340:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976125452800:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155627.507958:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976125452672:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9940us (10586us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155627.507968:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7374 00002000:00100000:0.0:1746155627.507978:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88013089bb80 x1830976125452672/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:698/0 lens 488/440 e 0 to 0 dl 1746155638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.507986:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089bb80 with x1830976125452672 ext(2097152->3145727) 00002000:00010000:0.0:1746155627.507991:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089bb80 00000100:00100000:0.0:1746155627.530582:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.531040:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.554793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.559585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.559652:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125159936:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155627.559661:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125160064:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155627.559683:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa71200/0x844e5faceb5f4a5e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16331 expref: 21 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.559696:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa71200, rc 0) 00000100:00100000:0.0:1746155627.559721:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:31704:x1830976125453824:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2953us (4935us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.559727:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15713 00000100:00100000:0.0:1746155627.564967:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.565029:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.565085:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.570634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.573401:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.576656:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125160576:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155627.576666:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125160704:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155627.576685:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094d62c00/0x844e5faceb5f4a7a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4059135] (req 3145728->4059135) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1633f expref: 31 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.576698:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d62c00, rc 0) 00000100:00100000:0.0:1746155627.576731:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:31704:x1830976125454976:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3024us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.576739:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15714 00000100:00100000:0.0:1746155627.579300:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.579341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.579529:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7992 00000100:00100000:0.0:1746155627.579538:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976125455232:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155627.579545:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155627.579555:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c054a00/0x844e5faceb5f4a57 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1632a expref: 33 pid: 18270 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.579564:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c054a00/0x844e5faceb5f4a57 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1632a expref: 33 pid: 18270 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.579574:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c054a00/0x844e5faceb5f4a57 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1632a expref: 33 pid: 18270 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.579946:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.579949:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.579955:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094d62c00/0x844e5faceb5f4a7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4059135) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1633f expref: 29 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.579963:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094d62c00/0x844e5faceb5f4a7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4059135) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1633f expref: 29 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155627.587261:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.589437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.636913:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.641215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.641645:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.647659:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.663497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.663544:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.667770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.669296:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125161472:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155627.669315:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125457024 00000100:00100000:0.0:1746155627.669320:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125457024 00000100:00100000:0.0:1746155627.669346:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15717 00000100:00100000:0.0:1746155627.669351:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976125457024:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155627.669362:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.669375:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c861e00/0x844e5faceb5f4ab2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16362 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155627.669410:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125161600:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155627.669455:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155627.669530:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.669577:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.669594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.669613:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125457152 00000100:00100000:0.0:1746155627.669615:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125457152 00000100:00100000:0.0:1746155627.669628:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125456896 00000100:00100000:0.0:1746155627.669630:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125456896 00000100:00100000:0.0:1746155627.669640:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15718 00000100:00100000:0.0:1746155627.669644:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976125457152:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155627.669650:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.669657:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c861200/0x844e5faceb5f4ab9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16369 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155627.669678:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125161728:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155627.669695:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155627.669738:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15719 00000100:00100000:0.0:1746155627.669742:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1963:x1830976125456896:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155627.669748:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.669754:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c860a00/0x844e5faceb5f4ac0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1635b expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155627.669770:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125161856:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155627.669786:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155627.669796:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125457280 00000100:00100000:0.0:1746155627.669798:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125457280 00010000:00010000:0.0:1746155627.669811:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4cc800/0x844e5faceb5f4a03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f162eb expref: 20 pid: 20796 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746155627.669826:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7995 00000100:00100000:0.0:1746155627.669830:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976125457280:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155627.669835:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155627.669852:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4cc800/0x844e5faceb5f4a03 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f162eb expref: 20 pid: 20796 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.669861:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4cc800/0x844e5faceb5f4a03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f162eb expref: 20 pid: 20796 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.669877:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4cc800/0x844e5faceb5f4a03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f162eb expref: 20 pid: 20796 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.669886:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155627.669899:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976125457280:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 69us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.669904:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7995 00000100:00100000:0.0:1746155627.669928:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125161344:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155627.669945:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa70400/0x844e5faceb5f4aab lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->1310719] (req 1048576->1310719) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16354 expref: 38 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.669952:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa70400, rc 0) 00000100:00100000:0.0:1746155627.669963:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:31714:x1830976125456768:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4953us (6419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.669968:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15716 00000100:00100000:0.0:1746155627.672564:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.672693:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125457408 00000100:00100000:0.0:1746155627.672700:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125457408 00010000:00010000:0.0:1746155627.672721:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fc10400/0x844e5faceb5f4a49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1631c expref: 38 pid: 20796 timeout: 856 lvb_type: 1 00000100:00100000:0.0:1746155627.672741:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7996 00000100:00100000:0.0:1746155627.672747:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1962:x1830976125457408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155627.672756:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155627.672772:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fc10400/0x844e5faceb5f4a49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1631c expref: 38 pid: 20796 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.672782:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fc10400/0x844e5faceb5f4a49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1631c expref: 38 pid: 20796 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.672798:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fc10400/0x844e5faceb5f4a49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1631c expref: 38 pid: 20796 timeout: 856 lvb_type: 1 00010000:00010000:0.0:1746155627.672808:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.672809:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.672814:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa70400/0x844e5faceb5f4aab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16354 expref: 37 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.672821:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa70400/0x844e5faceb5f4aab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16354 expref: 37 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.672997:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa70400/0x844e5faceb5f4aab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16354 expref: 37 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155627.673012:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fafc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125161984:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155627.673071:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034300 going to sleep for 11 seconds 00002000:00010000:0.0:1746155627.673095:0:18270:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime: 1746155627 -> 1746155628 00002000:00010000:0.0:1746155627.673097:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime: 1746155627 -> 1746155628 00002000:00010000:0.0:1746155627.673099:0:18270:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime: 1746155627 -> 1746155628 00000100:00100000:0.0:1746155627.673111:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125161856:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155627.673136:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c860a00/0x844e5faceb5f4ac0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1635b expref: 30 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.673143:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c860a00/0x844e5faceb5f4ac0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1635b expref: 30 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.673150:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c860a00, rc 0) 00000100:00100000:0.0:1746155627.673167:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1963:x1830976125456896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3424us (3572us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155627.673172:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15719 00002000:00010000:0.0:1746155627.673199:0:1625:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime: 1746155627 -> 1746155628 00002000:00010000:0.0:1746155627.673201:0:1625:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime: 1746155627 -> 1746155628 00000100:00100000:0.0:1746155627.673208:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125161728:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155627.673221:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c861200/0x844e5faceb5f4ab9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16369 expref: 33 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.673228:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c861200/0x844e5faceb5f4ab9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16369 expref: 33 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.673234:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c861200, rc 0) 00000100:00100000:0.0:1746155627.673246:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976125457152:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3602us (3716us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155627.673251:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15718 00002000:00010000:0.0:1746155627.673310:0:20796:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155627 -> 1746155628 00002000:00010000:0.0:1746155627.673312:0:20796:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime: 1746155627 -> 1746155628 00000100:00100000:0.0:1746155627.673320:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125161600:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155627.673331:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c861e00/0x844e5faceb5f4ab2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16362 expref: 37 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.673339:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c861e00/0x844e5faceb5f4ab2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16362 expref: 37 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.673346:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c861e00, rc 0) 00000100:00100000:0.0:1746155627.673362:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976125457024:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4010us (5600us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155627.673367:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15717 00000100:00100000:0.0:1746155627.679749:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fafc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125161984:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155627.679764:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155627.679782:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1962:x1830976125457408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7036us (7224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.679789:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7996 00000100:00100000:0.0:1746155627.684773:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.684814:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125162112:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155627.685607:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091007800/0x844e5faceb5f4ac7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16370 expref: 30 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.685625:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091007800, rc 0) 00000100:00100000:0.0:1746155627.685669:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:31719:x1830976125457792:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6705us (6772us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.685676:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15720 00000100:00100000:0.0:1746155627.707712:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1962:x1830976125457920:12345-192.168.202.51@tcp:4:cat.0 Request processed in 21903us (22945us total) trans 21474841342 rc 0/0 00000100:00100000:0.0:1746155627.707720:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1217 00002000:00100000:0.0:1746155627.707728:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1617920->2097151) req@ffff88009fafc380 x1830976125457920/t21474841342(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:698/0 lens 488/448 e 0 to 0 dl 1746155638 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.707736:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafc380 with x1830976125457920 ext(1617920->2097151) 00010000:00010000:0.0:1746155627.707743:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d62600/0x844e5faceb5f4a81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16346 expref: 34 pid: 20200 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746155627.707754:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d62600/0x844e5faceb5f4a81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16346 expref: 34 pid: 20200 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746155627.707763:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fafc380 00010000:00010000:0.0:1746155627.718555:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155627.718585:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37200/0x844e5faceb5f4ae3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16377 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.718600:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155627.718603:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155627.718647:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1963:x1830976125458816:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6070us (6218us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.718656:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 718 00000100:00100000:0.0:1746155627.722208:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125458944 00000100:00100000:0.0:1746155627.722216:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125458944 00000100:00100000:0.0:1746155627.722255:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15721 00000100:00100000:0.0:1746155627.722262:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:31725:x1830976125458944:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155627.722276:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.722289:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b407d800/0x844e5faceb5f4af1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1637e expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.722313:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa70400/0x844e5faceb5f4aab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16354 expref: 36 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.722320:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155627.722322:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155627.722325:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b407d800/0x844e5faceb5f4af1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1826816->2080767] (req 1826816->2080767) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1637e expref: 20 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.722353:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa70400/0x844e5faceb5f4aab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16354 expref: 36 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.722363:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa70400/0x844e5faceb5f4aab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1310719) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16354 expref: 36 pid: 20200 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746155627.722374:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fafc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125162240:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155627.722661:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155627.742095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.742126:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125459200 00000100:00100000:0.0:1746155627.742130:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125459200 00000100:00100000:0.0:1746155627.742169:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15722 00000100:00100000:0.0:1746155627.742176:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:31722:x1830976125459200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155627.742188:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.742200:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b407d600/0x844e5faceb5f4af8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16385 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.742220:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155627.742225:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b407d800/0x844e5faceb5f4af1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1826816->2080767] (req 1826816->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1637e expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.742231:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746155627.742235:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b407d600/0x844e5faceb5f4af8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16385 expref: 38 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.742268:0:20796:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b407d800/0x844e5faceb5f4af1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1826816->2080767] (req 1826816->2080767) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1637e expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.742280:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b407d600/0x844e5faceb5f4af8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16385 expref: 38 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.742290:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b407d600, rc 0) 00000100:00100000:0.0:1746155627.742317:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:31722:x1830976125459200:12345-192.168.202.51@tcp:101:cat.0 Request processed in 141us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.742323:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15722 00000100:00100000:0.0:1746155627.743596:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125459328 00000100:00100000:0.0:1746155627.743601:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125459328 00010000:00010000:0.0:1746155627.743622:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094d62600/0x844e5faceb5f4a81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16346 expref: 34 pid: 20200 timeout: 856 lvb_type: 0 00000100:00100000:0.0:1746155627.744062:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7997 00000100:00100000:0.0:1746155627.744069:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976125459328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155627.744136:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155627.744156:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094d62600/0x844e5faceb5f4a81 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16346 expref: 34 pid: 20200 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746155627.744166:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094d62600/0x844e5faceb5f4a81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16346 expref: 34 pid: 20200 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746155627.744183:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094d62600/0x844e5faceb5f4a81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16346 expref: 34 pid: 20200 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746155627.744193:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.744195:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.744201:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091007800/0x844e5faceb5f4ac7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16370 expref: 29 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.744207:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091007800/0x844e5faceb5f4ac7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16370 expref: 29 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.744229:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091007800/0x844e5faceb5f4ac7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16370 expref: 29 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155627.744239:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fafca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125162496:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155627.744288:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155627.751783:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fafca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125162496:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155627.751796:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155627.751825:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976125459328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7757us (8321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.751833:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7997 00000100:00100000:0.0:1746155627.751874:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.754747:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.770020:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125460736 00000100:00100000:0.0:1746155627.770026:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125460736 00000100:00100000:0.0:1746155627.770060:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4554 00000100:00100000:0.0:1746155627.770066:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:31725:x1830976125460736:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155627.770201:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:31725:x1830976125460736:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 135us (360us total) trans 8589944960 rc 0/0 00000100:00100000:0.0:1746155627.770206:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4554 00000100:00100000:0.0:1746155627.773770:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125460864 00000100:00100000:0.0:1746155627.773776:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125460864 00000100:00100000:0.0:1746155627.774011:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15723 00000100:00100000:0.0:1746155627.774018:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:31719:x1830976125460864:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155627.774028:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.774049:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312e6800/0x844e5faceb5f4aff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1638c expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.774067:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155627.774071:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312e6800/0x844e5faceb5f4aff lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1638c expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.774079:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312e6800/0x844e5faceb5f4aff lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1638c expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.774087:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6800, rc 0) 00000100:00100000:0.0:1746155627.774966:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:31719:x1830976125460864:12345-192.168.202.51@tcp:101:cat.0 Request processed in 947us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.774971:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15723 00000100:00100000:0.0:1746155627.789166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.806382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.811753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.816844:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.821428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.821445:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.821456:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.821468:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.821491:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.821527:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.821541:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125462528 00000100:00100000:0.0:1746155627.821544:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125462528 00000100:00100000:0.0:1746155627.821560:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125462784 00000100:00100000:0.0:1746155627.821562:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125462784 00000100:00100000:0.0:1746155627.821576:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15725 00000100:00100000:0.0:1746155627.821581:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125462400:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155627.821588:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.821598:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e78200/0x844e5faceb5f4b29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f163a8 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.821614:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.821616:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.821623:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e78200/0x844e5faceb5f4b29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f163a8 expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.821635:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e78200/0x844e5faceb5f4b29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f163a8 expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.821643:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e78200, rc 0) 00000100:00100000:0.0:1746155627.821667:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125462400:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.821671:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15725 00000100:00100000:0.0:1746155627.821683:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15726 00000100:00100000:0.0:1746155627.821687:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125462528:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155627.821693:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.821703:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e78c00/0x844e5faceb5f4b30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f163af expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.821716:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.821717:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.821721:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e78c00/0x844e5faceb5f4b30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f163af expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.821729:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e78c00/0x844e5faceb5f4b30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f163af expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.821735:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e78c00, rc 0) 00000100:00100000:0.0:1746155627.821847:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125462528:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 98us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.821852:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15726 00000100:00100000:0.0:1746155627.821865:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15729 00000100:00100000:0.0:1746155627.821870:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125462144:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155627.821875:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.821882:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130e79400/0x844e5faceb5f4b45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1639a expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.821890:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.821891:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155627.821895:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130e79400/0x844e5faceb5f4b45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1639a expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.821902:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130e79400/0x844e5faceb5f4b45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1639a expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155627.821913:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e79400, rc 0) 00000100:00100000:0.0:1746155627.821928:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fafdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125462144:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 58us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.821932:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15729 00000100:00100000:0.0:1746155627.826649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.826675:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.826686:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.829681:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7388 00000100:00100000:0.0:1746155627.829687:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976125464064:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155627.829716:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7389 00000100:00100000:0.0:1746155627.829720:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976125463936:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155627.835486:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976125464064:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5795us (6331us total) trans 0 rc 135168/135168 00000100:00100000:0.0:1746155627.835494:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7388 00002000:00100000:0.0:1746155627.835516:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (4059136->4194303) req@ffff8800a0ac5f80 x1830976125464064/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:698/0 lens 488/440 e 0 to 0 dl 1746155638 ref 1 fl Complete:/200/0 rc 135168/135168 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.835524:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac5f80 with x1830976125464064 ext(4059136->4194303) 00002000:00010000:0.0:1746155627.835529:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac5f80 00000100:00100000:0.0:1746155627.837207:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.839058:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.849223:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1962:x1830976125463680:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19691us (20086us total) trans 0 rc 1019904/1019904 00000100:00100000:0.0:1746155627.849235:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7387 00002000:00100000:0.0:1746155627.849243:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4165631) req@ffff8800a0ac7480 x1830976125463680/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:698/0 lens 488/440 e 0 to 0 dl 1746155638 ref 1 fl Complete:/200/0 rc 1019904/1019904 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.849251:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac7480 with x1830976125463680 ext(3145728->4165631) 00010000:00010000:0.0:1746155627.849257:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa71200/0x844e5faceb5f4a5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16331 expref: 24 pid: 20200 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746155627.849268:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa71200/0x844e5faceb5f4a5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16331 expref: 24 pid: 20200 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746155627.849273:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0ac7480 00000100:00100000:0.0:1746155627.849308:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.849371:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125464832 00000100:00100000:0.0:1746155627.849376:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125464832 00002000:00100000:0.0:1746155627.849397:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4165632->4194303) req@ffff88009045d180 x1830976125464832/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:698/0 lens 488/0 e 0 to 0 dl 1746155638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.849403:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045d180 with x1830976125464832 ext(4165632->4194303) 00010000:00010000:0.0:1746155627.849407:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fa71200/0x844e5faceb5f4a5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16331 expref: 24 pid: 20200 timeout: 856 lvb_type: 0 00010000:00010000:0.0:1746155627.849415:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fa71200/0x844e5faceb5f4a5e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16331 expref: 24 pid: 20200 timeout: 856 lvb_type: 0 00002000:00010000:0.0:1746155627.849419:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009045d180 00000100:00100000:0.0:1746155627.849430:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1223 00000100:00100000:0.0:1746155627.849435:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976125464832:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155627.857176:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.857209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.862675:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15736 00000100:00100000:0.0:1746155627.862681:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125465472:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155627.862688:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155627.862695:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f3e7600/0x844e5faceb5f4b99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f163fc expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155627.862717:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125164160:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155627.862737:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155627.866857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.868931:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.868952:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125466368 00000100:00100000:0.0:1746155627.868957:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125466368 00002000:00100000:0.0:1746155627.868978:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009045c000 x1830976125466368/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:698/0 lens 488/0 e 0 to 0 dl 1746155638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.868986:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045c000 with x1830976125466368 ext(3145728->4194303) 00002000:00010000:0.0:1746155627.868990:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045c000 00000100:00100000:0.0:1746155627.869003:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7391 00000100:00100000:0.0:1746155627.869009:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1963:x1830976125466368:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155627.888795:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1963:x1830976125466368:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19782us (19862us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155627.888804:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7391 00002000:00100000:0.0:1746155627.888815:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009045c000 x1830976125466368/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:698/0 lens 488/440 e 0 to 0 dl 1746155638 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.888823:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045c000 with x1830976125466368 ext(3145728->4194303) 00010000:00010000:0.0:1746155627.888829:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a094b600/0x844e5faceb5f4b8b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f163ee expref: 24 pid: 9235 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746155627.888839:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a094b600/0x844e5faceb5f4b8b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f163ee expref: 24 pid: 9235 timeout: 857 lvb_type: 0 00002000:00010000:0.0:1746155627.888845:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009045c000 00000100:00100000:0.0:1746155627.902788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.902798:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.902806:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.902816:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.902855:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.902869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.902880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.902891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.902907:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.902919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.902945:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125468416 00000100:00100000:0.0:1746155627.902948:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125468416 00002000:00100000:0.0:1746155627.902972:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4059135) req@ffff88009f778700 x1830976125468416/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:698/0 lens 488/0 e 0 to 0 dl 1746155638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.902981:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f778700 with x1830976125468416 ext(3145728->4059135) 00010000:00010000:0.0:1746155627.902987:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094d62c00/0x844e5faceb5f4a7a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1633f expref: 8 pid: 20200 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746155627.903000:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094d62c00/0x844e5faceb5f4a7a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4059135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1633f expref: 8 pid: 20200 timeout: 857 lvb_type: 0 00002000:00010000:0.0:1746155627.903005:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f778700 00000100:00100000:0.0:1746155627.903018:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1224 00000100:00100000:0.0:1746155627.903023:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976125468416:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155627.903766:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137120a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125165952:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155627.905814:0:20796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136b73200/0x844e5faceb5f4bb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.905821:0:20796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b73200/0x844e5faceb5f4bb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.905833:0:20796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136b73200/0x844e5faceb5f4bb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.905838:0:20796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136b73200/0x844e5faceb5f4bb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.905844:0:20796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136b73200/0x844e5faceb5f4bb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.905849:0:20796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b73200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155627.905851:0:20796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136b73200/0x844e5faceb5f4bb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.905857:0:20796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136b73200/0x844e5faceb5f4bb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.905865:0:20796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136b73200/0x844e5faceb5f4bb5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155627.905870:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b73200/0x844e5faceb5f4bb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155627.905901:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125466624:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 20148us (20718us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155627.905906:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15737 00000100:00100000:0.0:1746155627.907066:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137120700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125166336:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155627.907079:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a237000/0x844e5faceb5f4bd8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155627.908900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.908941:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.914776:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.917096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.917360:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.926924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.933089:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.933124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.940557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.945890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.949778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.949813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.949838:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.949860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.949872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.949897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.949918:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125471872 00000100:00100000:0.0:1746155627.949925:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125471872 00000100:00100000:0.0:1746155627.949954:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4557 00000100:00100000:0.0:1746155627.949961:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:31727:x1830976125471872:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:0.0:1746155627.950465:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:31727:x1830976125471872:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 504us (566us total) trans 8589944966 rc 0/0 00000100:00100000:0.0:1746155627.950471:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4557 00000100:00100000:0.0:1746155627.955578:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.964477:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.969842:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.969892:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155627.969913:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125472640 00000100:00100000:0.0:1746155627.969919:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125472640 00002000:00100000:0.0:1746155627.969951:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a06a4000 x1830976125472640/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:698/0 lens 488/0 e 0 to 0 dl 1746155638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.969959:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a4000 with x1830976125472640 ext(3145728->4194303) 00002000:00010000:0.0:1746155627.969963:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a06a4000 00000100:00100000:0.0:1746155627.969989:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125472768 00000100:00100000:0.0:1746155627.969992:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125472768 00002000:00100000:0.0:1746155627.970003:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a06a4380 x1830976125472768/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:698/0 lens 488/0 e 0 to 0 dl 1746155638 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155627.970009:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a4380 with x1830976125472768 ext(3145728->4194303) 00002000:00010000:0.0:1746155627.970012:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a06a4380 00000100:00100000:0.0:1746155627.970104:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7396 00000100:00100000:0.0:1746155627.970110:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1963:x1830976125472768:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155627.997443:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.016305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.024126:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.024159:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.024181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.024210:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.024235:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125473920 00000100:00100000:0.0:1746155628.024238:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125473920 00000100:00100000:0.0:1746155628.024320:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15752 00000100:00100000:0.0:1746155628.024326:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976125473536:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155628.024333:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155628.024342:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f4c5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16450 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.024353:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155628.024354:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155628.024359:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f4c5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16450 expref: 21 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155628.024368:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f4c5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16450 expref: 21 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155628.024378:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29600, rc 0) 00000100:00100000:0.0:1746155628.024566:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976125473536:12345-192.168.202.51@tcp:101:cat.0 Request processed in 240us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155628.024570:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15752 00000100:00100000:0.0:1746155628.029009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.063605:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155628.064046:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155628.068658:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155628.068978:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155628.078626:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.078661:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.080545:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.082962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.083024:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.083036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.083060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.083087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.083109:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.084106:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.085655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.086652:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.087472:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.088347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.091472:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.096563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.096736:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.097454:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125168768:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155628.097662:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125168896:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155628.097675:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125169024:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155628.097693:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5faa000/0x844e5faceb5f4ce9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [1048576->1585151] (req 1048576->1585151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f164c0 expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.097703:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5faa000, rc 0) 00000100:00100000:0.0:1746155628.097718:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:31732:x1830976125477632:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4093us (4478us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155628.097723:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15764 00000100:00100000:0.0:1746155628.098027:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.098049:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125478528 00000100:00100000:0.0:1746155628.098052:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125478528 00010000:00010000:0.0:1746155628.098065:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f640600/0x844e5faceb5f4c10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1643b expref: 9 pid: 1625 timeout: 857 lvb_type: 1 00000100:00100000:0.0:1746155628.098077:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8034 00000100:00100000:0.0:1746155628.098195:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125478528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155628.098203:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155628.098212:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f640600/0x844e5faceb5f4c10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1643b expref: 9 pid: 1625 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746155628.098219:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f640600/0x844e5faceb5f4c10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1643b expref: 9 pid: 1625 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746155628.098235:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f640600/0x844e5faceb5f4c10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1643b expref: 9 pid: 1625 timeout: 857 lvb_type: 1 00010000:00010000:0.0:1746155628.098247:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155628.098262:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976125478528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 180us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155628.098267:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8034 00000100:00100000:0.0:1746155628.102606:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.103957:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.109931:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125479424 00000100:00100000:0.0:1746155628.109938:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125479424 00000100:00100000:0.0:1746155628.110597:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125479680 00000100:00100000:0.0:1746155628.110600:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125479680 00000100:00100000:0.0:1746155628.114974:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125480192 00000100:00100000:0.0:1746155628.114980:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125480192 00000100:00100000:0.0:1746155628.115007:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4561 00000100:00100000:0.0:1746155628.115013:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:31729:x1830976125480192:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155628.115293:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:31729:x1830976125480192:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 279us (437us total) trans 8589944972 rc 0/0 00000100:00100000:0.0:1746155628.115300:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4561 00000100:00100000:0.0:1746155628.236602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.241428:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.241471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.241635:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15768 00000100:00100000:0.0:1746155628.241644:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976125480576:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155628.241659:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155628.241672:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd29800/0x844e5faceb5f4d2f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f164e3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155628.241712:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125169664:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155628.241773:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155628.252790:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.254023:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.254699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.277946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.284909:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.284997:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.285110:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.285146:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125481984 00000100:00100000:0.0:1746155628.285153:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125481984 00002000:00100000:0.0:1746155628.285188:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e3:0x0] (2048000->2097151) req@ffff88009f0db480 x1830976125481984/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:699/0 lens 488/0 e 0 to 0 dl 1746155639 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155628.285197:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0db480 with x1830976125481984 ext(2048000->2097151) 00010000:00010000:0.0:1746155628.285204:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009460ba00/0x844e5faceb5f4caa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2048000->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1649d expref: 19 pid: 9235 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746155628.285216:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009460ba00/0x844e5faceb5f4caa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2048000->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1649d expref: 19 pid: 9235 timeout: 857 lvb_type: 0 00002000:00010000:0.0:1746155628.285222:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f0db480 00000100:00100000:0.0:1746155628.285983:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1225 00000100:00100000:0.0:1746155628.285989:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976125481984:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155628.290655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.290827:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.292632:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.294985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.314381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.319555:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125483136 00000100:00100000:0.0:1746155628.319563:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125483136 00000100:00100000:0.0:1746155628.319607:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15773 00000100:00100000:0.0:1746155628.319614:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:31742:x1830976125483136:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155628.319628:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155628.319642:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094218e00/0x844e5faceb5f4d59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1650d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.319665:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009460b000/0x844e5faceb5f4ce2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3035135) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f164b9 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.319672:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155628.319673:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155628.319676:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094218e00/0x844e5faceb5f4d59 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1650d expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.319700:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009460b000/0x844e5faceb5f4ce2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3035135) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f164b9 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.319710:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009460b000/0x844e5faceb5f4ce2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3035135) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f164b9 expref: 22 pid: 9235 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746155628.319724:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d48700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125170688:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155628.319789:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155628.329417:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.341239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.344375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.346266:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.350732:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.350754:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.363657:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8041 00000100:00100000:0.0:1746155628.363668:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125484544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155628.363678:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155628.363694:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009460b000/0x844e5faceb5f4ce2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3035135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f164b9 expref: 23 pid: 9235 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746155628.363704:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009460b000/0x844e5faceb5f4ce2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3035135) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f164b9 expref: 23 pid: 9235 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746155628.363717:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009460b000/0x844e5faceb5f4ce2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3035135) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f164b9 expref: 23 pid: 9235 timeout: 857 lvb_type: 0 00010000:00010000:0.0:1746155628.363733:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155628.363735:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155628.363740:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094218e00/0x844e5faceb5f4d59 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1650d expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.363750:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094218e00/0x844e5faceb5f4d59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1650d expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.363773:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094218e00/0x844e5faceb5f4d59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1650d expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155628.363783:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d49f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125171328:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155628.363832:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155628.371183:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.371228:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.371251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.371424:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.371448:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.371523:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125485056 00000100:00100000:0.0:1746155628.371526:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125485056 00002000:00100000:0.0:1746155628.371539:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a0d4a680 x1830976125485056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:699/0 lens 488/0 e 0 to 0 dl 1746155639 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155628.371546:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4a680 with x1830976125485056 ext(1048576->2097151) 00002000:00010000:0.0:1746155628.371549:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4a680 00000100:00100000:0.0:1746155628.371558:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125485312 00000100:00100000:0.0:1746155628.371560:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125485312 00002000:00100000:0.0:1746155628.371568:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a0d4ad80 x1830976125485312/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:699/0 lens 488/0 e 0 to 0 dl 1746155639 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155628.371574:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4ad80 with x1830976125485312 ext(2097152->3145727) 00002000:00010000:0.0:1746155628.371576:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d4ad80 00000100:00100000:0.0:1746155628.373100:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7407 00000100:00100000:0.0:1746155628.373108:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976125484800:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155628.378950:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125485952 00000100:00100000:0.0:1746155628.378956:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125485952 00000100:00100000:0.0:1746155628.378991:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15775 00000100:00100000:0.0:1746155628.378997:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:31749:x1830976125485952:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155628.379008:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155628.379024:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2400/0x844e5faceb5f4d91 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16529 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.379055:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090980800/0x844e5faceb5f4d52 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16506 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.379061:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155628.379063:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155628.379066:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2400/0x844e5faceb5f4d91 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [430080->835583] (req 430080->835583) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16529 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.379086:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090980800/0x844e5faceb5f4d52 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16506 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.379094:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090980800/0x844e5faceb5f4d52 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16506 expref: 23 pid: 8436 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746155628.379103:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d4b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125171456:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155628.379146:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155628.387083:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.393985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.421010:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.427076:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125486720 00000100:00100000:0.0:1746155628.427084:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125486720 00000100:00100000:0.0:1746155628.427243:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15776 00000100:00100000:0.0:1746155628.427251:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:31745:x1830976125486720:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155628.427265:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155628.427280:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3000/0x844e5faceb5f4d98 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16530 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.427300:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155628.427302:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155628.427309:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3000/0x844e5faceb5f4d98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16530 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.427320:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbe3000/0x844e5faceb5f4d98 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16530 expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.427328:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbe3000, rc 0) 00000100:00100000:0.0:1746155628.427449:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:31745:x1830976125486720:12345-192.168.202.51@tcp:101:cat.0 Request processed in 195us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155628.427455:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15776 00000100:00100000:0.0:1746155628.429388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.430800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.437233:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.437467:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7414 00000100:00100000:0.0:1746155628.437475:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976125487232:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155628.443095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.453999:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.457700:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.460987:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.461025:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.461272:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7417 00000100:00100000:0.0:1746155628.461278:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125488000:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155628.465888:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.470532:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125488512 00000100:00100000:0.0:1746155628.470540:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125488512 00000100:00100000:0.0:1746155628.470578:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15782 00000100:00100000:0.0:1746155628.470586:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125488512:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155628.470600:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155628.470614:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2000/0x844e5faceb5f4dc2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1655a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155628.470656:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090b4d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125172352:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155628.470730:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155628.472369:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.481741:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.488242:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.488288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.497075:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.499126:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.499724:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.504717:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.510070:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.521260:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.528532:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.528895:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125491200 00000100:00100000:0.0:1746155628.528898:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125491200 00000100:00100000:0.0:1746155628.528929:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10868 00000100:00100000:0.0:1746155628.528934:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:31753:x1830976125491200:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155628.528948:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155628.528960:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe2c00/0x844e5faceb5f4dde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16576 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.529004:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe2000/0x844e5faceb5f4de5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155628.529106:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe2000/0x844e5faceb5f4de5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155628.529117:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe2000/0x844e5faceb5f4de5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155628.529129:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe2600/0x844e5faceb5f4dec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155628.529134:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe2600/0x844e5faceb5f4dec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155628.529139:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe2600/0x844e5faceb5f4dec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155628.529287:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3400/0x844e5faceb5f4df3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155628.529296:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610a00/0x844e5faceb5f4d6e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1651b expref: 299 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.529303:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5f4d83 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16522 expref: 23 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.529308:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbe3400/0x844e5faceb5f4df3 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155628.529330:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5f4d83 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16522 expref: 23 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.529339:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5f4d83 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16522 expref: 23 pid: 14232 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746155628.529348:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090b4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125173376:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155628.529591:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610a00/0x844e5faceb5f4d6e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1651b expref: 299 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.529598:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610a00/0x844e5faceb5f4d6e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1651b expref: 299 pid: 14232 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746155628.529605:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125173504:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155628.529643:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155628.534279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.534317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.537047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.538943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.548282:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.548316:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.548333:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125492224 00000100:00100000:0.0:1746155628.548340:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125492224 00000100:00100000:0.0:1746155628.548374:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125492480 00000100:00100000:0.0:1746155628.548377:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125492480 00000100:00100000:0.0:1746155628.548540:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15787 00000100:00100000:0.0:1746155628.548546:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800931c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+5:1962:x1830976125492480:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155628.548555:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155628.548564:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbe2000/0x844e5faceb5f4e01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16592 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155628.548600:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800931c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125173632:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155628.548656:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155628.548681:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.548732:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.548751:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.550646:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.552374:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.561378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.561748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.561785:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.566831:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.572312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.572628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.572646:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.576222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.576247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.576267:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.576296:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:0.0:1746155628.579545:0:9235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime: 1746155628 -> 1746155629 00002000:00010000:0.0:1746155628.579549:0:9235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime: 1746155627 -> 1746155629 00002000:00010000:0.0:1746155628.579551:0:9235:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime: 1746155628 -> 1746155629 00000100:00100000:0.0:1746155628.579568:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125174656:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155628.579590:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f4e63 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f165c3 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155628.579601:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f4e63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f165c3 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155628.579618:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7dc00, rc 0) 00000100:00100000:0.0:1746155628.579647:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800931c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976125494784:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3295us (3427us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155628.579653:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15793 00000100:00100000:0.0:1746155628.581692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.583119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.583151:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.583839:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.586255:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.589204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.642030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.681613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.683818:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.693652:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.695659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.700766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.701767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.704977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.705901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.705928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.708853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.711895:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.713083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.713574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.715496:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.715540:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.742460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.748311:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.754466:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.757575:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.781649:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.782212:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7431 00000100:00100000:0.0:1746155628.782218:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1962:x1830976125501440:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155628.782253:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7432 00000100:00100000:0.0:1746155628.786149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.786192:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125501952 00000100:00100000:0.0:1746155628.786199:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125501952 00000100:00100000:0.0:1746155628.787023:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15802 00000100:00100000:0.0:1746155628.787041:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a382450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:31765:x1830976125501952:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155628.787056:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155628.787070:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c70e00/0x844e5faceb5f4f04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1661e expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.787094:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c51b400/0x844e5faceb5f4eb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f165e6 expref: 17 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.787101:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155628.787102:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155628.787105:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c70e00/0x844e5faceb5f4f04 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1220608->1929215] (req 1220608->1929215) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1661e expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.787128:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c51b400/0x844e5faceb5f4eb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f165e6 expref: 17 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.787139:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c51b400/0x844e5faceb5f4eb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1175551) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f165e6 expref: 17 pid: 20200 timeout: 857 lvb_type: 0 00000100:00100000:0.0:1746155628.787148:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d49c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125176320:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155628.787196:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155628.792192:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.801922:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.805074:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.805594:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.813679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.813842:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.813875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.813925:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.823677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.828617:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.828660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.839173:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.847488:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.847545:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.847870:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.854698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.857637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.861418:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.861461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.863193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.865591:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.870537:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.871763:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.872136:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.873950:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.876280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.888936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.891097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.895819:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.899133:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.908799:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.910488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.916080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.923427:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.924120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.948297:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.980972:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.981001:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.981070:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155628.981290:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15817 00000100:00100000:0.0:1746155628.981297:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009faff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1963:x1830976125509248:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155628.981304:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155628.981311:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbca600/0x844e5faceb5f4f82 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1668e expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155628.981320:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155628.981322:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155628.981326:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbca600/0x844e5faceb5f4f82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1668e expref: 19 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155628.981334:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbca600/0x844e5faceb5f4f82 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1668e expref: 19 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155628.981341:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbca600, rc 0) 00000100:00100000:0.0:1746155628.992088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.035882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.063471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.096596:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.112740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.151654:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.153005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.153191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.204246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.207708:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.217828:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.217920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.219086:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.226305:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.226336:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.226361:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.226375:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.226394:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.226464:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15822 00000100:00100000:0.0:1746155629.226471:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125512448:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155629.226479:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155629.226488:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009460b600/0x844e5faceb5f4fc1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f166bf expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155629.226499:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155629.226517:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155629.226523:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009460b600/0x844e5faceb5f4fc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166bf expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155629.226533:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009460b600/0x844e5faceb5f4fc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166bf expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155629.226540:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009460b600, rc 0) 00000100:00100000:0.0:1746155629.226557:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125512448:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 87us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155629.226563:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15822 00000100:00100000:0.0:1746155629.226577:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15823 00000100:00100000:0.0:1746155629.226582:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125512704:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155629.226588:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155629.226594:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009460ba00/0x844e5faceb5f4fc8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f166cd expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155629.226607:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155629.226609:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155629.226613:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009460ba00/0x844e5faceb5f4fc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166cd expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155629.226622:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009460ba00/0x844e5faceb5f4fc8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166cd expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155629.226629:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009460ba00, rc 0) 00000100:00100000:0.0:1746155629.226641:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125512704:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 59us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155629.226646:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15823 00000100:00100000:0.0:1746155629.226655:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15825 00000100:00100000:0.0:1746155629.226659:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125512576:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155629.226664:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155629.226668:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5f4fd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f166c6 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155629.226676:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155629.226683:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5f4fd6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166c6 expref: 8 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155629.226690:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009460a800/0x844e5faceb5f4fd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166c6 expref: 8 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155629.226702:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009460a800, rc 0) 00000100:00100000:0.0:1746155629.226717:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125512576:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 57us (323us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155629.226722:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15825 00000100:00100000:0.0:1746155629.229140:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.231642:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.233544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.234105:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.236325:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.243791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.243833:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.245236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.247494:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.259803:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.259840:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.260136:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.260875:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.264003:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.264050:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.265122:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.274453:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.277809:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.282207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.287696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.288061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.290531:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.290560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.296353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.296751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.298814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.301172:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.301200:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.301347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.314013:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.319564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.335248:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.340312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.343345:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.344320:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.355766:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.356122:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.356168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.372156:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.375617:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.388854:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.393589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.401957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.407569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.427691:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.432111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.437179:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.467010:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.483780:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.504113:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.510615:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125522432 00000100:00100000:0.0:1746155629.510618:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125522432 00000100:00100000:0.0:1746155629.510643:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15843 00000100:00100000:0.0:1746155629.510650:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:31802:x1830976125522432:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155629.510661:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155629.510672:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ffa9400/0x844e5faceb5f50a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16767 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155629.510691:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013121f400/0x844e5faceb5f501c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3047423) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166fe expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155629.510698:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155629.510699:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155629.510702:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffa9400/0x844e5faceb5f50a1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16767 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155629.510726:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013121f400/0x844e5faceb5f501c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3047423) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166fe expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155629.510735:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013121f400/0x844e5faceb5f501c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3047423) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166fe expref: 18 pid: 20796 timeout: 858 lvb_type: 0 00000100:00100000:0.0:1746155629.510744:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff69180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125182592:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155629.512047:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155629.513086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.517418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.517999:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.527356:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.538239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.538279:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.543019:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.550969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.553981:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.559994:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.569193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.578346:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.582158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.584902:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.591747:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.598140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.598185:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.604687:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.608840:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.608880:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.613086:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.619214:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.619251:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.619605:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8095 00000100:00100000:0.0:1746155629.619612:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1963:x1830976125526784:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155629.619618:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155629.619629:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a01eac00/0x844e5faceb5f4f2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16648 expref: 24 pid: 20796 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746155629.619813:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a01eac00/0x844e5faceb5f4f2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16648 expref: 24 pid: 20796 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746155629.619826:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01eac00/0x844e5faceb5f4f2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16648 expref: 24 pid: 20796 timeout: 858 lvb_type: 1 00010000:00010000:0.0:1746155629.619840:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155629.619855:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1963:x1830976125526784:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 245us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155629.619860:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8095 00000100:00100000:0.0:1746155629.622161:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.626008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.626660:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125184128:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155629.626675:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155629.626697:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125526912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3948us (4542us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155629.626704:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8096 00000100:00100000:0.0:1746155629.635212:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.638272:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.642685:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.642712:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.642736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.642757:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.645279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.649802:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125185024:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155629.649817:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155629.651290:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976125528704:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5840us (6008us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155629.651299:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8099 00000100:00100000:0.0:1746155629.657053:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.657086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.663537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.663580:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.800371:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.808976:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.822772:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.828793:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.871840:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.871869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.871893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.871911:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125530624 00000100:00100000:0.0:1746155629.871918:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125530624 00000100:00100000:0.0:1746155629.871958:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125530880 00000100:00100000:0.0:1746155629.871960:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125530880 00000100:00100000:0.0:1746155629.871975:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 200 00000100:00100000:0.0:1746155629.871982:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:1963:x1830976125530624:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:0.0:1746155629.872102:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+306:1963:x1830976125530624:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 119us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155629.872111:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 200 00000100:00100000:0.0:1746155629.875667:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125530752 00000100:00100000:0.0:1746155629.875670:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125530752 00000100:00100000:0.0:1746155629.875701:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 371 00000100:00100000:0.0:1746155629.875706:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976125531008:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:0.0:1746155629.875733:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976125531008:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 27us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155629.875740:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 371 00000100:00100000:0.0:1746155629.884933:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.884976:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.885068:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.891982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.894921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.895004:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.895041:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125532160 00000100:00100000:0.0:1746155629.895044:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125532160 00002000:00100000:0.0:1746155629.895060:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e1:0x0] (372736->1048575) req@ffff8800936f6d80 x1830976125532160/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:700/0 lens 488/0 e 0 to 0 dl 1746155640 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155629.895403:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6d80 with x1830976125532160 ext(372736->1048575) 00010000:00010000:0.0:1746155629.895409:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008e256800/0x844e5faceb5f50c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1678a expref: 28 pid: 20796 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155629.895418:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008e256800/0x844e5faceb5f50c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 372736->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1678a expref: 28 pid: 20796 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746155629.895423:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936f6d80 00000100:00100000:0.0:1746155629.895533:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1246 00000100:00100000:0.0:1746155629.895539:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976125532160:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155629.905599:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.905713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.912398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.913734:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.925337:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.928333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.930373:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.933411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.935968:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.942437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.944053:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.948164:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.950951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.951818:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.959891:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.959913:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.960532:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8105 00000100:00100000:0.0:1746155629.960539:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1963:x1830976125534720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155629.960660:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155629.960678:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f62ca00/0x844e5faceb5f5149 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1680f expref: 23 pid: 8436 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155629.960689:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f62ca00/0x844e5faceb5f5149 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1680f expref: 23 pid: 8436 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155629.960704:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f62ca00/0x844e5faceb5f5149 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1680f expref: 23 pid: 8436 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155629.960722:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155629.960724:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155629.960729:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f62d200/0x844e5faceb5f5150 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16816 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155629.960736:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f62d200/0x844e5faceb5f5150 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16816 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155629.960758:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f62d200/0x844e5faceb5f5150 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1130495) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16816 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155629.960769:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125187712:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155629.961762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.963194:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.970362:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.970388:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.970449:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.975546:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.975969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.977035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.977049:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125536256 00000100:00100000:0.0:1746155629.977055:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125536256 00002000:00100000:0.0:1746155629.977073:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800a0d4f480 x1830976125536256/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:700/0 lens 488/0 e 0 to 0 dl 1746155640 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155629.977079:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4f480 with x1830976125536256 ext(1048576->2097151) 00002000:00010000:0.0:1746155629.977083:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d4f480 00000100:00100000:0.0:1746155629.977103:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7488 00000100:00100000:0.0:1746155629.977108:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976125536256:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155629.980457:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.981405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.981455:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.984465:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.984492:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.989908:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976125536256:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12797us (12883us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155629.989919:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7488 00002000:00100000:0.0:1746155629.989926:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800a0d4f480 x1830976125536256/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:700/0 lens 488/440 e 0 to 0 dl 1746155640 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155629.989934:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4f480 with x1830976125536256 ext(1048576->2097151) 00002000:00010000:0.0:1746155629.989938:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d4f480 00000100:00100000:0.0:1746155629.992130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.998003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.998045:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155629.998065:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125537536 00000100:00100000:0.0:1746155629.998071:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125537536 00002000:00100000:0.0:1746155629.998104:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->2367487) req@ffff88009fafed80 x1830976125537536/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:700/0 lens 488/0 e 0 to 0 dl 1746155640 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155629.998112:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fafed80 with x1830976125537536 ext(2097152->2367487) 00002000:00010000:0.0:1746155629.998116:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fafed80 00000100:00100000:0.0:1746155629.998143:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7489 00000100:00100000:0.0:1746155629.998150:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fafed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125537536:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155629.998524:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.009993:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.012088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.012221:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155630.012709:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746155630.012712:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155630.019433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.023534:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125538688 00000100:00100000:0.0:1746155630.023542:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125538688 00000100:00100000:0.0:1746155630.023584:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125538816 00000100:00100000:0.0:1746155630.023586:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125538816 00000100:00100000:0.0:1746155630.023609:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15880 00000100:00100000:0.0:1746155630.023615:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1963:x1830976125538688:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155630.023628:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155630.023693:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc32e00/0x844e5faceb5f51e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1687f expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155630.023734:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc08380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125189248:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155630.024156:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155630.030704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.030774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.030817:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15882 00000100:00100000:0.0:1746155630.030825:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc08700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976125539328:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155630.030840:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155630.030853:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbe3000/0x844e5faceb5f51f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16894 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155630.030892:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012ef01f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125189504:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155630.030963:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155630.076228:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.078643:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.086618:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.086648:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.086676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.086704:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125539712 00000100:00100000:0.0:1746155630.086710:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125539712 00010000:00010000:0.0:1746155630.086738:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801312c6400/0x844e5faceb5f519d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1684e expref: 8 pid: 20796 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746155630.086756:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125539840 00000100:00100000:0.0:1746155630.086757:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125539840 00010000:00010000:0.0:1746155630.086764:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc32200/0x844e5faceb5f50af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16775 expref: 23 pid: 29728 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746155630.086774:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125539968 00000100:00100000:0.0:1746155630.086776:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125539968 00010000:00010000:0.0:1746155630.086791:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ffa9400/0x844e5faceb5f50a1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16767 expref: 23 pid: 29728 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746155630.086803:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8111 00000100:00100000:0.0:1746155630.086810:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125539712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155630.086820:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155630.086837:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801312c6400/0x844e5faceb5f519d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1684e expref: 8 pid: 20796 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.086846:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801312c6400/0x844e5faceb5f519d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1684e expref: 8 pid: 20796 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.086864:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155630.086895:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125539712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 86us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.086900:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8111 00000100:00100000:0.0:1746155630.086913:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8112 00000100:00100000:0.0:1746155630.086917:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976125539840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155630.086923:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155630.086928:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dc32200/0x844e5faceb5f50af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16775 expref: 23 pid: 29728 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.086936:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dc32200/0x844e5faceb5f50af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16775 expref: 23 pid: 29728 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.086945:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc32200/0x844e5faceb5f50af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16775 expref: 23 pid: 29728 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.086958:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155630.086971:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976125539840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.086977:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8112 00000100:00100000:0.0:1746155630.086985:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8113 00000100:00100000:0.0:1746155630.086989:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125539968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155630.086994:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155630.086999:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ffa9400/0x844e5faceb5f50a1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16767 expref: 23 pid: 29728 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155630.087007:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ffa9400/0x844e5faceb5f50a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16767 expref: 23 pid: 29728 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155630.087016:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.087017:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.087032:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801315c5c00/0x844e5faceb5f51ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1689b expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.087045:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801315c5c00/0x844e5faceb5f51ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1689b expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.087068:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801315c5c00/0x844e5faceb5f51ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3715072->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1689b expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155630.087078:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125190272:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155630.087118:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b0c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746155630.087129:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155630.091346:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.103193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.103781:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.110657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.113151:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.139858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.140205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.151730:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.152254:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.152778:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7494 00000100:00100000:0.0:1746155630.152785:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976125542016:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155630.172306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.172372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.173380:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15889 00000100:00100000:0.0:1746155630.173389:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fd3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976125542272:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155630.173398:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155630.173406:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d8b8200/0x844e5faceb5f5222 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f168be expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155630.173425:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fd3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125191296:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155630.173654:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155630.179742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.183253:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125542528 00000100:00100000:0.0:1746155630.183259:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125542528 00002000:00100000:0.0:1746155630.183292:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->4612095) req@ffff8801317c6d80 x1830976125542528/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:701/0 lens 488/0 e 0 to 0 dl 1746155641 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155630.183300:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6d80 with x1830976125542528 ext(4194304->4612095) 00010000:00010000:0.0:1746155630.183306:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801315c4600/0x844e5faceb5f5206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4612095) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f168a2 expref: 23 pid: 9235 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155630.183318:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801315c4600/0x844e5faceb5f5206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4612095) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f168a2 expref: 23 pid: 9235 timeout: 859 lvb_type: 0 00002000:00010000:0.0:1746155630.183324:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801317c6d80 00000100:00100000:0.0:1746155630.183353:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1249 00000100:00100000:0.0:1746155630.183359:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125542528:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155630.188662:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155630.188874:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155630.197206:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.208456:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.215760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.227487:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.237080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.237205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.237815:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.238666:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7497 00000100:00100000:0.0:1746155630.238674:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125544064:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155630.262059:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.262098:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.262120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.262134:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.262674:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976125544064:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24000us (25467us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155630.262679:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7497 00002000:00100000:0.0:1746155630.262685:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff880090b4ca80 x1830976125544064/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:701/0 lens 488/440 e 0 to 0 dl 1746155641 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155630.262692:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090b4ca80 with x1830976125544064 ext(3145728->4194303) 00002000:00010000:0.0:1746155630.262696:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090b4ca80 00000100:00100000:0.0:1746155630.270873:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.270923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.277080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.287296:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.294424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.301590:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.314906:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.316608:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.322957:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.328669:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.332953:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.356587:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.356625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.356647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.356680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.356718:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125547392 00000100:00100000:0.0:1746155630.356725:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125547392 00002000:00100000:0.0:1746155630.356758:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800931c9180 x1830976125547392/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:701/0 lens 488/0 e 0 to 0 dl 1746155641 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155630.356767:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931c9180 with x1830976125547392 ext(3145728->4194303) 00002000:00010000:0.0:1746155630.356771:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800931c9180 00000100:00100000:0.0:1746155630.356968:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125547648 00000100:00100000:0.0:1746155630.356971:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125547648 00002000:00100000:0.0:1746155630.356984:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800931ca300 x1830976125547648/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:701/0 lens 488/0 e 0 to 0 dl 1746155641 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155630.356989:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800931ca300 with x1830976125547648 ext(2097152->3145727) 00002000:00010000:0.0:1746155630.356992:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800931ca300 00000100:00100000:0.0:1746155630.385497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.391669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.391707:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.394461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.400292:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.400369:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.403919:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.408758:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.409946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.411959:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.415438:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.416148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.419544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.419894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.419922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.419939:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.422820:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.428597:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.428759:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125550848 00000100:00100000:0.0:1746155630.428766:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125550848 00002000:00100000:0.0:1746155630.428801:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009ff6b100 x1830976125550848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:701/0 lens 488/0 e 0 to 0 dl 1746155641 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155630.428809:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6b100 with x1830976125550848 ext(0->1048575) 00002000:00010000:0.0:1746155630.428814:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6b100 00000100:00100000:0.0:1746155630.428842:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7509 00000100:00100000:0.0:1746155630.428899:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976125550848:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155630.458870:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.462934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.475584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.478215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.481419:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.499747:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.499797:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.511584:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.512844:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125552640 00000100:00100000:0.0:1746155630.512848:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125552640 00000100:00100000:0.0:1746155630.512881:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15913 00000100:00100000:0.0:1746155630.512887:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:31843:x1830976125552640:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155630.512898:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155630.512908:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc32200/0x844e5faceb5f52f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16974 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.512921:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df44400/0x844e5faceb5f52ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3911679) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1696d expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.512926:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155630.512927:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155630.512930:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc32200/0x844e5faceb5f52f4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16974 expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.512943:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012df44400/0x844e5faceb5f52ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3911679) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1696d expref: 23 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.512952:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012df44400/0x844e5faceb5f52ed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3911679) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1696d expref: 23 pid: 8437 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746155630.512960:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff68e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125194624:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155630.513010:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155630.534304:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.538762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.545561:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.546452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.548108:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.548132:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.560800:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.563030:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.563104:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.563118:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.563138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.563154:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15916 00000100:00100000:0.0:1746155630.563160:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125554432:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155630.563172:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155630.563184:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc33e00/0x844e5faceb5f5325 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16990 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.563200:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.563202:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.563207:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc33e00/0x844e5faceb5f5325 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16990 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.563218:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc33e00/0x844e5faceb5f5325 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16990 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.563226:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc33e00, rc 0) 00000100:00100000:0.0:1746155630.563727:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125554432:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 566us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.563732:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15916 00000100:00100000:0.0:1746155630.566108:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:0.0:1746155630.566172:0:19959:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155630 -> 1746155631 00002000:00010000:0.0:1746155630.566174:0:19959:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155630 -> 1746155631 00002000:00010000:0.0:1746155630.566175:0:19959:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime: 1746155630 -> 1746155631 00000100:00100000:0.0:1746155630.566185:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125195136:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155630.566207:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7cfc00/0x844e5faceb5f5333 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1699e expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.566216:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7cfc00/0x844e5faceb5f5333 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1699e expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.566232:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7cfc00, rc 0) 00000100:00100000:0.0:1746155630.566248:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125554688:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3015us (3129us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155630.566253:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15918 00000100:00100000:0.0:1746155630.572858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.572957:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.573011:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125555200 00000100:00100000:0.0:1746155630.573028:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125555200 00010000:00010000:0.0:1746155630.573054:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012df44400/0x844e5faceb5f52ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1696d expref: 26 pid: 8437 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746155630.573084:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8130 00000100:00100000:0.0:1746155630.573091:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1962:x1830976125555200:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155630.573103:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155630.573121:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df44400/0x844e5faceb5f52ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3911679) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1696d expref: 26 pid: 8437 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155630.573657:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df44400/0x844e5faceb5f52ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3911679) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1696d expref: 26 pid: 8437 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155630.573679:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df44400/0x844e5faceb5f52ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3911679) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1696d expref: 26 pid: 8437 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155630.573690:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.573692:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.573697:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dc32200/0x844e5faceb5f52f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16974 expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.573704:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dc32200/0x844e5faceb5f52f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16974 expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155630.577072:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.577129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.577175:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0da680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125195520:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155630.577192:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155630.577223:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1962:x1830976125555200:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4133us (4266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.577232:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8130 00000100:00100000:0.0:1746155630.577252:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125555840 00000100:00100000:0.0:1746155630.577255:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125555840 00010000:00010000:0.0:1746155630.577269:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df45000/0x844e5faceb5f5317 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16982 expref: 27 pid: 14234 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746155630.577285:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8131 00000100:00100000:0.0:1746155630.577290:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+27:1961:x1830976125555840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155630.577298:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155630.577303:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012df45000/0x844e5faceb5f5317 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16982 expref: 27 pid: 14234 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155630.577312:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012df45000/0x844e5faceb5f5317 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16982 expref: 27 pid: 14234 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155630.577327:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155630.577332:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012df45c00/0x844e5faceb5f5348 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.577339:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df45c00/0x844e5faceb5f5348 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.577344:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df45c00/0x844e5faceb5f5348 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.577356:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155630.577367:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+27:1961:x1830976125555840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 77us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.577372:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8131 00000100:00100000:0.0:1746155630.579579:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.585378:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125556608 00000100:00100000:0.0:1746155630.585384:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125556608 00002000:00100000:0.0:1746155630.585414:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f0d9c00 x1830976125556608/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:701/0 lens 488/0 e 0 to 0 dl 1746155641 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155630.585422:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d9c00 with x1830976125556608 ext(2097152->3145727) 00002000:00010000:0.0:1746155630.585426:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0d9c00 00000100:00100000:0.0:1746155630.585440:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7514 00000100:00100000:0.0:1746155630.585446:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1961:x1830976125556608:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155630.588916:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125195648:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155630.588941:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f04b400/0x844e5faceb5f535d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f169ba expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.588961:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f04b400/0x844e5faceb5f535d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f169ba expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.588982:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f04b400, rc 0) 00000100:00100000:0.0:1746155630.589002:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800912c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125556224:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5858us (6249us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155630.589009:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15921 00000100:00100000:0.0:1746155630.596164:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.598000:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.600735:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.600767:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.600794:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.600819:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.600832:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.600852:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.600867:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125557120 00000100:00100000:0.0:1746155630.600872:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125557120 00000100:00100000:0.0:1746155630.600895:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125557376 00000100:00100000:0.0:1746155630.600897:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125557376 00000100:00100000:0.0:1746155630.600908:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125557632 00000100:00100000:0.0:1746155630.600910:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125557632 00000100:00100000:0.0:1746155630.600920:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125557248 00000100:00100000:0.0:1746155630.600921:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125557248 00000100:00100000:0.0:1746155630.600931:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125557504 00000100:00100000:0.0:1746155630.600933:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125557504 00000100:00100000:0.0:1746155630.600941:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125557760 00000100:00100000:0.0:1746155630.600943:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125557760 00000100:00100000:0.0:1746155630.600954:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15924 00000100:00100000:0.0:1746155630.600960:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125557120:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155630.600989:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f5387 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.601001:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801315c4400/0x844e5faceb5f5268 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f168f6 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.601008:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc33e00/0x844e5faceb5f5325 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16990 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.601026:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06c5200/0x844e5faceb5f52c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16943 expref: 34 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.601032:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.601033:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.601036:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f5387 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.601057:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06c5200/0x844e5faceb5f52c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16943 expref: 34 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.601066:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06c5200/0x844e5faceb5f52c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16943 expref: 34 pid: 20796 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746155630.601082:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125195904:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155630.601143:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc33e00/0x844e5faceb5f5325 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16990 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.601151:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc33e00/0x844e5faceb5f5325 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16990 expref: 9 pid: 9235 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746155630.601159:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090b48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125196032:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155630.601181:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801315c4400/0x844e5faceb5f5268 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f168f6 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.601190:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801315c4400/0x844e5faceb5f5268 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f168f6 expref: 26 pid: 29728 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746155630.601197:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090b48700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125196160:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155630.601211:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155630.601226:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15925 00000100:00100000:0.0:1746155630.601232:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976125557376:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155630.601249:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091000800/0x844e5faceb5f538e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.601260:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ffab000/0x844e5faceb5f4efd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16617 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.601271:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009460b600/0x844e5faceb5f4fc1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166bf expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.601278:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f4f19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16633 expref: 26 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.601283:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.601285:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.601287:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091000800/0x844e5faceb5f538e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.601301:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f4f19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16633 expref: 26 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.601309:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f4f19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16633 expref: 26 pid: 20796 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746155630.601317:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090b48e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125196288:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155630.601340:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009460b600/0x844e5faceb5f4fc1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166bf expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.601348:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009460b600/0x844e5faceb5f4fc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166bf expref: 11 pid: 18270 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746155630.601356:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090b49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125196416:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155630.601376:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ffab000/0x844e5faceb5f4efd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16617 expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.601383:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ffab000/0x844e5faceb5f4efd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16617 expref: 25 pid: 4461 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746155630.601391:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090b4a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125196544:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155630.601403:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155630.605322:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.610989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.611087:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125195904:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155630.612448:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.612470:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.612484:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125558272 00000100:00100000:0.0:1746155630.612487:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125558272 00010000:00010000:0.0:1746155630.612522:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06c5200/0x844e5faceb5f52c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16943 expref: 35 pid: 20796 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746155630.612538:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125558528 00000100:00100000:0.0:1746155630.612540:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125558528 00010000:00010000:0.0:1746155630.612548:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f4f19 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16633 expref: 27 pid: 20796 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746155630.612561:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8132 00000100:00100000:0.0:1746155630.612566:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976125558272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155630.612573:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155630.612588:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a06c5200/0x844e5faceb5f52c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16943 expref: 35 pid: 20796 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.612596:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a06c5200/0x844e5faceb5f52c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16943 expref: 35 pid: 20796 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.612612:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06c5200/0x844e5faceb5f52c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16943 expref: 35 pid: 20796 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.612624:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155630.612643:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976125558272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 77us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.612648:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8132 00000100:00100000:0.0:1746155630.612660:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8133 00000100:00100000:0.0:1746155630.612664:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976125558528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155630.612670:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155630.612680:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f4f19 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16633 expref: 27 pid: 20796 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.612688:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f4f19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16633 expref: 27 pid: 20796 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.612699:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155630.612712:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976125558528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 47us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.612716:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8133 00000100:00100000:0.0:1746155630.612742:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.612753:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125558400 00000100:00100000:0.0:1746155630.612755:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125558400 00010000:00010000:0.0:1746155630.612764:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009460b600/0x844e5faceb5f4fc1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166bf expref: 12 pid: 18270 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746155630.612775:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8134 00000100:00100000:0.0:1746155630.612779:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125558400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155630.612784:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155630.612790:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009460b600/0x844e5faceb5f4fc1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166bf expref: 12 pid: 18270 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.612796:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009460b600/0x844e5faceb5f4fc1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f166bf expref: 12 pid: 18270 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.612804:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155630.612814:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125558400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 35us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.612818:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8134 00000100:00100000:0.0:1746155630.612849:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.612856:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125558144 00000100:00100000:0.0:1746155630.612858:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125558144 00010000:00010000:0.0:1746155630.612865:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc33e00/0x844e5faceb5f5325 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16990 expref: 10 pid: 9235 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746155630.612875:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8135 00000100:00100000:0.0:1746155630.612879:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125558144:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155630.612883:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155630.612889:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc33e00/0x844e5faceb5f5325 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16990 expref: 10 pid: 9235 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.612895:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc33e00/0x844e5faceb5f5325 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16990 expref: 10 pid: 9235 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.612903:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155630.612912:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125558144:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 33us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.612916:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8135 00000100:00100000:0.0:1746155630.613031:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.613039:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125559040 00000100:00100000:0.0:1746155630.613041:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125559040 00010000:00010000:0.0:1746155630.613049:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091001000/0x844e5faceb5f532c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16997 expref: 12 pid: 18270 timeout: 859 lvb_type: 1 00000100:00100000:0.0:1746155630.613061:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8136 00000100:00100000:0.0:1746155630.613065:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125559040:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155630.613070:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155630.613077:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091001000/0x844e5faceb5f532c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16997 expref: 12 pid: 18270 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.613085:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091001000/0x844e5faceb5f532c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16997 expref: 12 pid: 18270 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.613094:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155630.613109:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125559040:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 43us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.613117:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8136 00000100:00100000:0.0:1746155630.613144:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.613153:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125558912 00000100:00100000:0.0:1746155630.613155:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125558912 00010000:00010000:0.0:1746155630.613164:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7cfe00/0x844e5faceb5f531e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16989 expref: 30 pid: 8437 timeout: 859 lvb_type: 0 00000100:00100000:0.0:1746155630.613175:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8137 00000100:00100000:0.0:1746155630.613179:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1961:x1830976125558912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155630.613184:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155630.615555:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7cfe00/0x844e5faceb5f531e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16989 expref: 30 pid: 8437 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155630.615564:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7cfe00/0x844e5faceb5f531e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16989 expref: 30 pid: 8437 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155630.615574:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7cfe00/0x844e5faceb5f531e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16989 expref: 30 pid: 8437 timeout: 859 lvb_type: 0 00010000:00010000:0.0:1746155630.615582:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155630.615595:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1961:x1830976125558912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2416us (2451us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.615601:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8137 00000100:00100000:0.0:1746155630.617119:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8147 00000100:00100000:0.0:1746155630.617126:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125560064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155630.617135:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155630.617144:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df45a00/0x844e5faceb5f5364 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f169c1 expref: 8 pid: 9235 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.617152:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df45a00/0x844e5faceb5f5364 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f169c1 expref: 8 pid: 9235 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.617185:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df45a00/0x844e5faceb5f5364 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f169c1 expref: 8 pid: 9235 timeout: 859 lvb_type: 1 00010000:00010000:0.0:1746155630.617193:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155630.617209:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125560064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 84us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.617214:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8147 00000100:00100000:0.0:1746155630.620754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.622044:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125198208:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155630.622057:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155630.622226:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1963:x1830976125560320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1360us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.622233:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8149 00000100:00100000:0.0:1746155630.623832:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.643965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.644014:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.647474:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.651601:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.657168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.657212:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.665122:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.669332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.669393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.677419:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.678130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.678153:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.678164:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.678174:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.678198:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.678611:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15935 00000100:00100000:0.0:1746155630.678617:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976125563008:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155630.678624:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155630.678632:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131458000/0x844e5faceb5f53e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16a00 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155630.678646:0:20200:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x6814386d, atime: 0x6814386b, ctime: 0x6814386d, blocks: 0x81f 00010000:00010000:0.0:1746155630.678653:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.678654:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.678658:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131458000/0x844e5faceb5f53e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a00 expref: 27 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.678666:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131458000/0x844e5faceb5f53e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a00 expref: 27 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.678688:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131458000, rc 0) 00000100:00100000:0.0:1746155630.678702:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976125563008:12345-192.168.202.51@tcp:101:cat.0 Request processed in 86us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.678707:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15935 00000100:00100000:0.0:1746155630.678721:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15936 00000100:00100000:0.0:1746155630.678726:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976125563264:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155630.678730:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155630.678736:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131458200/0x844e5faceb5f53f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16a0e expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.678744:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.678746:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.678749:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131458200/0x844e5faceb5f53f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a0e expref: 36 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.679692:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131458200/0x844e5faceb5f53f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a0e expref: 36 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.679703:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131458200, rc 0) 00000100:00100000:0.0:1746155630.679720:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976125563264:12345-192.168.202.51@tcp:101:cat.0 Request processed in 994us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.679725:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15936 00000100:00100000:0.0:1746155630.690057:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.698573:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.699868:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.699894:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.700231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.700412:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.760379:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.765541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.766009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.769080:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.774705:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.789569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.791216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.791584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.792899:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155630.793424:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095da00/0x844e5faceb5f544b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793431:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095da00/0x844e5faceb5f544b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155630.793467:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:0.0:1746155630.793473:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155630.793488:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095da00/0x844e5faceb5f544b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793498:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095da00/0x844e5faceb5f544b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793544:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d600/0x844e5faceb5f543d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793550:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d600/0x844e5faceb5f543d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793555:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d600/0x844e5faceb5f543d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793560:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a095d600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155630.793564:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d600/0x844e5faceb5f543d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793570:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d600/0x844e5faceb5f543d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793579:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155630.793582:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155630.793585:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d600/0x844e5faceb5f543d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793589:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d600/0x844e5faceb5f543d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793625:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d800/0x844e5faceb5f5444 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793631:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d800/0x844e5faceb5f5444 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793635:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d800/0x844e5faceb5f5444 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793639:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a095d800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155630.793641:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d800/0x844e5faceb5f5444 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793645:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d800/0x844e5faceb5f5444 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793652:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fab9a00) 00010000:00010000:0.0:1746155630.793654:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155630.793657:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d800/0x844e5faceb5f5444 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793661:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d800/0x844e5faceb5f5444 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155630.793695:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095d400/0x844e5faceb5f5436 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a3f expref: 28 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.793707:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a095da00/0x844e5faceb5f544b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a3f expref: 27 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.793712:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155630.793714:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155630.793716:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a095da00, rc 0) 00000100:00100000:0.0:1746155630.794027:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+27:31860:x1830976125565824:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 4324us (4462us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.794033:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10893 00000100:00100000:0.0:1746155630.796101:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.796134:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.796155:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.796164:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.796171:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.796186:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.796305:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15946 00000100:00100000:0.0:1746155630.796309:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125566592:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155630.796314:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155630.796318:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df44c00/0x844e5faceb5f5460 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16a4d expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.796325:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.796326:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.796330:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df44c00/0x844e5faceb5f5460 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a4d expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.796336:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df44c00/0x844e5faceb5f5460 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a4d expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.796342:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df44c00, rc 0) 00000100:00100000:0.0:1746155630.796365:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976125566592:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 56us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.796369:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15946 00000100:00100000:0.0:1746155630.796378:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15947 00000100:00100000:0.0:1746155630.796380:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125566848:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155630.796384:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155630.796387:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df44400/0x844e5faceb5f546e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16a5b expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155630.796392:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.796393:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155630.796396:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012df44400/0x844e5faceb5f546e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a5b expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.796401:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012df44400/0x844e5faceb5f546e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a5b expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.796405:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df44400, rc 0) 00000100:00100000:0.0:1746155630.796412:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125566848:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 31us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.796418:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15947 00000100:00100000:0.0:1746155630.801637:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.805630:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.809172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.813574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.826601:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.829952:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.830658:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.830682:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.833038:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312f4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125199872:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155630.833051:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155630.833089:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976125568384:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2154us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.833095:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8159 00000100:00100000:0.0:1746155630.838787:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.843377:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.899253:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.921456:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.933368:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.934540:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.935396:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.935425:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.935525:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125200128:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155630.935549:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801315c4600/0x844e5faceb5f54c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a93 expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.935563:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801315c4600/0x844e5faceb5f54c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a93 expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155630.935574:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801315c4600, rc 0) 00000100:00100000:0.0:1746155630.935605:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1963:x1830976125569792:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2102us (2243us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155630.935611:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 15951 00000100:00100000:0.0:1746155630.946840:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125200256 00000100:00100000:0.0:1746155630.946847:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125200256 00000100:00100000:0.0:1746155630.947066:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1746155630.947071:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1830976125200256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746155630.947081:0:8440:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 573898752 pending 27262976 free 3850371072 avail 3848273920 00000100:00100000:0.0:1746155630.947104:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1830976125200256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155630.947109:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:0.0:1746155630.947607:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155630.947621:0:3298:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841339 gen 2 00000004:00080000:0.0:1746155630.947624:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fef2300, transno 21474841257 00000004:00080000:0.0:1746155630.947640:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095269500, transno 21474841258 00000004:00080000:0.0:1746155630.947646:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526a680, transno 21474841259 00000004:00080000:0.0:1746155630.947648:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26fb80, transno 21474841260 00000004:00080000:0.0:1746155630.947650:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fef2680, transno 21474841261 00000004:00080000:0.0:1746155630.947652:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526a300, transno 21474841262 00000004:00080000:0.0:1746155630.947654:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fef3480, transno 21474841263 00000004:00080000:0.0:1746155630.947656:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095269f80, transno 21474841264 00000004:00080000:0.0:1746155630.947658:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137120000, transno 21474841265 00000004:00080000:0.0:1746155630.947660:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca94e00, transno 21474841266 00000004:00080000:0.0:1746155630.947662:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137123800, transno 21474841267 00000004:00080000:0.0:1746155630.947664:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137122d80, transno 21474841268 00000004:00080000:0.0:1746155630.947666:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137122a00, transno 21474841269 00000004:00080000:0.0:1746155630.947668:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca96300, transno 21474841270 00000004:00080000:0.0:1746155630.947670:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137121f80, transno 21474841271 00000004:00080000:0.0:1746155630.947671:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca96a00, transno 21474841272 00000004:00080000:0.0:1746155630.947673:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800912c2d80, transno 21474841276 00000004:00080000:0.0:1746155630.947675:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800912c0e00, transno 21474841277 00000004:00080000:0.0:1746155630.947677:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800912c3800, transno 21474841278 00000004:00080000:0.0:1746155630.947679:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800912c3100, transno 21474841279 00000004:00080000:0.0:1746155630.947681:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800912c2680, transno 21474841280 00000004:00080000:0.0:1746155630.947682:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800912c0000, transno 21474841281 00000004:00080000:0.0:1746155630.947685:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800912c1f80, transno 21474841282 00000004:00080000:0.0:1746155630.947687:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800912c0380, transno 21474841283 00000004:00080000:0.0:1746155630.947688:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28c700, transno 21474841284 00000004:00080000:0.0:1746155630.947691:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fe8dc00, transno 21474841285 00000004:00080000:0.0:1746155630.947693:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf5f80, transno 21474841286 00000004:00080000:0.0:1746155630.947695:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fe8c700, transno 21474841287 00000004:00080000:0.0:1746155630.947696:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf7480, transno 21474841288 00000004:00080000:0.0:1746155630.947698:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fe8d880, transno 21474841289 00000004:00080000:0.0:1746155630.947700:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fe8fb80, transno 21474841290 00000004:00080000:0.0:1746155630.947702:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fe8ea00, transno 21474841291 00000004:00080000:0.0:1746155630.947704:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f700a80, transno 21474841305 00000004:00080000:0.0:1746155630.947706:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01d2680, transno 21474841306 00000004:00080000:0.0:1746155630.947708:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f703b80, transno 21474841307 00000004:00080000:0.0:1746155630.947710:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0b0380, transno 21474841308 00000004:00080000:0.0:1746155630.947712:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01d3100, transno 21474841309 00000004:00080000:0.0:1746155630.947714:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f702300, transno 21474841310 00000004:00080000:0.0:1746155630.947716:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0b1500, transno 21474841311 00000004:00080000:0.0:1746155630.947718:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f703100, transno 21474841312 00000004:00080000:0.0:1746155630.947720:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc6d80, transno 21474841316 00000004:00080000:0.0:1746155630.947722:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0b2680, transno 21474841317 00000004:00080000:0.0:1746155630.947724:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc7100, transno 21474841318 00000004:00080000:0.0:1746155630.947726:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f700700, transno 21474841319 00000004:00080000:0.0:1746155630.947729:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc5c00, transno 21474841320 00000004:00080000:0.0:1746155630.947731:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc7480, transno 21474841321 00000004:00080000:0.0:1746155630.947733:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0b0a80, transno 21474841322 00000004:00080000:0.0:1746155630.947735:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0b2300, transno 21474841323 00000004:00080000:0.0:1746155630.947737:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe91880, transno 21474841324 00000004:00080000:0.0:1746155630.947739:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800943e8a80, transno 21474841325 00000004:00080000:0.0:1746155630.947742:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe93480, transno 21474841326 00000004:00080000:0.0:1746155630.947743:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800943eb100, transno 21474841327 00000004:00080000:0.0:1746155630.947745:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800943eaa00, transno 21474841328 00000004:00080000:0.0:1746155630.947747:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800943ead80, transno 21474841329 00000004:00080000:0.0:1746155630.947748:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800943eb480, transno 21474841330 00000004:00080000:0.0:1746155630.947750:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800943ea300, transno 21474841331 00000004:00080000:0.0:1746155630.947751:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb6b480, transno 21474841332 00000004:00080000:0.0:1746155630.947753:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb68a80, transno 21474841333 00000004:00080000:0.0:1746155630.947755:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb6b800, transno 21474841334 00000004:00080000:0.0:1746155630.947756:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb68e00, transno 21474841335 00000004:00080000:0.0:1746155630.947758:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb6ad80, transno 21474841336 00000004:00080000:0.0:1746155630.947759:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb68380, transno 21474841337 00000004:00080000:0.0:1746155630.947761:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb69180, transno 21474841338 00000004:00080000:0.0:1746155630.947763:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb6bb80, transno 21474841339 00000100:00100000:0.0:1746155630.947768:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125200256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746155630.951572:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.951709:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125571328 00000100:00100000:0.0:1746155630.951712:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125571328 00002000:00100000:0.0:1746155630.951728:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009f0dbb80 x1830976125571328/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:701/0 lens 488/0 e 0 to 0 dl 1746155641 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155630.951736:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0dbb80 with x1830976125571328 ext(1048576->2097151) 00002000:00010000:0.0:1746155630.951739:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0dbb80 00000100:00100000:0.0:1746155630.951767:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7529 00000100:00100000:0.0:1746155630.951773:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1962:x1830976125571328:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155630.952269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.964469:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.964800:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1962:x1830976125571072:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13039us (13162us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155630.964808:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7528 00002000:00100000:0.0:1746155630.964816:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f0db100 x1830976125571072/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:701/0 lens 488/440 e 0 to 0 dl 1746155641 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155630.964825:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0db100 with x1830976125571072 ext(1048576->2097151) 00002000:00010000:0.0:1746155630.964829:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0db100 00000100:00100000:0.0:1746155630.964841:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125571840 00000100:00100000:0.0:1746155630.964845:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125571840 00002000:00100000:0.0:1746155630.964879:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e3:0x0] (1212416->1904639) req@ffff88009f778700 x1830976125571840/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:701/0 lens 488/0 e 0 to 0 dl 1746155641 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155630.964886:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f778700 with x1830976125571840 ext(1212416->1904639) 00010000:00010000:0.0:1746155630.964892:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801315c5000/0x844e5faceb5f549f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a7e expref: 29 pid: 8438 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155630.964907:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801315c5000/0x844e5faceb5f549f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1212416->1904639) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a7e expref: 29 pid: 8438 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746155630.964918:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f778700 00000100:00100000:0.0:1746155630.964932:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1260 00000100:00100000:0.0:1746155630.964938:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f778700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976125571840:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155630.984583:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.987961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.987997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155630.998771:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155631.000181:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f00200/0x844e5faceb5f53fe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a15 expref: 30 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155631.000193:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f00200/0x844e5faceb5f53fe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a15 expref: 30 pid: 20200 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746155631.000203:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125200896:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155631.003553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.003579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155631.003628:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155631.007708:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.007747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.009348:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125573888 00000100:00100000:0.0:1746155631.009357:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125573888 00002000:00100000:0.0:1746155631.009377:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8801312f7480 x1830976125573888/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:702/0 lens 504/0 e 0 to 0 dl 1746155642 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.009386:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312f7480 with x1830976125573888 ext(3145728->4194303) 00002000:00010000:0.0:1746155631.009390:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801312f7480 00000100:00100000:0.0:1746155631.009416:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7534 00000100:00100000:0.0:1746155631.009422:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1963:x1830976125573888:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155631.009780:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.009899:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125574400 00000100:00100000:0.0:1746155631.009902:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125574400 00002000:00100000:0.0:1746155631.009916:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e1:0x0] (372736->376831) req@ffff88009f779880 x1830976125574400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:702/0 lens 488/0 e 0 to 0 dl 1746155642 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.009923:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f779880 with x1830976125574400 ext(372736->376831) 00002000:00010000:0.0:1746155631.009926:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f779880 00000100:00100000:0.0:1746155631.009936:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125574144 00000100:00100000:0.0:1746155631.009938:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125574144 00002000:00100000:0.0:1746155631.009949:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8801312f6d80 x1830976125574144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:702/0 lens 488/0 e 0 to 0 dl 1746155642 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.009956:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312f6d80 with x1830976125574144 ext(2097152->3145727) 00002000:00010000:0.0:1746155631.009958:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312f6d80 00000100:00100000:0.0:1746155631.009968:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7535 00000100:00100000:0.0:1746155631.009973:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1960:x1830976125574400:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155631.010053:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1960:x1830976125574400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 78us (273us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155631.010058:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7535 00002000:00100000:0.0:1746155631.010063:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e1:0x0] (372736->376831) req@ffff88009f779880 x1830976125574400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:702/0 lens 488/4536 e 0 to 0 dl 1746155642 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.010070:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f779880 with x1830976125574400 ext(372736->376831) 00002000:00010000:0.0:1746155631.010073:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f779880 00000100:00100000:0.0:1746155631.010083:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7536 00000100:00100000:0.0:1746155631.010088:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976125574144:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155631.014558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.022728:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.030160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.030189:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.030211:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125575040 00000100:00100000:0.0:1746155631.030472:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125575040 00010000:00010000:0.0:1746155631.030486:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a887200/0x844e5faceb5f540c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a1c expref: 26 pid: 19959 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746155631.030525:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8165 00000100:00100000:0.0:1746155631.030590:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f778000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976125575040:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155631.030597:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155631.030605:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a887200/0x844e5faceb5f540c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a1c expref: 26 pid: 19959 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746155631.030613:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a887200/0x844e5faceb5f540c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a1c expref: 26 pid: 19959 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746155631.030623:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a887200/0x844e5faceb5f540c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a1c expref: 26 pid: 19959 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746155631.030667:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155631.030682:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f778000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976125575040:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 151us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155631.030688:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8165 00000100:00100000:0.0:1746155631.030711:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.030722:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125574912 00000100:00100000:0.0:1746155631.030725:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125574912 00010000:00010000:0.0:1746155631.030734:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012df44c00/0x844e5faceb5f5460 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a4d expref: 9 pid: 4461 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746155631.030757:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8166 00000100:00100000:0.0:1746155631.030762:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f778380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125574912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155631.030768:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155631.030775:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df44c00/0x844e5faceb5f5460 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a4d expref: 9 pid: 4461 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746155631.030782:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df44c00/0x844e5faceb5f5460 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a4d expref: 9 pid: 4461 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746155631.030792:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df44c00/0x844e5faceb5f5460 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16a4d expref: 9 pid: 4461 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746155631.030799:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155631.030801:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155631.030889:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a095ce00/0x844e5faceb5f54fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16abd expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.030897:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a095ce00/0x844e5faceb5f54fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16abd expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.030922:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a095ce00/0x844e5faceb5f54fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16abd expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155631.030932:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f779180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125201920:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155631.031064:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155631.034664:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.038820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.048156:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.048201:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.050377:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.050396:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125576448 00000100:00100000:0.0:1746155631.050399:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125576448 00002000:00100000:0.0:1746155631.050417:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f778e00 x1830976125576448/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:702/0 lens 488/0 e 0 to 0 dl 1746155642 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.050425:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f778e00 with x1830976125576448 ext(2097152->3145727) 00002000:00010000:0.0:1746155631.050429:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f778e00 00000100:00100000:0.0:1746155631.050438:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7540 00000100:00100000:0.0:1746155631.050443:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1963:x1830976125576448:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155631.056548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.061455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.062898:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f779f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1962:x1830976125575936:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13709us (14745us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155631.062906:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7538 00002000:00100000:0.0:1746155631.062913:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f779f80 x1830976125575936/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:702/0 lens 488/440 e 0 to 0 dl 1746155642 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.062921:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f779f80 with x1830976125575936 ext(2097152->3145727) 00002000:00010000:0.0:1746155631.062925:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f779f80 00000100:00100000:0.0:1746155631.068584:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.076247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.082119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.082766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.084213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.092709:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.094243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.094272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.097398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.097424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.097453:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.104495:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.108734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.117717:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.328691:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.328738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.328929:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7546 00000100:00100000:0.0:1746155631.328937:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1960:x1830976125579776:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155631.355660:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.357333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.357368:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.362184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.362221:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125580544 00000100:00100000:0.0:1746155631.362229:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125580544 00002000:00100000:0.0:1746155631.362266:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1298431) req@ffff880095269c00 x1830976125580544/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:702/0 lens 488/0 e 0 to 0 dl 1746155642 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.362274:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269c00 with x1830976125580544 ext(1048576->1298431) 00010000:00010000:0.0:1746155631.362287:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f53ea00/0x844e5faceb5f5532 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16af5 expref: 28 pid: 19959 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.362299:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f53ea00/0x844e5faceb5f5532 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16af5 expref: 28 pid: 19959 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746155631.362305:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095269c00 00000100:00100000:0.0:1746155631.362322:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1264 00000100:00100000:0.0:1746155631.362329:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125580544:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155631.364692:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.366478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.369107:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1961:x1830976125580544:12345-192.168.202.51@tcp:4:cat.0 Request processed in 6771us (6924us total) trans 21474841359 rc 0/0 00000100:00100000:0.0:1746155631.369117:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1264 00002000:00100000:0.0:1746155631.369126:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1298431) req@ffff880095269c00 x1830976125580544/t21474841359(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:702/0 lens 488/448 e 0 to 0 dl 1746155642 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.369134:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269c00 with x1830976125580544 ext(1048576->1298431) 00010000:00010000:0.0:1746155631.369140:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f53ea00/0x844e5faceb5f5532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16af5 expref: 29 pid: 19959 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.369151:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f53ea00/0x844e5faceb5f5532 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1298431) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16af5 expref: 29 pid: 19959 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746155631.369157:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880095269c00 00000100:00100000:0.0:1746155631.370107:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125580928 00000100:00100000:0.0:1746155631.370112:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125580928 00002000:00100000:0.0:1746155631.370133:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e1:0x0] (622592->1048575) req@ffff8801312f4a80 x1830976125580928/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:702/0 lens 488/0 e 0 to 0 dl 1746155642 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.370140:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312f4a80 with x1830976125580928 ext(622592->1048575) 00010000:00010000:0.0:1746155631.370145:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800949dd200/0x844e5faceb5f5508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16acb expref: 30 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.370152:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800949dd200/0x844e5faceb5f5508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16acb expref: 30 pid: 8437 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746155631.370157:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312f4a80 00000100:00100000:0.0:1746155631.370411:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1265 00000100:00100000:0.0:1746155631.370417:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1960:x1830976125580928:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155631.374603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.375997:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125580928:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5579us (6065us total) trans 17179874021 rc 0/0 00000100:00100000:0.0:1746155631.376005:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1265 00002000:00100000:0.0:1746155631.376024:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e1:0x0] (622592->1048575) req@ffff8801312f4a80 x1830976125580928/t17179874021(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:702/0 lens 488/448 e 0 to 0 dl 1746155642 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.376032:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312f4a80 with x1830976125580928 ext(622592->1048575) 00010000:00010000:0.0:1746155631.376039:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800949dd200/0x844e5faceb5f5508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16acb expref: 32 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.376048:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800949dd200/0x844e5faceb5f5508 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 622592->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16acb expref: 32 pid: 8437 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746155631.376054:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801312f4a80 00000100:00100000:0.0:1746155631.377416:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.379793:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.386381:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.387543:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.388363:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.388576:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7548 00000100:00100000:0.0:1746155631.388581:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976125582080:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155631.399230:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976125582080:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10648us (10867us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155631.399237:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7548 00002000:00100000:0.0:1746155631.399242:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009526b800 x1830976125582080/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:702/0 lens 488/440 e 0 to 0 dl 1746155642 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.399334:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526b800 with x1830976125582080 ext(0->1048575) 00002000:00010000:0.0:1746155631.399338:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009526b800 00000100:00100000:0.0:1746155631.405057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.405579:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.409151:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125583360 00000100:00100000:0.0:1746155631.409156:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125583360 00002000:00100000:0.0:1746155631.409187:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8801312f7100 x1830976125583360/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:702/0 lens 488/0 e 0 to 0 dl 1746155642 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.409201:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312f7100 with x1830976125583360 ext(1048576->2097151) 00010000:00010000:0.0:1746155631.409209:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2af400/0x844e5faceb5f5563 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16b26 expref: 28 pid: 29728 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.409224:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2af400/0x844e5faceb5f5563 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16b26 expref: 28 pid: 29728 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746155631.409231:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801312f7100 00000100:00100000:0.0:1746155631.409251:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1268 00000100:00100000:0.0:1746155631.409258:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125583360:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155631.420872:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.420923:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.423742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.423827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.423956:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.426274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.426310:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.428269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.428300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.428362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.429892:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.431788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.431821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.431846:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.431895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.433759:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1962:x1830976125584896:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 5092us (5394us total) trans 21474841362 rc 0/0 00000100:00100000:0.0:1746155631.433767:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1271 00002000:00100000:0.0:1746155631.433774:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e0:0x0] (1712128->2097151) req@ffff88009a6da300 x1830976125584896/t21474841362(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:702/0 lens 488/448 e 0 to 0 dl 1746155642 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.433782:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6da300 with x1830976125584896 ext(1712128->2097151) 00010000:00010000:0.0:1746155631.433788:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f2a1e00/0x844e5faceb5f5578 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16b3b expref: 31 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.433849:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f2a1e00/0x844e5faceb5f5578 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1712128->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16b3b expref: 31 pid: 8437 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746155631.433856:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6da300 00000100:00100000:0.0:1746155631.434864:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.434908:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.435030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.437212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.438358:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.442237:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1960:x1830976125586048:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7178us (7325us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155631.442246:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1272 00002000:00100000:0.0:1746155631.442255:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009a6db100 x1830976125586048/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:702/0 lens 488/440 e 0 to 0 dl 1746155642 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.442264:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6db100 with x1830976125586048 ext(1048576->2097151) 00010000:00010000:0.0:1746155631.442271:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f3c1c00/0x844e5faceb5f5586 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16b49 expref: 30 pid: 29728 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.442284:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f3c1c00/0x844e5faceb5f5586 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16b49 expref: 30 pid: 29728 timeout: 860 lvb_type: 0 00002000:00010000:0.0:1746155631.442290:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6db100 00000100:00100000:0.0:1746155631.443117:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.445616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.447927:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.449378:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.449448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.449522:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.451487:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.451797:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.451810:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.453086:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 15988 00000100:00100000:0.0:1746155631.453092:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976125588096:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155631.453098:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155631.453103:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c19600/0x844e5faceb5f5612 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16bb2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155631.453419:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125207296:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155631.453474:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155631.453516:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.456387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.456427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.456449:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.460307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.460335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.460347:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.470521:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.470965:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.471032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.471046:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125590400 00000100:00100000:0.0:1746155631.471048:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125590400 00010000:00010000:0.0:1746155631.471062:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092872a00/0x844e5faceb5f55b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16b5e expref: 11 pid: 29728 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746155631.471078:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8186 00000100:00100000:0.0:1746155631.471083:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125590400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155631.471091:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155631.471103:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092872a00/0x844e5faceb5f55b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16b5e expref: 11 pid: 29728 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746155631.471111:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092872a00/0x844e5faceb5f55b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16b5e expref: 11 pid: 29728 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746155631.471124:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092872a00/0x844e5faceb5f55b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16b5e expref: 11 pid: 29728 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746155631.471138:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155631.471165:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125590400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 81us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155631.471170:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8186 00000100:00100000:0.0:1746155631.471200:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.471211:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125590912 00000100:00100000:0.0:1746155631.471214:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125590912 00010000:00010000:0.0:1746155631.471223:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801315c4200/0x844e5faceb5f54e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16aa8 expref: 32 pid: 8437 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746155631.471236:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8187 00000100:00100000:0.0:1746155631.471240:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1963:x1830976125590912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155631.471247:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155631.471256:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801315c4200/0x844e5faceb5f54e5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16aa8 expref: 32 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.471263:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801315c4200/0x844e5faceb5f54e5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16aa8 expref: 32 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.471999:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801315c4200/0x844e5faceb5f54e5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16aa8 expref: 33 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.472711:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155631.472727:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1963:x1830976125590912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1485us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155631.472737:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8187 00000100:00100000:0.0:1746155631.472759:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8197 00000100:00100000:0.0:1746155631.472764:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976125592448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155631.472771:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155631.472781:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a095c800/0x844e5faceb5f5501 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ac4 expref: 37 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.472790:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a095c800/0x844e5faceb5f5501 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ac4 expref: 37 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.472802:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a095c800/0x844e5faceb5f5501 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ac4 expref: 36 pid: 8437 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.472810:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155631.472821:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976125592448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 57us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155631.472826:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8197 00000100:00100000:0.0:1746155631.478569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.483052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.485181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.485919:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.488115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.491284:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.491396:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.491851:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.491868:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125594240 00000100:00100000:0.0:1746155631.491870:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125594240 00000100:00100000:0.0:1746155631.491889:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4583 00000100:00100000:0.0:1746155631.491894:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+39:27129:x1830976125594240:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746155631.492250:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+38:27129:x1830976125594240:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 354us (398us total) trans 8589945018 rc 0/0 00000100:00100000:0.0:1746155631.492256:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4583 00000100:00100000:0.0:1746155631.492329:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.492351:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.492365:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.493133:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8205 00000100:00100000:0.0:1746155631.493142:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+312:1961:x1830976125594496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155631.493148:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155631.493151:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f482e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f161d3 expref: 312 pid: 27374 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.493298:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f482e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f161d3 expref: 310 pid: 27374 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.493309:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f482e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f161d3 expref: 310 pid: 27374 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.493318:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155631.493321:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092872000/0x844e5faceb5f5689 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155631.493326:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155631.493355:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+309:1961:x1830976125594496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 215us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155631.493360:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8205 00000100:00100000:0.0:1746155631.494214:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.499797:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125594880 00000100:00100000:0.0:1746155631.499807:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125594880 00000100:00100000:0.0:1746155631.499863:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10903 00000100:00100000:0.0:1746155631.500104:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+309:31886:x1830976125594880:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155631.500125:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155631.500142:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f519c00/0x844e5faceb5f5690 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16bea expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.500190:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872000/0x844e5faceb5f5689 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155631.500199:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f519c00/0x844e5faceb5f5690 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bea expref: 310 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.500214:0:19870:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880092872000/0x844e5faceb5f5689 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155631.500225:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f519c00/0x844e5faceb5f5690 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bea expref: 310 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.500235:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155631.500238:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155631.500240:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f519c00/0x844e5faceb5f5690 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bea expref: 310 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.500245:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f519c00, rc 0) 00000100:00100000:0.0:1746155631.500284:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+310:31886:x1830976125594880:12345-192.168.202.51@tcp:101:cat.0 Request processed in 414us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155631.500303:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10903 00010000:00010000:0.0:1746155631.520233:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.520245:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebaea00/0x844e5faceb5f5627 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bb9 expref: 30 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.520256:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.520283:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebaea00/0x844e5faceb5f5627 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bb9 expref: 27 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.520293:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebaea00/0x844e5faceb5f5627 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bb9 expref: 24 pid: 14234 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746155631.520303:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125210496:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155631.521432:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fbeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155631.521444:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125211008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155631.521460:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155631.521473:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125211520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155631.521483:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155631.521491:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125212160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155631.521514:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155631.521523:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125212672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155631.521534:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155631.521600:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125212416 00000100:00100000:0.0:1746155631.521603:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125212416 00000004:00080000:0.0:1746155631.522749:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0d9500/2, rc 0, transno 17179874027 00000100:00100000:0.0:1746155631.522753:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125211008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155631.523081:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526b100/2, rc 0, transno 17179874028 00000100:00100000:0.0:1746155631.523086:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125211520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155631.523097:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312f6300/2, rc 0, transno 21474841366 00000100:00100000:0.0:1746155631.523100:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125212160:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155631.523106:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312f7800/2, rc 0, transno 21474841367 00000100:00100000:0.0:1746155631.523108:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125212672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155631.523768:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.523916:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125210496:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155631.523929:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155631.524454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.524523:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125595520 00000100:00100000:0.0:1746155631.524526:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125595520 00010000:00010000:0.0:1746155631.524540:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebaea00/0x844e5faceb5f5627 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bb9 expref: 8 pid: 14234 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746155631.524570:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8207 00000100:00100000:0.0:1746155631.524575:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125595520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155631.524582:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155631.524586:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebaea00/0x844e5faceb5f5627 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bb9 expref: 8 pid: 14234 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.524595:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebaea00/0x844e5faceb5f5627 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bb9 expref: 8 pid: 14234 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.524609:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ebaea00/0x844e5faceb5f5627 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bb9 expref: 8 pid: 14234 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.524621:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155631.524625:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524632:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524637:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524650:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155631.524666:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125595520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 91us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155631.524671:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8207 00010000:00010000:0.0:1746155631.524703:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524709:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155631.524719:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155631.524814:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524821:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524826:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524830:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f53f800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155631.524833:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524839:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524846:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155631.524848:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155631.524850:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 2/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524855:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f53f800/0x844e5faceb5f56ac lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524865:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64de00/0x844e5faceb5f569e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524869:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64de00/0x844e5faceb5f569e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524873:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64de00/0x844e5faceb5f569e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524877:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c64de00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155631.524879:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64de00/0x844e5faceb5f569e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524883:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64de00/0x844e5faceb5f569e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524889:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155631.524891:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155631.524893:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64de00/0x844e5faceb5f569e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524901:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64de00/0x844e5faceb5f569e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524907:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d200/0x844e5faceb5f56a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524912:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d200/0x844e5faceb5f56a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524916:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d200/0x844e5faceb5f56a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524920:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c64d200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155631.524922:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d200/0x844e5faceb5f56a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524926:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d200/0x844e5faceb5f56a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524931:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0a00) 00010000:00010000:0.0:1746155631.524933:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155631.524935:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d200/0x844e5faceb5f56a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524939:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d200/0x844e5faceb5f56a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.524968:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64dc00/0x844e5faceb5f5697 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bf1 expref: 289 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.524981:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64dc00/0x844e5faceb5f5697 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bf1 expref: 289 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.524992:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c64dc00, rc 0) 00000100:00100000:0.0:1746155631.525022:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:31892:x1830976125595136:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6919us (7001us total) trans 8589945020 rc 301/301 00000100:00100000:0.0:1746155631.525028:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10904 00000100:00100000:0.0:1746155631.525383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.528379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.528872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.533869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.545458:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.554647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.554680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.554718:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.584339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.585092:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.591247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.594738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.598965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.598997:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125598336 00000100:00100000:0.0:1746155631.599004:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125598336 00010000:00010000:0.0:1746155631.599044:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f56b3 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bf8 expref: 9 pid: 14234 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746155631.599075:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8208 00000100:00100000:0.0:1746155631.599081:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125598336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155631.599091:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155631.599098:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f56b3 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bf8 expref: 9 pid: 14234 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.599107:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f56b3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bf8 expref: 9 pid: 14234 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.599124:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155631.599128:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5f56eb lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.599139:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5f56eb lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.599145:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5f56eb lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155631.599157:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155631.599188:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125598336:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 107us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155631.599194:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8208 00000100:00100000:0.0:1746155631.605184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.622660:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125213440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155631.622799:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155631.622821:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125213952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155631.622839:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155631.622849:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125214464:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155631.622860:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155631.622875:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125214976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155631.622887:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155631.622897:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746155631.622901:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125213312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155631.622913:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155631.622921:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125213824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155631.622931:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155631.622939:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125214336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155631.622949:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155631.622954:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125214848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155631.622964:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155631.623209:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16024 00000100:00100000:0.0:1746155631.623214:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3296:x1830976125213184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155631.623267:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16025 00000100:00100000:0.0:1746155631.623271:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3298:x1830976125213952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155631.623347:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:0.0:1746155631.623349:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155631.623351:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155631.623353:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155631.623354:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155631.623376:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3298:x1830976125213952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (536us total) trans 21474841372 rc 0/0 00000100:00100000:0.0:1746155631.623382:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16025 00000100:00100000:0.0:1746155631.623393:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16026 00000100:00100000:0.0:1746155631.623397:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3296:x1830976125213056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155631.623848:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16032 00000100:00100000:0.0:1746155631.623853:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3298:x1830976125214848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155631.623863:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16033 00000100:00100000:0.0:1746155631.623867:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3295:x1830976125213568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155631.624242:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746155631.624244:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155631 -> 1746155631 00002000:00010000:0.0:1746155631.624246:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155631 -> 1746155631 00002000:00010000:0.0:1746155631.624247:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155631 -> 1746155631 00002000:00010000:0.0:1746155631.624249:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:0.0:1746155631.624412:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976125213184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1198us (1595us total) trans 17179874033 rc 0/0 00000100:00100000:0.0:1746155631.624417:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16024 00000004:00080000:0.0:1746155631.624529:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca95180/2, rc 0, transno 17179874032 00000100:00100000:0.0:1746155631.624536:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125214976:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155631.624544:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca97480/2, rc 0, transno 17179874031 00000100:00100000:0.0:1746155631.624547:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125213440:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155631.624553:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ef480/2, rc 0, transno 21474841372 00000100:00100000:0.0:1746155631.624556:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125213952:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155631.624587:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ec380/2, rc 0, transno 21474841374 00000100:00100000:0.0:1746155631.624589:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125214464:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155631.624654:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155631.624656:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155631 -> 1746155631 00002000:00010000:0.0:1746155631.624658:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155631 -> 1746155631 00002000:00010000:0.0:1746155631.624659:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155631 -> 1746155631 00002000:00010000:0.0:1746155631.624661:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155631.624681:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976125213056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1283us (1835us total) trans 21474841376 rc 0/0 00000100:00100000:0.0:1746155631.624685:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16026 00002000:00010000:0.0:1746155631.625251:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155631.625253:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155631 -> 1746155631 00002000:00010000:0.0:1746155631.625255:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155630 -> 1746155630 00002000:00010000:0.0:1746155631.625256:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155631 -> 1746155631 00002000:00010000:0.0:1746155631.625258:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155631.625276:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976125213568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1409us (2244us total) trans 21474841377 rc 0/0 00000100:00100000:0.0:1746155631.625280:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16033 00000100:00100000:0.0:1746155631.625288:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125213696 00000100:00100000:0.0:1746155631.625290:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125213696 00000004:00080000:0.0:1746155631.625670:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac7b80/2, rc 0, transno 21474841378 00000100:00100000:0.0:1746155631.625673:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125213312:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155631.625678:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ee300/2, rc 0, transno 21474841375 00000100:00100000:0.0:1746155631.625680:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125213824:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155631.625685:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca94e00/2, rc 0, transno 17179874034 00000100:00100000:0.0:1746155631.625687:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125214336:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155631.625691:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca96a00/2, rc 0, transno 17179874036 00000100:00100000:0.0:1746155631.625693:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125214848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155631.626362:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.636846:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.641932:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.643969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.644324:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8209 00000100:00100000:0.0:1746155631.644331:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1962:x1830976125599104:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155631.644342:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155631.644361:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3c1c00/0x844e5faceb5f56c1 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bff expref: 40 pid: 29728 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.644371:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3c1c00/0x844e5faceb5f56c1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16bff expref: 40 pid: 29728 timeout: 860 lvb_type: 0 00010000:00010000:0.0:1746155631.644387:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155631.644390:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155631.644395:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a887200/0x844e5faceb5f56f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2146304->2809855) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c30 expref: 40 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.644401:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a887200/0x844e5faceb5f56f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2146304->2809855) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c30 expref: 40 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.644423:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a887200/0x844e5faceb5f56f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2146304->2809855) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c30 expref: 40 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155631.644433:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125215488:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155631.644492:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fbeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155631.646417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.650538:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.652428:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.677897:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.695772:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.699779:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16043 00000100:00100000:0.0:1746155631.699786:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976125600896:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155631.699792:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155631.699798:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131459600/0x844e5faceb5f5746 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16c5a expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.699807:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155631.699808:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155631.699813:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131459600/0x844e5faceb5f5746 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c5a expref: 31 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155631.699821:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131459600/0x844e5faceb5f5746 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c5a expref: 31 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155631.699827:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131459600, rc 0) 00000100:00100000:0.0:1746155631.699851:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976125600896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 66us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155631.699856:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16043 00000100:00100000:0.0:1746155631.700193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.700218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.700244:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.719708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.720787:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.720813:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.721554:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.748107:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.749455:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.751976:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.752047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.752475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.752486:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125602816 00000100:00100000:0.0:1746155631.752489:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125602816 00000100:00100000:0.0:1746155631.752811:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.752825:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.752844:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.752864:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.754784:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.759456:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125603840 00000100:00100000:0.0:1746155631.759459:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125603840 00010000:00010000:0.0:1746155631.759472:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c64dc00/0x844e5faceb5f573f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c4c expref: 33 pid: 8437 timeout: 860 lvb_type: 1 00000100:00100000:0.0:1746155631.759487:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8212 00000100:00100000:0.0:1746155631.759491:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d759050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1960:x1830976125603840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155631.759497:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155631.759522:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c64dc00/0x844e5faceb5f573f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c4c expref: 33 pid: 8437 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746155631.759530:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c64dc00/0x844e5faceb5f573f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c4c expref: 33 pid: 8437 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746155631.759542:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c64dc00/0x844e5faceb5f573f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c4c expref: 33 pid: 8437 timeout: 860 lvb_type: 1 00010000:00010000:0.0:1746155631.759552:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155631.759554:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155631.759559:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a886c00/0x844e5faceb5f57af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1462272->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ca7 expref: 32 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.759566:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886c00/0x844e5faceb5f57af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1462272->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ca7 expref: 32 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.759588:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a886c00/0x844e5faceb5f57af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1462272->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ca7 expref: 32 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155631.759598:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc53800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125216384:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155631.759634:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fbe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155631.760306:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125604096 00000100:00100000:0.0:1746155631.760310:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125604096 00000100:00100000:0.0:1746155631.760330:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10911 00000100:00100000:0.0:1746155631.760334:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:31901:x1830976125604096:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155631.760346:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155631.760357:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19000/0x844e5faceb5f57b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16cae expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.760884:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f57bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.760895:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6a00/0x844e5faceb5f5715 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c37 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.760902:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f519e00/0x844e5faceb5f5777 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c6f expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.760907:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f57bd lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.760924:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f519e00/0x844e5faceb5f5777 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c6f expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.760932:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f519e00/0x844e5faceb5f5777 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c6f expref: 8 pid: 19870 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746155631.760940:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc52a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125216512:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155631.761517:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6a00/0x844e5faceb5f5715 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c37 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.761525:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e6a00/0x844e5faceb5f5715 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c37 expref: 9 pid: 15474 timeout: 860 lvb_type: 0 00000100:00100000:0.0:1746155631.761533:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125216640:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155631.762084:0:19870:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fbe480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155631.763801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.763858:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.767566:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125605120 00000100:00100000:0.0:1746155631.767569:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125605120 00000100:00100000:0.0:1746155631.767591:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10912 00000100:00100000:0.0:1746155631.767596:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:31901:x1830976125605120:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155631.767658:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155631.767660:0:19870:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746155631.767675:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f57bd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16cae expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.767699:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155631.767702:0:19870:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155631.767708:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f57d2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16cbc expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.767767:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f57d9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.767776:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f57d9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.767783:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f57d9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.767791:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f57d9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.767796:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f57d9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.767801:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f57d9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.767805:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c18800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155631.767809:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f57d9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.767814:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f57d9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.768018:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155631.768021:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155631.768024:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f57d9 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.768029:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f57d9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.768048:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f57d2 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16cbc expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.768055:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f57d2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16cbc expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.768061:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c19600, rc 0) 00000100:00100000:0.0:1746155631.768081:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:31901:x1830976125605120:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 485us (578us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155631.768092:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10912 00000100:00100000:0.0:1746155631.770464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.770484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.770551:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.772380:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.772407:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.772431:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.772468:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.773426:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7568 00000100:00100000:0.0:1746155631.773433:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1960:x1830976125606272:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155631.784053:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.786145:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1960:x1830976125606272:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12710us (13711us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155631.786156:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7568 00002000:00100000:0.0:1746155631.786163:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009fac7800 x1830976125606272/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:702/0 lens 488/440 e 0 to 0 dl 1746155642 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.786171:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7800 with x1830976125606272 ext(2097152->3145727) 00002000:00010000:0.0:1746155631.786176:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fac7800 00000100:00100000:0.0:1746155631.799311:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.854560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.863955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.863986:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.864074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.873904:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.874654:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1830976125217920:0@lo:400:kworker.0 00000100:00100000:0.0:1746155631.874860:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155631.874938:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125217792 00000100:00100000:0.0:1746155631.874942:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125217792 00000100:00100000:0.0:1746155631.874972:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125217920 00000100:00100000:0.0:1746155631.874974:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125217920 00000100:00100000:0.0:1746155631.874988:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1746155631.874993:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830976125217792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746155631.875032:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830976125217792:12345-0@lo:400:kworker.0 Request processed in 38us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155631.876187:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1746155631.876215:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1830976125217920:0@lo:400:kworker.0 00000100:00100000:0.0:1746155631.881363:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.889469:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.891963:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.904063:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.907880:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125609728 00000100:00100000:0.0:1746155631.907886:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125609728 00000100:00100000:0.0:1746155631.907919:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10915 00000100:00100000:0.0:1746155631.907924:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:31911:x1830976125609728:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155631.907940:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155631.907951:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18400/0x844e5faceb5f5834 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16ced expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.908038:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19000/0x844e5faceb5f583b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908048:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19000/0x844e5faceb5f583b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908057:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19000/0x844e5faceb5f583b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908067:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5842 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908073:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5842 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908078:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5842 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908171:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f5849 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908178:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f5849 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908187:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f5849 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:0.0:1746155631.908194:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155631.908260:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19000/0x844e5faceb5f583b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908266:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19000/0x844e5faceb5f583b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908270:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19000/0x844e5faceb5f583b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908274:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c19000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155631.908277:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19000/0x844e5faceb5f583b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908282:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19000/0x844e5faceb5f583b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908290:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155631.908293:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155631.908296:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19000/0x844e5faceb5f583b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908304:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19000/0x844e5faceb5f583b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908326:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5842 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908331:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5842 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908338:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5842 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908342:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c19600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155631.908344:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5842 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908348:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5842 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908354:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ae84f00) 00010000:00010000:0.0:1746155631.908359:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155631.908361:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5842 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908365:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5842 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155631.908393:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18400/0x844e5faceb5f5834 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ced expref: 13 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.908402:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f5849 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ced expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.908406:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155631.908407:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155631.908409:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c18800, rc 0) 00000100:00100000:0.0:1746155631.908443:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:31911:x1830976125609728:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 518us (626us total) trans 8589945033 rc 0/0 00000100:00100000:0.0:1746155631.908448:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10915 00000100:00100000:0.0:1746155631.909626:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.926705:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.929730:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.930164:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.936380:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125610880 00000100:00100000:0.0:1746155631.936390:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125610880 00000100:00100000:0.0:1746155631.947792:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.947824:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.947851:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.947914:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8221 00000100:00100000:0.0:1746155631.947924:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125611264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155631.947933:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155631.947949:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800909e7600/0x844e5faceb5f57a8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ca0 expref: 7 pid: 4461 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746155631.948318:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800909e7600/0x844e5faceb5f57a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ca0 expref: 7 pid: 4461 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746155631.948337:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800909e7600/0x844e5faceb5f57a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ca0 expref: 7 pid: 4461 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746155631.948351:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155631.948368:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976125611264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 447us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155631.948374:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8221 00000100:00100000:0.0:1746155631.951381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.951835:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.951850:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125612032 00000100:00100000:0.0:1746155631.951853:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125612032 00002000:00100000:0.0:1746155631.951867:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2646016->2650111) req@ffff88012cdeed80 x1830976125612032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:702/0 lens 488/0 e 0 to 0 dl 1746155642 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.951874:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeed80 with x1830976125612032 ext(2646016->2650111) 00002000:00010000:0.0:1746155631.951877:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdeed80 00000100:00100000:0.0:1746155631.951887:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7574 00000100:00100000:0.0:1746155631.951891:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976125612032:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155631.951960:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976125612032:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 68us (125us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155631.951965:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7574 00002000:00100000:0.0:1746155631.951969:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2646016->2650111) req@ffff88012cdeed80 x1830976125612032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:702/0 lens 488/4536 e 0 to 0 dl 1746155642 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155631.951976:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeed80 with x1830976125612032 ext(2646016->2650111) 00002000:00010000:0.0:1746155631.951978:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdeed80 00000100:00100000:0.0:1746155631.959420:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.959771:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16063 00000100:00100000:0.0:1746155631.959789:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:31909:x1830976125612288:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155631.959801:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155631.959811:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093c19200/0x844e5faceb5f588f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16d10 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.959826:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800909e6e00/0x844e5faceb5f577e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c76 expref: 31 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.959837:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f53f400/0x844e5faceb5f5803 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16cd8 expref: 41 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155631.959842:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155631.959843:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155631.959846:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c19200/0x844e5faceb5f588f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->3207167] (req 3145728->3207167) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d10 expref: 41 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.959860:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f53f400/0x844e5faceb5f5803 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16cd8 expref: 41 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155631.959869:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f53f400/0x844e5faceb5f5803 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16cd8 expref: 41 pid: 10591 timeout: 861 lvb_type: 1 00000100:00100000:0.0:1746155631.959878:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125219584:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155631.962103:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800909e6e00/0x844e5faceb5f577e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c76 expref: 31 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155631.962120:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800909e6e00/0x844e5faceb5f577e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c76 expref: 31 pid: 20200 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746155631.962134:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125219712:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155631.962179:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fbe480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155631.964895:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.968928:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.970334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.971076:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.971212:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.972313:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125219840:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155631.972326:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155631.972359:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976125612672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1912us (2025us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155631.972366:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8226 00000100:00100000:0.0:1746155631.975076:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.975121:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.989157:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.994871:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.998541:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.998573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.998634:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155631.999998:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7581 00000100:00100000:0.0:1746155632.000014:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976125614848:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155632.003938:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125615360 00000100:00100000:0.0:1746155632.003944:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125615360 00002000:00100000:0.0:1746155632.003983:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e0:0x0] (1478656->1482751) req@ffff8801312f5c00 x1830976125615360/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.003992:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312f5c00 with x1830976125615360 ext(1478656->1482751) 00002000:00010000:0.0:1746155632.003997:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312f5c00 00000100:00100000:0.0:1746155632.004022:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7583 00000100:00100000:0.0:1746155632.004028:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1960:x1830976125615360:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155632.004145:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1960:x1830976125615360:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 117us (278us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155632.004150:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7583 00002000:00100000:0.0:1746155632.004156:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e0:0x0] (1478656->1482751) req@ffff8801312f5c00 x1830976125615360/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/4536 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.004162:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801312f5c00 with x1830976125615360 ext(1478656->1482751) 00002000:00010000:0.0:1746155632.004165:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801312f5c00 00000100:00100000:0.0:1746155632.006960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.007057:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155632.007356:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155632.021816:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.024373:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.026439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.027246:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155632.027874:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155632.030164:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155632.030954:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155632.031897:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.038853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.043989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.044046:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.063459:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.063672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.067310:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.068822:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.069523:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.087401:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.095929:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.095980:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.098606:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125618816 00000100:00100000:0.0:1746155632.098614:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125618816 00002000:00100000:0.0:1746155632.098645:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800936f5c00 x1830976125618816/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.098654:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5c00 with x1830976125618816 ext(3145728->4194303) 00002000:00010000:0.0:1746155632.098658:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936f5c00 00000100:00100000:0.0:1746155632.098675:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7589 00000100:00100000:0.0:1746155632.098680:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125618816:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155632.113234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155632.116611:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155632.124516:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125619328 00000100:00100000:0.0:1746155632.124525:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125619328 00000100:00100000:0.0:1746155632.125331:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4594 00000100:00100000:0.0:1746155632.125352:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0dec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:31920:x1830976125619328:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155632.125697:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0dec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:31920:x1830976125619328:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 358us (1414us total) trans 8589945038 rc 0/0 00000100:00100000:0.0:1746155632.125703:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4594 00000100:00100000:0.0:1746155632.135282:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.145846:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.148190:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.151215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.155588:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.158861:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125620352 00000100:00100000:0.0:1746155632.158868:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125620352 00010000:00010000:0.0:1746155632.158893:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c64d000/0x844e5faceb5f5881 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d02 expref: 33 pid: 9235 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746155632.158926:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8232 00000100:00100000:0.0:1746155632.158932:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976125620352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155632.158942:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155632.158959:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c64d000/0x844e5faceb5f5881 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d02 expref: 33 pid: 9235 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.158970:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c64d000/0x844e5faceb5f5881 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d02 expref: 33 pid: 9235 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.158985:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c64d000/0x844e5faceb5f5881 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d02 expref: 33 pid: 9235 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.158999:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155632.159011:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155632.159016:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f00800/0x844e5faceb5f5929 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d72 expref: 35 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.159024:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f00800/0x844e5faceb5f5929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d72 expref: 35 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.159051:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094f00800/0x844e5faceb5f5929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d72 expref: 35 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155632.159062:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125222016:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155632.159128:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fbe480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155632.161351:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.164365:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.167854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.168585:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.168624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.169458:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8234 00000100:00100000:0.0:1746155632.169465:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1963:x1830976125620992:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155632.169473:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155632.169483:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131459600/0x844e5faceb5f5746 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c5a expref: 33 pid: 8438 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746155632.169589:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131459600/0x844e5faceb5f5746 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c5a expref: 33 pid: 8438 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746155632.169607:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131459600/0x844e5faceb5f5746 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c5a expref: 33 pid: 8438 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746155632.169619:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155632.169643:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1963:x1830976125620992:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 179us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155632.169649:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8234 00000100:00100000:0.0:1746155632.173492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.179966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.215484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.215589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.217124:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.223802:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.231185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.236543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.279360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.282471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.283300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.285723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.285749:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.298146:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.299615:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.299699:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.299736:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7595 00000100:00100000:0.0:1746155632.299742:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:1962:x1830976125624192:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155632.302259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.309425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.311188:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.311383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.315440:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125223808:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155632.315451:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c64d400/0x844e5faceb5f59a0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16db1 expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155632.315458:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c64d400/0x844e5faceb5f59a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16db1 expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155632.315465:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c64d400, rc 0) 00000100:00100000:0.0:1746155632.315479:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976125625344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3611us (4292us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155632.315483:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16082 00000100:00100000:0.0:1746155632.319763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.320248:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.320314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.323558:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.329309:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125626240 00000100:00100000:0.0:1746155632.329315:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125626240 00002000:00100000:0.0:1746155632.329342:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2568192->3145727) req@ffff8800936f5880 x1830976125626240/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.329350:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5880 with x1830976125626240 ext(2568192->3145727) 00010000:00010000:0.0:1746155632.329357:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f5937 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2568192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d80 expref: 41 pid: 9235 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.329367:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f5937 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2568192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d80 expref: 41 pid: 9235 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746155632.329373:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936f5880 00000100:00100000:0.0:1746155632.329623:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1282 00000100:00100000:0.0:1746155632.329630:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1961:x1830976125626240:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155632.333749:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.338189:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.339291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.343964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.359071:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.359117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.363446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.363480:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.363667:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1284 00000100:00100000:0.0:1746155632.363672:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+37:1962:x1830976125627392:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155632.369949:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.370745:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.378114:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125224960:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155632.378124:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155632.378414:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+38:1963:x1830976125627776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7044us (7669us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155632.378419:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8242 00000100:00100000:0.0:1746155632.388863:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.388895:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.388925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.390629:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7603 00000100:00100000:0.0:1746155632.390636:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1961:x1830976125628800:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155632.394406:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155632.399849:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155632.400494:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.405141:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.408132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.411551:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.412552:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.412971:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125629952 00000100:00100000:0.0:1746155632.412976:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125629952 00000100:00100000:0.0:1746155632.413008:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 724 00000100:00100000:0.0:1746155632.413014:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1961:x1830976125629952:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155632.413022:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155632.413033:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c2afe00/0x844e5faceb5f5a10 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16df7 expref: 21 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.413045:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155632.413048:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155632.414896:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976125629952:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1875us (2338us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155632.414905:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 724 00000100:00100000:0.0:1746155632.418418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.418453:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.418483:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.418529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.418541:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125630592 00000100:00100000:0.0:1746155632.418543:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125630592 00000100:00100000:0.0:1746155632.418864:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.420043:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125225472:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155632.420062:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131458800/0x844e5faceb5f5a25 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e0c expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155632.420070:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131458800/0x844e5faceb5f5a25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e0c expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155632.420212:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131458800, rc 0) 00000100:00100000:0.0:1746155632.420231:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125630336:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1635us (1777us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155632.420237:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16092 00000100:00100000:0.0:1746155632.420914:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.420947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.420976:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.421018:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155632.425419:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f519e00/0x844e5faceb5f59ed lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16de9 expref: 10 pid: 27374 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746155632.425437:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125225728:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155632.425447:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0000/0x844e5faceb5f5a5d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155632.425453:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0000/0x844e5faceb5f5a5d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155632.425457:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0000/0x844e5faceb5f5a5d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155632.425478:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155632.425615:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0e00/0x844e5faceb5f5a56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e36 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.425626:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0000/0x844e5faceb5f5a5d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e36 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.425632:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155632.425634:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155632.425636:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3c0000, rc 0) 00000100:00100000:0.0:1746155632.425668:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:31932:x1830976125631360:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3320us (3404us total) trans 8589945047 rc 0/0 00000100:00100000:0.0:1746155632.425674:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10923 00000100:00100000:0.0:1746155632.429765:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.431404:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.439378:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1960:x1830976125632128:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9500us (9608us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155632.439388:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7605 00002000:00100000:1.0:1746155632.439396:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880137120000 x1830976125632128/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/440 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.439403:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137120000 with x1830976125632128 ext(4194304->5083135) 00002000:00010000:1.0:1746155632.439407:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137120000 00000100:00100000:0.0:1746155632.441384:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.441419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.441454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.446055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.448491:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.450889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.453597:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.453671:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.453709:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.453723:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125634176 00000100:00100000:0.0:1746155632.453726:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125634176 00002000:00100000:0.0:1746155632.453741:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880137121880 x1830976125634176/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.453748:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121880 with x1830976125634176 ext(2097152->3145727) 00010000:00010000:0.0:1746155632.453754:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae000/0x844e5faceb5f5a80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e52 expref: 37 pid: 18270 timeout: 861 lvb_type: 1 00010000:00010000:0.0:1746155632.453762:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae000/0x844e5faceb5f5a80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e52 expref: 37 pid: 18270 timeout: 861 lvb_type: 1 00002000:00010000:0.0:1746155632.453767:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880137121880 00000100:00100000:0.0:1746155632.453784:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1286 00000100:00100000:0.0:1746155632.453789:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976125634176:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155632.454308:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.454321:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125634432 00000100:00100000:1.0:1746155632.454325:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125634432 00002000:00100000:1.0:1746155632.454340:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800936f5180 x1830976125634432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.454352:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5180 with x1830976125634432 ext(3145728->4194303) 00010000:00010000:1.0:1746155632.454356:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae000/0x844e5faceb5f5a80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e52 expref: 38 pid: 18270 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746155632.454364:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae000/0x844e5faceb5f5a80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e52 expref: 38 pid: 18270 timeout: 861 lvb_type: 1 00002000:00010000:1.0:1746155632.454370:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936f5180 00000100:00100000:1.0:1746155632.454382:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1287 00000100:00100000:1.0:1746155632.454387:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1960:x1830976125634432:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155632.457531:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.462936:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125634816 00000100:00100000:0.0:1746155632.462943:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125634816 00000100:00100000:0.0:1746155632.462976:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10926 00000100:00100000:0.0:1746155632.462983:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:31936:x1830976125634816:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155632.463009:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155632.463026:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a29c200/0x844e5faceb5f5aa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16e67 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.463115:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a29c000/0x844e5faceb5f5aaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463129:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a29c000/0x844e5faceb5f5aaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463138:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a29c000/0x844e5faceb5f5aaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463149:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a886c00/0x844e5faceb5f5ab1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463190:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a886c00/0x844e5faceb5f5ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463196:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a886c00/0x844e5faceb5f5ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463279:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887200/0x844e5faceb5f5ab8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463287:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887200/0x844e5faceb5f5ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463296:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887200/0x844e5faceb5f5ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:0.0:1746155632.463303:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155632.463368:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a29c000/0x844e5faceb5f5aaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463374:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a29c000/0x844e5faceb5f5aaa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463379:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a29c000/0x844e5faceb5f5aaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463384:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a29c000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155632.463387:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a29c000/0x844e5faceb5f5aaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463398:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a29c000/0x844e5faceb5f5aaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463407:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155632.463409:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155632.463413:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a29c000/0x844e5faceb5f5aaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463417:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a29c000/0x844e5faceb5f5aaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463440:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a886c00/0x844e5faceb5f5ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463445:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a886c00/0x844e5faceb5f5ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463452:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a886c00/0x844e5faceb5f5ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463456:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a886c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155632.463458:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a886c00/0x844e5faceb5f5ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463463:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a886c00/0x844e5faceb5f5ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463469:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800942dc400) 00010000:00010000:0.0:1746155632.463471:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155632.463472:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a886c00/0x844e5faceb5f5ab1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463476:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a886c00/0x844e5faceb5f5ab1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.463793:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a29c200/0x844e5faceb5f5aa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e67 expref: 301 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.463804:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887200/0x844e5faceb5f5ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e67 expref: 300 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.463810:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155632.463812:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155632.463814:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a887200, rc 0) 00000100:00100000:1.0:1746155632.463915:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:31936:x1830976125634816:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 931us (1489us total) trans 8589945049 rc 0/0 00000100:00100000:1.0:1746155632.463921:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10926 00000100:00100000:1.0:1746155632.464135:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976125634432:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9747us (9831us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155632.464142:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1287 00002000:00100000:1.0:1746155632.464147:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800936f5180 x1830976125634432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/440 e 0 to 0 dl 1746155643 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.464154:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5180 with x1830976125634432 ext(3145728->4194303) 00010000:00010000:1.0:1746155632.464160:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae000/0x844e5faceb5f5a80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e52 expref: 39 pid: 18270 timeout: 861 lvb_type: 1 00010000:00010000:1.0:1746155632.464171:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae000/0x844e5faceb5f5a80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e52 expref: 39 pid: 18270 timeout: 861 lvb_type: 1 00002000:00010000:1.0:1746155632.464176:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936f5180 00000100:00100000:0.0:1746155632.471040:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125634944 00000100:00100000:0.0:1746155632.471048:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125634944 00000100:00100000:0.0:1746155632.471091:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16103 00000100:00100000:0.0:1746155632.471098:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:31931:x1830976125634944:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155632.471111:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155632.471124:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f5ac6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16e6e expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.471144:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155632.471146:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155632.471152:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f5ac6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e6e expref: 38 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.471164:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f5ac6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e6e expref: 38 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.471172:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a886e00, rc 0) 00000100:00100000:0.0:1746155632.471214:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:31931:x1830976125634944:12345-192.168.202.51@tcp:101:cat.0 Request processed in 117us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155632.471273:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16103 00000100:00100000:0.0:1746155632.471443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.471524:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.474060:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125635584 00000100:00100000:0.0:1746155632.474064:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125635584 00010000:00010000:0.0:1746155632.474077:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f3c0200/0x844e5faceb5f59bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16dcd expref: 38 pid: 20200 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746155632.474097:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8250 00000100:00100000:0.0:1746155632.474102:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976125635584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155632.474110:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155632.474125:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f3c0200/0x844e5faceb5f59bc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16dcd expref: 38 pid: 20200 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.474134:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f3c0200/0x844e5faceb5f59bc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16dcd expref: 38 pid: 20200 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.474240:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f3c0200/0x844e5faceb5f59bc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16dcd expref: 38 pid: 20200 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.474250:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155632.474265:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976125635584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 163us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155632.474270:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8250 00000100:00100000:0.0:1746155632.475086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.476179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.476807:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125636096 00000100:00100000:0.0:1746155632.476811:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125636096 00002000:00100000:0.0:1746155632.476825:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009ca94000 x1830976125636096/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.476831:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94000 with x1830976125636096 ext(2097152->3145727) 00002000:00010000:0.0:1746155632.476834:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca94000 00000100:00100000:0.0:1746155632.476855:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7609 00000100:00100000:0.0:1746155632.476860:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976125636096:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155632.478812:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.485845:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.486897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.486913:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125636864 00000100:00100000:0.0:1746155632.486917:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125636864 00002000:00100000:0.0:1746155632.486931:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3809280->3813375) req@ffff8801317c6680 x1830976125636864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.486937:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6680 with x1830976125636864 ext(3809280->3813375) 00002000:00010000:0.0:1746155632.486940:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c6680 00000100:00100000:0.0:1746155632.486948:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7612 00000100:00100000:0.0:1746155632.486953:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+39:1961:x1830976125636864:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155632.487026:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+39:1961:x1830976125636864:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 71us (129us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155632.487031:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7612 00002000:00100000:0.0:1746155632.487035:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3809280->3813375) req@ffff8801317c6680 x1830976125636864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/4536 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.487050:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6680 with x1830976125636864 ext(3809280->3813375) 00002000:00010000:0.0:1746155632.487053:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c6680 00000100:00100000:0.0:1746155632.491936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.493423:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125637504 00000100:00100000:0.0:1746155632.493427:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125637504 00000100:00100000:0.0:1746155632.493464:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16105 00000100:00100000:0.0:1746155632.493471:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:31931:x1830976125637504:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155632.493480:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155632.493494:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f5ad4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16e7c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.493534:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131459c00/0x844e5faceb5f5a9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3371008->18446744073709551615] (req 3371008->3813375) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e60 expref: 38 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.493550:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155632.493551:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155632.493554:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f5ad4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e7c expref: 38 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.493576:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131459c00/0x844e5faceb5f5a9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3371008->18446744073709551615] (req 3371008->3813375) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e60 expref: 38 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.493584:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131459c00/0x844e5faceb5f5a9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3371008->18446744073709551615] (req 3371008->3813375) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e60 expref: 38 pid: 9235 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746155632.493593:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125227008:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155632.493651:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3fbe6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155632.495886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.496106:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125637632 00000100:00100000:1.0:1746155632.496111:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125637632 00002000:00100000:1.0:1746155632.496135:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3371008->3813375) req@ffff8801317c4000 x1830976125637632/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.496143:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4000 with x1830976125637632 ext(3371008->3813375) 00010000:00010000:1.0:1746155632.496149:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131459c00/0x844e5faceb5f5a9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3371008->18446744073709551615] (req 3371008->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e60 expref: 39 pid: 9235 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746155632.496169:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131459c00/0x844e5faceb5f5a9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3371008->18446744073709551615] (req 3371008->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e60 expref: 39 pid: 9235 timeout: 861 lvb_type: 0 00002000:00010000:1.0:1746155632.496175:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317c4000 00000100:00100000:1.0:1746155632.496202:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1288 00000100:00100000:1.0:1746155632.496209:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+39:1961:x1830976125637632:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155632.510727:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+41:1961:x1830976125637632:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 14508us (14834us total) trans 21474841386 rc 0/0 00000100:00100000:1.0:1746155632.510739:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1288 00002000:00100000:1.0:1746155632.510750:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3371008->3813375) req@ffff8801317c4000 x1830976125637632/t21474841386(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/448 e 0 to 0 dl 1746155643 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.510759:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4000 with x1830976125637632 ext(3371008->3813375) 00010000:00010000:1.0:1746155632.510769:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131459c00/0x844e5faceb5f5a9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3371008->18446744073709551615] (req 3371008->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e60 expref: 41 pid: 9235 timeout: 861 lvb_type: 0 00010000:00010000:1.0:1746155632.510784:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131459c00/0x844e5faceb5f5a9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3371008->18446744073709551615] (req 3371008->3813375) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e60 expref: 41 pid: 9235 timeout: 861 lvb_type: 0 00002000:00010000:1.0:1746155632.510790:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317c4000 00000100:00100000:0.0:1746155632.518202:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.524414:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.524539:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125638016 00000100:00100000:1.0:1746155632.524545:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125638016 00002000:00100000:1.0:1746155632.524576:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8801317c6a00 x1830976125638016/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.524585:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6a00 with x1830976125638016 ext(3145728->4194303) 00002000:00010000:1.0:1746155632.524588:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c6a00 00000100:00100000:1.0:1746155632.524602:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7613 00000100:00100000:1.0:1746155632.524608:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1960:x1830976125638016:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155632.533313:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1960:x1830976125638016:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8696us (8891us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155632.533324:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7613 00002000:00100000:1.0:1746155632.533335:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8801317c6a00 x1830976125638016/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/440 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.533344:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6a00 with x1830976125638016 ext(3145728->4194303) 00002000:00010000:1.0:1746155632.533349:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c6a00 00000100:00100000:1.0:1746155632.542463:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125638272 00000100:00100000:1.0:1746155632.542471:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125638272 00002000:00100000:1.0:1746155632.542530:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009ca94380 x1830976125638272/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.542539:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94380 with x1830976125638272 ext(4194304->5083135) 00002000:00010000:1.0:1746155632.542544:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca94380 00000100:00100000:1.0:1746155632.542566:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7614 00000100:00100000:1.0:1746155632.542573:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976125638272:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155632.551411:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976125638272:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8831us (9356us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155632.551421:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7614 00002000:00100000:1.0:1746155632.551431:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009ca94380 x1830976125638272/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/440 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.551440:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94380 with x1830976125638272 ext(4194304->5083135) 00002000:00010000:1.0:1746155632.551444:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca94380 00000100:00100000:0.0:1746155632.620820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.621032:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125638528 00000100:00100000:1.0:1746155632.621039:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125638528 00000100:00100000:1.0:1746155632.621087:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10927 00000100:00100000:1.0:1746155632.621094:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:31943:x1830976125638528:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155632.621113:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155632.621127:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5adb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16e83 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.621212:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f5ae2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621222:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f5ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621231:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f5ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621242:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18400/0x844e5faceb5f5ae9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621247:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18400/0x844e5faceb5f5ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621252:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18400/0x844e5faceb5f5ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621328:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5af0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621336:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5af0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621342:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5af0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:1.0:1746155632.621350:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155632.621414:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f5ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621421:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f5ae2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621427:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f5ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621432:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c19e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155632.621435:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f5ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621441:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f5ae2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621449:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155632.621451:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155632.621454:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f5ae2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621459:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f5ae2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621472:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18400/0x844e5faceb5f5ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621477:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18400/0x844e5faceb5f5ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621482:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18400/0x844e5faceb5f5ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621486:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093c18400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155632.621488:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18400/0x844e5faceb5f5ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621492:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18400/0x844e5faceb5f5ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621528:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0200) 00010000:00010000:1.0:1746155632.621530:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155632.621532:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18400/0x844e5faceb5f5ae9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621537:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18400/0x844e5faceb5f5ae9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.621566:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5adb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e83 expref: 24 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.621575:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5af0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e83 expref: 23 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.621581:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155632.621583:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155632.621584:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c19600, rc 0) 00000100:00100000:1.0:1746155632.621622:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:31943:x1830976125638528:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 528us (809us total) trans 8589945052 rc 0/0 00000100:00100000:1.0:1746155632.621627:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10927 00000100:00100000:0.0:1746155632.709316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.709382:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125638912 00000100:00100000:1.0:1746155632.709389:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125638912 00000100:00100000:1.0:1746155632.709425:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16108 00000100:00100000:1.0:1746155632.709431:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+41:31946:x1830976125638912:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155632.709445:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155632.709459:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c18000/0x844e5faceb5f5b0c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16e98 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.709485:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae600/0x844e5faceb5f5acd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2088959) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e75 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.709491:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155632.709492:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155632.709495:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c18000/0x844e5faceb5f5b0c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e98 expref: 42 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.709545:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae600/0x844e5faceb5f5acd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2088959) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e75 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.709556:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae600/0x844e5faceb5f5acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2088959) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e75 expref: 37 pid: 8437 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746155632.709567:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125227392:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155632.709626:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155632.719012:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.719077:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125639040 00000100:00100000:0.0:1746155632.719083:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125639040 00002000:00100000:0.0:1746155632.719115:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (2011136->2088959) req@ffff8800936f5f80 x1830976125639040/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.719123:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5f80 with x1830976125639040 ext(2011136->2088959) 00010000:00010000:0.0:1746155632.719130:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae600/0x844e5faceb5f5acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e75 expref: 38 pid: 8437 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.719146:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae600/0x844e5faceb5f5acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e75 expref: 38 pid: 8437 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746155632.719153:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936f5f80 00000100:00100000:0.0:1746155632.719168:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1289 00000100:00100000:0.0:1746155632.719174:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1960:x1830976125639040:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155632.721694:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976125639040:12345-192.168.202.51@tcp:4:cat.0 Request processed in 2514us (2678us total) trans 21474841387 rc 0/0 00000100:00100000:0.0:1746155632.721702:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1289 00002000:00100000:0.0:1746155632.721709:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (2011136->2088959) req@ffff8800936f5f80 x1830976125639040/t21474841387(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/448 e 0 to 0 dl 1746155643 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.721717:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5f80 with x1830976125639040 ext(2011136->2088959) 00010000:00010000:0.0:1746155632.721723:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae600/0x844e5faceb5f5acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e75 expref: 40 pid: 8437 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.721734:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae600/0x844e5faceb5f5acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e75 expref: 40 pid: 8437 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746155632.721741:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936f5f80 00000100:00100000:0.0:1746155632.724284:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.724308:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125639168 00000100:00100000:0.0:1746155632.724314:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125639168 00010000:00010000:0.0:1746155632.724339:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae600/0x844e5faceb5f5acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2011136->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e75 expref: 40 pid: 8437 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746155632.724365:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8254 00000100:00100000:0.0:1746155632.724372:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125639168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155632.724382:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155632.724397:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae600/0x844e5faceb5f5acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2088959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e75 expref: 40 pid: 8437 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.724406:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae600/0x844e5faceb5f5acd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2088959) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e75 expref: 40 pid: 8437 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.724423:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae600/0x844e5faceb5f5acd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2011136->2088959) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e75 expref: 40 pid: 8437 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.724433:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155632.724435:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155632.724441:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c18000/0x844e5faceb5f5b0c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e98 expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.724447:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c18000/0x844e5faceb5f5b0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e98 expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.724470:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093c18000/0x844e5faceb5f5b0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e98 expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155632.724481:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125227520:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155632.724548:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155632.728061:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125227520:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155632.728078:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155632.728108:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976125639168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3736us (3827us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155632.728116:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8254 00000100:00100000:0.0:1746155632.739446:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125639424 00000100:00100000:0.0:1746155632.739454:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125639424 00002000:00100000:0.0:1746155632.739489:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880095268a80 x1830976125639424/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.739498:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095268a80 with x1830976125639424 ext(1048576->2097151) 00002000:00010000:0.0:1746155632.739521:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095268a80 00000100:00100000:0.0:1746155632.739536:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125639680 00000100:00100000:1.0:1746155632.739538:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125639936 00000100:00100000:0.0:1746155632.739539:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125639680 00000100:00100000:1.0:1746155632.739541:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125639936 00002000:00100000:0.0:1746155632.739549:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880095269880 x1830976125639680/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.739554:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009526b480 x1830976125639936/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.739556:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269880 with x1830976125639680 ext(1048576->2097151) 00002000:00100000:1.0:1746155632.739559:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526b480 with x1830976125639936 ext(1048576->2097151) 00002000:00010000:0.0:1746155632.739559:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095269880 00002000:00010000:1.0:1746155632.739562:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009526b480 00000100:00100000:0.0:1746155632.739570:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7615 00000100:00100000:1.0:1746155632.739580:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7616 00000100:00100000:1.0:1746155632.739584:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+43:1960:x1830976125639680:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155632.740732:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+43:1960:x1830976125639424:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155632.745930:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125640192 00000100:00100000:0.0:1746155632.745938:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125640192 00000100:00100000:1.0:1746155632.747876:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10928 00000100:00100000:1.0:1746155632.747887:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:31948:x1830976125640192:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155632.747907:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155632.747922:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f5b13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16e9f expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.748010:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5b1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.748022:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d800/0x844e5faceb5f5a72 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e3d expref: 10 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.748029:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887200/0x844e5faceb5f5ab8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e67 expref: 302 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.748035:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5af0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e83 expref: 22 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.748041:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5b1a lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155632.748068:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5af0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e83 expref: 22 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.748079:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5af0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e83 expref: 22 pid: 19870 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746155632.748089:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125227648:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155632.748162:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887200/0x844e5faceb5f5ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e67 expref: 302 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.748169:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887200/0x844e5faceb5f5ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e67 expref: 302 pid: 19870 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746155632.748176:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125227776:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155632.748204:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d800/0x844e5faceb5f5a72 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e3d expref: 10 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.748212:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d800/0x844e5faceb5f5a72 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e3d expref: 10 pid: 19870 timeout: 861 lvb_type: 0 00000100:00100000:1.0:1746155632.748219:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125227904:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155632.748234:0:19870:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155632.756073:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.756095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.756114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.756157:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125227648:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155632.756166:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125227776:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155632.756172:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125227904:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155632.756191:0:19870:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5b1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000100:00100000:0.0:1746155632.756828:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125640320 00000100:00100000:0.0:1746155632.756835:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125640320 00010000:00010000:0.0:1746155632.756855:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5af0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e83 expref: 23 pid: 19870 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746155632.756872:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125640448 00000100:00100000:0.0:1746155632.756875:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125640448 00010000:00010000:0.0:1746155632.756883:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d800/0x844e5faceb5f5a72 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e3d expref: 11 pid: 19870 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746155632.756895:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125640576 00000100:00100000:0.0:1746155632.756897:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125640576 00010000:00010000:0.0:1746155632.756904:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887200/0x844e5faceb5f5ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e67 expref: 303 pid: 19870 timeout: 861 lvb_type: 0 00000100:00100000:0.0:1746155632.756918:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8255 00000100:00100000:0.0:1746155632.756925:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976125640320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155632.756935:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155632.756940:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5af0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e83 expref: 23 pid: 19870 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.756949:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5af0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e83 expref: 23 pid: 19870 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.756967:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19600/0x844e5faceb5f5af0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e83 expref: 23 pid: 19870 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.756978:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155632.756982:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5b1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.756989:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5b1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.756994:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155632.757027:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976125640320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 102us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155632.757033:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8255 00000100:00100000:0.0:1746155632.757044:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8256 00000100:00100000:0.0:1746155632.757049:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125640448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155632.757055:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155632.757058:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d800/0x844e5faceb5f5a72 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e3d expref: 11 pid: 19870 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.757065:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d800/0x844e5faceb5f5a72 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e3d expref: 11 pid: 19870 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.757075:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c64d800/0x844e5faceb5f5a72 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e3d expref: 11 pid: 19870 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.757083:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155632.757085:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5b1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.757090:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5b1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.757093:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155632.757107:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125640448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 58us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155632.757112:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8256 00000100:00100000:0.0:1746155632.757142:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8257 00000100:00100000:0.0:1746155632.757147:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:1960:x1830976125640576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155632.757152:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155632.757156:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887200/0x844e5faceb5f5ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e67 expref: 303 pid: 19870 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.757163:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887200/0x844e5faceb5f5ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e67 expref: 303 pid: 19870 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.757172:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887200/0x844e5faceb5f5ab8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e67 expref: 303 pid: 19870 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.757179:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155632.757182:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5b1a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.757187:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5b1a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.757193:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5b1a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.757206:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155632.757219:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:1960:x1830976125640576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 72us (1104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155632.757223:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8257 00010000:00010000:0.0:1746155632.757240:0:19870:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5b1a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155632.757245:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5b1a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:0.0:1746155632.757258:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155632.757351:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19e00/0x844e5faceb5f5b13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e9f expref: 303 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.757366:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093c19c00/0x844e5faceb5f5b1a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e9f expref: 302 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155632.757372:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155632.757374:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155632.757376:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c19c00, rc 0) 00000100:00100000:0.0:1746155632.757395:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:31948:x1830976125640192:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 9512us (16187us total) trans 8589945053 rc 0/0 00000100:00100000:0.0:1746155632.757401:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10928 00000100:00100000:0.0:1746155632.761666:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+44:1960:x1830976125639680:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22074us (22331us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155632.761677:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7616 00002000:00100000:0.0:1746155632.761686:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880095269880 x1830976125639680/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/440 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.761694:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269880 with x1830976125639680 ext(1048576->2097151) 00002000:00010000:0.0:1746155632.761698:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095269880 00000100:00100000:0.0:1746155632.762710:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+42:1960:x1830976125639424:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23132us (23406us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155632.762716:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7615 00002000:00100000:0.0:1746155632.762722:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880095268a80 x1830976125639424/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/440 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.762730:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095268a80 with x1830976125639424 ext(1048576->2097151) 00002000:00010000:0.0:1746155632.762733:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095268a80 00000001:00080000:0.0:1746155632.769491:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841377 is committed 00000001:00080000:0.0:1746155632.769558:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841362 is committed 00000001:00080000:0.0:1746155632.769571:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841342 is committed 00000001:00080000:0.0:1746155632.769583:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841386 is committed 00000001:00080000:0.0:1746155632.769590:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841379 is committed 00000001:00080000:0.0:1746155632.769612:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841349 is committed 00000001:00080000:0.0:1746155632.769630:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841360 is committed 00000001:00080000:0.0:1746155632.769673:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841385 is committed 00000100:00100000:1.0:1746155632.782296:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.816837:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.818023:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1963:x1830976125640960:12345-192.168.202.51@tcp:3:cat.0 Request processed in 32889us (32988us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155632.818031:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7618 00002000:00100000:0.0:1746155632.818038:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f3eea00 x1830976125640960/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/440 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.818046:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3eea00 with x1830976125640960 ext(2097152->3145727) 00002000:00010000:0.0:1746155632.818050:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3eea00 00000100:00100000:1.0:1746155632.828966:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.837132:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.842473:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.842490:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125642624 00000100:00100000:0.0:1746155632.842495:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125642624 00002000:00100000:0.0:1746155632.842532:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8801317c6d80 x1830976125642624/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.842540:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6d80 with x1830976125642624 ext(3145728->4194303) 00010000:00010000:0.0:1746155632.842546:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094218200/0x844e5faceb5f5b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ead expref: 34 pid: 8437 timeout: 861 lvb_type: 0 00010000:00010000:0.0:1746155632.842556:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094218200/0x844e5faceb5f5b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ead expref: 34 pid: 8437 timeout: 861 lvb_type: 0 00002000:00010000:0.0:1746155632.842568:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801317c6d80 00000100:00100000:0.0:1746155632.842579:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1290 00000100:00100000:0.0:1746155632.842585:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1962:x1830976125642624:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155632.857356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.858141:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.858195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.858207:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.858224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.858237:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125643392 00000100:00100000:0.0:1746155632.858240:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125643392 00010000:00010000:0.0:1746155632.858253:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae800/0x844e5faceb5f5a41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e28 expref: 9 pid: 8437 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746155632.858268:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125643648 00000100:00100000:0.0:1746155632.858270:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125643648 00000100:00100000:1.0:1746155632.858274:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125643520 00000100:00100000:1.0:1746155632.858278:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125643520 00010000:00010000:0.0:1746155632.858278:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f5ad4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e7c expref: 17 pid: 8437 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155632.858291:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f53ea00/0x844e5faceb5f59ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ddb expref: 18 pid: 20200 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746155632.858292:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8262 00000100:00100000:0.0:1746155632.858297:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1963:x1830976125643392:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155632.858303:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155632.858304:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8263 00000100:00100000:1.0:1746155632.858309:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976125643648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155632.858312:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae800/0x844e5faceb5f5a41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e28 expref: 10 pid: 8437 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155632.858315:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155632.858321:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae800/0x844e5faceb5f5a41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e28 expref: 10 pid: 8437 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155632.858326:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f5ad4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e7c expref: 18 pid: 8437 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746155632.858332:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c2ae800/0x844e5faceb5f5a41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e28 expref: 10 pid: 8437 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155632.858334:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f5ad4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e7c expref: 18 pid: 8437 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155632.858346:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f5ad4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e7c expref: 18 pid: 8437 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746155632.858351:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155632.858355:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155632.858369:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1963:x1830976125643392:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 72us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155632.858371:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976125643648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 62us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155632.858374:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8262 00000100:00100000:1.0:1746155632.858377:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8263 00000100:00100000:0.0:1746155632.860989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.864066:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125644288 00000100:00100000:1.0:1746155632.864210:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125644288 00002000:00100000:1.0:1746155632.864235:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1437696->1441791) req@ffff88009f778a80 x1830976125644288/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.864243:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f778a80 with x1830976125644288 ext(1437696->1441791) 00002000:00010000:1.0:1746155632.864247:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f778a80 00000100:00100000:1.0:1746155632.864271:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7622 00000100:00100000:1.0:1746155632.864277:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976125644288:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155632.864388:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976125644288:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 110us (395us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155632.864394:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7622 00002000:00100000:1.0:1746155632.864398:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1437696->1441791) req@ffff88009f778a80 x1830976125644288/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/4536 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.865009:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f778a80 with x1830976125644288 ext(1437696->1441791) 00002000:00010000:1.0:1746155632.865013:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f778a80 00000100:00100000:0.0:1746155632.870274:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:1960:x1830976125643136:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 15567us (16183us total) trans 17179874044 rc 0/0 00000100:00100000:0.0:1746155632.870287:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1291 00002000:00100000:0.0:1746155632.870297:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2502656->3145727) req@ffff88009f3efb80 x1830976125643136/t17179874044(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/448 e 0 to 0 dl 1746155643 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.870306:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3efb80 with x1830976125643136 ext(2502656->3145727) 00010000:00010000:0.0:1746155632.870314:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094218200/0x844e5faceb5f5b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ead expref: 36 pid: 8437 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746155632.870326:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094218200/0x844e5faceb5f5b2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ead expref: 36 pid: 8437 timeout: 862 lvb_type: 0 00002000:00010000:0.0:1746155632.870333:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f3efb80 00000100:00100000:1.0:1746155632.870341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.870351:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125644544 00000100:00100000:0.0:1746155632.870356:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125644544 00000100:00100000:1.0:1746155632.870369:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:0.0:1746155632.870381:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2392064->2396159) req@ffff8800936f5500 x1830976125644544/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.870392:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5500 with x1830976125644544 ext(2392064->2396159) 00000100:00100000:1.0:1746155632.870393:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125644800 00002000:00010000:0.0:1746155632.870395:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f5500 00000100:00100000:1.0:1746155632.870397:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125644800 00000100:00100000:0.0:1746155632.870408:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7623 00002000:00100000:1.0:1746155632.870411:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800936f6300 x1830976125644800/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746155632.870413:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976125644544:12345-192.168.202.51@tcp:3:multiop.0 00002000:00100000:1.0:1746155632.870418:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6300 with x1830976125644800 ext(3145728->4194303) 00002000:00010000:1.0:1746155632.870422:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f6300 00000100:00100000:1.0:1746155632.870437:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7624 00000100:00100000:1.0:1746155632.870442:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976125644800:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155632.870544:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976125644544:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 130us (204us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155632.870550:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7623 00002000:00100000:0.0:1746155632.870554:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2392064->2396159) req@ffff8800936f5500 x1830976125644544/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/4536 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155632.870561:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5500 with x1830976125644544 ext(2392064->2396159) 00002000:00010000:0.0:1746155632.870563:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f5500 00000100:00100000:0.0:1746155632.875569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.875609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.877306:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976125644800:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 6862us (6934us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155632.877314:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7624 00002000:00100000:1.0:1746155632.877321:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800936f6300 x1830976125644800/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/440 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.877330:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6300 with x1830976125644800 ext(3145728->4194303) 00002000:00010000:1.0:1746155632.877333:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f6300 00000100:00100000:1.0:1746155632.880905:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125645696 00000100:00100000:1.0:1746155632.880912:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125645696 00002000:00100000:1.0:1746155632.880939:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f3ece00 x1830976125645696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.880948:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ece00 with x1830976125645696 ext(2097152->3145727) 00002000:00010000:1.0:1746155632.880952:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3ece00 00000100:00100000:1.0:1746155632.881195:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7625 00000100:00100000:1.0:1746155632.881201:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1961:x1830976125645696:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155632.883829:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16118 00000100:00100000:1.0:1746155632.883836:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1960:x1830976125646336:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155632.883847:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155632.883856:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0400/0x844e5faceb5f5b67 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16ee5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155632.883868:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155632.883869:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155632.883876:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0400/0x844e5faceb5f5b67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ee5 expref: 37 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155632.883889:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0400/0x844e5faceb5f5b67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ee5 expref: 37 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155632.883897:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3c0400, rc 0) 00000100:00100000:1.0:1746155632.883917:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+37:1960:x1830976125646336:12345-192.168.202.51@tcp:101:cat.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155632.883922:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16118 00000100:00100000:1.0:1746155632.890142:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976125645696:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8937us (9264us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155632.890150:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7625 00002000:00100000:1.0:1746155632.890158:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f3ece00 x1830976125645696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/440 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.890163:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ece00 with x1830976125645696 ext(2097152->3145727) 00002000:00010000:1.0:1746155632.890167:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3ece00 00000100:00100000:0.0:1746155632.895705:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.895766:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125646976 00000100:00100000:1.0:1746155632.895775:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125646976 00002000:00100000:1.0:1746155632.895809:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8801317c4e00 x1830976125646976/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.895818:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4e00 with x1830976125646976 ext(4194304->5083135) 00002000:00010000:1.0:1746155632.895823:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317c4e00 00000100:00100000:1.0:1746155632.895852:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7627 00000100:00100000:1.0:1746155632.895859:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125646976:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155632.901116:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.902901:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125646976:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7040us (7199us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155632.902910:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7627 00002000:00100000:1.0:1746155632.902919:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8801317c4e00 x1830976125646976/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/440 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.902927:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4e00 with x1830976125646976 ext(4194304->5083135) 00002000:00010000:1.0:1746155632.902931:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317c4e00 00000100:00100000:0.0:1746155632.905402:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.905442:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125647232 00000100:00100000:1.0:1746155632.905448:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125647232 00002000:00100000:1.0:1746155632.905473:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->2396159) req@ffff8801317c4700 x1830976125647232/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.905481:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4700 with x1830976125647232 ext(2097152->2396159) 00010000:00010000:1.0:1746155632.905487:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e4c200/0x844e5faceb5f5b44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2396159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ec2 expref: 8 pid: 9235 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155632.905498:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e4c200/0x844e5faceb5f5b44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2396159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ec2 expref: 8 pid: 9235 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746155632.905527:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317c4700 00000100:00100000:1.0:1746155632.905546:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1292 00000100:00100000:1.0:1746155632.905552:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976125647232:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155632.906081:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.907413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.907458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.907583:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125647616 00000100:00100000:1.0:1746155632.907586:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125647616 00000100:00100000:1.0:1746155632.907602:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16122 00000100:00100000:1.0:1746155632.907607:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125647488:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155632.907614:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155632.907622:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0600/0x844e5faceb5f5b83 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16f01 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155632.907641:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125230848:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155632.907949:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155632.910322:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125647232:12345-192.168.202.51@tcp:4:cat.0 Request processed in 4764us (4918us total) trans 21474841388 rc 0/0 00000100:00100000:1.0:1746155632.910332:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1292 00002000:00100000:1.0:1746155632.910340:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->2396159) req@ffff8801317c4700 x1830976125647232/t21474841388(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:703/0 lens 488/448 e 0 to 0 dl 1746155643 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.910352:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4700 with x1830976125647232 ext(2097152->2396159) 00010000:00010000:1.0:1746155632.910360:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e4c200/0x844e5faceb5f5b44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2396159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ec2 expref: 12 pid: 9235 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155632.910371:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e4c200/0x844e5faceb5f5b44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->2396159) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ec2 expref: 12 pid: 9235 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746155632.910377:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317c4700 00000100:00100000:1.0:1746155632.910804:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125230848:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155632.910826:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0600/0x844e5faceb5f5b83 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f01 expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155632.910837:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0600/0x844e5faceb5f5b83 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f01 expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155632.910857:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3c0600, rc 0) 00000100:00100000:1.0:1746155632.910878:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125647488:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3270us (3466us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155632.910883:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16122 00000100:00100000:0.0:1746155632.912685:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.912717:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.913115:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.913150:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155632.913227:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125647872 00000100:00100000:1.0:1746155632.913231:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125647872 00000100:00100000:1.0:1746155632.913265:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125648000 00000100:00100000:1.0:1746155632.913267:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125648000 00000100:00100000:1.0:1746155632.913279:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16124 00000100:00100000:1.0:1746155632.913284:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125647872:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155632.913293:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155632.913302:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa70600/0x844e5faceb5f5b91 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16f0f expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155632.913326:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125231104:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155632.913361:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c850000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155632.917922:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125231104:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155632.917948:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa70600/0x844e5faceb5f5b91 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f0f expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155632.917959:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa70600/0x844e5faceb5f5b91 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f0f expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155632.917969:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa70600, rc 0) 00000100:00100000:1.0:1746155632.918018:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125647872:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4733us (5298us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155632.918025:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16124 00000100:00100000:1.0:1746155632.923067:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125648384 00000100:00100000:1.0:1746155632.923075:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125648384 00002000:00100000:1.0:1746155632.923112:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88008e26f100 x1830976125648384/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.923127:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26f100 with x1830976125648384 ext(2097152->3145727) 00002000:00010000:1.0:1746155632.923131:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26f100 00000100:00100000:1.0:1746155632.923146:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125648896 00000100:00100000:1.0:1746155632.923149:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125648896 00002000:00100000:1.0:1746155632.923161:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88008e26e680 x1830976125648896/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/0 e 0 to 0 dl 1746155643 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.923167:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26e680 with x1830976125648896 ext(3145728->4194303) 00002000:00010000:1.0:1746155632.923170:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26e680 00000100:00100000:1.0:1746155632.923243:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7629 00000100:00100000:1.0:1746155632.923260:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976125648896:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155632.923424:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7630 00000100:00100000:1.0:1746155632.923442:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976125648512:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155632.938253:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976125648512:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 14813us (15280us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155632.938263:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7630 00002000:00100000:1.0:1746155632.938272:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88008e26d180 x1830976125648512/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:703/0 lens 488/440 e 0 to 0 dl 1746155643 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155632.938280:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26d180 with x1830976125648512 ext(3145728->4194303) 00002000:00010000:1.0:1746155632.938285:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26d180 00000100:00100000:0.0:1746155632.957245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.984340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155632.990828:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.004781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.008789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.008818:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.009138:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.010026:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125650048 00000100:00100000:0.0:1746155633.010031:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125650048 00000100:00100000:1.0:1746155633.010039:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125650304 00000100:00100000:1.0:1746155633.010043:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125650304 00000100:00100000:0.0:1746155633.010247:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16128 00000100:00100000:0.0:1746155633.010254:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976125650048:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155633.010261:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155633.010270:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fccce00/0x844e5faceb5f5bc9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16f39 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155633.010302:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137122d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125231488:192.168.202.51@tcp:106: 00000100:00080000:1.0:1746155633.010518:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155633.010626:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155633.010658:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.010707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.017100:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.023975:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155633.025115:0:19870:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012d1f1c00/0x844e5faceb5f5bec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155633.025121:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d1f1c00/0x844e5faceb5f5bec lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:0.0:1746155633.025135:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155633.025247:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d1f1000/0x844e5faceb5f5be5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f4e expref: 13 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.025262:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d1f1c00/0x844e5faceb5f5bec lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f4e expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.025268:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155633.025271:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155633.025272:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d1f1c00, rc 0) 00000100:00100000:0.0:1746155633.025295:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137120700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:31955:x1830976125650560:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 8101us (8201us total) trans 8589945056 rc 0/0 00000100:00100000:0.0:1746155633.025301:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10930 00000100:00100000:0.0:1746155633.029063:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.031814:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.035797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.035836:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.035859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.035872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.035897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.036083:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.036099:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125651712 00000100:00100000:0.0:1746155633.036102:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125651712 00000100:00100000:0.0:1746155633.036120:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16133 00000100:00100000:0.0:1746155633.036126:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125651584:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155633.036144:0:29728:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fccce00/0x844e5faceb5f5c1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.036154:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5355000/0x844e5faceb5f5b52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ed0 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.036160:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155633.036162:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155633.036164:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fccce00/0x844e5faceb5f5c1d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.036179:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5355000/0x844e5faceb5f5b52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ed0 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.036187:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5355000/0x844e5faceb5f5b52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ed0 expref: 19 pid: 8437 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746155633.036196:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125232128:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155633.036219:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155633.036236:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16134 00000100:00100000:0.0:1746155633.036241:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125651840:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155633.036255:0:19959:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.036264:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c18e00/0x844e5faceb5f5b75 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ef3 expref: 14 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.036269:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd0e200/0x844e5faceb5f5bd0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f47 expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155633.036275:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e4d200/0x844e5faceb5f5b9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f1d expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155633.036280:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc8400/0x844e5faceb5f5b4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ec9 expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.036285:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155633.036286:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155633.036288:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 7/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.036301:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc8400/0x844e5faceb5f5b4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ec9 expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.036308:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc8400/0x844e5faceb5f5b4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ec9 expref: 9 pid: 9235 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746155633.036316:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125232384:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155633.036339:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e4d200/0x844e5faceb5f5b9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f1d expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155633.036346:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e4d200/0x844e5faceb5f5b9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f1d expref: 9 pid: 9235 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746155633.036352:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125232640:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155633.036373:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd0e200/0x844e5faceb5f5bd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f47 expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155633.036380:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd0e200/0x844e5faceb5f5bd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f47 expref: 10 pid: 9235 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746155633.036392:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125232896:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155633.036412:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093c18e00/0x844e5faceb5f5b75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ef3 expref: 14 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.036419:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093c18e00/0x844e5faceb5f5b75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ef3 expref: 14 pid: 18270 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746155633.036426:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125233152:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155633.036437:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155633.047546:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125232128:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155633.047566:0:29728:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fccce00/0x844e5faceb5f5c1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155633.047573:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125232640:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155633.047682:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125232384:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155633.048346:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125232896:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155633.048354:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125233152:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155633.048390:0:19959:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155633.048533:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125651968 00000100:00100000:0.0:1746155633.048537:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125651968 00010000:00010000:0.0:1746155633.048552:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800913f0400/0x844e5faceb5f5bc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f2b expref: 11 pid: 8437 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746155633.048578:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8274 00000100:00100000:0.0:1746155633.048584:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976125651968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155633.048591:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155633.048603:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800913f0400/0x844e5faceb5f5bc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f2b expref: 11 pid: 8437 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746155633.048612:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800913f0400/0x844e5faceb5f5bc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f2b expref: 11 pid: 8437 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746155633.048628:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800913f0400/0x844e5faceb5f5bc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f2b expref: 11 pid: 8437 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746155633.048643:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155633.048659:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976125651968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 76us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155633.048665:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8274 00000100:00100000:0.0:1746155633.048674:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125652224 00000100:00100000:0.0:1746155633.048676:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125652224 00010000:00010000:0.0:1746155633.048683:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e4d200/0x844e5faceb5f5b9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f1d expref: 11 pid: 9235 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746155633.048696:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8275 00000100:00100000:0.0:1746155633.048700:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976125652224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155633.048705:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155633.048712:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e4d200/0x844e5faceb5f5b9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f1d expref: 11 pid: 9235 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746155633.048720:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e4d200/0x844e5faceb5f5b9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f1d expref: 11 pid: 9235 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746155633.048729:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e4d200/0x844e5faceb5f5b9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f1d expref: 11 pid: 9235 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746155633.048737:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155633.048749:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1963:x1830976125652224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155633.048754:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8275 00000100:00100000:1.0:1746155633.048829:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.048865:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.050126:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.050140:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125653120 00000100:00100000:1.0:1746155633.050143:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125653120 00010000:00010000:1.0:1746155633.050156:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093c18000/0x844e5faceb5f5b0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e98 expref: 11 pid: 8437 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.050327:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125653248 00000100:00100000:1.0:1746155633.050330:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125653248 00010000:00010000:1.0:1746155633.050341:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b800600/0x844e5faceb5f5785 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c7d expref: 10 pid: 20200 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.050354:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8276 00000100:00100000:1.0:1746155633.050359:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976125653120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155633.050365:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155633.050376:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093c18000/0x844e5faceb5f5b0c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e98 expref: 11 pid: 8437 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.050388:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093c18000/0x844e5faceb5f5b0c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e98 expref: 11 pid: 8437 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.050399:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c18000/0x844e5faceb5f5b0c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16e98 expref: 11 pid: 8437 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.050412:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.050429:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976125653120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 69us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.050434:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8276 00000100:00100000:1.0:1746155633.050451:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8277 00000100:00100000:1.0:1746155633.050455:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125653248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155633.050460:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155633.050470:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b800600/0x844e5faceb5f5785 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c7d expref: 10 pid: 20200 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.050478:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b800600/0x844e5faceb5f5785 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c7d expref: 10 pid: 20200 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.050488:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b800600/0x844e5faceb5f5785 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c7d expref: 10 pid: 20200 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.050496:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.050522:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976125653248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 66us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.050530:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8277 00000100:00100000:0.0:1746155633.050835:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125653376 00000100:00100000:0.0:1746155633.050839:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125653376 00000100:00100000:0.0:1746155633.050866:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16142 00000100:00100000:0.0:1746155633.050870:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976125653376:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155633.050876:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155633.050883:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092873400/0x844e5faceb5f5c5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16f7f expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.050892:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155633.050897:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092873400/0x844e5faceb5f5c5c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f7f expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155633.050905:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092873400/0x844e5faceb5f5c5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f7f expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155633.050912:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092873400, rc 0) 00000100:00100000:0.0:1746155633.050926:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976125653376:12345-192.168.202.51@tcp:101:cat.0 Request processed in 55us (576us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155633.050930:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16142 00000100:00100000:0.0:1746155633.052783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.052811:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.052823:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.052839:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125652352 00000100:00100000:0.0:1746155633.052843:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125652352 00010000:00010000:0.0:1746155633.052862:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094219c00/0x844e5faceb5f5b28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ea6 expref: 15 pid: 8437 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.052864:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125653504 00000100:00100000:1.0:1746155633.052868:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125653504 00000100:00100000:0.0:1746155633.052880:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125654016 00010000:00010000:1.0:1746155633.052882:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5cc8400/0x844e5faceb5f5b4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ec9 expref: 10 pid: 9235 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746155633.052882:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125654016 00010000:00010000:0.0:1746155633.052891:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01eae00/0x844e5faceb5f5b36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16eb4 expref: 22 pid: 8437 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.053785:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8278 00000100:00100000:1.0:1746155633.053793:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976125652352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155633.053802:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155633.053819:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094219c00/0x844e5faceb5f5b28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ea6 expref: 15 pid: 8437 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.053829:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094219c00/0x844e5faceb5f5b28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ea6 expref: 15 pid: 8437 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.053844:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094219c00/0x844e5faceb5f5b28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ea6 expref: 15 pid: 8437 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.053856:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155633.053856:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155633.053858:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.053861:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d1f1400/0x844e5faceb5f5c16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.053868:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d1f1400/0x844e5faceb5f5c16 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.053884:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.053897:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976125652352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 106us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.053902:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8278 00000100:00100000:1.0:1746155633.054278:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125654144 00000100:00100000:1.0:1746155633.054281:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125654144 00010000:00010000:1.0:1746155633.054298:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1200/0x844e5faceb5f5bde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f40 expref: 9 pid: 8436 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.054318:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8283 00000100:00100000:1.0:1746155633.054323:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125654144:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155633.054329:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155633.054336:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1200/0x844e5faceb5f5bde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f40 expref: 9 pid: 8436 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.054343:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1200/0x844e5faceb5f5bde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f40 expref: 9 pid: 8436 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.054363:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1200/0x844e5faceb5f5bde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f40 expref: 9 pid: 8436 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.054375:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.054394:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125654144:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 71us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.054399:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8283 00000100:00100000:1.0:1746155633.054730:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.054762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.054788:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.054799:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125654400 00000100:00100000:1.0:1746155633.054801:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125654400 00010000:00010000:1.0:1746155633.054812:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093c18e00/0x844e5faceb5f5b75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ef3 expref: 14 pid: 18270 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.054824:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125654528 00000100:00100000:1.0:1746155633.054826:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125654528 00010000:00010000:1.0:1746155633.054833:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5355000/0x844e5faceb5f5b52 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ed0 expref: 21 pid: 8437 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.054845:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8284 00000100:00100000:1.0:1746155633.054849:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976125654400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155633.054855:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155633.054862:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093c18e00/0x844e5faceb5f5b75 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ef3 expref: 14 pid: 18270 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.054870:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093c18e00/0x844e5faceb5f5b75 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ef3 expref: 14 pid: 18270 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.054880:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c18e00/0x844e5faceb5f5b75 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ef3 expref: 14 pid: 18270 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.054888:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.054890:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.054892:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155633.055213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.055228:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125653760 00000100:00100000:0.0:1746155633.055231:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125653760 00010000:00010000:0.0:1746155633.055241:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3c1800/0x844e5faceb5f56cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c0d expref: 21 pid: 29728 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746155633.055254:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8286 00000100:00100000:0.0:1746155633.055259:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976125653760:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155633.055264:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155633.055271:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3c1800/0x844e5faceb5f56cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c0d expref: 21 pid: 29728 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746155633.055277:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3c1800/0x844e5faceb5f56cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c0d expref: 21 pid: 29728 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.055440:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055456:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.055472:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976125654400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 622us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.055478:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8284 00010000:00010000:1.0:1746155633.055527:0:19959:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055535:0:19959:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055548:0:19959:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055554:0:19959:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055561:0:19959:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055566:0:19959:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fccd200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155633.055568:0:19959:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055574:0:19959:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055587:0:19959:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055596:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fccd200/0x844e5faceb5f5c24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155633.055626:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125651840:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 19383us (19764us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.055632:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16134 00010000:00010000:1.0:1746155633.055648:0:29728:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fccce00/0x844e5faceb5f5c1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055654:0:29728:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fccce00/0x844e5faceb5f5c1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055666:0:29728:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fccce00/0x844e5faceb5f5c1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055671:0:29728:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fccce00/0x844e5faceb5f5c1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055676:0:29728:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fccce00/0x844e5faceb5f5c1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055681:0:29728:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fccce00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155633.055683:0:29728:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fccce00/0x844e5faceb5f5c1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055688:0:29728:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fccce00/0x844e5faceb5f5c1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055695:0:29728:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fccce00/0x844e5faceb5f5c1d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055700:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fccce00/0x844e5faceb5f5c1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155633.055726:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125651584:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 19600us (19889us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.055730:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16133 00000100:00100000:1.0:1746155633.055756:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.055767:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125654272 00000100:00100000:1.0:1746155633.055770:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125654272 00010000:00010000:1.0:1746155633.055780:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0400/0x844e5faceb5f5b67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ee5 expref: 10 pid: 8436 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.055793:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8287 00000100:00100000:1.0:1746155633.055797:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1963:x1830976125654272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155633.055802:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155633.055810:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0400/0x844e5faceb5f5b67 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ee5 expref: 10 pid: 8436 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.055817:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0400/0x844e5faceb5f5b67 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ee5 expref: 10 pid: 8436 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.055827:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3c0400/0x844e5faceb5f5b67 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ee5 expref: 10 pid: 8436 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.055834:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.055836:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.055838:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a3f39400/0x844e5faceb5f5c39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055843:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3f39400/0x844e5faceb5f5c39 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.055864:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.055879:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1963:x1830976125654272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 81us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.055883:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8287 00010000:00010000:0.0:1746155633.055896:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f3c1800/0x844e5faceb5f56cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c0d expref: 21 pid: 29728 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746155633.055905:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155633.055906:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155633.055909:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5f5c2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.055915:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b3000/0x844e5faceb5f5c2b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.056864:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155633.056882:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976125653760:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1622us (1669us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155633.056887:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8286 00000100:00100000:1.0:1746155633.059803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.066636:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.067458:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.067574:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125655040 00000100:00100000:1.0:1746155633.067578:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125655040 00010000:00010000:1.0:1746155633.067595:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e4de00/0x844e5faceb5f5b3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ebb expref: 15 pid: 8437 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.068340:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8288 00000100:00100000:1.0:1746155633.068349:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976125655040:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155633.068358:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155633.068373:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e4de00/0x844e5faceb5f5b3d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ebb expref: 15 pid: 8437 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.068389:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e4de00/0x844e5faceb5f5b3d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ebb expref: 15 pid: 8437 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.068406:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e4de00/0x844e5faceb5f5b3d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ebb expref: 15 pid: 8437 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.068434:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.068436:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.068440:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5f5c32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.068447:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2200/0x844e5faceb5f5c32 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.068471:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.068529:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1962:x1830976125655040:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 181us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.068534:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8288 00000100:00100000:0.0:1746155633.074028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.077749:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.077779:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.077792:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125655424 00000100:00100000:1.0:1746155633.077799:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125655424 00000100:00100000:0.0:1746155633.077806:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.077817:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155633.077823:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092872200/0x844e5faceb5f58f8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d64 expref: 302 pid: 19870 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.077870:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125655552 00000100:00100000:1.0:1746155633.077872:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125655552 00010000:00010000:1.0:1746155633.077881:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093c18800/0x844e5faceb5f5849 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ced expref: 23 pid: 19870 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.077896:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125655680 00000100:00100000:1.0:1746155633.077897:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125655680 00010000:00010000:1.0:1746155633.077904:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dd600/0x844e5faceb5f56f2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c29 expref: 303 pid: 19870 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.077910:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125655808 00000100:00100000:1.0:1746155633.077912:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125655808 00010000:00010000:1.0:1746155633.077917:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800909e7e00/0x844e5faceb5f56eb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16c22 expref: 304 pid: 15474 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.077925:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8289 00000100:00100000:1.0:1746155633.077930:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+304:1961:x1830976125655424:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155633.077939:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155633.077943:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092872200/0x844e5faceb5f58f8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d64 expref: 304 pid: 19870 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.077951:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092872200/0x844e5faceb5f58f8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d64 expref: 304 pid: 19870 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.078052:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872200/0x844e5faceb5f58f8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16d64 expref: 304 pid: 19870 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.078070:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155633.078074:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012d1f1600/0x844e5faceb5f5c6a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155633.078080:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.078102:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:1961:x1830976125655424:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 172us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.078110:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8289 00000100:00100000:0.0:1746155633.078239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.081608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.085641:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.085666:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125656192 00000100:00100000:0.0:1746155633.085672:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125656192 00000100:00100000:0.0:1746155633.085701:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10934 00000100:00100000:0.0:1746155633.085707:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:31959:x1830976125656192:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155633.085722:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155633.085736:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f5c78 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16f94 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.085783:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d1f1600/0x844e5faceb5f5c6a lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155633.085790:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f5c78 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f94 expref: 22 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.085802:0:27374:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012d1f1600/0x844e5faceb5f5c6a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155633.085813:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f5c78 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f94 expref: 22 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.085822:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155633.085825:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155633.085828:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f5c78 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16f94 expref: 22 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.085834:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a36000, rc 0) 00000100:00100000:0.0:1746155633.085863:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:31959:x1830976125656192:12345-192.168.202.51@tcp:101:cat.0 Request processed in 157us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155633.085868:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10934 00000100:00100000:0.0:1746155633.100822:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125234688:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155633.100859:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155633.100880:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125235200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155633.100891:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155633.100900:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125235712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155633.100913:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155633.100924:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125236224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155633.100935:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155633.100945:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1746155633.100948:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125235072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155633.100957:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155633.100966:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125235456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155633.100975:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155633.100983:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125236096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155633.101005:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155633.101015:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009018a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125236608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155633.101026:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155633.101042:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125234944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155633.101054:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155633.101062:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125235584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155633.101075:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155633.101080:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125235968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155633.101090:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155633.101096:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125236480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155633.101105:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155633.101118:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125236224 00000100:00100000:0.0:1746155633.101121:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125236224 00000100:00100000:0.0:1746155633.101133:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125235072 00000100:00100000:0.0:1746155633.101135:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125235072 00000100:00100000:0.0:1746155633.101141:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125235456 00000100:00100000:0.0:1746155633.101142:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125235456 00000100:00100000:0.0:1746155633.101148:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125236096 00000100:00100000:0.0:1746155633.101149:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125236096 00000100:00100000:0.0:1746155633.101154:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125236608 00000100:00100000:0.0:1746155633.101155:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125236608 00000100:00100000:0.0:1746155633.101161:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125235584 00000100:00100000:0.0:1746155633.101163:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125235584 00000100:00100000:0.0:1746155633.101168:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125236480 00000100:00100000:0.0:1746155633.101169:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125236480 00000100:00100000:0.0:1746155633.101177:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16147 00000100:00100000:0.0:1746155633.101180:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3298:x1830976125235712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155633.101202:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16148 00000100:00100000:0.0:1746155633.101206:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3298:x1830976125236224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155633.101312:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:0.0:1746155633.101315:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155633.101317:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155633.101318:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155633.101320:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155633.101337:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3298:x1830976125236224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (400us total) trans 21474841390 rc 0/0 00000100:00100000:0.0:1746155633.101342:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16148 00000100:00100000:0.0:1746155633.101351:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16150 00000100:00100000:0.0:1746155633.101356:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3298:x1830976125235456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155633.101417:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155633.101419:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155632 -> 1746155632 00002000:00010000:0.0:1746155633.101421:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155632 -> 1746155632 00002000:00010000:0.0:1746155633.101422:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155632 -> 1746155632 00002000:00010000:0.0:1746155633.101424:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155633.101440:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3298:x1830976125235456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (463us total) trans 21474841391 rc 0/0 00000100:00100000:0.0:1746155633.101444:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16150 00000100:00100000:0.0:1746155633.101453:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16152 00000100:00100000:0.0:1746155633.101456:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3298:x1830976125236608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155633.101555:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3298:x1830976125236608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (527us total) trans 21474841393 rc 0/0 00000100:00100000:0.0:1746155633.101560:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16152 00000100:00100000:0.0:1746155633.101569:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16154 00000100:00100000:0.0:1746155633.101573:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976125235584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155633.101665:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976125235584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (588us total) trans 17179874050 rc 0/0 00000100:00100000:0.0:1746155633.101670:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16154 00000100:00100000:0.0:1746155633.101678:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16156 00000100:00100000:0.0:1746155633.101683:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976125236480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155633.101750:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976125236480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (643us total) trans 21474841395 rc 0/0 00000100:00100000:0.0:1746155633.101755:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16156 00000100:00100000:0.0:1746155633.101763:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125234816 00000100:00100000:0.0:1746155633.101765:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125234816 00000100:00100000:0.0:1746155633.101775:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125235328 00000100:00100000:0.0:1746155633.101777:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125235328 00000100:00100000:0.0:1746155633.101782:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125235840 00000100:00100000:0.0:1746155633.101783:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125235840 00000100:00100000:0.0:1746155633.101788:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125236352 00000100:00100000:0.0:1746155633.101790:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125236352 00000100:00100000:0.0:1746155633.101795:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16158 00000100:00100000:0.0:1746155633.101799:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976125235328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155633.101869:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125235328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (131us total) trans 17179874051 rc 0/0 00000100:00100000:0.0:1746155633.101874:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16158 00000100:00100000:0.0:1746155633.101882:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16160 00000100:00100000:0.0:1746155633.101886:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125236352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155633.101951:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125236352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (175us total) trans 21474841397 rc 0/0 00000100:00100000:0.0:1746155633.101956:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16160 00000004:00080000:0.0:1746155633.101975:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131496d80/2, rc 0, transno 17179874049 00000100:00100000:0.0:1746155633.101978:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131496d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125234944:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155633.101983:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131495180/2, rc 0, transno 17179874050 00000100:00100000:0.0:1746155633.101985:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125235584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155633.102619:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976125235712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1437us (1704us total) trans 17179874052 rc 0/0 00000100:00100000:1.0:1746155633.102625:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16147 00000100:00100000:1.0:1746155633.102706:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125234816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 911us (995us total) trans 17179874053 rc 0/0 00000100:00100000:1.0:1746155633.102711:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16157 00000004:00080000:0.0:1746155633.103485:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090188e00/2, rc 0, transno 21474841394 00000100:00100000:0.0:1746155633.103489:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125235968:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155633.103784:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090188700/2, rc 0, transno 21474841395 00000100:00100000:0.0:1746155633.103787:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125236480:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155633.103803:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125236864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155633.104225:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155633.104246:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131494a80/2, rc 0, transno 17179874048 00000100:00100000:0.0:1746155633.104249:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125235072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155633.104256:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009018bb80/2, rc 0, transno 21474841391 00000100:00100000:0.0:1746155633.104259:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009018bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125235456:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155633.104266:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090189180/2, rc 0, transno 21474841392 00000100:00100000:0.0:1746155633.104268:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125236096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155633.104274:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009018a300/2, rc 0, transno 21474841393 00000100:00100000:0.0:1746155633.104276:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009018a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125236608:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155633.104282:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090188a80/2, rc 0, transno 21474841390 00000100:00100000:0.0:1746155633.104284:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125236224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155633.104290:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366f800/2, rc 0, transno 17179874046 00000100:00100000:0.0:1746155633.104292:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125234688:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155633.104297:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131495f80/2, rc 0, transno 17179874047 00000100:00100000:0.0:1746155633.104298:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125235200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155633.104303:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131497100/2, rc 0, transno 17179874052 00000100:00100000:0.0:1746155633.104305:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125235712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155633.104665:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6d9c00/2, rc 0, transno 17179874054 00000100:00100000:0.0:1746155633.104669:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125236864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155633.105924:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.105959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.106008:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125656704 00000100:00100000:1.0:1746155633.106012:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125656704 00000100:00100000:1.0:1746155633.106029:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10936 00000100:00100000:1.0:1746155633.106033:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:31964:x1830976125656704:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.106042:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.106049:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dde00/0x844e5faceb5f5c86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16fa2 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.106121:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dce00/0x844e5faceb5f5c94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106132:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dce00/0x844e5faceb5f5c94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106140:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dce00/0x844e5faceb5f5c94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106150:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ddc00/0x844e5faceb5f5c9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106154:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ddc00/0x844e5faceb5f5c9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106163:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ddc00/0x844e5faceb5f5c9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106241:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dc200/0x844e5faceb5f5ca9 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106262:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dc200/0x844e5faceb5f5ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106267:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dc200/0x844e5faceb5f5ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155633.106273:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155633.106335:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dc200/0x844e5faceb5f5ca9 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106341:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dc200/0x844e5faceb5f5ca9 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106346:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dc200/0x844e5faceb5f5ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106350:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800949dc200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.106353:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dc200/0x844e5faceb5f5ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106359:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dc200/0x844e5faceb5f5ca9 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106367:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155633.106370:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155633.106372:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f5cb0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155633.106381:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dc200/0x844e5faceb5f5ca9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106385:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dc200/0x844e5faceb5f5ca9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106394:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dce00/0x844e5faceb5f5c94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106398:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dce00/0x844e5faceb5f5c94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106402:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dce00/0x844e5faceb5f5c94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106406:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800949dce00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.106408:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dce00/0x844e5faceb5f5c94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106412:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dce00/0x844e5faceb5f5c94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106418:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155633.106419:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155633.106421:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dce00/0x844e5faceb5f5c94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106425:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dce00/0x844e5faceb5f5c94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106430:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ddc00/0x844e5faceb5f5c9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106434:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ddc00/0x844e5faceb5f5c9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106438:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ddc00/0x844e5faceb5f5c9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106441:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800949ddc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.106443:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ddc00/0x844e5faceb5f5c9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106447:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ddc00/0x844e5faceb5f5c9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106451:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0200) 00010000:00010000:1.0:1746155633.106452:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155633.106453:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ddc00/0x844e5faceb5f5c9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106457:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800949ddc00/0x844e5faceb5f5c9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155633.106480:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dde00/0x844e5faceb5f5c86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fa2 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.106486:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dde00/0x844e5faceb5f5c86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fa2 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.106492:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800949dde00, rc 0) 00000100:00100000:1.0:1746155633.106534:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:31964:x1830976125656704:12345-192.168.202.51@tcp:101:cat.0 Request processed in 499us (574us total) trans 8589945059 rc 301/301 00000100:00100000:1.0:1746155633.106540:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10936 00000100:00100000:0.0:1746155633.107671:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.107750:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.108729:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125656832 00000100:00100000:1.0:1746155633.108734:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125656832 00000100:00100000:1.0:1746155633.108756:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10937 00000100:00100000:1.0:1746155633.108761:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:31955:x1830976125656832:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155633.108772:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.108785:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dca00/0x844e5faceb5f5cbe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16fa9 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.108818:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dca00/0x844e5faceb5f5cbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fa9 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.108829:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dca00/0x844e5faceb5f5cbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fa9 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.108844:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155633.108846:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155633.108849:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800949dca00, rc 0) 00000100:00100000:1.0:1746155633.108874:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:31955:x1830976125656832:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 112us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.108879:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10937 00000100:00100000:0.0:1746155633.110018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.110547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.115651:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.115733:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.116408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.116491:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10938 00000100:00100000:0.0:1746155633.116497:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:31955:x1830976125657728:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155633.116520:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155633.116533:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0600/0x844e5faceb5f5ccc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16fb0 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.116589:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c1a00/0x844e5faceb5f5cda lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155633.116609:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c1a00/0x844e5faceb5f5cda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155633.116614:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c1a00/0x844e5faceb5f5cda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155633.116626:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:0.0:1746155633.116629:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155633.116639:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c1a00/0x844e5faceb5f5cda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155633.116656:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0600/0x844e5faceb5f5ccc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fb0 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.116667:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c1a00/0x844e5faceb5f5cda lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fb0 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.116683:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155633.116685:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155633.116686:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3c1a00, rc 0) 00000100:00100000:0.0:1746155633.116721:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:31955:x1830976125657728:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 224us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155633.116726:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10938 00000100:00100000:0.0:1746155633.119072:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.119114:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.119164:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125658112 00000100:00100000:1.0:1746155633.119170:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125658112 00000100:00100000:1.0:1746155633.119199:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16162 00000100:00100000:1.0:1746155633.119205:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1960:x1830976125658112:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155633.119216:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.119229:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800949dd200/0x844e5faceb5f5ce8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16fc5 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.119245:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.119247:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.119254:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800949dd200/0x844e5faceb5f5ce8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fc5 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.119266:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800949dd200/0x844e5faceb5f5ce8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fc5 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.119274:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800949dd200, rc 0) 00000100:00100000:1.0:1746155633.119294:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125658112:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 90us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.119300:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16162 00000100:00100000:0.0:1746155633.119356:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.119368:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.119380:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.119392:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.119409:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.119697:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16165 00000100:00100000:1.0:1746155633.119703:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125658752:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155633.119709:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.119716:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800949dc400/0x844e5faceb5f5cfd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16fe1 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155633.119727:0:10591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e4:0x0] initial LVB size: 5079552, mtime: 0x68143871, atime: 0x68143870, ctime: 0x68143871, blocks: 0x170f 00010000:00010000:1.0:1746155633.119734:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.119735:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.119739:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800949dc400/0x844e5faceb5f5cfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fe1 expref: 8 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.119747:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800949dc400/0x844e5faceb5f5cfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fe1 expref: 8 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.119753:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800949dc400, rc 0) 00000100:00100000:1.0:1746155633.119764:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125658752:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 62us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.119769:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16165 00000100:00100000:1.0:1746155633.119777:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16167 00000100:00100000:1.0:1746155633.119781:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125658880:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155633.119785:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.119791:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800949dd800/0x844e5faceb5f5d0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16fe8 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155633.119800:0:10591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e2:0x0] initial LVB size: 4194304, mtime: 0x68143871, atime: 0x68143870, ctime: 0x68143870, blocks: 0x1029 00010000:00010000:1.0:1746155633.119806:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.119807:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.119810:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800949dd800/0x844e5faceb5f5d0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fe8 expref: 9 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.119817:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800949dd800/0x844e5faceb5f5d0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fe8 expref: 9 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.119823:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800949dd800, rc 0) 00000100:00100000:1.0:1746155633.119835:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125658880:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 54us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.119839:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16167 00000100:00100000:0.0:1746155633.124884:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.124921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.124948:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.124969:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.124981:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.125013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.125028:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125659392 00000100:00100000:0.0:1746155633.125030:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125659392 00000100:00100000:0.0:1746155633.125379:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16168 00000100:00100000:0.0:1746155633.125387:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976125659008:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155633.125401:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155633.125413:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e4c800/0x844e5faceb5f5d3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16fef expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.125430:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155633.125432:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155633.125438:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e4c800/0x844e5faceb5f5d3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fef expref: 22 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155633.125451:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e4c800/0x844e5faceb5f5d3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fef expref: 22 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155633.125461:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e4c800, rc 0) 00000100:00100000:1.0:1746155633.125530:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16170 00000100:00100000:1.0:1746155633.125537:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976125659264:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.125543:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.125550:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800949dde00/0x844e5faceb5f5d43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f16ffd expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.125563:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.125564:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.125568:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800949dde00/0x844e5faceb5f5d43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ffd expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.125576:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800949dde00/0x844e5faceb5f5d43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ffd expref: 18 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.125582:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800949dde00, rc 0) 00000100:00100000:1.0:1746155633.125875:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976125659264:12345-192.168.202.51@tcp:101:cat.0 Request processed in 339us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.125879:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16170 00000100:00100000:0.0:1746155633.125885:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976125659008:12345-192.168.202.51@tcp:101:cat.0 Request processed in 500us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155633.126136:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16168 00000100:00100000:0.0:1746155633.139785:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.152137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.152492:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.152531:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125660288 00000100:00100000:1.0:1746155633.152537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.152539:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125660288 00000100:00100000:1.0:1746155633.152550:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:0.0:1746155633.152560:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff8800936f4700 x1830976125660288/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155633.152567:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4700 with x1830976125660288 ext(0->1048575) 00002000:00010000:0.0:1746155633.152570:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936f4700 00000100:00100000:1.0:1746155633.152583:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.152584:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125660544 00000100:00100000:0.0:1746155633.152586:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125660544 00000100:00100000:1.0:1746155633.152599:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125660800 00002000:00100000:0.0:1746155633.152601:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800936f6680 x1830976125660544/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155633.152602:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125660800 00002000:00100000:0.0:1746155633.152607:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6680 with x1830976125660544 ext(1048576->2097151) 00002000:00010000:0.0:1746155633.152609:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f6680 00002000:00100000:1.0:1746155633.152616:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800936f4380 x1830976125660800/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155633.152621:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125661056 00002000:00100000:1.0:1746155633.152623:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4380 with x1830976125660800 ext(1048576->2097151) 00000100:00100000:0.0:1746155633.152624:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125661056 00002000:00010000:1.0:1746155633.152626:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f4380 00002000:00100000:0.0:1746155633.152633:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800936f4a80 x1830976125661056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155633.152637:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7635 00000100:00100000:1.0:1746155633.152642:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976125660288:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:0.0:1746155633.152643:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4a80 with x1830976125661056 ext(1048576->2097151) 00002000:00010000:0.0:1746155633.152646:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936f4a80 00000100:00100000:0.0:1746155633.152661:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7636 00000100:00100000:0.0:1746155633.152667:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976125660544:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155633.152783:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7637 00000100:00100000:1.0:1746155633.152788:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976125660800:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155633.171530:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976125660800:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18708us (18946us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155633.171540:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7637 00002000:00100000:1.0:1746155633.171550:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800936f4380 x1830976125660800/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/440 e 0 to 0 dl 1746155644 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.171559:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4380 with x1830976125660800 ext(1048576->2097151) 00002000:00010000:1.0:1746155633.171564:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f4380 00000100:00100000:0.0:1746155633.179603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.180565:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976125660544:12345-192.168.202.51@tcp:3:cat.0 Request processed in 27896us (28026us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155633.180572:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7636 00002000:00100000:1.0:1746155633.180579:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800936f6680 x1830976125660544/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/440 e 0 to 0 dl 1746155644 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.180587:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6680 with x1830976125660544 ext(1048576->2097151) 00002000:00010000:1.0:1746155633.180590:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f6680 00000100:00100000:0.0:1746155633.190034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.190118:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.190142:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125661568 00000100:00100000:0.0:1746155633.190148:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125661568 00010000:00010000:0.0:1746155633.190169:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d1f1c00/0x844e5faceb5f5ce1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fb7 expref: 290 pid: 19870 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746155633.190271:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125661440 00000100:00100000:0.0:1746155633.190274:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125661440 00010000:00010000:0.0:1746155633.190286:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c1a00/0x844e5faceb5f5cda lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fb0 expref: 8 pid: 14234 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.190315:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8295 00000100:00100000:1.0:1746155633.190324:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1960:x1830976125661568:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155633.190333:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155633.190339:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d1f1c00/0x844e5faceb5f5ce1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fb7 expref: 290 pid: 19870 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.190356:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d1f1c00/0x844e5faceb5f5ce1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fb7 expref: 290 pid: 19870 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.190433:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d1f1c00/0x844e5faceb5f5ce1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fb7 expref: 290 pid: 19870 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.190470:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155633.190473:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f5d6d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.190479:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f5d6d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.190483:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.190518:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1960:x1830976125661568:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 179us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.190523:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8295 00000100:00100000:0.0:1746155633.192262:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.192380:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125661696 00000100:00100000:1.0:1746155633.192384:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125661696 00010000:00010000:1.0:1746155633.192401:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dca00/0x844e5faceb5f5cbe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fa9 expref: 7 pid: 14234 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.192430:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8297 00000100:00100000:1.0:1746155633.192436:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125661696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155633.192443:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155633.192448:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dca00/0x844e5faceb5f5cbe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fa9 expref: 7 pid: 14234 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746155633.193804:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976125660288:12345-192.168.202.51@tcp:3:cat.0 Request processed in 41157us (41307us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155633.193812:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7635 00002000:00100000:0.0:1746155633.193821:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff8800936f4700 x1830976125660288/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/440 e 0 to 0 dl 1746155644 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155633.193829:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4700 with x1830976125660288 ext(0->1048575) 00002000:00010000:0.0:1746155633.193832:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936f4700 00010000:00010000:1.0:1746155633.193922:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dca00/0x844e5faceb5f5cbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fa9 expref: 7 pid: 14234 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.193944:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800949dca00/0x844e5faceb5f5cbe lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fa9 expref: 7 pid: 14234 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.193955:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155633.193959:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f5d6d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.193966:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f5d6d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.193971:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f5d6d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.193987:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.194017:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1960:x1830976125661696:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1581us (1759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.194024:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8297 00010000:00010000:1.0:1746155633.194048:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f5d6d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.194053:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f5d6d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155633.196955:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125661824 00000100:00100000:0.0:1746155633.196962:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125661824 00000100:00100000:0.0:1746155633.197006:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16175 00000100:00100000:0.0:1746155633.197013:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:31959:x1830976125661824:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155633.197030:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155633.197043:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1600/0x844e5faceb5f5d74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17027 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.197061:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155633.197063:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155633.197069:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1600/0x844e5faceb5f5d74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17027 expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.197081:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1600/0x844e5faceb5f5d74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17027 expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.197089:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d1f1600, rc 0) 00000100:00100000:0.0:1746155633.197121:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:31959:x1830976125661824:12345-192.168.202.51@tcp:101:cat.0 Request processed in 109us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155633.197126:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16175 00000040:00080000:1.0:1746155633.198112:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3435, 88 off289184 00000004:00080000:1.0:1746155633.198118:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762347614571ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155633.198143:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3456, 88 off291296 00000004:00080000:1.0:1746155633.198147:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762347643748ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155633.198172:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3457, 88 off291384 00000004:00080000:1.0:1746155633.198175:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762347672016ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155633.198182:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3436, 88 off289272 00000004:00080000:1.0:1746155633.198186:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762347682772ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155633.198192:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3437, 88 off289360 00000004:00080000:1.0:1746155633.198194:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762347691088ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155633.198203:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3458, 88 off291472 00000004:00080000:1.0:1746155633.198205:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762347702186ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155633.199077:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3459, 88 off291560 00000004:00080000:1.0:1746155633.199085:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762348581174ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155633.199111:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3460, 88 off291648 00000004:00080000:1.0:1746155633.199114:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762348610819ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155633.199125:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3438, 88 off289448 00000004:00080000:1.0:1746155633.199127:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762348624077ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155633.199133:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3461, 88 off291736 00000004:00080000:1.0:1746155633.199136:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762348632714ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155633.199141:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3439, 88 off289536 00000004:00080000:1.0:1746155633.199144:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762348640714ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155633.199149:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3462, 88 off291824 00000004:00080000:1.0:1746155633.199151:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762348648619ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155633.199157:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3440, 88 off289624 00000004:00080000:1.0:1746155633.199159:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762348656651ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155633.199166:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3441, 88 off289712 00000004:00080000:1.0:1746155633.199168:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762348665291ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155633.199174:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3442, 88 off289800 00000004:00080000:1.0:1746155633.199180:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762348677589ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155633.199187:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3443, 88 off289888 00000004:00080000:1.0:1746155633.199189:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 762348686119ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155633.199195:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3463, 88 off291912 00000004:00080000:1.0:1746155633.199197:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 762348694469ns, next at 716011101328ns, rc = 0 00000100:00100000:0.0:1746155633.208851:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155633.242758:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f5d6d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17020 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.242772:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155633.242775:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746155633.242778:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131004600/0x844e5faceb5f5d7b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1702e expref: 11 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.242787:0:27374:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131004600/0x844e5faceb5f5d7b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1702e expref: 11 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.242793:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131004600/0x844e5faceb5f5d7b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1702e expref: 11 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.242799:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a800/0x844e5faceb5f5d82 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17035 expref: 289 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.242805:0:27374:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a800/0x844e5faceb5f5d82 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17035 expref: 289 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.242811:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a800/0x844e5faceb5f5d82 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17035 expref: 289 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.242843:0:27374:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009520a800/0x844e5faceb5f5d82 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17035 expref: 289 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155633.242854:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125237504:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155633.242937:0:27374:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131004600/0x844e5faceb5f5d7b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1702e expref: 11 pid: 19870 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155633.242948:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125237632:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155633.242965:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155633.247767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.248205:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125237504:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155633.248214:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125237632:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155633.248240:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c000/0x844e5faceb5f5d66 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17020 expref: 9 pid: 27374 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746155633.248255:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f5d6d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17020 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.248272:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd4d600, rc 0) 00000100:00100000:1.0:1746155633.248306:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:31962:x1830976125661312:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 68576us (68712us total) trans 8589945063 rc 0/0 00000100:00100000:1.0:1746155633.248313:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10941 00000100:00100000:0.0:1746155633.248832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.254745:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.267191:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7640 00000100:00100000:1.0:1746155633.267203:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976125662848:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155633.276950:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976125662848:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9743us (11989us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155633.276960:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7640 00002000:00100000:1.0:1746155633.276969:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88012cdeca80 x1830976125662848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/440 e 0 to 0 dl 1746155644 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.276978:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeca80 with x1830976125662848 ext(1048576->2097151) 00002000:00010000:1.0:1746155633.276982:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdeca80 00000100:00100000:0.0:1746155633.290132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.290498:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.291043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.291611:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.291650:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125663488 00000100:00100000:0.0:1746155633.291659:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125663488 00002000:00100000:0.0:1746155633.291702:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88012b6c0700 x1830976125663488/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155633.291716:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c0700 with x1830976125663488 ext(1048576->2097151) 00002000:00010000:0.0:1746155633.291721:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c0700 00000100:00100000:1.0:1746155633.292482:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125662976 00000100:00100000:1.0:1746155633.292486:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125662976 00000100:00100000:0.0:1746155633.292906:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7641 00000100:00100000:0.0:1746155633.292916:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976125663488:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155633.293838:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16193 00000100:00100000:1.0:1746155633.293845:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976125663104:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.293854:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.293866:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e4d400/0x844e5faceb5f5d89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17043 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.293881:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.293883:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.293890:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e4d400/0x844e5faceb5f5d89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17043 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.293903:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e4d400/0x844e5faceb5f5d89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17043 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.293912:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e4d400, rc 0) 00000100:00100000:1.0:1746155633.293954:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125663104:12345-192.168.202.51@tcp:101:cat.0 Request processed in 110us (3833us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.293959:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16193 00000100:00100000:1.0:1746155633.293974:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16194 00000100:00100000:1.0:1746155633.293978:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125662976:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.293984:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.294000:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e4de00/0x844e5faceb5f5d90 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1703c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.294009:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.294011:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.294015:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e4de00/0x844e5faceb5f5d90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1703c expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.294023:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e4de00/0x844e5faceb5f5d90 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1703c expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.294028:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e4de00, rc 0) 00000100:00100000:1.0:1746155633.294040:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a380050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125662976:12345-192.168.202.51@tcp:101:cat.0 Request processed in 62us (3543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.294044:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16194 00000100:00100000:1.0:1746155633.294139:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16195 00000100:00100000:1.0:1746155633.294145:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:31962:x1830976125663232:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155633.294150:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.294156:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e4ce00/0x844e5faceb5f5d97 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1704a expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.294168:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1000/0x844e5faceb5f5d04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fda expref: 7 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.294174:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1600/0x844e5faceb5f5d74 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17027 expref: 11 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.294181:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5f5d51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17004 expref: 21 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.294185:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.294186:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.294189:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e4ce00/0x844e5faceb5f5d97 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1810432->2097151] (req 1810432->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1704a expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.294211:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5f5d51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17004 expref: 21 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.294221:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5f5d51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17004 expref: 21 pid: 4461 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.294230:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125239936:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155633.294275:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1600/0x844e5faceb5f5d74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17027 expref: 11 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.294282:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1600/0x844e5faceb5f5d74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17027 expref: 11 pid: 20796 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.294289:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125240064:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155633.294308:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1000/0x844e5faceb5f5d04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fda expref: 7 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.294315:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1000/0x844e5faceb5f5d04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fda expref: 7 pid: 9235 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.294321:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125240192:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155633.294332:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155633.318028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.318060:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.318100:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125663616 00000100:00100000:0.0:1746155633.318107:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125663616 00010000:00010000:0.0:1746155633.318132:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5f5d51 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17004 expref: 22 pid: 4461 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746155633.318154:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8298 00000100:00100000:0.0:1746155633.318159:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976125663616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155633.318169:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155633.318185:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5f5d51 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17004 expref: 22 pid: 4461 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746155633.318194:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5f5d51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17004 expref: 22 pid: 4461 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746155633.318213:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155633.318713:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd4c200/0x844e5faceb5f5d51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17004 expref: 22 pid: 4461 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.318872:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125239936:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155633.318884:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125240064:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155633.318891:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1000/0x844e5faceb5f5d04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fda expref: 7 pid: 9235 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.318904:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125240192:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155633.318925:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e4ce00/0x844e5faceb5f5d97 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1810432->2097151] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1704a expref: 11 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.319049:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e4ce00, rc 0) 00000100:00100000:1.0:1746155633.319072:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:31962:x1830976125663232:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 24927us (28030us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.319137:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16195 00000100:00100000:0.0:1746155633.320204:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976125663616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2044us (2181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155633.320210:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8298 00000100:00100000:1.0:1746155633.320236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.320714:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125663872 00000100:00100000:0.0:1746155633.320720:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125663872 00010000:00010000:0.0:1746155633.320737:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1600/0x844e5faceb5f5d74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17027 expref: 11 pid: 20796 timeout: 862 lvb_type: 0 00000100:00100000:0.0:1746155633.320762:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8300 00000100:00100000:0.0:1746155633.320768:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976125663872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155633.320777:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155633.320790:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1600/0x844e5faceb5f5d74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17027 expref: 11 pid: 20796 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746155633.320800:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1600/0x844e5faceb5f5d74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17027 expref: 11 pid: 20796 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746155633.320815:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d1f1600/0x844e5faceb5f5d74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17027 expref: 11 pid: 20796 timeout: 862 lvb_type: 0 00010000:00010000:0.0:1746155633.320827:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155633.320829:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155633.320834:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e4ce00/0x844e5faceb5f5d97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1704a expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.320840:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e4ce00/0x844e5faceb5f5d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1704a expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.320865:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094e4ce00/0x844e5faceb5f5d97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1704a expref: 10 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155633.320875:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125240320:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155633.320927:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155633.324005:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.324037:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.324062:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.324084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.324123:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125664128 00000100:00100000:0.0:1746155633.324129:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125664128 00002000:00100000:0.0:1746155633.324161:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012b6c1c00 x1830976125664128/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155633.324169:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c1c00 with x1830976125664128 ext(2097152->3145727) 00002000:00010000:0.0:1746155633.324173:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b6c1c00 00000100:00100000:0.0:1746155633.324184:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125664512 00000100:00100000:0.0:1746155633.324186:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125664512 00002000:00100000:0.0:1746155633.324195:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012b6c2300 x1830976125664512/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155633.324201:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c2300 with x1830976125664512 ext(2097152->3145727) 00002000:00010000:0.0:1746155633.324204:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c2300 00000100:00100000:0.0:1746155633.324210:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125664640 00000100:00100000:0.0:1746155633.324212:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125664640 00002000:00100000:0.0:1746155633.324219:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88012b6c2d80 x1830976125664640/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155633.324225:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c2d80 with x1830976125664640 ext(3145728->4194303) 00002000:00010000:0.0:1746155633.324227:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c2d80 00000100:00100000:0.0:1746155633.324232:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125664768 00000100:00100000:0.0:1746155633.324234:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125664768 00002000:00100000:0.0:1746155633.324240:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012b6c3b80 x1830976125664768/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155633.324252:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c3b80 with x1830976125664768 ext(3145728->4194303) 00002000:00010000:0.0:1746155633.324254:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b6c3b80 00000100:00100000:0.0:1746155633.324264:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7642 00000100:00100000:0.0:1746155633.324269:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125664128:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155633.325930:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7643 00000100:00100000:0.0:1746155633.325939:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976125664512:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155633.347389:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125664128:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23112us (23390us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155633.347398:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7642 00002000:00100000:0.0:1746155633.347406:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012b6c1c00 x1830976125664128/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:704/0 lens 488/440 e 0 to 0 dl 1746155644 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155633.347413:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c1c00 with x1830976125664128 ext(2097152->3145727) 00002000:00010000:0.0:1746155633.347418:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b6c1c00 00000100:00100000:0.0:1746155633.352938:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.358179:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.358321:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125666304 00000100:00100000:1.0:1746155633.358329:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125666304 00002000:00100000:1.0:1746155633.358363:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1810432->2097151) req@ffff88012b6c0a80 x1830976125666304/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.358372:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c0a80 with x1830976125666304 ext(1810432->2097151) 00010000:00010000:1.0:1746155633.358380:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094e4ce00/0x844e5faceb5f5d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1704a expref: 11 pid: 8436 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.358395:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094e4ce00/0x844e5faceb5f5d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1704a expref: 11 pid: 8436 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746155633.358402:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b6c0a80 00000100:00100000:1.0:1746155633.358429:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1296 00000100:00100000:1.0:1746155633.358436:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125666304:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155633.360715:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.367567:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.369210:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1961:x1830976125666304:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10769us (11035us total) trans 17179874064 rc 0/0 00000100:00100000:1.0:1746155633.369220:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1296 00002000:00100000:1.0:1746155633.369228:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1810432->2097151) req@ffff88012b6c0a80 x1830976125666304/t17179874064(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:704/0 lens 488/448 e 0 to 0 dl 1746155644 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155633.370321:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.370409:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.370429:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:1.0:1746155633.371667:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c0a80 with x1830976125666304 ext(1810432->2097151) 00010000:00010000:1.0:1746155633.371675:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094e4ce00/0x844e5faceb5f5d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1704a expref: 12 pid: 8436 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.371684:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094e4ce00/0x844e5faceb5f5d97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1810432->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1704a expref: 12 pid: 8436 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746155633.371689:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b6c0a80 00000100:00100000:0.0:1746155633.371825:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.371884:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.376055:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125667200 00000100:00100000:1.0:1746155633.376064:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125667200 00000100:00100000:1.0:1746155633.376109:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16200 00000100:00100000:1.0:1746155633.376116:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:31959:x1830976125667200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.376132:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.376145:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a236600/0x844e5faceb5f5dba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1706d expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.376167:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c046600/0x844e5faceb5f5dac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1705f expref: 12 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.376174:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155633.376175:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155633.376178:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a236600/0x844e5faceb5f5dba lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1706d expref: 12 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.376199:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c046600/0x844e5faceb5f5dac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1705f expref: 12 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.376207:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c046600/0x844e5faceb5f5dac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1705f expref: 12 pid: 8438 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.376215:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125242112:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155633.376280:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155633.376628:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.376658:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.380366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.380403:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.380437:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.380584:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125667712 00000100:00100000:1.0:1746155633.380591:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125667712 00002000:00100000:1.0:1746155633.380622:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fb6b480 x1830976125667712/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.380631:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b480 with x1830976125667712 ext(1048576->2097151) 00002000:00010000:1.0:1746155633.380635:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6b480 00000100:00100000:1.0:1746155633.380648:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125668096 00000100:00100000:1.0:1746155633.380650:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125668096 00002000:00100000:1.0:1746155633.380659:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2404352->2408447) req@ffff88009fb6b800 x1830976125668096/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.380665:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b800 with x1830976125668096 ext(2404352->2408447) 00010000:00010000:1.0:1746155633.380670:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c046600/0x844e5faceb5f5dac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1705f expref: 12 pid: 8438 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.380679:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c046600/0x844e5faceb5f5dac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1705f expref: 12 pid: 8438 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746155633.380684:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb6b800 00000100:00100000:1.0:1746155633.380694:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1297 00000100:00100000:1.0:1746155633.380700:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125668096:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155633.380833:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125668096:12345-192.168.202.51@tcp:3:cat.0 Request processed in 132us (395us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155633.380839:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1297 00002000:00100000:1.0:1746155633.380844:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2404352->2408447) req@ffff88009fb6b800 x1830976125668096/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:704/0 lens 488/4536 e 0 to 0 dl 1746155644 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.380851:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b800 with x1830976125668096 ext(2404352->2408447) 00010000:00010000:1.0:1746155633.380855:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c046600/0x844e5faceb5f5dac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1705f expref: 12 pid: 8438 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.380864:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c046600/0x844e5faceb5f5dac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1705f expref: 12 pid: 8438 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746155633.380869:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb6b800 00000100:00100000:1.0:1746155633.380879:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7647 00000100:00100000:1.0:1746155633.380883:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976125667712:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155633.388376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.388408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.389459:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125668608 00000100:00100000:1.0:1746155633.389463:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125668608 00000100:00100000:1.0:1746155633.389488:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4608 00000100:00100000:1.0:1746155633.389493:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:31962:x1830976125668608:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155633.389690:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:31962:x1830976125668608:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 196us (1280us total) trans 8589945064 rc 0/0 00000100:00100000:1.0:1746155633.389696:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4608 00000100:00100000:0.0:1746155633.390915:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.392248:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976125667712:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 11363us (11889us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155633.392254:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7647 00002000:00100000:1.0:1746155633.392258:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fb6b480 x1830976125667712/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/440 e 0 to 0 dl 1746155644 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.392265:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b480 with x1830976125667712 ext(1048576->2097151) 00002000:00010000:1.0:1746155633.392268:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6b480 00000100:00100000:0.0:1746155633.395931:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.400462:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.401451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.409197:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.416674:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.416710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.416732:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.416761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.417145:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7651 00000100:00100000:0.0:1746155633.417152:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976125670400:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155633.431905:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976125670400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14752us (15192us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155633.431912:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7651 00002000:00100000:0.0:1746155633.431917:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009fb68700 x1830976125670400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/440 e 0 to 0 dl 1746155644 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155633.431924:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68700 with x1830976125670400 ext(2097152->3145727) 00002000:00010000:0.0:1746155633.431927:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb68700 00000100:00100000:0.0:1746155633.439699:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.441708:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.441776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.441813:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125670784 00000100:00100000:1.0:1746155633.441820:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125670784 00000100:00100000:1.0:1746155633.441851:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125670912 00000100:00100000:1.0:1746155633.441854:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125670912 00000100:00100000:1.0:1746155633.441869:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125671040 00000100:00100000:1.0:1746155633.441872:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125671040 00000100:00100000:1.0:1746155633.441885:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16202 00000100:00100000:1.0:1746155633.441892:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976125670784:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.441906:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.441921:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbea200/0x844e5faceb5f5dc8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1707b expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155633.441964:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125242496:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155633.442046:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155633.442060:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16203 00000100:00100000:1.0:1746155633.442065:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976125670912:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.442072:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.442079:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb600/0x844e5faceb5f5dcf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17082 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155633.442101:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125242624:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155633.442122:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155633.442188:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16204 00000100:00100000:1.0:1746155633.442193:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976125671040:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.442198:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.442205:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5646600/0x844e5faceb5f5dd6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17089 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.442215:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.442217:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.442223:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5646600/0x844e5faceb5f5dd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17089 expref: 15 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.442239:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5646600/0x844e5faceb5f5dd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17089 expref: 15 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.442247:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5646600, rc 0) 00000100:00100000:1.0:1746155633.442261:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976125671040:12345-192.168.202.51@tcp:101:cat.0 Request processed in 68us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.442265:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16204 00002000:00010000:0.0:1746155633.446232:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime: 1746155632 -> 1746155633 00002000:00010000:0.0:1746155633.446236:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime: 1746155632 -> 1746155633 00002000:00010000:0.0:1746155633.446239:0:8436:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime: 1746155632 -> 1746155633 00000100:00100000:0.0:1746155633.446253:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125242624:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155633.446276:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb600/0x844e5faceb5f5dcf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17082 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155633.446288:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb600/0x844e5faceb5f5dcf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17082 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155633.446312:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbeb600, rc 0) 00000100:00100000:0.0:1746155633.446335:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976125670912:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4269us (4633us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155633.446341:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16203 00000100:00100000:0.0:1746155633.463037:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.465587:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.490455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.490542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.490580:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125671680 00000100:00100000:1.0:1746155633.490588:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125671680 00000100:00100000:1.0:1746155633.490619:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125671808 00000100:00100000:1.0:1746155633.490621:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125671808 00000100:00100000:1.0:1746155633.490750:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16206 00000100:00100000:1.0:1746155633.490755:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1963:x1830976125671808:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.490762:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.490769:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb600/0x844e5faceb5f5de4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17097 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155633.490791:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125242880:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155633.490822:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155633.497626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.497665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.497886:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16208 00000100:00100000:1.0:1746155633.497894:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976125671936:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.497902:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.497911:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbebe00/0x844e5faceb5f5df2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1709e expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155633.497943:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125243008:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155633.498678:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155633.501319:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125243008:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155633.501345:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbebe00/0x844e5faceb5f5df2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1709e expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.501356:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbebe00/0x844e5faceb5f5df2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1709e expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.501633:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbebe00, rc 0) 00000100:00100000:1.0:1746155633.501653:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976125671936:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3759us (3986us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155633.501658:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16208 00000100:00100000:0.0:1746155633.504715:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.528748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.528878:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125672576 00000100:00100000:1.0:1746155633.528886:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125672576 00000100:00100000:1.0:1746155633.528938:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10944 00000100:00100000:1.0:1746155633.528949:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:31973:x1830976125672576:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155633.528969:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.528984:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f5df9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f170ac expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.529094:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529105:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529114:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529123:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f5e07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529129:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f5e07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529133:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f5e07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529214:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e0e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529221:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e0e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529226:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e0e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155633.529234:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155633.529292:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e0e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529298:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e0e lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529303:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e0e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529307:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbeb200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.529311:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e0e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529317:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e0e lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529325:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155633.529327:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155633.529331:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e0e lrc: 2/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529335:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e0e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529361:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529366:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e00 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529370:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529374:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbea600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.529376:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529381:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529387:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155633.529389:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155633.529391:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529395:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529403:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f5e07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529407:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f5e07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529412:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f5e07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529415:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbeac00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.529417:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f5e07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529421:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f5e07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529426:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0200) 00010000:00010000:1.0:1746155633.529428:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155633.529430:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f5e07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529434:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f5e07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.529459:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f5df9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170ac expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.529466:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f5df9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170ac expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.529472:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbeb800, rc 0) 00000100:00100000:1.0:1746155633.529534:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:31973:x1830976125672576:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 589us (792us total) trans 8589945067 rc 301/301 00000100:00100000:1.0:1746155633.529539:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10944 00000100:00100000:0.0:1746155633.536695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.536765:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125672704 00000100:00100000:1.0:1746155633.536772:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125672704 00000100:00100000:1.0:1746155633.536811:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16209 00000100:00100000:1.0:1746155633.536818:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:31973:x1830976125672704:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155633.536831:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.536844:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f5e1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f170b3 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.536870:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800949dd800/0x844e5faceb5f5d0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fe8 expref: 7 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.536878:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e4d400/0x844e5faceb5f5d89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17043 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.536885:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c71800/0x844e5faceb5f5d58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17012 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.536891:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.536892:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.536896:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f5e1c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2801664->2904063] (req 2801664->2904063) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170b3 expref: 18 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.536919:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c71800/0x844e5faceb5f5d58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17012 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.536934:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c71800/0x844e5faceb5f5d58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17012 expref: 18 pid: 8437 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.536944:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125243264:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155633.537019:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e4d400/0x844e5faceb5f5d89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17043 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.537026:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e4d400/0x844e5faceb5f5d89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17043 expref: 8 pid: 8436 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.537034:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125243392:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155633.537056:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800949dd800/0x844e5faceb5f5d0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fe8 expref: 7 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.537064:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800949dd800/0x844e5faceb5f5d0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fe8 expref: 7 pid: 10591 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.537071:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125243520:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155633.537085:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155633.541072:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.541099:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.541123:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125672832 00000100:00100000:0.0:1746155633.541129:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125672832 00010000:00010000:0.0:1746155633.541154:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800949dd800/0x844e5faceb5f5d0b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fe8 expref: 8 pid: 10591 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746155633.541190:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125672960 00000100:00100000:0.0:1746155633.541193:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125672960 00010000:00010000:0.0:1746155633.541202:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c71800/0x844e5faceb5f5d58 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17012 expref: 19 pid: 8437 timeout: 862 lvb_type: 1 00000100:00100000:0.0:1746155633.541216:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8312 00000100:00100000:0.0:1746155633.541221:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125672832:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155633.541231:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155633.541247:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800949dd800/0x844e5faceb5f5d0b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fe8 expref: 8 pid: 10591 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746155633.541256:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800949dd800/0x844e5faceb5f5d0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fe8 expref: 8 pid: 10591 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.541359:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125243264:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155633.541367:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125243392:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155633.541372:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125243520:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155633.541435:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800949dd800/0x844e5faceb5f5d0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fe8 expref: 8 pid: 10591 timeout: 862 lvb_type: 1 00010000:00010000:0.0:1746155633.541627:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155633.541629:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155633.541635:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f5e1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->2904063) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170b3 expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155633.541771:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f5e1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2801664->2904063) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170b3 expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.541801:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f5e1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2904063) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170b3 expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.541810:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbebc00, rc 0) 00000100:00100000:1.0:1746155633.541824:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:31973:x1830976125672704:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5008us (5136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.541829:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16209 00010000:00010000:1.0:1746155633.542166:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f5e1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2801664->2904063) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170b3 expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155633.542177:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125243648:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155633.542233:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155633.545557:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125243648:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155633.545574:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.545630:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125672832:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4407us (4563us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.545640:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8312 00000100:00100000:0.0:1746155633.545737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.549312:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125673600 00000100:00100000:0.0:1746155633.549319:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125673600 00002000:00100000:0.0:1746155633.549347:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2899968->2904063) req@ffff88012cded500 x1830976125673600/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155633.549354:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded500 with x1830976125673600 ext(2899968->2904063) 00002000:00010000:0.0:1746155633.549359:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cded500 00000100:00100000:0.0:1746155633.549385:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7657 00000100:00100000:0.0:1746155633.549391:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976125673600:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155633.549560:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976125673600:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 168us (290us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155633.550158:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7657 00002000:00100000:0.0:1746155633.550166:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2899968->2904063) req@ffff88012cded500 x1830976125673600/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/4536 e 0 to 0 dl 1746155644 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155633.550173:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded500 with x1830976125673600 ext(2899968->2904063) 00002000:00010000:0.0:1746155633.550176:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cded500 00000100:00100000:0.0:1746155633.551983:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125673856 00000100:00100000:0.0:1746155633.552002:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125673856 00000100:00100000:0.0:1746155633.552106:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4611 00000100:00100000:0.0:1746155633.552113:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:31973:x1830976125673856:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155633.552404:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:31973:x1830976125673856:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 291us (442us total) trans 8589945068 rc 0/0 00000100:00100000:0.0:1746155633.552411:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4611 00000100:00100000:0.0:1746155633.611553:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.617669:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.617897:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125674240 00000100:00100000:1.0:1746155633.617905:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125674240 00000100:00100000:1.0:1746155633.619763:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16210 00000100:00100000:1.0:1746155633.619778:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:31976:x1830976125674240:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155633.619795:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.619810:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbeb600/0x844e5faceb5f5e46 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f170c1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.619839:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a236600/0x844e5faceb5f5dba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1706d expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.619848:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009048a800/0x844e5faceb5f5dc1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17074 expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.619853:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.619854:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.619857:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbeb600/0x844e5faceb5f5e46 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3350528->3489791] (req 3350528->3489791) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170c1 expref: 14 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.619882:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009048a800/0x844e5faceb5f5dc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17074 expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.619892:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009048a800/0x844e5faceb5f5dc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17074 expref: 21 pid: 8436 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.619902:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125243776:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155633.620010:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a236600/0x844e5faceb5f5dba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1706d expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.620017:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a236600/0x844e5faceb5f5dba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1706d expref: 14 pid: 8436 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.620025:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125243904:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155633.620045:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155633.622870:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125243776:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155633.624466:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125243904:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155633.624492:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbeb600/0x844e5faceb5f5e46 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3350528->3489791] (req 3350528->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170c1 expref: 14 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.624540:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbeb600, rc 0) 00000100:00100000:1.0:1746155633.624582:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:31976:x1830976125674240:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4809us (6921us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.624589:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16210 00000100:00100000:0.0:1746155633.625137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.625557:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125674368 00000100:00100000:1.0:1746155633.625562:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125674368 00010000:00010000:1.0:1746155633.625583:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009048a800/0x844e5faceb5f5dc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17074 expref: 22 pid: 8436 timeout: 862 lvb_type: 1 00000100:00100000:1.0:1746155633.625613:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8315 00000100:00100000:1.0:1746155633.625619:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976125674368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155633.625628:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155633.625646:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009048a800/0x844e5faceb5f5dc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17074 expref: 22 pid: 8436 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.625656:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009048a800/0x844e5faceb5f5dc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17074 expref: 22 pid: 8436 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.625673:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009048a800/0x844e5faceb5f5dc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17074 expref: 22 pid: 8436 timeout: 862 lvb_type: 1 00010000:00010000:1.0:1746155633.625727:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.625754:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976125674368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 135us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.625758:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8315 00000100:00100000:0.0:1746155633.626953:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.627021:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125674496 00000100:00100000:1.0:1746155633.627025:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125674496 00010000:00010000:1.0:1746155633.627040:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a236600/0x844e5faceb5f5dba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1706d expref: 14 pid: 8436 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.627108:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8316 00000100:00100000:1.0:1746155633.627113:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976125674496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155633.627121:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155633.627132:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a236600/0x844e5faceb5f5dba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1706d expref: 14 pid: 8436 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.627141:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a236600/0x844e5faceb5f5dba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1706d expref: 14 pid: 8436 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.627152:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a236600/0x844e5faceb5f5dba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1706d expref: 14 pid: 8436 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.627161:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.627162:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.627168:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbeb600/0x844e5faceb5f5e46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3489791) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170c1 expref: 13 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.627174:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbeb600/0x844e5faceb5f5e46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3489791) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170c1 expref: 13 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.627199:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbeb600/0x844e5faceb5f5e46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3350528->3489791) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170c1 expref: 13 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155633.627209:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125244032:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155633.627564:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155633.630077:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.630094:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125244032:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155633.630109:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.630136:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1961:x1830976125674496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3022us (3185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.630146:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8316 00000100:00100000:0.0:1746155633.634943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.637344:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.675244:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.675465:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125675520 00000100:00100000:1.0:1746155633.675473:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125675520 00000100:00100000:1.0:1746155633.675543:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10946 00000100:00100000:1.0:1746155633.675550:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:31979:x1830976125675520:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155633.675698:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.675829:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f170c8 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.675915:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f5e54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.675925:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f5e54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.675934:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f5e54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.675948:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.675953:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.675958:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676054:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e62 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676061:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e62 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676066:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e62 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155633.676073:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155633.676138:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e62 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676144:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e62 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676150:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e62 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676155:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbea600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.676158:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e62 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676164:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e62 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676173:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155633.676175:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155633.676178:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e62 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676183:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea600/0x844e5faceb5f5e62 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676211:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f5e54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676216:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f5e54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676221:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f5e54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676225:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbeb800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.676227:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f5e54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676231:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f5e54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676236:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155633.676238:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155633.676240:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f5e54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676244:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f5e54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676251:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676256:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676260:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676264:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbebe00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.676266:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676270:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676274:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0800) 00010000:00010000:1.0:1746155633.676276:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155633.676278:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676282:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.676308:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e4d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170c8 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.676314:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170c8 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.676321:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbeb200, rc 0) 00000100:00100000:1.0:1746155633.676358:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:31979:x1830976125675520:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 809us (1121us total) trans 8589945071 rc 301/301 00000100:00100000:1.0:1746155633.676367:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10946 00000100:00100000:0.0:1746155633.709619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.709677:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125675776 00000100:00100000:1.0:1746155633.709685:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125675776 00000100:00100000:1.0:1746155633.709756:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10947 00000100:00100000:1.0:1746155633.709762:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:31982:x1830976125675776:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.709778:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.709791:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f5e70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f170cf expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.709877:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea200/0x844e5faceb5f5e77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.709888:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea200/0x844e5faceb5f5e77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.709897:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea200/0x844e5faceb5f5e77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.709907:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeba00/0x844e5faceb5f5e7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.709911:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeba00/0x844e5faceb5f5e7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.709915:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeba00/0x844e5faceb5f5e7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710411:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5f5e85 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710419:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5f5e85 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710425:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5f5e85 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155633.710433:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155633.710499:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5f5e85 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710547:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5f5e85 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710552:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5f5e85 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710557:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbeaa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.710560:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5f5e85 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710565:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5f5e85 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710575:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155633.710577:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155633.710580:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5f5e85 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710585:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeaa00/0x844e5faceb5f5e85 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710604:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea200/0x844e5faceb5f5e77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710609:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea200/0x844e5faceb5f5e77 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710618:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea200/0x844e5faceb5f5e77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710621:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbea200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.710624:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea200/0x844e5faceb5f5e77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710628:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea200/0x844e5faceb5f5e77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710638:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155633.710641:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155633.710643:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea200/0x844e5faceb5f5e77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710647:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbea200/0x844e5faceb5f5e77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710654:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeba00/0x844e5faceb5f5e7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710659:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeba00/0x844e5faceb5f5e7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710664:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeba00/0x844e5faceb5f5e7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710668:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbeba00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.710670:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeba00/0x844e5faceb5f5e7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710674:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeba00/0x844e5faceb5f5e7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710683:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0a00) 00010000:00010000:1.0:1746155633.710685:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155633.710686:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeba00/0x844e5faceb5f5e7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710690:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeba00/0x844e5faceb5f5e7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.710720:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f5e70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170cf expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.710728:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeac00/0x844e5faceb5f5e70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170cf expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.710734:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbeac00, rc 0) 00000100:00100000:1.0:1746155633.710791:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:31982:x1830976125675776:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1028us (1179us total) trans 8589945072 rc 301/301 00000100:00100000:1.0:1746155633.710797:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10947 00000100:00100000:0.0:1746155633.713444:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.715814:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.715886:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125676160 00000100:00100000:1.0:1746155633.715892:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125676160 00000100:00100000:1.0:1746155633.715931:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10948 00000100:00100000:1.0:1746155633.715937:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:31982:x1830976125676160:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.715953:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.715968:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e93 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f170d6 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.716040:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e9a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.716055:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e9a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.716064:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e9a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155633.716084:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155633.716088:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155633.716099:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e9a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.716117:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb200/0x844e5faceb5f5e93 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170d6 expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.716130:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e9a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170d6 expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.716137:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155633.716140:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155633.716142:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbebe00, rc 0) 00000100:00100000:1.0:1746155633.716191:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:31982:x1830976125676160:12345-192.168.202.51@tcp:101:cat.0 Request processed in 252us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.716196:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10948 00000100:00100000:0.0:1746155633.718762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.718832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.719215:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125676544 00000100:00100000:1.0:1746155633.719219:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125676544 00000100:00100000:1.0:1746155633.719251:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16211 00000100:00100000:1.0:1746155633.719256:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976125676544:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.719265:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.719277:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbeba00/0x844e5faceb5f5ea1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f170dd expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155633.719315:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125244160:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155633.719393:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155633.721599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:1.0:1746155633.721697:0:8438:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155633 -> 1746155634 00002000:00010000:1.0:1746155633.721700:0:8438:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155632 -> 1746155633 00002000:00010000:1.0:1746155633.721702:0:8438:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime: 1746155633 -> 1746155634 00000100:00100000:1.0:1746155633.721718:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125244160:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155633.721743:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbeba00/0x844e5faceb5f5ea1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170dd expref: 22 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.721755:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbeba00/0x844e5faceb5f5ea1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170dd expref: 22 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.721765:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbeba00, rc 0) 00000100:00100000:1.0:1746155633.721796:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976125676544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2539us (2964us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155633.721802:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16211 00000100:00100000:0.0:1746155633.723425:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.725718:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.725757:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.726571:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.731255:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.731320:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.731337:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16212 00000100:00100000:0.0:1746155633.731345:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976125677824:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155633.731357:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155633.731369:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a237800/0x844e5faceb5f5ee0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f170f2 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155633.731407:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fe8ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125244288:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155633.731834:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155633.731841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.732124:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976125677440:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6276us (6408us total) trans 0 rc 425984/425984 00000100:00100000:1.0:1746155633.732130:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7661 00002000:00100000:1.0:1746155633.732136:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (0->425983) req@ffff88012fe8ed80 x1830976125677440/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/440 e 0 to 0 dl 1746155644 ref 1 fl Complete:/200/0 rc 425984/425984 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.732143:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8ed80 with x1830976125677440 ext(0->425983) 00002000:00010000:1.0:1746155633.732146:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fe8ed80 00000100:00100000:0.0:1746155633.737200:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.741407:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.741485:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125678336 00000100:00100000:1.0:1746155633.741492:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125678336 00002000:00100000:1.0:1746155633.741549:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (425984->1048575) req@ffff88012fe8df80 x1830976125678336/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.741559:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8df80 with x1830976125678336 ext(425984->1048575) 00010000:00010000:1.0:1746155633.741571:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f291000/0x844e5faceb5f5da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17058 expref: 21 pid: 1625 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.741584:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f291000/0x844e5faceb5f5da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17058 expref: 21 pid: 1625 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746155633.741591:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fe8df80 00000100:00100000:1.0:1746155633.741613:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1299 00000100:00100000:1.0:1746155633.741620:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976125678336:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155633.753963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.760064:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125678336:12345-192.168.202.51@tcp:4:cat.0 Request processed in 18432us (18648us total) trans 17179874066 rc 0/0 00000100:00100000:1.0:1746155633.760077:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1299 00002000:00100000:1.0:1746155633.760090:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (425984->1048575) req@ffff88012fe8df80 x1830976125678336/t17179874066(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/448 e 0 to 0 dl 1746155644 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.760100:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fe8df80 with x1830976125678336 ext(425984->1048575) 00010000:00010000:1.0:1746155633.760109:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f291000/0x844e5faceb5f5da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17058 expref: 24 pid: 1625 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.760121:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f291000/0x844e5faceb5f5da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17058 expref: 24 pid: 1625 timeout: 862 lvb_type: 0 00002000:00010000:1.0:1746155633.760129:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012fe8df80 00000100:00100000:0.0:1746155633.763958:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.764065:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125678720 00000100:00100000:1.0:1746155633.764072:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125678720 00010000:00010000:1.0:1746155633.764095:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f291000/0x844e5faceb5f5da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 425984->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17058 expref: 24 pid: 1625 timeout: 862 lvb_type: 0 00000100:00100000:1.0:1746155633.764214:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8317 00000100:00100000:1.0:1746155633.764221:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976125678720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155633.764232:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155633.764247:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f291000/0x844e5faceb5f5da5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 425984->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17058 expref: 24 pid: 1625 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.764256:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f291000/0x844e5faceb5f5da5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 425984->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17058 expref: 24 pid: 1625 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.764272:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f291000/0x844e5faceb5f5da5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 425984->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17058 expref: 24 pid: 1625 timeout: 862 lvb_type: 0 00010000:00010000:1.0:1746155633.764297:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.764299:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155633.764304:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009048b800/0x844e5faceb5f5eee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17107 expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.764310:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009048b800/0x844e5faceb5f5eee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17107 expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.764339:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009048b800/0x844e5faceb5f5eee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17107 expref: 15 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155633.764349:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125244928:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155633.764409:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155633.769281:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.769870:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125244928:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155633.771355:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155633.771385:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976125678720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7161us (7426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155633.771392:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8317 00000100:00100000:0.0:1746155633.773670:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.782349:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.782470:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125679488 00000100:00100000:1.0:1746155633.782479:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125679488 00002000:00100000:1.0:1746155633.782537:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012bdf6a00 x1830976125679488/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.782546:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf6a00 with x1830976125679488 ext(2097152->3145727) 00002000:00010000:1.0:1746155633.782551:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf6a00 00000100:00100000:1.0:1746155633.782580:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7664 00000100:00100000:1.0:1746155633.782587:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976125679488:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155633.782772:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.782796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.782813:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125680000 00000100:00100000:1.0:1746155633.782815:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125680000 00000100:00100000:0.0:1746155633.782815:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:1.0:1746155633.782829:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3248128->4194303) req@ffff88012bdf6300 x1830976125680000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.782836:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf6300 with x1830976125680000 ext(3248128->4194303) 00002000:00010000:1.0:1746155633.782839:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf6300 00000100:00100000:1.0:1746155633.782859:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7665 00000100:00100000:1.0:1746155633.782864:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976125679616:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155633.794190:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125679488:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11594us (11840us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155633.794200:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7664 00002000:00100000:1.0:1746155633.794211:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012bdf6a00 x1830976125679488/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:704/0 lens 488/440 e 0 to 0 dl 1746155644 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.794218:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf6a00 with x1830976125679488 ext(2097152->3145727) 00002000:00010000:1.0:1746155633.794223:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf6a00 00000100:00100000:1.0:1746155633.796384:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.803579:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.810223:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.810265:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.814135:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.821598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.823842:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.823876:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.823910:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.823959:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125681536 00000100:00100000:1.0:1746155633.823962:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125681536 00002000:00100000:1.0:1746155633.823976:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88012bdf7100 x1830976125681536/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:704/0 lens 488/0 e 0 to 0 dl 1746155644 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155633.823983:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7100 with x1830976125681536 ext(1048576->2097151) 00002000:00010000:1.0:1746155633.823996:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf7100 00000100:00100000:1.0:1746155633.824008:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7669 00000100:00100000:1.0:1746155633.824013:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125681280:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155633.824272:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7671 00000100:00100000:0.0:1746155633.824278:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976125681792:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155633.857924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.857941:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125682432 00000100:00100000:1.0:1746155633.857944:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125682432 00000100:00100000:1.0:1746155633.857967:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10951 00000100:00100000:1.0:1746155633.857972:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:31988:x1830976125682432:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155633.857980:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.857999:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094219a00/0x844e5faceb5f5f26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1713f expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.858082:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094218e00/0x844e5faceb5f5f2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858091:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094218e00/0x844e5faceb5f5f2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858099:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094218e00/0x844e5faceb5f5f2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858108:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5f5f34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858112:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5f5f34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858116:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5f5f34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858198:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094219c00/0x844e5faceb5f5f3b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858205:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094219c00/0x844e5faceb5f5f3b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858209:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094219c00/0x844e5faceb5f5f3b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155633.858216:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155633.858285:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094219c00/0x844e5faceb5f5f3b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858294:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094219c00/0x844e5faceb5f5f3b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858299:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094219c00/0x844e5faceb5f5f3b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858303:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094219c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.858306:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094219c00/0x844e5faceb5f5f3b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858311:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094219c00/0x844e5faceb5f5f3b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858320:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155633.858323:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155633.858326:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094219c00/0x844e5faceb5f5f3b lrc: 2/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858331:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094219c00/0x844e5faceb5f5f3b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858348:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094218e00/0x844e5faceb5f5f2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858352:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094218e00/0x844e5faceb5f5f2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858356:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094218e00/0x844e5faceb5f5f2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858360:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094218e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.858362:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094218e00/0x844e5faceb5f5f2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858369:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094218e00/0x844e5faceb5f5f2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858375:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155633.858376:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155633.858379:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094218e00/0x844e5faceb5f5f2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858383:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094218e00/0x844e5faceb5f5f2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858389:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5f5f34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858393:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5f5f34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858397:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5f5f34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858400:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094218200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155633.858402:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5f5f34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858406:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5f5f34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858411:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0100) 00010000:00010000:1.0:1746155633.858413:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155633.858415:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5f5f34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858418:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094218200/0x844e5faceb5f5f34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155633.858447:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094219a00/0x844e5faceb5f5f26 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1713f expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.858453:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094219a00/0x844e5faceb5f5f26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1713f expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155633.858460:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094219a00, rc 0) 00000100:00100000:1.0:1746155633.858493:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:31988:x1830976125682432:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 520us (569us total) trans 8589945076 rc 301/301 00000100:00100000:1.0:1746155633.858499:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10951 00000100:00100000:0.0:1746155633.883874:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.910637:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.916372:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.928030:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.931165:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.936144:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.939932:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.942278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.944449:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.945913:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.947792:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.957539:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.957577:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.969228:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.973243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.973288:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.978484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.980600:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.982236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.985303:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.989489:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.993151:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.996006:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.996037:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.996965:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155633.997192:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125687168 00000100:00100000:1.0:1746155633.997195:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125687168 00000100:00100000:1.0:1746155633.997217:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16230 00000100:00100000:1.0:1746155633.997222:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125687168:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155633.997229:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155633.997238:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f5fc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17185 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155633.997267:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125246592:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155633.997451:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155633.997519:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155633.999193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:1.0:1746155633.999420:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155633 -> 1746155634 00000100:00100000:1.0:1746155633.999436:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125246592:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155633.999455:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f5fc0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17185 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.999467:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f5fc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17185 expref: 24 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155633.999476:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013121e400, rc 0) 00000100:00100000:1.0:1746155633.999490:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125687168:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2268us (2527us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155633.999496:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16230 00000100:00100000:0.0:1746155634.001034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.003850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.004349:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125687808 00000100:00100000:0.0:1746155634.004355:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125687808 00000100:00100000:0.0:1746155634.004383:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4617 00000100:00100000:0.0:1746155634.004388:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:31985:x1830976125687808:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:0.0:1746155634.004533:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:31985:x1830976125687808:12345-192.168.202.51@tcp:35:cat.0 Request processed in 144us (688us total) trans 8589945081 rc 0/0 00000100:00100000:0.0:1746155634.004538:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4617 00000100:00100000:0.0:1746155634.005288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155634.005450:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155634.006952:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.006983:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155634.007420:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155634.013134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.013176:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125688832 00000100:00100000:1.0:1746155634.013184:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125688832 00002000:00100000:1.0:1746155634.013218:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3997696->4001791) req@ffff8800a62a1180 x1830976125688832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.013228:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a1180 with x1830976125688832 ext(3997696->4001791) 00002000:00010000:1.0:1746155634.013232:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a1180 00000100:00100000:1.0:1746155634.013248:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7683 00000100:00100000:1.0:1746155634.013254:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976125688832:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155634.013451:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976125688832:12345-192.168.202.51@tcp:3:cat.0 Request processed in 197us (325us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155634.013458:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7683 00002000:00100000:1.0:1746155634.013464:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3997696->4001791) req@ffff8800a62a1180 x1830976125688832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:705/0 lens 488/4536 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.013471:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a1180 with x1830976125688832 ext(3997696->4001791) 00002000:00010000:1.0:1746155634.013473:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a1180 00000100:00100000:0.0:1746155634.018715:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155634.018820:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155634.023727:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.026971:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155634.029430:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155634.039581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.043348:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.057136:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.060495:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.069210:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.075592:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.090130:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.092040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.098052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.099446:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.104236:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.117337:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.127170:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.127394:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125692032 00000100:00100000:1.0:1746155634.127403:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125692032 00000100:00100000:1.0:1746155634.127491:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4619 00000100:00100000:1.0:1746155634.127500:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:31955:x1830976125692032:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:1.0:1746155634.127740:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:31955:x1830976125692032:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 240us (578us total) trans 8589945084 rc 0/0 00000100:00100000:1.0:1746155634.127747:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4619 00000100:00080000:0.0:1746155634.128103:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155634.129408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.130874:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.131868:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.131890:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.131911:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.131968:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125692928 00000100:00100000:1.0:1746155634.131971:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125692928 00000100:00100000:1.0:1746155634.132097:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16237 00000100:00100000:1.0:1746155634.132103:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125692928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155634.132109:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155634.132117:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093c19800/0x844e5faceb5f6037 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f171c4 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.132126:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.132128:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.132132:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093c19800/0x844e5faceb5f6037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171c4 expref: 12 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.132141:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093c19800/0x844e5faceb5f6037 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171c4 expref: 12 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.132150:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093c19800, rc 0) 00000100:00100000:1.0:1746155634.132165:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125692928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 63us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.132171:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16237 00000100:00100000:0.0:1746155634.140335:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.144200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.144267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.144334:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125693184 00000100:00100000:1.0:1746155634.144340:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125693184 00010000:00010000:1.0:1746155634.144366:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5646600/0x844e5faceb5f5dd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17089 expref: 19 pid: 19959 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746155634.144386:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125693312 00000100:00100000:1.0:1746155634.144388:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125693312 00010000:00010000:1.0:1746155634.144397:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f290e00/0x844e5faceb5f5d9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17051 expref: 24 pid: 8438 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746155634.144412:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8328 00000100:00100000:1.0:1746155634.144418:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976125693184:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155634.144721:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155634.144766:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5646600/0x844e5faceb5f5dd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17089 expref: 19 pid: 19959 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746155634.144775:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5646600/0x844e5faceb5f5dd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17089 expref: 19 pid: 19959 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746155634.144793:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5646600/0x844e5faceb5f5dd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17089 expref: 19 pid: 19959 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746155634.145137:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.145139:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.145146:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e86d400/0x844e5faceb5f603e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1798143) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171cb expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.145153:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e86d400/0x844e5faceb5f603e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1798143) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171cb expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.145184:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e86d400/0x844e5faceb5f603e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1798143) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171cb expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155634.145195:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125248000:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155634.146031:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53373c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155634.147721:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125248000:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155634.147736:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155634.148186:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976125693184:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3767us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.148196:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8328 00000100:00100000:0.0:1746155634.148328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.149679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.150398:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.150646:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.150659:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125693824 00000100:00100000:0.0:1746155634.150662:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125693824 00002000:00100000:0.0:1746155634.150679:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a3fc6680 x1830976125693824/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155634.150686:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc6680 with x1830976125693824 ext(2097152->3145727) 00002000:00010000:0.0:1746155634.150690:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc6680 00000100:00100000:0.0:1746155634.150698:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125694080 00000100:00100000:0.0:1746155634.150700:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125694080 00002000:00100000:0.0:1746155634.150709:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a3fc4a80 x1830976125694080/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155634.150715:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc4a80 with x1830976125694080 ext(3145728->4194303) 00002000:00010000:0.0:1746155634.150717:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc4a80 00000100:00100000:0.0:1746155634.150734:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7691 00000100:00100000:0.0:1746155634.150739:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976125693824:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155634.150854:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.150866:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125694336 00000100:00100000:1.0:1746155634.150869:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125694336 00002000:00100000:1.0:1746155634.150882:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012b6c1180 x1830976125694336/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.150889:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b6c1180 with x1830976125694336 ext(2097152->3145727) 00002000:00010000:1.0:1746155634.150892:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b6c1180 00000100:00100000:1.0:1746155634.150905:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7693 00000100:00100000:1.0:1746155634.150910:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1961:x1830976125694336:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155634.154491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.165924:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976125693824:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15179us (15521us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155634.165932:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7691 00002000:00100000:1.0:1746155634.165940:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a3fc6680 x1830976125693824/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/440 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.165948:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc6680 with x1830976125693824 ext(2097152->3145727) 00002000:00010000:1.0:1746155634.165952:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc6680 00000100:00100000:0.0:1746155634.168284:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.171753:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.185400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.239611:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.246056:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.246119:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125696000 00000100:00100000:1.0:1746155634.246127:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125696000 00000100:00100000:1.0:1746155634.246184:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 726 00000100:00100000:1.0:1746155634.246191:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1961:x1830976125696000:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155634.246203:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155634.246222:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74f800/0x844e5faceb5f605a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171d2 expref: 301 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.246251:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155634.246255:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155634.246298:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1961:x1830976125696000:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 106us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.246304:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 726 00000100:00100000:0.0:1746155634.287182:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.289678:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.289735:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125696384 00000100:00100000:1.0:1746155634.289740:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125696384 00010000:00010000:1.0:1746155634.289760:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047c00/0x844e5faceb5f5ed2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170eb expref: 23 pid: 15474 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746155634.289777:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8330 00000100:00100000:1.0:1746155634.289782:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1963:x1830976125696384:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155634.289791:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155634.289795:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047c00/0x844e5faceb5f5ed2 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170eb expref: 23 pid: 15474 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.289807:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047c00/0x844e5faceb5f5ed2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170eb expref: 23 pid: 15474 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.289822:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155634.289825:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74ee00/0x844e5faceb5f606f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155634.289830:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74ee00/0x844e5faceb5f606f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155634.289835:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155634.289859:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1963:x1830976125696384:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.289863:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8330 00000100:00100000:1.0:1746155634.290457:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.290718:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125696512 00000100:00100000:0.0:1746155634.290721:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125696512 00010000:00010000:0.0:1746155634.290738:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e9a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170d6 expref: 300 pid: 27374 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746155634.290931:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8331 00000100:00100000:0.0:1746155634.290937:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1961:x1830976125696512:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155634.290944:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155634.290948:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e9a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170d6 expref: 300 pid: 27374 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746155634.290957:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e9a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170d6 expref: 300 pid: 27374 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746155634.290970:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f5e9a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f170d6 expref: 300 pid: 27374 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746155634.290994:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155634.290998:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74ee00/0x844e5faceb5f606f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155634.291003:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74ee00/0x844e5faceb5f606f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155634.291008:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74ee00/0x844e5faceb5f606f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155634.291203:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155634.291493:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1961:x1830976125696512:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 556us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.291499:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8331 00000100:00100000:0.0:1746155634.304604:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.315925:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.316398:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.326947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.326968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.326993:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125697408 00000100:00100000:1.0:1746155634.326998:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125697408 00010000:00010000:1.0:1746155634.327033:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d1f1200/0x844e5faceb5f5cf6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fcc expref: 7 pid: 9235 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746155634.327061:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125697280 00000100:00100000:1.0:1746155634.327062:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125697280 00010000:00010000:1.0:1746155634.327069:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800949dde00/0x844e5faceb5f5d43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ffd expref: 26 pid: 8436 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746155634.327080:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8332 00000100:00100000:1.0:1746155634.327086:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125697408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155634.327096:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155634.327112:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d1f1200/0x844e5faceb5f5cf6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fcc expref: 7 pid: 9235 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746155634.327120:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d1f1200/0x844e5faceb5f5cf6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16fcc expref: 7 pid: 9235 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746155634.327138:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155634.327166:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125697408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.327171:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8332 00000100:00100000:1.0:1746155634.327182:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8333 00000100:00100000:1.0:1746155634.327185:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125697280:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155634.327190:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155634.327195:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800949dde00/0x844e5faceb5f5d43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ffd expref: 26 pid: 8436 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746155634.327201:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800949dde00/0x844e5faceb5f5d43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ffd expref: 26 pid: 8436 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746155634.327210:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800949dde00/0x844e5faceb5f5d43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f16ffd expref: 26 pid: 8436 timeout: 863 lvb_type: 1 00010000:00010000:1.0:1746155634.327220:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155634.327230:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125697280:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 44us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.327234:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8333 00000100:00100000:1.0:1746155634.327252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.327261:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125697536 00000100:00100000:1.0:1746155634.327263:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125697536 00010000:00010000:1.0:1746155634.327270:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d400/0x844e5faceb5f5d5f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17019 expref: 12 pid: 20200 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746155634.327281:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8334 00000100:00100000:1.0:1746155634.327285:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976125697536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155634.327289:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155634.327293:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d400/0x844e5faceb5f5d5f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17019 expref: 12 pid: 20200 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.327300:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d400/0x844e5faceb5f5d5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17019 expref: 12 pid: 20200 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.327309:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.327310:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.327315:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f60a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1064960->1798143) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171e7 expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.327321:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f60a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1064960->1798143) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171e7 expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.327342:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f60a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1064960->1798143) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171e7 expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155634.327356:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125248768:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155634.327397:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53373c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746155634.327596:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746155634.327786:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976125697152:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9630us (11388us total) trans 0 rc 479232/479232 00000100:00100000:1.0:1746155634.327793:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7696 00002000:00100000:1.0:1746155634.327800:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800a3fc6a00 x1830976125697152/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 504/440 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 479232/479232 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.327808:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc6a00 with x1830976125697152 ext(1048576->2097151) 00002000:00010000:1.0:1746155634.327811:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc6a00 00000100:00100000:1.0:1746155634.329391:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125248768:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155634.329401:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155634.329432:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976125697536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2145us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.329438:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8334 00000100:00100000:0.0:1746155634.329869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.329921:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125697792 00000100:00100000:1.0:1746155634.329925:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125697792 00002000:00100000:1.0:1746155634.329946:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1064960->1069055) req@ffff8800a3fc5180 x1830976125697792/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.329954:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5180 with x1830976125697792 ext(1064960->1069055) 00002000:00010000:1.0:1746155634.329957:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc5180 00000100:00100000:1.0:1746155634.329977:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7697 00000100:00100000:1.0:1746155634.329990:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125697792:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155634.330092:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125697792:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 109us (223us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155634.330097:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7697 00002000:00100000:1.0:1746155634.330101:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1064960->1069055) req@ffff8800a3fc5180 x1830976125697792/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:705/0 lens 488/4536 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.330107:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5180 with x1830976125697792 ext(1064960->1069055) 00002000:00010000:1.0:1746155634.330110:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc5180 00000100:00100000:0.0:1746155634.337611:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.338216:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.341583:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125698432 00000100:00100000:0.0:1746155634.341588:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125698432 00000100:00100000:0.0:1746155634.341616:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4623 00000100:00100000:0.0:1746155634.341621:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:32008:x1830976125698432:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155634.341903:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:32008:x1830976125698432:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 280us (473us total) trans 8589945092 rc 0/0 00000100:00100000:0.0:1746155634.341909:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4623 00000100:00100000:0.0:1746155634.342998:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.349121:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.349726:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.353095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.354857:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.356789:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.368728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.377089:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.383852:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.395328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.395413:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125700224 00000100:00100000:1.0:1746155634.395420:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125700224 00010000:00010000:1.0:1746155634.395448:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012e86d400/0x844e5faceb5f603e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171cb expref: 20 pid: 20796 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746155634.395484:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8335 00000100:00100000:1.0:1746155634.395490:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976125700224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155634.395528:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155634.395546:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012e86d400/0x844e5faceb5f603e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1228800->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171cb expref: 20 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.395556:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012e86d400/0x844e5faceb5f603e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1228800->1798143) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171cb expref: 20 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.395575:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e86d400/0x844e5faceb5f603e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1228800->1798143) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171cb expref: 20 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.395660:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.395663:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.395669:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093c18e00/0x844e5faceb5f60e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17211 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.395676:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093c18e00/0x844e5faceb5f60e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17211 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.395703:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093c18e00/0x844e5faceb5f60e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17211 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155634.395714:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125249536:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155634.397672:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155634.400255:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125249536:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155634.400356:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155634.400430:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976125700224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4938us (5106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.400439:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8335 00000100:00100000:0.0:1746155634.404887:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.443492:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.446472:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.448411:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.449125:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.454821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.460227:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.466288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.469238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.478825:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.493121:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.497013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.501638:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.505609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.505647:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.505669:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.505691:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125702528 00000100:00100000:0.0:1746155634.505699:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125702528 00000100:00100000:1.0:1746155634.505771:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125702784 00000100:00100000:1.0:1746155634.505775:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125702784 00000100:00100000:1.0:1746155634.506097:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16248 00000100:00100000:1.0:1746155634.506106:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125702784:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155634.506143:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155634.506162:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f53f800/0x844e5faceb5f6117 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1723b expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155634.506222:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125250688:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155634.506300:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155634.506367:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125702912 00000100:00100000:0.0:1746155634.506371:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125702912 00000100:00100000:0.0:1746155634.506390:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16250 00000100:00100000:0.0:1746155634.506396:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1960:x1830976125702912:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155634.506404:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.506414:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f612c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17242 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.506426:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.506428:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.506435:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f612c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17242 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.506448:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f612c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17242 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.506457:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450d600, rc 0) 00000100:00100000:0.0:1746155634.506480:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125702912:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 83us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.506486:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16250 00000100:00100000:0.0:1746155634.506885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.507211:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.508108:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125250688:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155634.508133:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f53f800/0x844e5faceb5f6117 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1723b expref: 10 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.508143:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f53f800/0x844e5faceb5f6117 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1723b expref: 10 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.508157:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f53f800, rc 0) 00000100:00100000:1.0:1746155634.508181:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125702784:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 2077us (2510us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155634.508186:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16248 00000100:00100000:0.0:1746155634.511552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.514270:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.521953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.525687:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.525958:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.526978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.527002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.527041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.527061:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.527083:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16254 00000100:00100000:0.0:1746155634.527091:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125704192:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155634.527119:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5f6172 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.527138:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5291e00/0x844e5faceb5f5efc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17115 expref: 10 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.527146:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093c18c00/0x844e5faceb5f611e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17234 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.527159:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5291800/0x844e5faceb5f5f11 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1712a expref: 21 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.527165:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.527167:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.527170:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5f6172 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.527193:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5291800/0x844e5faceb5f5f11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1712a expref: 21 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.527203:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5291800/0x844e5faceb5f5f11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1712a expref: 21 pid: 20796 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746155634.527215:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125251328:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155634.527260:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093c18c00/0x844e5faceb5f611e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17234 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.527268:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093c18c00/0x844e5faceb5f611e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17234 expref: 9 pid: 20796 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746155634.527277:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125251712:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155634.527306:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5291e00/0x844e5faceb5f5efc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17115 expref: 10 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.527319:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5291e00/0x844e5faceb5f5efc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17115 expref: 10 pid: 8438 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746155634.527327:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125251968:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155634.527345:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155634.529331:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125251328:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155634.531007:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.531797:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125251712:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155634.531808:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125251968:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.531829:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5f6172 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155634.533952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.533976:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.534013:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.534026:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.534042:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125705472 00000100:00100000:0.0:1746155634.534048:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125705472 00010000:00010000:0.0:1746155634.534072:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c2ae200/0x844e5faceb5f5f0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1711c expref: 23 pid: 19959 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746155634.534091:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125704960 00000100:00100000:0.0:1746155634.534093:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125704960 00010000:00010000:0.0:1746155634.534102:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5291800/0x844e5faceb5f5f11 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1712a expref: 22 pid: 20796 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746155634.534113:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125705216 00000100:00100000:0.0:1746155634.534115:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125705216 00010000:00010000:0.0:1746155634.534122:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093c18600/0x844e5faceb5f6125 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1722d expref: 9 pid: 20200 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746155634.534139:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8344 00000100:00100000:0.0:1746155634.534145:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125705472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155634.534154:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155634.534169:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c2ae200/0x844e5faceb5f5f0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1711c expref: 23 pid: 19959 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746155634.534177:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c2ae200/0x844e5faceb5f5f0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1711c expref: 23 pid: 19959 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746155634.534193:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c2ae200/0x844e5faceb5f5f0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1711c expref: 23 pid: 19959 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746155634.534207:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155634.534234:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976125705472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 89us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.534240:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8344 00000100:00100000:0.0:1746155634.534251:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8346 00000100:00100000:0.0:1746155634.534255:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125705216:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155634.534259:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155634.534264:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093c18600/0x844e5faceb5f6125 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1722d expref: 9 pid: 20200 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746155634.534271:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093c18600/0x844e5faceb5f6125 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1722d expref: 9 pid: 20200 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746155634.534284:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c18600/0x844e5faceb5f6125 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1722d expref: 9 pid: 20200 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746155634.534292:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155634.534384:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125705600 00000100:00100000:1.0:1746155634.534388:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125705600 00002000:00100000:1.0:1746155634.534419:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2969600->3145727) req@ffff8800910cb100 x1830976125705600/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.534427:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cb100 with x1830976125705600 ext(2969600->3145727) 00010000:00010000:1.0:1746155634.534435:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093c18800/0x844e5faceb5f60ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17218 expref: 11 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.534449:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093c18800/0x844e5faceb5f60ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17218 expref: 11 pid: 20796 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746155634.534455:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800910cb100 00000100:00100000:1.0:1746155634.534472:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1307 00000100:00100000:1.0:1746155634.534477:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976125705600:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155634.534541:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125705216:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 284us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.534553:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8346 00000100:00100000:0.0:1746155634.534581:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.534593:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125705728 00000100:00100000:0.0:1746155634.534595:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125705728 00010000:00010000:0.0:1746155634.534604:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5291e00/0x844e5faceb5f5efc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17115 expref: 12 pid: 8438 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746155634.534625:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8347 00000100:00100000:0.0:1746155634.534629:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125705728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155634.534634:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155634.534645:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5291e00/0x844e5faceb5f5efc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17115 expref: 12 pid: 8438 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746155634.534652:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5291e00/0x844e5faceb5f5efc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17115 expref: 12 pid: 8438 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746155634.535302:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5291e00/0x844e5faceb5f5efc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17115 expref: 13 pid: 8438 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746155634.535316:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155634.535334:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125705728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 705us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.535339:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8347 00000100:00100000:0.0:1746155634.535413:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.535625:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.535648:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.535886:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8349 00000100:00100000:1.0:1746155634.535893:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976125705344:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155634.535900:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155634.535914:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093c18e00/0x844e5faceb5f60e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17211 expref: 22 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.535921:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093c18e00/0x844e5faceb5f60e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17211 expref: 22 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.535934:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093c18e00/0x844e5faceb5f60e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17211 expref: 22 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.535949:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.535951:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.535956:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a74e600/0x844e5faceb5f6179 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.535964:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a74e600/0x844e5faceb5f6179 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.536583:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5f6172 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.536592:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5f6172 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.536613:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5f6172 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.536620:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5f6172 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.536626:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5f6172 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.536631:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009450d000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155634.536634:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5f6172 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.536645:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5f6172 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.536656:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5f6172 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.536661:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450d000/0x844e5faceb5f6172 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155634.536703:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125704192:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 9613us (10744us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.536715:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16254 00010000:00010000:1.0:1746155634.536809:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155634.536828:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976125705344:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 936us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.536834:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8349 00000100:00100000:0.0:1746155634.537280:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.537341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.537414:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125706112 00000100:00100000:1.0:1746155634.537418:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125706112 00010000:00010000:1.0:1746155634.537434:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009048b800/0x844e5faceb5f5eee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17107 expref: 19 pid: 8438 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746155634.537451:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8350 00000100:00100000:1.0:1746155634.537456:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976125706112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155634.537464:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155634.537475:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009048b800/0x844e5faceb5f5eee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17107 expref: 19 pid: 8438 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.537483:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009048b800/0x844e5faceb5f5eee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17107 expref: 19 pid: 8438 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.537494:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009048b800/0x844e5faceb5f5eee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17107 expref: 19 pid: 8438 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.537517:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.537518:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.537521:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5f6180 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.537532:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1800/0x844e5faceb5f6180 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.537551:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155634.537571:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976125706112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 114us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.537576:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8350 00000100:00100000:1.0:1746155634.541604:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1963:x1830976125705600:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 7117us (7617us total) trans 21474841410 rc 0/0 00000100:00100000:1.0:1746155634.541616:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1307 00002000:00100000:1.0:1746155634.541628:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2969600->3145727) req@ffff8800910cb100 x1830976125705600/t21474841410(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/448 e 0 to 0 dl 1746155645 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.541639:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cb100 with x1830976125705600 ext(2969600->3145727) 00010000:00010000:1.0:1746155634.541649:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093c18800/0x844e5faceb5f60ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17218 expref: 12 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.541661:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093c18800/0x844e5faceb5f60ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17218 expref: 12 pid: 20796 timeout: 863 lvb_type: 0 00002000:00010000:1.0:1746155634.541668:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800910cb100 00000100:00100000:0.0:1746155634.546092:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125706240 00000100:00100000:0.0:1746155634.546101:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125706240 00010000:00010000:0.0:1746155634.546134:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093c18800/0x844e5faceb5f60ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17218 expref: 12 pid: 20796 timeout: 863 lvb_type: 0 00000100:00100000:0.0:1746155634.546172:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8351 00000100:00100000:0.0:1746155634.546179:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976125706240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155634.546191:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155634.546214:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093c18800/0x844e5faceb5f60ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17218 expref: 12 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746155634.546230:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093c18800/0x844e5faceb5f60ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17218 expref: 12 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746155634.546254:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093c18800/0x844e5faceb5f60ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2969600->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17218 expref: 12 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:0.0:1746155634.546269:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.546271:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.546275:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009520c600/0x844e5faceb5f6187 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.546283:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009520c600/0x844e5faceb5f6187 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.546317:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155634.546592:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976125706240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 413us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.546598:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8351 00000100:00100000:0.0:1746155634.561153:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.561235:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125706368 00000100:00100000:1.0:1746155634.561244:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125706368 00010000:00010000:1.0:1746155634.561281:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a74fe00/0x844e5faceb5f60f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1721f expref: 20 pid: 20796 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746155634.561467:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8352 00000100:00100000:1.0:1746155634.561478:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976125706368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155634.561494:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155634.561532:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a74fe00/0x844e5faceb5f60f4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1721f expref: 20 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.561542:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a74fe00/0x844e5faceb5f60f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1721f expref: 20 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.561564:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a74fe00/0x844e5faceb5f60f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3993599) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1721f expref: 20 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.561594:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.561596:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.561601:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009520da00/0x844e5faceb5f6195 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.561610:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009520da00/0x844e5faceb5f6195 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.561852:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155634.561889:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1963:x1830976125706368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 415us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.561895:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8352 00000100:00100000:1.0:1746155634.564217:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125706496 00000100:00100000:1.0:1746155634.564224:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125706496 00010000:00010000:1.0:1746155634.564250:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f60a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1064960->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171e7 expref: 23 pid: 20796 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746155634.564285:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8353 00000100:00100000:1.0:1746155634.564292:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125706496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155634.564303:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155634.564322:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f60a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1798143) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171e7 expref: 23 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.564334:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f60a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1798143) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171e7 expref: 23 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.564354:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f60a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1064960->1798143) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f171e7 expref: 23 pid: 20796 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.564366:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.564368:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.564372:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f618e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.564379:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f618e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.564411:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155634.564450:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976125706496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 159us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.564457:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8353 00000100:00100000:0.0:1746155634.566557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.569241:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.569272:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.569296:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.569309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.569331:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.569389:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125707392 00000100:00100000:1.0:1746155634.569395:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125707392 00010000:00010000:1.0:1746155634.569410:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f5d6d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17020 expref: 27 pid: 27374 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746155634.569426:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8355 00000100:00100000:1.0:1746155634.569431:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1962:x1830976125707136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155634.569439:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155634.569442:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131004600/0x844e5faceb5f5d7b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1702e expref: 27 pid: 19870 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.569457:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131004600/0x844e5faceb5f5d7b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1702e expref: 27 pid: 19870 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.569526:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131004600/0x844e5faceb5f5d7b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1702e expref: 27 pid: 19870 timeout: 863 lvb_type: 0 00010000:00010000:1.0:1746155634.569814:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155634.569818:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155634.569838:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976125707136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 407us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.569844:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8355 00000100:00100000:1.0:1746155634.596837:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125254272 00000100:00100000:1.0:1746155634.596841:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125254272 00000100:00100000:1.0:1746155634.596858:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16267 00000100:00100000:1.0:1746155634.596863:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3296:x1830976125254272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.596972:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3296:x1830976125254272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (141us total) trans 17179874071 rc 0/0 00000100:00100000:1.0:1746155634.596991:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16267 00000100:00100000:1.0:1746155634.597076:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125254400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.597093:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155634.597104:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125254912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.597115:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155634.597124:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746155634.597128:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125254528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.597141:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155634.597150:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125255040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.597161:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155634.597183:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125254400 00000100:00100000:1.0:1746155634.597186:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125254400 00000100:00100000:1.0:1746155634.597197:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125254912 00000100:00100000:1.0:1746155634.597199:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125254912 00000100:00100000:1.0:1746155634.597206:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125254528 00000100:00100000:1.0:1746155634.597207:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125254528 00000100:00100000:1.0:1746155634.597214:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125255040 00000100:00100000:1.0:1746155634.597215:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125255040 00000100:00100000:1.0:1746155634.597222:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16268 00000100:00100000:1.0:1746155634.597226:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3297:x1830976125254400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.597308:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976125254400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (213us total) trans 17179874072 rc 0/0 00000100:00100000:0.0:1746155634.597315:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16269 00000100:00100000:0.0:1746155634.597326:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976125254912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155634.597409:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976125254912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (292us total) trans 17179874073 rc 0/0 00000100:00100000:1.0:1746155634.597852:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16268 00000100:00100000:0.0:1746155634.597858:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16269 00000100:00100000:1.0:1746155634.597864:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16270 00000100:00100000:1.0:1746155634.597869:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3297:x1830976125254528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155634.597870:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16271 00000100:00100000:0.0:1746155634.597875:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3297:x1830976125255040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.597956:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976125254528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (813us total) trans 17179874074 rc 0/0 00000100:00100000:1.0:1746155634.597962:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16270 00000004:00080000:1.0:1746155634.597997:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb6ad80/2, rc 0, transno 17179874074 00000100:00100000:1.0:1746155634.598004:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125254528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155634.598004:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976125255040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (841us total) trans 17179874075 rc 0/0 00000100:00100000:0.0:1746155634.598010:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16271 00000004:00080000:1.0:1746155634.598011:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910c9f80/2, rc 0, transno 17179874075 00000100:00100000:1.0:1746155634.598014:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125255040:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155634.598020:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb6bb80/2, rc 0, transno 17179874072 00000100:00100000:1.0:1746155634.598022:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125254400:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155634.598028:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910c8e00/2, rc 0, transno 17179874073 00000100:00100000:1.0:1746155634.598030:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125254912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.599446:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.599686:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125254656 00000100:00100000:0.0:1746155634.599689:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125254656 00000100:00100000:0.0:1746155634.599705:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125255168 00000100:00100000:0.0:1746155634.599707:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125255168 00000100:00100000:0.0:1746155634.599717:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16272 00000100:00100000:0.0:1746155634.599721:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3295:x1830976125254656:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.599755:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16273 00000100:00100000:1.0:1746155634.599762:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3295:x1830976125255168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155634.599832:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3295:x1830976125254656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (1173us total) trans 17179874076 rc 0/0 00000100:00100000:0.0:1746155634.599838:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16272 00000100:00100000:1.0:1746155634.599845:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3295:x1830976125255168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (420us total) trans 17179874077 rc 0/0 00000100:00100000:1.0:1746155634.599850:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16273 00000100:00100000:1.0:1746155634.599924:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125254784 00000100:00100000:1.0:1746155634.599927:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125254784 00000100:00100000:1.0:1746155634.599939:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125255296 00000100:00100000:1.0:1746155634.599940:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125255296 00000100:00100000:1.0:1746155634.599949:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16274 00000100:00100000:1.0:1746155634.599953:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3295:x1830976125254784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.600030:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3295:x1830976125254784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (117us total) trans 17179874078 rc 0/0 00000100:00100000:1.0:1746155634.600034:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16274 00000100:00100000:1.0:1746155634.600043:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16275 00000100:00100000:1.0:1746155634.600047:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3295:x1830976125255296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.600102:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3295:x1830976125255296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (166us total) trans 17179874079 rc 0/0 00000100:00100000:1.0:1746155634.600106:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16275 00000100:00100000:0.0:1746155634.604780:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.608854:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.611783:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.638681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.639088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.639168:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125708672 00000100:00100000:1.0:1746155634.639171:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125708672 00000100:00100000:1.0:1746155634.639199:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10967 00000100:00100000:1.0:1746155634.639204:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32030:x1830976125708672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155634.639213:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155634.639220:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5faa800/0x844e5faceb5f61cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1727a expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.639263:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b1e00/0x844e5faceb5f61d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639269:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b1e00/0x844e5faceb5f61d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639279:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b1e00/0x844e5faceb5f61d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639286:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f61db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639291:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f61db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639295:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f61db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639336:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74b800/0x844e5faceb5f61e2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639342:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74b800/0x844e5faceb5f61e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639358:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74b800/0x844e5faceb5f61e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155634.639364:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155634.639421:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b1e00/0x844e5faceb5f61d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639427:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b1e00/0x844e5faceb5f61d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639432:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b1e00/0x844e5faceb5f61d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639437:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b52b1e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155634.639440:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b1e00/0x844e5faceb5f61d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639446:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b1e00/0x844e5faceb5f61d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639460:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155634.639462:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155634.639466:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b1e00/0x844e5faceb5f61d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.639470:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b1e00/0x844e5faceb5f61d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.640010:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f61db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.640019:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f61db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.640023:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f61db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.640027:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd4d600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155634.640029:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f61db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.640033:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f61db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.640040:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fab9c00) 00010000:00010000:1.0:1746155634.640042:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155634.640044:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f61db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.640048:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f61db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.640074:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5faa800/0x844e5faceb5f61cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1727a expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.640085:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74b800/0x844e5faceb5f61e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1727a expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.640090:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155634.640092:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155634.640094:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a74b800, rc 0) 00000100:00100000:1.0:1746155634.640145:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32030:x1830976125708672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 939us (1056us total) trans 8589945102 rc 0/0 00000100:00100000:1.0:1746155634.640151:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10967 00000100:00100000:0.0:1746155634.646712:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.646749:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.646776:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.646790:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.646804:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.646829:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.646856:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125708928 00000100:00100000:0.0:1746155634.646863:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125708928 00000100:00100000:0.0:1746155634.646891:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125709184 00000100:00100000:0.0:1746155634.646893:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125709184 00000100:00100000:0.0:1746155634.646916:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125709440 00000100:00100000:0.0:1746155634.646918:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125709440 00000100:00100000:0.0:1746155634.646927:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125708800 00000100:00100000:0.0:1746155634.646929:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125708800 00000100:00100000:0.0:1746155634.646937:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125709056 00000100:00100000:0.0:1746155634.646938:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125709056 00000100:00100000:0.0:1746155634.646950:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16276 00000100:00100000:0.0:1746155634.647178:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976125708928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155634.647184:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.647192:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a626e600/0x844e5faceb5f61fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17288 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155634.647203:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x68143872, atime: 0x68143872, ctime: 0x68143872, blocks: 0x821 00000100:00100000:1.0:1746155634.647205:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16280 00010000:00010000:0.0:1746155634.647210:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.647212:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746155634.647213:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125709056:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155634.647216:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626e600/0x844e5faceb5f61fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17288 expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.647220:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.647225:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a626e600/0x844e5faceb5f61fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17288 expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.647229:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f6205 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1728f expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.647232:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a626e600, rc 0) 00002000:00010000:1.0:1746155634.647241:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x68143872, atime: 0x68143872, ctime: 0x68143872, blocks: 0x81d 00000100:00100000:0.0:1746155634.647247:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125708928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 292us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.647252:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16276 00010000:00010000:1.0:1746155634.647255:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.647257:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.647262:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f6205 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1728f expref: 14 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155634.647262:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16281 00000100:00100000:0.0:1746155634.647267:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125709312:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155634.647271:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155634.647272:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f6205 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1728f expref: 14 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.647278:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd4d600, rc 0) 00010000:00010000:0.0:1746155634.647278:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a626f600/0x844e5faceb5f620c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1729d expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155634.647287:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e4:0x0] initial LVB size: 5079552, mtime: 0x68143872, atime: 0x68143872, ctime: 0x68143872, blocks: 0x170f 00010000:00010000:0.0:1746155634.647294:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746155634.647296:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125709056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 84us (490us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155634.647296:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.647299:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a626f600/0x844e5faceb5f620c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1729d expref: 23 pid: 18270 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155634.647301:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16280 00010000:00010000:0.0:1746155634.647308:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a626f600/0x844e5faceb5f620c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1729d expref: 23 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.647314:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a626f600, rc 0) 00000100:00100000:0.0:1746155634.647328:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125709312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 61us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.647332:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16281 00000100:00100000:0.0:1746155634.657651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.657717:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.657770:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.657795:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.657816:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.657852:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.657874:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.657894:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.657923:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.657969:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.658010:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125710208 00000100:00100000:0.0:1746155634.658018:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125710208 00000100:00100000:0.0:1746155634.658054:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125710464 00000100:00100000:0.0:1746155634.658057:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125710464 00000100:00100000:0.0:1746155634.658071:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125710720 00000100:00100000:0.0:1746155634.658074:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125710720 00000100:00100000:0.0:1746155634.658089:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125710976 00000100:00100000:0.0:1746155634.658092:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125710976 00000100:00100000:0.0:1746155634.658105:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125711104 00000100:00100000:0.0:1746155634.658108:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125711104 00000100:00100000:0.0:1746155634.658122:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125711232 00000100:00100000:0.0:1746155634.658125:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125711232 00000100:00100000:0.0:1746155634.658142:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16282 00000100:00100000:0.0:1746155634.658150:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125710208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155634.658168:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.658184:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ba00/0x844e5faceb5f621a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f172ab expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.658205:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.658207:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.658217:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ba00/0x844e5faceb5f621a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ab expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.658232:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ba00/0x844e5faceb5f621a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ab expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.658248:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4ba00, rc 0) 00000100:00100000:0.0:1746155634.658297:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976125710208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 146us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.658303:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16282 00000100:00100000:0.0:1746155634.658326:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16283 00000100:00100000:0.0:1746155634.658333:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976125710464:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155634.658341:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.658351:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f6221 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f172b2 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.658364:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.658366:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.658371:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f6221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b2 expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.658382:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f6221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b2 expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.658389:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4a800, rc 0) 00000100:00100000:0.0:1746155634.658411:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976125710464:12345-192.168.202.51@tcp:101:cat.0 Request processed in 78us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.658416:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16283 00000100:00100000:0.0:1746155634.658431:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16284 00000100:00100000:0.0:1746155634.658437:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976125710720:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155634.658447:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.658456:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f6228 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f172b9 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.658466:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.658468:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.658473:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f6228 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b9 expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.658482:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f6228 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b9 expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.658490:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a626f200, rc 0) 00000100:00100000:0.0:1746155634.658544:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976125710720:12345-192.168.202.51@tcp:101:cat.0 Request processed in 105us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.658549:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16284 00000100:00100000:0.0:1746155634.658565:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16285 00000100:00100000:0.0:1746155634.658571:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976125710976:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155634.658579:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.658587:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f622f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f172c0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.658599:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.658600:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.658606:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f622f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c0 expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.658619:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f622f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c0 expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.658626:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a626f000, rc 0) 00000100:00100000:0.0:1746155634.658649:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976125710976:12345-192.168.202.51@tcp:101:cat.0 Request processed in 78us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.658654:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16285 00000100:00100000:0.0:1746155634.658668:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16286 00000100:00100000:0.0:1746155634.658673:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125711104:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155634.658680:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.658688:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe4aa00/0x844e5faceb5f6236 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f172c7 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.658699:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.658700:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.658705:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4aa00/0x844e5faceb5f6236 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c7 expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.658714:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4aa00/0x844e5faceb5f6236 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c7 expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.658721:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4aa00, rc 0) 00000100:00100000:0.0:1746155634.658741:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976125711104:12345-192.168.202.51@tcp:101:cat.0 Request processed in 68us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.658746:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16286 00000100:00100000:0.0:1746155634.658761:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16287 00000100:00100000:0.0:1746155634.658766:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976125711232:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155634.658771:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.658776:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b400/0x844e5faceb5f623d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f172ce expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.658784:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.658785:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.658788:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b400/0x844e5faceb5f623d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ce expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.658795:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b400/0x844e5faceb5f623d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ce expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.658801:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4b400, rc 0) 00000100:00100000:0.0:1746155634.658814:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976125711232:12345-192.168.202.51@tcp:101:cat.0 Request processed in 48us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.658819:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16287 00000100:00100000:0.0:1746155634.658951:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125709824 00000100:00100000:0.0:1746155634.658954:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125709824 00002000:00100000:0.0:1746155634.658975:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff8800a6061c00 x1830976125709824/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155634.658992:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6061c00 with x1830976125709824 ext(0->1048575) 00002000:00010000:0.0:1746155634.658996:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6061c00 00000100:00100000:0.0:1746155634.659005:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125710336 00000100:00100000:0.0:1746155634.659006:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125710336 00002000:00100000:0.0:1746155634.659014:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a6060a80 x1830976125710336/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155634.659026:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060a80 with x1830976125710336 ext(1048576->2097151) 00002000:00010000:0.0:1746155634.659029:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6060a80 00000100:00100000:0.0:1746155634.659034:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125709952 00000100:00100000:0.0:1746155634.659035:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125709952 00002000:00100000:0.0:1746155634.659042:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800a6062d80 x1830976125709952/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155634.659047:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6062d80 with x1830976125709952 ext(1048576->2097151) 00002000:00010000:0.0:1746155634.659049:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6062d80 00000100:00100000:0.0:1746155634.659057:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125710848 00000100:00100000:0.0:1746155634.659058:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125710848 00002000:00100000:0.0:1746155634.659066:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800a6061180 x1830976125710848/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155634.659071:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6061180 with x1830976125710848 ext(1048576->2097151) 00002000:00010000:0.0:1746155634.659074:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6061180 00000100:00100000:0.0:1746155634.659082:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7703 00000100:00100000:0.0:1746155634.659087:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125709824:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155634.659588:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7704 00000100:00100000:1.0:1746155634.659597:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976125710336:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155634.660264:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7705 00000100:00100000:0.0:1746155634.660270:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125709952:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155634.676652:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125710336:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17048us (18875us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155634.676662:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7704 00002000:00100000:1.0:1746155634.676673:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a6060a80 x1830976125710336/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/440 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.676682:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060a80 with x1830976125710336 ext(1048576->2097151) 00002000:00010000:1.0:1746155634.676687:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6060a80 00000100:00100000:0.0:1746155634.684600:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.686388:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7710 00000100:00100000:1.0:1746155634.686397:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976125712256:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155634.690115:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976125709952:12345-192.168.202.51@tcp:3:cat.0 Request processed in 29837us (32291us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155634.690124:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7705 00002000:00100000:1.0:1746155634.690134:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800a6062d80 x1830976125709952/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/440 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.690142:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6062d80 with x1830976125709952 ext(1048576->2097151) 00002000:00010000:1.0:1746155634.690147:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6062d80 00000100:00100000:0.0:1746155634.704638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.710950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.711038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.712565:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.712585:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.712826:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7712 00000100:00100000:1.0:1746155634.712833:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976125713280:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155634.713164:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7713 00000100:00100000:0.0:1746155634.713172:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125713408:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155634.716975:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976125712256:12345-192.168.202.51@tcp:3:cat.0 Request processed in 30575us (32372us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155634.716998:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7710 00002000:00100000:0.0:1746155634.717007:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800a6063b80 x1830976125712256/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:705/0 lens 488/440 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155634.717015:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6063b80 with x1830976125712256 ext(1048576->2097151) 00002000:00010000:0.0:1746155634.717020:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6063b80 00000100:00100000:0.0:1746155634.718032:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.721389:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976125713280:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8552us (8820us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155634.721399:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7712 00002000:00100000:1.0:1746155634.721406:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a0ac5500 x1830976125713280/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/440 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.721414:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac5500 with x1830976125713280 ext(3145728->4194303) 00002000:00010000:1.0:1746155634.721419:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0ac5500 00000100:00100000:1.0:1746155634.736902:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125713408:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23722us (24307us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155634.736912:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7713 00002000:00100000:1.0:1746155634.736922:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a0ac4000 x1830976125713408/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/440 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.736930:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac4000 with x1830976125713408 ext(2097152->3145727) 00002000:00010000:1.0:1746155634.736935:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0ac4000 00000100:00100000:0.0:1746155634.745653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.748783:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.748809:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.748838:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.748891:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125714688 00000100:00100000:1.0:1746155634.748894:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125714688 00002000:00100000:1.0:1746155634.748907:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012f1f2680 x1830976125714688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.748914:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2680 with x1830976125714688 ext(2097152->3145727) 00002000:00010000:1.0:1746155634.748917:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f2680 00000100:00100000:1.0:1746155634.748927:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7716 00000100:00100000:1.0:1746155634.748932:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976125714432:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155634.752435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.753664:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125715072 00000100:00100000:0.0:1746155634.753672:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125715072 00000100:00100000:0.0:1746155634.753705:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10970 00000100:00100000:0.0:1746155634.753712:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32036:x1830976125715072:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155634.753730:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.753744:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1000/0x844e5faceb5f6260 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f172e3 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.753789:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1200/0x844e5faceb5f6267 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155634.753799:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1200/0x844e5faceb5f6267 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155634.753811:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1200/0x844e5faceb5f6267 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.758941:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135013400/0x844e5faceb5f6275 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.758953:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135013400/0x844e5faceb5f6275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.758963:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135013400/0x844e5faceb5f6275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.759062:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135013200/0x844e5faceb5f627c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.759077:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801313cd600/0x844e5faceb5f624b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172d5 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.759083:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135013200/0x844e5faceb5f627c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.759109:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801313cd600/0x844e5faceb5f624b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172d5 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.759121:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801313cd600/0x844e5faceb5f624b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172d5 expref: 9 pid: 15474 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746155634.759131:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125255680:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155634.760122:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53373c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155634.761943:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976125714432:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13005us (13157us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155634.761952:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7716 00002000:00100000:1.0:1746155634.761960:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012f1f3100 x1830976125714432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:705/0 lens 488/440 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.761968:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3100 with x1830976125714432 ext(3145728->4194303) 00002000:00010000:1.0:1746155634.761973:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3100 00000100:00100000:0.0:1746155634.765656:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.766046:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976125714688:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17102us (17233us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155634.766055:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7717 00002000:00100000:0.0:1746155634.766064:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012f1f2680 x1830976125714688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:705/0 lens 488/440 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155634.766072:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2680 with x1830976125714688 ext(2097152->3145727) 00002000:00010000:0.0:1746155634.766077:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f2680 00000100:00100000:1.0:1746155634.766165:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125255680:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.766183:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135013200/0x844e5faceb5f627c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766615:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135013200/0x844e5faceb5f627c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766622:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135013200/0x844e5faceb5f627c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155634.766653:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155634.766657:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155634.766670:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135013200/0x844e5faceb5f627c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766677:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135013200/0x844e5faceb5f627c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766685:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1200/0x844e5faceb5f6267 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766691:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1200/0x844e5faceb5f6267 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766696:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1200/0x844e5faceb5f6267 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766701:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdd1200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155634.766704:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1200/0x844e5faceb5f6267 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766710:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1200/0x844e5faceb5f6267 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766717:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155634.766720:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155634.766722:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1200/0x844e5faceb5f6267 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766727:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1200/0x844e5faceb5f6267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766738:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135013400/0x844e5faceb5f6275 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766743:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135013400/0x844e5faceb5f6275 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766747:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135013400/0x844e5faceb5f6275 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766751:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135013400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155634.766753:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135013400/0x844e5faceb5f6275 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766758:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135013400/0x844e5faceb5f6275 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766762:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0100) 00010000:00010000:1.0:1746155634.766764:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155634.766766:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135013400/0x844e5faceb5f6275 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766770:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135013400/0x844e5faceb5f6275 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.766795:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1000/0x844e5faceb5f6260 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172e3 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.766804:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135013200/0x844e5faceb5f627c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172e3 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.766810:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155634.766812:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155634.766814:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135013200, rc 0) 00000100:00100000:1.0:1746155634.766846:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32036:x1830976125715072:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 13134us (14416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.766851:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10970 00000100:00100000:0.0:1746155634.769397:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.769470:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.769615:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7719 00000100:00100000:0.0:1746155634.769623:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976125715584:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155634.773286:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.773944:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.774012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.774025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.774043:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125715840 00000100:00100000:0.0:1746155634.774049:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125715840 00000100:00100000:0.0:1746155634.774077:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125715968 00000100:00100000:0.0:1746155634.774078:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125715968 00000100:00100000:0.0:1746155634.774087:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125716096 00000100:00100000:0.0:1746155634.774088:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125716096 00000100:00100000:0.0:1746155634.774097:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125716224 00000100:00100000:0.0:1746155634.774099:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125716224 00000100:00100000:0.0:1746155634.774110:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16289 00000100:00100000:0.0:1746155634.774117:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976125715840:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155634.774131:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.774145:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0200/0x844e5faceb5f628a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f172f8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.774162:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.774164:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.774170:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0200/0x844e5faceb5f628a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172f8 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.774183:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0200/0x844e5faceb5f628a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172f8 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.774193:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd0200, rc 0) 00000100:00100000:0.0:1746155634.774237:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125715840:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 120us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.774243:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16289 00000100:00100000:0.0:1746155634.774256:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16290 00000100:00100000:0.0:1746155634.774260:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976125715968:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155634.774265:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.774271:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0c00/0x844e5faceb5f6291 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f172ff expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.774280:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.774281:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.774286:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0c00/0x844e5faceb5f6291 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ff expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.774293:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0c00/0x844e5faceb5f6291 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ff expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.774300:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd0c00, rc 0) 00000100:00100000:0.0:1746155634.774313:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125715968:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 53us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.774323:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16290 00000100:00100000:0.0:1746155634.774330:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125716352 00000100:00100000:0.0:1746155634.774332:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125716352 00000100:00100000:0.0:1746155634.774344:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16291 00000100:00100000:0.0:1746155634.774348:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976125716096:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155634.774354:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.774361:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0400/0x844e5faceb5f6298 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17306 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.774371:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.774372:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.774376:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0400/0x844e5faceb5f6298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17306 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.774385:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0400/0x844e5faceb5f6298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17306 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.774392:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd0400, rc 0) 00000100:00100000:0.0:1746155634.774404:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125716096:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 56us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.774409:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16291 00000100:00100000:0.0:1746155634.774417:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16292 00000100:00100000:0.0:1746155634.774420:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976125716224:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155634.774425:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.774430:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0800/0x844e5faceb5f629f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1730d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.774438:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.774439:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.774443:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0800/0x844e5faceb5f629f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1730d expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.774450:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0800/0x844e5faceb5f629f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1730d expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.774456:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd0800, rc 0) 00000100:00100000:0.0:1746155634.774467:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125716224:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 46us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.774471:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16292 00000100:00100000:0.0:1746155634.774478:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16293 00000100:00100000:0.0:1746155634.774482:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125716352:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155634.774486:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.774491:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0600/0x844e5faceb5f62a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17314 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.774499:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.774515:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155634.774519:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0600/0x844e5faceb5f62a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17314 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.774527:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0600/0x844e5faceb5f62a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17314 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155634.774534:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd0600, rc 0) 00000100:00100000:0.0:1746155634.774546:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125716352:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 64us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.774551:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16293 00000100:00100000:1.0:1746155634.776307:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976125715584:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6682us (6912us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155634.776315:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7719 00002000:00100000:1.0:1746155634.776320:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012f1f3800 x1830976125715584/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/440 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.776328:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3800 with x1830976125715584 ext(4194304->5083135) 00002000:00010000:1.0:1746155634.776331:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3800 00000100:00100000:0.0:1746155634.777396:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.777466:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125716864 00000100:00100000:1.0:1746155634.777471:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125716864 00000100:00100000:1.0:1746155634.777519:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10972 00000100:00100000:1.0:1746155634.777526:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32036:x1830976125716864:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155634.777538:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155634.777551:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135012e00/0x844e5faceb5f62ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1731b expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.777626:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135012c00/0x844e5faceb5f62b4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.777638:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135013200/0x844e5faceb5f627c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172e3 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.777644:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135012c00/0x844e5faceb5f62b4 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.777668:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135013200/0x844e5faceb5f627c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172e3 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.777679:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135013200/0x844e5faceb5f627c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172e3 expref: 11 pid: 27374 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746155634.777689:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125255808:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155634.777754:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53373c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155634.778650:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125255808:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.778664:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135012c00/0x844e5faceb5f62b4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155634.778675:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155634.778877:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135012c00/0x844e5faceb5f62b4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.778883:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135012c00/0x844e5faceb5f62b4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155634.778893:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155634.779005:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135012e00/0x844e5faceb5f62ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1731b expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.779029:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135012c00/0x844e5faceb5f62b4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1731b expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.779036:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155634.779038:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155634.779040:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135012c00, rc 0) 00000100:00100000:1.0:1746155634.779059:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:32036:x1830976125716864:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 1535us (1665us total) trans 8589945105 rc 0/0 00000100:00100000:1.0:1746155634.779065:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10972 00000100:00100000:0.0:1746155634.780285:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.780354:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125717248 00000100:00100000:1.0:1746155634.780359:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125717248 00000100:00100000:1.0:1746155634.780434:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10973 00000100:00100000:1.0:1746155634.780444:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:32036:x1830976125717248:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155634.780457:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155634.780459:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746155634.780469:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135012c00/0x844e5faceb5f62b4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1731b expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.780477:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155634.780480:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155634.780485:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135012800/0x844e5faceb5f62c2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17322 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.780578:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f62c9 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.780586:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f62c9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.780592:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f62c9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.780599:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f62c9 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.780603:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f62c9 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.780608:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f62c9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.780613:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135012600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155634.780615:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f62c9 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.780620:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f62c9 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.780625:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155634.780627:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155634.780629:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f62c9 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.780632:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f62c9 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.780646:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135012800/0x844e5faceb5f62c2 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17322 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.780652:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135012800/0x844e5faceb5f62c2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17322 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.780658:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135012800, rc 0) 00000100:00100000:1.0:1746155634.780688:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32036:x1830976125717248:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 247us (404us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155634.780693:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10973 00000100:00100000:0.0:1746155634.781696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.782860:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.794621:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.794742:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125718016 00000100:00100000:1.0:1746155634.794750:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125718016 00000100:00100000:1.0:1746155634.794858:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10974 00000100:00100000:1.0:1746155634.794866:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32027:x1830976125718016:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155634.794883:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155634.794886:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746155634.794907:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff0fe00/0x844e5faceb5f6259 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172dc expref: 288 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.794920:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155634.794924:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155634.794932:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135012400/0x844e5faceb5f62d0 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17329 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.794972:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.794993:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f61a3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1726c expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.795000:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e4da00/0x844e5faceb5f626e lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ea expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.795005:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.795028:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094e4da00/0x844e5faceb5f626e lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ea expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.795037:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e4da00/0x844e5faceb5f626e lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ea expref: 9 pid: 15474 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746155634.795051:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125255936:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.795954:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f61a3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1726c expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.795963:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f61a3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1726c expref: 10 pid: 15474 timeout: 863 lvb_type: 0 00000100:00100000:1.0:1746155634.795970:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125256064:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155634.796004:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155634.798104:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.798141:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.798230:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125255936:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155634.798240:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125256064:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.798257:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.798421:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.798427:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000040:00080000:1.0:1746155634.799040:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3453, 88 off290768 00000004:00080000:1.0:1746155634.799045:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763948541711ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155634.799976:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3472, 88 off292704 00000004:00080000:1.0:1746155634.799991:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763949487680ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155634.800443:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3473, 88 off292792 00000004:00080000:1.0:1746155634.800447:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763949944519ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155634.800457:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3454, 88 off290856 00000004:00080000:1.0:1746155634.800459:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763949956044ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155634.800472:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3455, 88 off290944 00000004:00080000:1.0:1746155634.800474:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763949970961ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155634.800479:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3474, 88 off292880 00000004:00080000:1.0:1746155634.800482:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763949979148ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155634.800490:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3475, 88 off292968 00000004:00080000:1.0:1746155634.800495:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763949992224ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155634.800517:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3476, 88 off293056 00000004:00080000:1.0:1746155634.800520:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763950017073ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155634.800526:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3456, 88 off291032 00000004:00080000:1.0:1746155634.800528:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763950025119ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155634.800540:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3477, 88 off293144 00000004:00080000:1.0:1746155634.800542:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763950038814ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155634.800547:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3457, 88 off291120 00000004:00080000:1.0:1746155634.800549:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763950046478ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155634.800556:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3478, 88 off293232 00000004:00080000:1.0:1746155634.800558:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763950055253ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155634.800563:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3458, 88 off291208 00000004:00080000:1.0:1746155634.800565:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763950062171ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155634.800572:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3459, 88 off291296 00000004:00080000:1.0:1746155634.800573:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763950070659ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155634.800579:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3460, 88 off291384 00000004:00080000:1.0:1746155634.800581:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763950078356ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155634.800588:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3461, 88 off291472 00000004:00080000:1.0:1746155634.800590:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 763950086741ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155634.800595:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3479, 88 off293320 00000004:00080000:1.0:1746155634.800597:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 763950094109ns, next at 716011101328ns, rc = 0 00000100:00100000:1.0:1746155634.804416:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.804532:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125718400 00000100:00100000:0.0:1746155634.804539:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125718400 00000100:00100000:0.0:1746155634.804571:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10975 00000100:00100000:0.0:1746155634.804578:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32035:x1830976125718400:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155634.804707:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155634.804721:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17330 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.804759:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155634.804767:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17330 expref: 10 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.804780:0:19870:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155634.804788:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17330 expref: 10 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.804797:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155634.804799:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155634.804801:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17330 expref: 10 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155634.804806:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdd1600, rc 0) 00000100:00100000:0.0:1746155634.804836:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32035:x1830976125718400:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 259us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.804841:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10975 00010000:00010000:1.0:1746155634.819324:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17329 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.819337:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155634.819339:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746155634.819343:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17330 expref: 9 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.819351:0:27374:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17330 expref: 9 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.819357:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17330 expref: 9 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.819387:0:27374:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17330 expref: 6 pid: 19870 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155634.819397:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125256192:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155634.819461:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155634.819475:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125256320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.819519:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155634.819653:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125256832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.819671:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155634.819693:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125257088 00000100:00100000:1.0:1746155634.819880:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125257088 00000100:00100000:1.0:1746155634.819897:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16295 00000100:00100000:1.0:1746155634.819902:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976125256576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155634.819995:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:1.0:1746155634.819998:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155634 -> 1746155634 00002000:00010000:1.0:1746155634.820000:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155634 -> 1746155634 00002000:00010000:1.0:1746155634.820002:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155634 -> 1746155634 00002000:00010000:1.0:1746155634.820003:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5903 -> 5903 00000100:00100000:0.0:1746155634.820019:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16297 00000100:00100000:1.0:1746155634.820024:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3295:x1830976125256576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (483us total) trans 17179874081 rc 0/0 00000100:00100000:0.0:1746155634.820025:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3295:x1830976125257216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.820030:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16295 00000100:00100000:1.0:1746155634.820039:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16298 00000100:00100000:1.0:1746155634.820044:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3298:x1830976125256448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155634.820096:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16300 00000100:00100000:0.0:1746155634.820100:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3297:x1830976125256832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155634.820110:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155634.820112:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155634 -> 1746155634 00002000:00010000:1.0:1746155634.820114:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155634 -> 1746155634 00002000:00010000:1.0:1746155634.820115:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155634 -> 1746155634 00002000:00010000:1.0:1746155634.820117:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155634.820135:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3298:x1830976125256448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (510us total) trans 17179874084 rc 0/0 00000100:00100000:1.0:1746155634.820140:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16298 00000100:00100000:1.0:1746155634.820160:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125257344:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155634.820175:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155634.820177:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3297:x1830976125256832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (506us total) trans 17179874086 rc 0/0 00000100:00100000:0.0:1746155634.820182:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16300 00000100:00100000:1.0:1746155634.820187:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125257856:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155634.820200:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155634.820408:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125257344 00000100:00100000:0.0:1746155634.820411:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125257344 00000004:00080000:1.0:1746155634.820869:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b6c0000/2, rc 0, transno 17179874080 00000100:00100000:1.0:1746155634.820876:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125256320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155634.820883:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b6c0380/2, rc 0, transno 17179874086 00000100:00100000:1.0:1746155634.820885:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125256832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.820891:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746155634.820894:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125257472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155634.820910:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155634.820919:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125257984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155634.820931:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155634.820945:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125257472 00000100:00100000:1.0:1746155634.820947:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125257472 00000100:00100000:1.0:1746155634.820957:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125257984 00000100:00100000:1.0:1746155634.820959:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125257984 00000100:00100000:1.0:1746155634.820965:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16305 00000100:00100000:1.0:1746155634.820969:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976125257472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155634.821062:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155634.821064:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155634 -> 1746155634 00002000:00010000:1.0:1746155634.821066:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155634 -> 1746155634 00002000:00010000:1.0:1746155634.821068:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155634 -> 1746155634 00002000:00010000:1.0:1746155634.821069:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746155634.821087:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3297:x1830976125257472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (176us total) trans 21474841422 rc 0/0 00000100:00100000:1.0:1746155634.821091:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16305 00000100:00100000:0.0:1746155634.822159:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125258240 00000100:00100000:0.0:1746155634.822163:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125258240 00000100:00100000:0.0:1746155634.822180:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16307 00000100:00100000:0.0:1746155634.822184:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3296:x1830976125258240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155634.822265:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+35:3296:x1830976125258240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (1223us total) trans 21474841425 rc 0/0 00000100:00100000:0.0:1746155634.822270:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16307 00000004:00080000:0.0:1746155634.822295:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b6c2a00/2, rc 0, transno 17179874084 00000100:00100000:0.0:1746155634.822299:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125256448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155634.822305:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b6c1880/2, rc 0, transno 17179874085 00000100:00100000:0.0:1746155634.822308:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b6c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125256960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155634.822335:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976125257216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2311us (2725us total) trans 17179874083 rc 0/0 00000100:00100000:0.0:1746155634.822340:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16297 00000100:00100000:1.0:1746155634.822384:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125258368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.822402:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746155634.822418:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130899500/2, rc 0, transno 21474841422 00000100:00100000:1.0:1746155634.822420:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125257472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155634.822426:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976125257088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2284us (2860us total) trans 17179874087 rc 0/0 00000004:00080000:1.0:1746155634.822428:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130898a80/2, rc 0, transno 21474841423 00000100:00100000:1.0:1746155634.822430:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125257984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155634.822431:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16301 00000004:00080000:1.0:1746155634.822436:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013089aa00/2, rc 0, transno 21474841424 00000100:00100000:1.0:1746155634.822438:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125257344:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155634.822440:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125258368 00000100:00100000:0.0:1746155634.822441:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125258368 00000004:00080000:1.0:1746155634.822443:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130899180/2, rc 0, transno 21474841421 00000100:00100000:1.0:1746155634.822445:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125257856:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155634.822453:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16308 00000100:00100000:0.0:1746155634.822457:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3297:x1830976125258368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155634.822544:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3297:x1830976125258368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (140us total) trans 17179874088 rc 0/0 00000100:00100000:0.0:1746155634.822549:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16308 00000100:00100000:0.0:1746155634.822556:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125257600 00000100:00100000:0.0:1746155634.822559:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125257600 00000100:00100000:0.0:1746155634.822567:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125258112 00000100:00100000:0.0:1746155634.822569:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125258112 00000100:00100000:0.0:1746155634.822578:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16309 00000100:00100000:0.0:1746155634.822581:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3295:x1830976125257600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155634.822756:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155634.822759:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155634 -> 1746155634 00002000:00010000:0.0:1746155634.822761:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155634 -> 1746155634 00002000:00010000:0.0:1746155634.822763:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155634 -> 1746155634 00002000:00010000:0.0:1746155634.822764:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155634.822784:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3295:x1830976125257600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (263us total) trans 21474841427 rc 0/0 00000100:00100000:0.0:1746155634.822789:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16309 00000004:00080000:1.0:1746155634.822946:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0ac7480/2, rc 0, transno 17179874088 00000100:00100000:1.0:1746155634.822949:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125258368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155634.823021:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125256192:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155634.823047:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135012400/0x844e5faceb5f62d0 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17329 expref: 288 pid: 27374 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746155634.823060:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17329 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.823082:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135012200, rc 0) 00000100:00100000:1.0:1746155634.823108:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32027:x1830976125718016:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 28244us (28494us total) trans 8589945108 rc 0/0 00000100:00100000:1.0:1746155634.823115:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10974 00000100:00100000:0.0:1746155634.823218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.845764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.845809:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.845882:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125718656 00000100:00100000:1.0:1746155634.845890:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125718656 00000100:00100000:1.0:1746155634.845940:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16312 00000100:00100000:1.0:1746155634.845944:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32027:x1830976125718656:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155634.845956:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155634.845969:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5f62e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17337 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.846004:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a626f600/0x844e5faceb5f620c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1729d expref: 23 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.846012:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0800/0x844e5faceb5f629f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1730d expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.846018:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4aa00/0x844e5faceb5f6236 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c7 expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.846023:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.846024:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.846027:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5f62e5 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3727360->4194303] (req 3727360->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17337 expref: 25 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.846049:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe4aa00/0x844e5faceb5f6236 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c7 expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.846058:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4aa00/0x844e5faceb5f6236 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c7 expref: 25 pid: 20796 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746155634.846068:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125258496:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.848024:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0800/0x844e5faceb5f629f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1730d expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.848036:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0800/0x844e5faceb5f629f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1730d expref: 7 pid: 8437 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746155634.848046:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125258880:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.848071:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a626f600/0x844e5faceb5f620c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1729d expref: 23 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.848078:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a626f600/0x844e5faceb5f620c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1729d expref: 23 pid: 18270 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746155634.848085:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125259008:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155634.848099:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155634.851713:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.851745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.851760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.851775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.851788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.851811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.851826:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125719424 00000100:00100000:0.0:1746155634.851829:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125719424 00010000:00010000:0.0:1746155634.851843:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a626f600/0x844e5faceb5f620c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1729d expref: 25 pid: 18270 timeout: 863 lvb_type: 1 00000100:00100000:0.0:1746155634.851855:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125719040 00000100:00100000:0.0:1746155634.851857:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125719040 00010000:00010000:0.0:1746155634.851865:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4ba00/0x844e5faceb5f621a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ab expref: 27 pid: 20796 timeout: 863 lvb_type: 1 00000100:00100000:1.0:1746155634.851927:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125258496:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155634.851934:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125258880:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155634.851939:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125259008:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155634.851974:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8367 00000100:00100000:0.0:1746155634.851991:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1962:x1830976125719552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155634.851999:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155634.852007:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88008ff0f000/0x844e5faceb5f6213 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17281 expref: 24 pid: 10591 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746155634.852015:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ff0f000/0x844e5faceb5f6213 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17281 expref: 24 pid: 10591 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746155634.852026:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff0f000/0x844e5faceb5f6213 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17281 expref: 24 pid: 10591 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746155634.852043:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155634.852058:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1962:x1830976125719552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 68us (282us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155634.852088:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17600/0x844e5faceb5f62e5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [3727360->4194303] (req 3727360->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17337 expref: 27 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.852096:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e17600, rc 0) 00000100:00100000:1.0:1746155634.852116:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:32027:x1830976125718656:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6171us (6359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.852121:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16312 00000100:00100000:0.0:1746155634.852564:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8367 00000100:00100000:0.0:1746155634.852589:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8369 00000100:00100000:0.0:1746155634.852595:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976125719168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155634.852601:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155634.852610:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0800/0x844e5faceb5f629f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1730d expref: 7 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746155634.852618:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0800/0x844e5faceb5f629f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1730d expref: 7 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746155634.852629:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0800/0x844e5faceb5f629f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1730d expref: 7 pid: 8437 timeout: 863 lvb_type: 1 00010000:00010000:0.0:1746155634.852636:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155634.852655:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1962:x1830976125719168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 60us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155634.852660:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8369 00000100:00100000:0.0:1746155634.855192:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.855995:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.859056:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.859151:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125720192 00000100:00100000:1.0:1746155634.859156:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125720192 00000100:00100000:1.0:1746155634.859196:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16313 00000100:00100000:1.0:1746155634.859203:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32035:x1830976125720192:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155634.859215:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155634.859229:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135013c00/0x844e5faceb5f62f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17345 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.859250:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a626e600/0x844e5faceb5f61fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17288 expref: 15 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.859258:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0200/0x844e5faceb5f628a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172f8 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.859265:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f6221 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b2 expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.859271:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.859273:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.859276:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135013c00/0x844e5faceb5f62f3 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [1048576->1314815] (req 1048576->1314815) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17345 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.859298:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f6221 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b2 expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.859313:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f6221 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b2 expref: 24 pid: 20796 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155634.859324:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125259520:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.859401:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0200/0x844e5faceb5f628a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172f8 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.859413:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0200/0x844e5faceb5f628a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172f8 expref: 8 pid: 8437 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155634.859421:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125259648:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.859445:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a626e600/0x844e5faceb5f61fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17288 expref: 15 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.859452:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a626e600/0x844e5faceb5f61fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17288 expref: 15 pid: 18270 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155634.859459:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125259776:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155634.859650:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155634.861748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.861773:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125259520:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155634.862370:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125259776:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155634.862379:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125259648:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.862398:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135013c00/0x844e5faceb5f62f3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1048576->1314815] (req 1048576->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17345 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.862408:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135013c00, rc 0) 00000100:00100000:1.0:1746155634.862431:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32035:x1830976125720192:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3229us (3378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.862437:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16313 00000100:00100000:0.0:1746155634.864131:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.864337:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125720576 00000100:00100000:1.0:1746155634.864343:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125720576 00000100:00100000:1.0:1746155634.864380:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16314 00000100:00100000:1.0:1746155634.864386:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32027:x1830976125720576:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155634.864399:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155634.864409:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135012c00/0x844e5faceb5f62fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1734c expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.864430:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ff0e600/0x844e5faceb5f61f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172a4 expref: 14 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.864439:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0600/0x844e5faceb5f62a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17314 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.864445:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b400/0x844e5faceb5f623d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ce expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.864450:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.864451:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155634.864455:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135012c00/0x844e5faceb5f62fa lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3145728->3571711] (req 3145728->3571711) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1734c expref: 25 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.864476:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b400/0x844e5faceb5f623d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ce expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.864486:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b400/0x844e5faceb5f623d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ce expref: 25 pid: 20796 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155634.864500:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125259904:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.864594:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0600/0x844e5faceb5f62a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17314 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.864602:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0600/0x844e5faceb5f62a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17314 expref: 8 pid: 8437 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155634.864609:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125260032:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.864628:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ff0e600/0x844e5faceb5f61f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172a4 expref: 14 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.864635:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ff0e600/0x844e5faceb5f61f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172a4 expref: 14 pid: 10591 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155634.864641:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125260160:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155634.864652:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155634.865023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.865338:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.866078:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.866095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155634.866370:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4b400/0x844e5faceb5f623d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ce expref: 25 pid: 20796 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155634.866394:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125259904:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.866402:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0600/0x844e5faceb5f62a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17314 expref: 7 pid: 8437 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155634.866413:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125260032:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155634.866419:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125260160:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155634.866433:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135012c00/0x844e5faceb5f62fa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->3571711] (req 3145728->3571711) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1734c expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.866440:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135012c00, rc 0) 00000100:00100000:1.0:1746155634.866461:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32027:x1830976125720576:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2075us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155634.866466:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16314 00000100:00100000:0.0:1746155634.866569:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.870338:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.873597:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.873646:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125721600 00000100:00100000:1.0:1746155634.873652:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125721600 00002000:00100000:1.0:1746155634.873681:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3567616->3571711) req@ffff88009ca97480 x1830976125721600/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.873688:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97480 with x1830976125721600 ext(3567616->3571711) 00002000:00010000:1.0:1746155634.873691:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca97480 00000100:00100000:0.0:1746155634.874195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.874238:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7724 00000100:00100000:1.0:1746155634.874246:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125721600:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155634.874440:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125721600:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 194us (848us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155634.874446:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7724 00002000:00100000:1.0:1746155634.874452:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3567616->3571711) req@ffff88009ca97480 x1830976125721600/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:705/0 lens 488/4536 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.874464:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97480 with x1830976125721600 ext(3567616->3571711) 00002000:00010000:1.0:1746155634.874467:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca97480 00000100:00100000:1.0:1746155634.874485:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125721856 00000100:00100000:1.0:1746155634.874488:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125721856 00000100:00100000:1.0:1746155634.874791:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4632 00000100:00100000:1.0:1746155634.874798:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32035:x1830976125721856:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155634.875027:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32035:x1830976125721856:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 229us (831us total) trans 8589945109 rc 0/0 00000100:00100000:1.0:1746155634.875032:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4632 00000100:00100000:0.0:1746155634.878385:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.879160:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.879212:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125722240 00000100:00100000:1.0:1746155634.879297:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125722240 00000100:00100000:1.0:1746155634.879321:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4633 00000100:00100000:1.0:1746155634.879327:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32027:x1830976125722240:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155634.879464:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32027:x1830976125722240:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 137us (303us total) trans 8589945110 rc 0/0 00000100:00100000:1.0:1746155634.879469:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4633 00000100:00100000:0.0:1746155634.899388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.899452:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125722496 00000100:00100000:1.0:1746155634.899459:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125722496 00000100:00100000:1.0:1746155634.899695:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10976 00000100:00100000:1.0:1746155634.899704:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32044:x1830976125722496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155634.899721:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155634.899735:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135013a00/0x844e5faceb5f6301 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17353 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.899826:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17400/0x844e5faceb5f6308 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.899835:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17400/0x844e5faceb5f6308 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.899846:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17400/0x844e5faceb5f6308 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.899856:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5f630f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.899861:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5f630f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.899866:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5f630f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.899949:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17800/0x844e5faceb5f6316 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.899955:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17800/0x844e5faceb5f6316 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.899960:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17800/0x844e5faceb5f6316 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155634.899966:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155634.900047:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17400/0x844e5faceb5f6308 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900053:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17400/0x844e5faceb5f6308 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900061:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17400/0x844e5faceb5f6308 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900065:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3e17400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155634.900067:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17400/0x844e5faceb5f6308 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900072:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17400/0x844e5faceb5f6308 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900090:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155634.900092:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155634.900095:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17400/0x844e5faceb5f6308 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900099:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17400/0x844e5faceb5f6308 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900119:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5f630f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900123:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5f630f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900128:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5f630f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900131:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3e16e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155634.900132:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5f630f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900136:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5f630f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900144:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0800) 00010000:00010000:1.0:1746155634.900145:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155634.900147:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5f630f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900151:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e16e00/0x844e5faceb5f630f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.900336:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135013a00/0x844e5faceb5f6301 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17353 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.900345:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17800/0x844e5faceb5f6316 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17353 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.900350:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155634.900352:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155634.900354:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e17800, rc 0) 00000100:00100000:1.0:1746155634.901283:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32044:x1830976125722496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1578us (1899us total) trans 8589945111 rc 0/0 00000100:00100000:1.0:1746155634.901289:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10976 00000100:00100000:0.0:1746155634.905004:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.905044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.905104:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125722624 00000100:00100000:1.0:1746155634.905110:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125722624 00000100:00100000:1.0:1746155634.905141:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16315 00000100:00100000:1.0:1746155634.905146:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976125722624:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155634.905158:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155634.905171:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16600/0x844e5faceb5f6324 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1735a expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155634.905522:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125260672:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155634.905571:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00002000:00010000:1.0:1746155634.908241:0:20796:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155634 -> 1746155635 00002000:00010000:1.0:1746155634.908244:0:20796:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155634 -> 1746155635 00002000:00010000:1.0:1746155634.908246:0:20796:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime: 1746155634 -> 1746155635 00000100:00100000:1.0:1746155634.908919:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125260672:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155634.908938:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16600/0x844e5faceb5f6324 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1735a expref: 22 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.908947:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e16600/0x844e5faceb5f6324 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1735a expref: 22 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155634.909018:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e16600, rc 0) 00000100:00100000:1.0:1746155634.909183:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976125722624:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4035us (4182us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155634.909189:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16315 00000100:00100000:0.0:1746155634.919099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.919134:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.919166:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.919191:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.919481:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125723136 00000100:00100000:0.0:1746155634.919488:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125723136 00002000:00100000:0.0:1746155634.919544:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (0->614399) req@ffff88009ca94700 x1830976125723136/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155634.919553:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94700 with x1830976125723136 ext(0->614399) 00002000:00010000:0.0:1746155634.919558:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca94700 00000100:00100000:0.0:1746155634.919975:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125723264 00000100:00100000:0.0:1746155634.919988:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125723264 00002000:00100000:0.0:1746155634.920001:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1314816->2097151) req@ffff88009ca97100 x1830976125723264/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155634.920008:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97100 with x1830976125723264 ext(1314816->2097151) 00002000:00010000:0.0:1746155634.920012:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca97100 00000100:00100000:1.0:1746155634.920055:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125723520 00000100:00100000:1.0:1746155634.920058:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125723520 00002000:00100000:1.0:1746155634.920072:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009ca97800 x1830976125723520/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.920079:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97800 with x1830976125723520 ext(1048576->2097151) 00002000:00010000:1.0:1746155634.920081:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca97800 00000100:00100000:1.0:1746155634.920090:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125723776 00000100:00100000:1.0:1746155634.920092:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125723776 00002000:00100000:1.0:1746155634.920100:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009366e300 x1830976125723776/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/0 e 0 to 0 dl 1746155645 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.920106:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366e300 with x1830976125723776 ext(1048576->2097151) 00002000:00010000:1.0:1746155634.920109:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366e300 00000100:00100000:1.0:1746155634.920121:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7725 00000100:00100000:1.0:1746155634.920127:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976125723136:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155634.923024:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7728 00000100:00100000:0.0:1746155634.923033:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1962:x1830976125723776:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155634.932102:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1962:x1830976125723136:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11966us (13001us total) trans 0 rc 614400/614400 00000100:00100000:1.0:1746155634.932112:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7725 00002000:00100000:1.0:1746155634.932123:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (0->614399) req@ffff88009ca94700 x1830976125723136/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:705/0 lens 488/440 e 0 to 0 dl 1746155645 ref 1 fl Complete:/200/0 rc 614400/614400 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155634.932130:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94700 with x1830976125723136 ext(0->614399) 00002000:00010000:1.0:1746155634.932135:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca94700 00000100:00100000:0.0:1746155634.949968:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.950353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.957179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.960613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.972694:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.979366:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.994241:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.996877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155634.997930:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155634.998011:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125725184 00000100:00100000:1.0:1746155634.998015:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125725184 00000100:00100000:1.0:1746155634.998037:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10977 00000100:00100000:1.0:1746155634.998042:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32049:x1830976125725184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155634.998055:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155634.998067:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ac00/0x844e5faceb5f634e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17384 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.998245:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f6355 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998255:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f6355 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998266:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f6355 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998277:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b000/0x844e5faceb5f635c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998282:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b000/0x844e5faceb5f635c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998287:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b000/0x844e5faceb5f635c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998366:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b200/0x844e5faceb5f6363 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998373:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b200/0x844e5faceb5f6363 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998378:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b200/0x844e5faceb5f6363 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155634.998385:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155634.998446:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f6355 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998451:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f6355 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998456:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f6355 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998460:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f17ae00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155634.998463:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f6355 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998469:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f6355 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998477:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155634.998479:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155634.998482:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f6355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998486:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f6355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998499:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b000/0x844e5faceb5f635c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998519:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b000/0x844e5faceb5f635c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998524:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b000/0x844e5faceb5f635c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998527:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f17b000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155634.998529:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b000/0x844e5faceb5f635c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998545:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b000/0x844e5faceb5f635c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998551:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0700) 00010000:00010000:1.0:1746155634.998553:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155634.998555:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b000/0x844e5faceb5f635c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998559:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b000/0x844e5faceb5f635c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155634.998588:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ac00/0x844e5faceb5f634e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17384 expref: 291 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.998596:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b200/0x844e5faceb5f6363 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17384 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155634.998601:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155634.998603:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155634.998605:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17b200, rc 0) 00000100:00100000:1.0:1746155634.998625:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32049:x1830976125725184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 583us (696us total) trans 8589945112 rc 0/0 00000100:00100000:1.0:1746155634.998631:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10977 00000100:00100000:0.0:1746155635.001500:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.001774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.001956:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125725440 00000100:00100000:1.0:1746155635.001962:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125725440 00000100:00100000:1.0:1746155635.002006:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10978 00000100:00100000:1.0:1746155635.002012:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32047:x1830976125725440:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155635.002028:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155635.002042:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b600/0x844e5faceb5f6371 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1738b expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.002109:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b800/0x844e5faceb5f6378 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.002120:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17800/0x844e5faceb5f6316 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17353 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.002127:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b200/0x844e5faceb5f6363 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17384 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.002133:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b800/0x844e5faceb5f6378 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.002156:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b200/0x844e5faceb5f6363 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17384 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.002165:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b200/0x844e5faceb5f6363 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17384 expref: 289 pid: 27374 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746155635.002174:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125261440:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.002234:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17800/0x844e5faceb5f6316 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17353 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.002241:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e17800/0x844e5faceb5f6316 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17353 expref: 11 pid: 27374 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746155635.002837:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125261568:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155635.002878:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155635.005126:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125261440:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155635.005135:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125261568:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.005151:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b800/0x844e5faceb5f6378 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155635.005334:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.005651:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.005834:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.005874:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8378 00000100:00100000:0.0:1746155635.005881:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1961:x1830976125725824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155635.005889:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155635.005894:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b200/0x844e5faceb5f6363 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17384 expref: 291 pid: 27374 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746155635.005903:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b200/0x844e5faceb5f6363 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17384 expref: 291 pid: 27374 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746155635.005919:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b200/0x844e5faceb5f6363 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17384 expref: 291 pid: 27374 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746155635.006279:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155635.006284:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b800/0x844e5faceb5f6378 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155635.006290:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b800/0x844e5faceb5f6378 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155635.006295:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155635.006349:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1961:x1830976125725824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 468us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.006354:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8378 00010000:00010000:1.0:1746155635.006787:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b800/0x844e5faceb5f6378 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.006793:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b800/0x844e5faceb5f6378 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155635.006808:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155635.006907:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b600/0x844e5faceb5f6371 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1738b expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.006933:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b800/0x844e5faceb5f6378 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1738b expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.006938:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155635.006940:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155635.006942:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17b800, rc 0) 00000100:00100000:1.0:1746155635.006963:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32047:x1830976125725440:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4951us (5469us total) trans 8589945114 rc 0/0 00000100:00100000:1.0:1746155635.006968:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10978 00000100:00100000:0.0:1746155635.007586:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125726208 00000100:00100000:0.0:1746155635.007589:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125726208 00000100:00100000:0.0:1746155635.007604:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125726336 00000100:00100000:0.0:1746155635.007606:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125726336 00000100:00100000:0.0:1746155635.007615:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125726464 00000100:00100000:0.0:1746155635.007617:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125726464 00000100:00100000:0.0:1746155635.007628:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16322 00000100:00100000:0.0:1746155635.007633:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976125726208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155635.007641:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155635.007649:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df29400/0x844e5faceb5f638d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17399 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155635.007670:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125261824:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155635.007704:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3329c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746155635.008939:0:9235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime: 1746155634 -> 1746155635 00002000:00010000:1.0:1746155635.008942:0:9235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime: 1746155634 -> 1746155635 00002000:00010000:1.0:1746155635.008943:0:9235:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime: 1746155634 -> 1746155635 00000100:00100000:1.0:1746155635.008952:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125261824:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155635.008965:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df29400/0x844e5faceb5f638d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17399 expref: 30 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.008973:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df29400/0x844e5faceb5f638d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17399 expref: 30 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.008996:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df29400, rc 0) 00000100:00100000:1.0:1746155635.009013:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976125726208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1380us (2401us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155635.009017:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16322 00000100:00100000:0.0:1746155635.013007:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.017665:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.017719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.025344:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.025367:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125727360 00000100:00100000:1.0:1746155635.025373:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125727360 00002000:00100000:1.0:1746155635.025405:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009018b100 x1830976125727360/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.025414:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018b100 with x1830976125727360 ext(2097152->3145727) 00002000:00010000:1.0:1746155635.025418:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009018b100 00000100:00100000:1.0:1746155635.025432:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7731 00000100:00100000:1.0:1746155635.025438:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125727360:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155635.026393:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125727488 00000100:00100000:0.0:1746155635.026397:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125727488 00002000:00100000:0.0:1746155635.026413:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f703100 x1830976125727488/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155635.026420:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f703100 with x1830976125727488 ext(3145728->4194303) 00002000:00010000:0.0:1746155635.026423:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f703100 00000100:00100000:0.0:1746155635.026434:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7732 00000100:00100000:0.0:1746155635.026438:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125727488:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155635.038881:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009018b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125727360:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13442us (13542us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155635.038888:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7731 00002000:00100000:1.0:1746155635.038893:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009018b100 x1830976125727360/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.038901:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009018b100 with x1830976125727360 ext(2097152->3145727) 00002000:00010000:1.0:1746155635.038904:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009018b100 00000100:00100000:1.0:1746155635.040199:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125727488:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13756us (14188us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155635.040206:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7732 00002000:00100000:1.0:1746155635.040213:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f703100 x1830976125727488/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.040220:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f703100 with x1830976125727488 ext(3145728->4194303) 00002000:00010000:1.0:1746155635.040223:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f703100 00000100:00100000:0.0:1746155635.043425:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.045778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.049541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.049698:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125728128 00000100:00100000:1.0:1746155635.049705:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125728128 00002000:00100000:1.0:1746155635.049738:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880131495c00 x1830976125728128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.049746:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495c00 with x1830976125728128 ext(0->1048575) 00002000:00010000:1.0:1746155635.049751:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495c00 00000100:00100000:1.0:1746155635.049777:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7733 00000100:00100000:1.0:1746155635.049783:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976125728128:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155635.051352:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.062138:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976125728128:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12347us (12594us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155635.062148:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7733 00002000:00100000:1.0:1746155635.062159:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880131495c00 x1830976125728128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.062168:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495c00 with x1830976125728128 ext(0->1048575) 00002000:00010000:1.0:1746155635.062174:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495c00 00000100:00100000:0.0:1746155635.071542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.073047:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125728512 00000100:00100000:1.0:1746155635.073056:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125728512 00000100:00100000:1.0:1746155635.073109:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16327 00000100:00100000:1.0:1746155635.073116:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32049:x1830976125728512:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155635.073132:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155635.073147:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df29200/0x844e5faceb5f63b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f173bc expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.073172:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135013c00/0x844e5faceb5f62f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17345 expref: 13 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.073179:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155635.073181:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155635.073184:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df29200/0x844e5faceb5f63b0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173bc expref: 26 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.073209:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135013c00/0x844e5faceb5f62f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17345 expref: 13 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.073219:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135013c00/0x844e5faceb5f62f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1314815) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17345 expref: 13 pid: 20796 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746155635.073229:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125262464:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155635.073309:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155635.081704:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125262464:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.081730:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df29200/0x844e5faceb5f63b0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173bc expref: 26 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.081745:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df29200, rc 0) 00000100:00100000:1.0:1746155635.081794:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:32049:x1830976125728512:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8678us (10292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.081802:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16327 00000100:00100000:0.0:1746155635.083765:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.083844:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.084818:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125728768 00000100:00100000:1.0:1746155635.084822:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125728768 00000100:00100000:1.0:1746155635.084842:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16328 00000100:00100000:1.0:1746155635.084847:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125728768:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155635.084854:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155635.084866:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df29800/0x844e5faceb5f63b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f173c3 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.084912:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125262592:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155635.084968:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155635.093058:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125262592:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155635.093086:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df29800/0x844e5faceb5f63b7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173c3 expref: 17 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155635.093098:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df29800/0x844e5faceb5f63b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173c3 expref: 17 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155635.093110:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df29800, rc 0) 00000100:00100000:0.0:1746155635.093144:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125728768:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8296us (9383us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155635.093151:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16328 00000100:00100000:0.0:1746155635.114548:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.120658:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.136006:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.136032:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125729280 00000100:00100000:1.0:1746155635.136039:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125729280 00000100:00100000:1.0:1746155635.136076:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10979 00000100:00100000:1.0:1746155635.136082:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32051:x1830976125729280:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155635.136100:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155635.136114:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28800/0x844e5faceb5f63c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f173d1 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.136202:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28c00/0x844e5faceb5f63cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136212:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28c00/0x844e5faceb5f63cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136221:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28c00/0x844e5faceb5f63cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136231:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28e00/0x844e5faceb5f63d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136237:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28e00/0x844e5faceb5f63d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136243:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28e00/0x844e5faceb5f63d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136323:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28a00/0x844e5faceb5f63da lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136330:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28a00/0x844e5faceb5f63da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136336:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28a00/0x844e5faceb5f63da lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155635.136343:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155635.136403:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28c00/0x844e5faceb5f63cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136409:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28c00/0x844e5faceb5f63cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136414:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28c00/0x844e5faceb5f63cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136419:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012df28c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155635.136422:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28c00/0x844e5faceb5f63cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136427:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28c00/0x844e5faceb5f63cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136436:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155635.136439:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155635.136442:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28c00/0x844e5faceb5f63cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136446:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28c00/0x844e5faceb5f63cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136459:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28e00/0x844e5faceb5f63d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136463:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28e00/0x844e5faceb5f63d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136467:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28e00/0x844e5faceb5f63d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136471:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012df28e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155635.136473:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28e00/0x844e5faceb5f63d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136478:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28e00/0x844e5faceb5f63d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136483:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0700) 00010000:00010000:1.0:1746155635.136485:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155635.136487:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28e00/0x844e5faceb5f63d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136491:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28e00/0x844e5faceb5f63d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.136536:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28800/0x844e5faceb5f63c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173d1 expref: 293 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.136550:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28a00/0x844e5faceb5f63da lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173d1 expref: 292 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.136555:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155635.136557:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155635.136559:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df28a00, rc 0) 00000100:00100000:1.0:1746155635.136589:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32051:x1830976125729280:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 507us (584us total) trans 8589945115 rc 0/0 00000100:00100000:1.0:1746155635.136594:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10979 00000100:00100000:0.0:1746155635.138878:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.138895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.138909:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125729536 00000100:00100000:0.0:1746155635.138914:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125729536 00002000:00100000:0.0:1746155635.138941:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8801317c7b80 x1830976125729536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155635.138951:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c7b80 with x1830976125729536 ext(1048576->2097151) 00002000:00010000:0.0:1746155635.138955:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c7b80 00000100:00100000:0.0:1746155635.138966:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125729792 00000100:00100000:0.0:1746155635.138968:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125729792 00002000:00100000:0.0:1746155635.138987:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880137121180 x1830976125729792/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155635.138999:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121180 with x1830976125729792 ext(1048576->2097151) 00002000:00010000:0.0:1746155635.139002:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880137121180 00000100:00100000:0.0:1746155635.139012:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7735 00000100:00100000:0.0:1746155635.139018:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976125729536:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155635.150247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.160842:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125729536:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21822us (21967us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155635.160849:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7735 00002000:00100000:0.0:1746155635.160854:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8801317c7b80 x1830976125729536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155635.160861:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c7b80 with x1830976125729536 ext(1048576->2097151) 00002000:00010000:0.0:1746155635.160865:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c7b80 00000100:00100000:0.0:1746155635.172451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.191234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.201255:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7740 00000100:00100000:1.0:1746155635.201262:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976125731200:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155635.213365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.220203:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976125731200:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18935us (19812us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155635.220215:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7740 00002000:00100000:0.0:1746155635.220226:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f703b80 x1830976125731200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155635.220234:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f703b80 with x1830976125731200 ext(3145728->4194303) 00010000:00010000:0.0:1746155635.220242:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f4fb800/0x844e5faceb5f63e8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173d8 expref: 28 pid: 9235 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746155635.220259:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f4fb800/0x844e5faceb5f63e8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173d8 expref: 28 pid: 9235 timeout: 864 lvb_type: 0 00002000:00010000:0.0:1746155635.220264:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f703b80 00000100:00100000:0.0:1746155635.223206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.226743:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.227453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.230444:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.241204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.241246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.241689:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125732480 00000100:00100000:1.0:1746155635.241694:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125732480 00002000:00100000:1.0:1746155635.241722:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3305472->4194303) req@ffff88009f880000 x1830976125732480/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.241730:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f880000 with x1830976125732480 ext(3305472->4194303) 00010000:00010000:1.0:1746155635.241738:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f4fb600/0x844e5faceb5f63ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173df expref: 15 pid: 18270 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.241747:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f4fb600/0x844e5faceb5f63ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173df expref: 15 pid: 18270 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746155635.241753:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f880000 00000100:00100000:1.0:1746155635.241772:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1315 00000100:00100000:1.0:1746155635.241780:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1962:x1830976125732480:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155635.249439:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.250392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.250495:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125732864 00000100:00100000:1.0:1746155635.250527:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125732864 00010000:00010000:1.0:1746155635.250543:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4fba00/0x844e5faceb5f6340 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17376 expref: 25 pid: 4461 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746155635.251180:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8386 00000100:00100000:1.0:1746155635.251242:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1962:x1830976125732864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155635.251251:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155635.251263:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4fba00/0x844e5faceb5f6340 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17376 expref: 25 pid: 4461 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.251272:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4fba00/0x844e5faceb5f6340 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17376 expref: 25 pid: 4461 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.251285:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4fba00/0x844e5faceb5f6340 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17376 expref: 25 pid: 4461 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.251302:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.251304:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.252625:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012df29e00/0x844e5faceb5f63fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4354047) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173ed expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.252636:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012df29e00/0x844e5faceb5f63fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4354047) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173ed expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.252671:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012df29e00/0x844e5faceb5f63fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4354047) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173ed expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.252689:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125263744:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155635.253394:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155635.256375:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125263744:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155635.256390:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155635.256474:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1962:x1830976125732864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5232us (6080us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.256484:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8386 00000100:00100000:1.0:1746155635.258402:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976125732480:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 16619us (17150us total) trans 21474841430 rc 0/0 00000100:00100000:1.0:1746155635.258409:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1315 00002000:00100000:1.0:1746155635.258414:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3305472->4194303) req@ffff88009f880000 x1830976125732480/t21474841430(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/448 e 0 to 0 dl 1746155646 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.258420:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f880000 with x1830976125732480 ext(3305472->4194303) 00010000:00010000:1.0:1746155635.258426:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f4fb600/0x844e5faceb5f63ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173df expref: 17 pid: 18270 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.258439:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f4fb600/0x844e5faceb5f63ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173df expref: 17 pid: 18270 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746155635.258444:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f880000 00000100:00100000:0.0:1746155635.263628:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.263754:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125733248 00000100:00100000:1.0:1746155635.263762:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125733248 00010000:00010000:1.0:1746155635.263789:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4fb600/0x844e5faceb5f63ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3305472->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173df expref: 17 pid: 18270 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746155635.263824:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8387 00000100:00100000:1.0:1746155635.263830:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976125733248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155635.263841:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155635.263859:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4fb600/0x844e5faceb5f63ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3305472->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173df expref: 17 pid: 18270 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.263869:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4fb600/0x844e5faceb5f63ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3305472->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173df expref: 17 pid: 18270 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.263891:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4fb600/0x844e5faceb5f63ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3305472->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173df expref: 17 pid: 18270 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.263912:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.263914:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.263919:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df28800/0x844e5faceb5f63f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173e6 expref: 26 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.263926:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df28800/0x844e5faceb5f63f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173e6 expref: 26 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.263951:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012df28800/0x844e5faceb5f63f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173e6 expref: 26 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.263961:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125263872:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155635.264132:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155635.265661:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.267489:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125263872:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155635.267499:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155635.267689:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.267748:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125733248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3913us (4122us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.267755:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8387 00000100:00100000:1.0:1746155635.267772:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125733760 00000100:00100000:1.0:1746155635.267775:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125733760 00002000:00100000:1.0:1746155635.267930:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f881500 x1830976125733760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.267939:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881500 with x1830976125733760 ext(3145728->4194303) 00002000:00010000:1.0:1746155635.267943:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f881500 00000100:00100000:1.0:1746155635.267964:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7743 00000100:00100000:1.0:1746155635.267970:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976125733760:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155635.268220:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.274148:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.274895:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976125733760:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 6923us (7204us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155635.274902:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7743 00002000:00100000:1.0:1746155635.274909:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f881500 x1830976125733760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.274916:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881500 with x1830976125733760 ext(3145728->4194303) 00002000:00010000:1.0:1746155635.274920:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f881500 00000100:00100000:0.0:1746155635.277766:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.277830:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125734144 00000100:00100000:1.0:1746155635.277835:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125734144 00002000:00100000:1.0:1746155635.277860:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3768320->3772415) req@ffff88009f881f80 x1830976125734144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.277868:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881f80 with x1830976125734144 ext(3768320->3772415) 00002000:00010000:1.0:1746155635.277873:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f881f80 00000100:00100000:1.0:1746155635.277895:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7744 00000100:00100000:1.0:1746155635.277901:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125734144:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155635.278045:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125734144:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 143us (278us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155635.278051:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7744 00002000:00100000:1.0:1746155635.278056:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3768320->3772415) req@ffff88009f881f80 x1830976125734144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/4536 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.278063:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881f80 with x1830976125734144 ext(3768320->3772415) 00002000:00010000:1.0:1746155635.278066:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f881f80 00000100:00100000:0.0:1746155635.278937:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.278988:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125734400 00000100:00100000:1.0:1746155635.278992:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125734400 00002000:00100000:1.0:1746155635.279007:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012fef2300 x1830976125734400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.279014:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef2300 with x1830976125734400 ext(4194304->5083135) 00002000:00010000:1.0:1746155635.279017:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef2300 00000100:00100000:1.0:1746155635.279037:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7745 00000100:00100000:1.0:1746155635.279043:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125734400:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155635.283738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.284525:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125734400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5481us (5587us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155635.284533:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7745 00002000:00100000:1.0:1746155635.284540:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012fef2300 x1830976125734400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.284553:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef2300 with x1830976125734400 ext(4194304->5083135) 00002000:00010000:1.0:1746155635.284557:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012fef2300 00000100:00100000:0.0:1746155635.287562:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.287619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.296249:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.296332:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125735040 00000100:00100000:1.0:1746155635.296339:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125735040 00002000:00100000:1.0:1746155635.296371:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3620864->3624959) req@ffff88012fef3480 x1830976125735040/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.296377:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef3480 with x1830976125735040 ext(3620864->3624959) 00002000:00010000:1.0:1746155635.296381:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef3480 00000100:00100000:1.0:1746155635.296404:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7746 00000100:00100000:1.0:1746155635.296410:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976125735040:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155635.296591:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976125735040:12345-192.168.202.51@tcp:3:cat.0 Request processed in 180us (348us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155635.296597:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7746 00002000:00100000:1.0:1746155635.296603:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3620864->3624959) req@ffff88012fef3480 x1830976125735040/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/4536 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.296609:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef3480 with x1830976125735040 ext(3620864->3624959) 00002000:00010000:1.0:1746155635.296611:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef3480 00000100:00100000:0.0:1746155635.299750:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.299880:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125735296 00000100:00100000:1.0:1746155635.299887:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125735296 00000100:00100000:1.0:1746155635.299967:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4636 00000100:00100000:1.0:1746155635.299984:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0dcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32051:x1830976125735296:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155635.300142:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0dcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32051:x1830976125735296:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 168us (397us total) trans 8589945117 rc 0/0 00000100:00100000:1.0:1746155635.300152:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4636 00000100:00100000:0.0:1746155635.307928:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.307992:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125735424 00000100:00100000:1.0:1746155635.307999:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125735424 00000100:00100000:1.0:1746155635.308044:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10980 00000100:00100000:1.0:1746155635.308048:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32056:x1830976125735424:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155635.308067:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155635.308078:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd600/0x844e5faceb5f6419 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17409 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.308120:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f6420 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.308127:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f6420 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.308133:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f6420 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.308141:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cda00/0x844e5faceb5f6427 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.308144:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cda00/0x844e5faceb5f6427 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.308147:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cda00/0x844e5faceb5f6427 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.308236:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cdc00/0x844e5faceb5f642e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.308244:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b800/0x844e5faceb5f6378 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1738b expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.308250:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cdc00/0x844e5faceb5f642e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.308274:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b800/0x844e5faceb5f6378 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1738b expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.308283:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b800/0x844e5faceb5f6378 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1738b expref: 11 pid: 15474 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746155635.308294:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125264640:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155635.308379:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155635.309942:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125264640:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.309958:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cdc00/0x844e5faceb5f642e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155635.310013:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.311552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155635.312175:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cdc00/0x844e5faceb5f642e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312181:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cdc00/0x844e5faceb5f642e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155635.312205:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155635.312208:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155635.312220:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cdc00/0x844e5faceb5f642e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312228:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cdc00/0x844e5faceb5f642e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312234:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f6420 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312240:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f6420 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312245:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f6420 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312250:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6cd800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155635.312253:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f6420 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312258:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f6420 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312265:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155635.312267:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155635.312270:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f6420 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312274:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f6420 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312284:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cda00/0x844e5faceb5f6427 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312289:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cda00/0x844e5faceb5f6427 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312293:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cda00/0x844e5faceb5f6427 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312297:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6cda00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155635.312302:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cda00/0x844e5faceb5f6427 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312310:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cda00/0x844e5faceb5f6427 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312314:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0f00) 00010000:00010000:1.0:1746155635.312316:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155635.312318:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cda00/0x844e5faceb5f6427 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312321:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cda00/0x844e5faceb5f6427 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.312343:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd600/0x844e5faceb5f6419 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17409 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.312352:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cdc00/0x844e5faceb5f642e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17409 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.312357:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155635.312359:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155635.312360:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6cdc00, rc 0) 00000100:00100000:1.0:1746155635.312380:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32056:x1830976125735424:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4332us (4459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.312385:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10980 00000100:00100000:0.0:1746155635.315371:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.315404:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.315563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:1.0:1746155635.315743:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746155635.315765:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16338 00000100:00100000:1.0:1746155635.315773:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125735936:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155635.315781:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155635.315791:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6cce00/0x844e5faceb5f643c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17410 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.315803:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.315804:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.315810:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cce00/0x844e5faceb5f643c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17410 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.315821:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cce00/0x844e5faceb5f643c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17410 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.315827:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6cce00, rc 0) 00000100:00100000:0.0:1746155635.315854:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.316180:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125735936:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 409us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.316186:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16338 00000100:00100000:0.0:1746155635.320901:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.321083:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125736576 00000100:00100000:1.0:1746155635.321090:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125736576 00000100:00100000:1.0:1746155635.321142:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10981 00000100:00100000:1.0:1746155635.321149:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32056:x1830976125736576:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155635.321167:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155635.321180:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cc800/0x844e5faceb5f6451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1742c expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.321260:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd600/0x844e5faceb5f6458 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.321272:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cdc00/0x844e5faceb5f642e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17409 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.321278:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd600/0x844e5faceb5f6458 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.321303:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cdc00/0x844e5faceb5f642e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17409 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.321312:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cdc00/0x844e5faceb5f642e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17409 expref: 8 pid: 27374 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746155635.321322:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125265024:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155635.321390:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155635.322843:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.322948:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125265024:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.322964:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd600/0x844e5faceb5f6458 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.323414:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd600/0x844e5faceb5f6458 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.323420:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd600/0x844e5faceb5f6458 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155635.323432:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155635.323561:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cc800/0x844e5faceb5f6451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1742c expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.323579:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd600/0x844e5faceb5f6458 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1742c expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.323585:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155635.323587:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155635.323589:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6cd600, rc 0) 00000100:00100000:1.0:1746155635.323610:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32056:x1830976125736576:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2462us (2714us total) trans 8589945119 rc 0/0 00000100:00100000:1.0:1746155635.323616:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10981 00000100:00100000:0.0:1746155635.324839:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.324882:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125736832 00000100:00100000:1.0:1746155635.324887:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125736832 00000100:00100000:1.0:1746155635.324920:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10982 00000100:00100000:1.0:1746155635.324926:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32056:x1830976125736832:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155635.324942:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155635.324952:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cda00/0x844e5faceb5f6466 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17433 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.325018:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f646d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.325029:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd600/0x844e5faceb5f6458 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1742c expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.325035:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f646d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.325062:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd600/0x844e5faceb5f6458 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1742c expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.325072:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd600/0x844e5faceb5f6458 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1742c expref: 9 pid: 27374 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746155635.325081:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125265152:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155635.325144:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca296c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155635.326700:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125265152:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.326716:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f646d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155635.327594:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155635.327860:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f646d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.327867:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f646d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155635.327896:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155635.327900:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155635.328042:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f646d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.328065:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cda00/0x844e5faceb5f6466 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17433 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.328076:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f646d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17433 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.328082:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155635.328084:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155635.328087:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6cd800, rc 0) 00000100:00100000:1.0:1746155635.328490:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32056:x1830976125736832:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3562us (3652us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.328497:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10982 00000100:00100000:0.0:1746155635.332217:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.334497:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.339186:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090b49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125265408:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155635.339201:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f17b000/0x844e5faceb5f647b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17441 expref: 9 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155635.339210:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f17b000/0x844e5faceb5f647b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17441 expref: 9 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155635.339219:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17b000, rc 0) 00000100:00100000:0.0:1746155635.339811:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125737216:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4906us (5317us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155635.339818:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16342 00000100:00100000:0.0:1746155635.343899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.343956:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125737472 00000100:00100000:1.0:1746155635.343968:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125737472 00000100:00100000:1.0:1746155635.344411:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10983 00000100:00100000:1.0:1746155635.344419:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32056:x1830976125737472:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155635.344436:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155635.344451:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd200/0x844e5faceb5f6482 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17448 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.344558:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd000/0x844e5faceb5f6489 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.344569:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd000/0x844e5faceb5f6489 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.344725:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd000/0x844e5faceb5f6489 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155635.344735:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155635.344826:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd200/0x844e5faceb5f6482 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17448 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.344841:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd000/0x844e5faceb5f6489 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17448 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.344848:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155635.344850:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155635.344853:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6cd000, rc 0) 00000100:00100000:1.0:1746155635.345279:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32056:x1830976125737472:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 860us (1386us total) trans 8589945120 rc 0/0 00000100:00100000:1.0:1746155635.345285:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10983 00000100:00100000:0.0:1746155635.347446:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.347479:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.348631:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16344 00000100:00100000:1.0:1746155635.348639:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125737984:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155635.348658:0:19959:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f649e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.348671:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091006a00/0x844e5faceb5f61f0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17296 expref: 24 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.348677:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0400/0x844e5faceb5f6298 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17306 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.348684:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f622f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c0 expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.348689:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.348690:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.348692:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f649e lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.348707:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f622f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c0 expref: 25 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.348715:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f622f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c0 expref: 25 pid: 20796 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155635.348724:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125265792:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.348752:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0400/0x844e5faceb5f6298 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17306 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155635.348754:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155635.348759:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0400/0x844e5faceb5f6298 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17306 expref: 7 pid: 8437 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155635.348770:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125265920:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.348789:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091006a00/0x844e5faceb5f61f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17296 expref: 24 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.348795:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091006a00/0x844e5faceb5f61f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17296 expref: 24 pid: 29728 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155635.348801:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131494e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125266048:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155635.348812:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca296c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155635.348862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.348906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.349034:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16346 00000100:00100000:1.0:1746155635.349040:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125737600:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155635.349055:0:9235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.349062:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cc600/0x844e5faceb5f63a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173ae expref: 25 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.349068:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cce00/0x844e5faceb5f643c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17410 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.349074:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x844e5faceb5f63a9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173b5 expref: 24 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.349079:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.349081:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.349083:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.349097:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x844e5faceb5f63a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173b5 expref: 24 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.349104:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x844e5faceb5f63a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173b5 expref: 24 pid: 18270 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155635.349111:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131495500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125266304:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155635.349126:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155635.349144:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6cce00/0x844e5faceb5f643c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17410 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.349151:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cce00/0x844e5faceb5f643c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17410 expref: 8 pid: 9235 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155635.349158:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125266432:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.349201:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6cc600/0x844e5faceb5f63a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173ae expref: 25 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155635.349201:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16347 00000100:00100000:0.0:1746155635.349207:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125737856:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155635.349208:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cc600/0x844e5faceb5f63a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173ae expref: 25 pid: 18270 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746155635.349215:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125266560:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155635.349222:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.349227:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746155635.349232:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f6205 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1728f expref: 15 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155635.349239:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0c00/0x844e5faceb5f6291 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ff expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155635.349245:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f6228 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b9 expref: 26 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155635.349250:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155635.349251:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155635.349253:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.349266:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f6228 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b9 expref: 26 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155635.349273:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f6228 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b9 expref: 26 pid: 20796 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746155635.349280:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125266688:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155635.349301:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0c00/0x844e5faceb5f6291 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ff expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155635.349308:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0c00/0x844e5faceb5f6291 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ff expref: 10 pid: 8437 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746155635.349315:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125266816:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155635.349329:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f6205 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1728f expref: 15 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155635.349336:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f6205 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1728f expref: 15 pid: 1625 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746155635.349343:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125266944:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155635.349352:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155635.354132:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.354173:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.354209:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125266688:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155635.354217:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125266816:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155635.354224:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125266944:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155635.354241:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.354312:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8394 00000100:00100000:1.0:1746155635.354326:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125738880:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155635.354338:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155635.354350:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0400/0x844e5faceb5f6298 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17306 expref: 10 pid: 8437 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.354359:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0400/0x844e5faceb5f6298 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17306 expref: 10 pid: 8437 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.354371:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155635.354388:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125738880:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 63us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.354394:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8394 00000100:00100000:1.0:1746155635.354420:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131495500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125266304:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155635.354428:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125266432:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155635.354441:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125266560:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.354459:0:9235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.354478:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090188000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125265792:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.354485:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdd0400/0x844e5faceb5f6298 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17306 expref: 9 pid: 8437 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155635.354496:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090189880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125265920:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155635.354525:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131494e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125266048:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.354537:0:19959:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f649e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155635.355611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.355636:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.355657:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.355678:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.355689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.355705:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.355719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.355729:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.355742:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125739136 00000100:00100000:0.0:1746155635.355746:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125739136 00002000:00100000:0.0:1746155635.355769:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3624959) req@ffff88009b880700 x1830976125739136/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155635.355778:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880700 with x1830976125739136 ext(3145728->3624959) 00010000:00010000:0.0:1746155635.355784:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136a56a00/0x844e5faceb5f640b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173fb expref: 26 pid: 18270 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746155635.355793:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136a56a00/0x844e5faceb5f640b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173fb expref: 26 pid: 18270 timeout: 864 lvb_type: 0 00002000:00010000:0.0:1746155635.355799:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b880700 00000100:00100000:0.0:1746155635.355809:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125739648 00000100:00100000:0.0:1746155635.355811:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125739648 00002000:00100000:0.0:1746155635.355820:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e4:0x0] (3768320->4194303) req@ffff88009b880000 x1830976125739648/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155635.355825:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880000 with x1830976125739648 ext(3768320->4194303) 00010000:00010000:0.0:1746155635.355829:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ff01400/0x844e5faceb5f6404 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173f4 expref: 26 pid: 18270 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746155635.355841:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ff01400/0x844e5faceb5f6404 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173f4 expref: 26 pid: 18270 timeout: 864 lvb_type: 0 00002000:00010000:0.0:1746155635.355851:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b880000 00000100:00100000:0.0:1746155635.355862:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1317 00000100:00100000:0.0:1746155635.355867:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976125739136:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155635.355888:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125739008 00000100:00100000:1.0:1746155635.355891:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125739008 00010000:00010000:1.0:1746155635.355900:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f622f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c0 expref: 27 pid: 20796 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155635.355909:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125738368 00000100:00100000:1.0:1746155635.355910:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125738368 00010000:00010000:1.0:1746155635.355916:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f17a400/0x844e5faceb5f6435 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17417 expref: 12 pid: 29728 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155635.355923:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125739520 00000100:00100000:1.0:1746155635.355924:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125739520 00010000:00010000:1.0:1746155635.355930:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f6228 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b9 expref: 27 pid: 20796 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155635.355939:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8396 00000100:00100000:1.0:1746155635.355943:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125739008:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155635.355948:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155635.355955:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f622f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c0 expref: 28 pid: 20796 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.355962:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f622f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c0 expref: 28 pid: 20796 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.355982:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f622f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172c0 expref: 28 pid: 20796 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.355993:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155635.356016:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976125739008:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 72us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.356020:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8396 00000100:00100000:1.0:1746155635.356028:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8397 00000100:00100000:1.0:1746155635.356033:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125739264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155635.356039:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155635.356046:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0c00/0x844e5faceb5f6291 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ff expref: 12 pid: 8437 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.356054:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0c00/0x844e5faceb5f6291 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ff expref: 12 pid: 8437 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.356063:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdd0c00/0x844e5faceb5f6291 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172ff expref: 12 pid: 8437 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.356070:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155635.356082:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125739264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.356532:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8397 00000100:00100000:1.0:1746155635.356542:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8400 00000100:00100000:1.0:1746155635.356546:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976125739520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155635.356552:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155635.356558:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f6228 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b9 expref: 27 pid: 20796 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.356566:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f6228 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b9 expref: 27 pid: 20796 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.356574:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f6228 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f172b9 expref: 27 pid: 20796 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.356582:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155635.356653:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976125739520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 106us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.356658:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8400 00000100:00100000:0.0:1746155635.357028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.357073:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.357099:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125739392 00000100:00100000:1.0:1746155635.357101:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125739392 00010000:00010000:1.0:1746155635.357110:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x844e5faceb5f63a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173b5 expref: 25 pid: 18270 timeout: 864 lvb_type: 1 00000100:00100000:0.0:1746155635.357112:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.357354:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125739776 00000100:00100000:1.0:1746155635.357357:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125739776 00010000:00010000:1.0:1746155635.357367:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091006a00/0x844e5faceb5f61f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17296 expref: 26 pid: 29728 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155635.357380:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125739904 00000100:00100000:1.0:1746155635.357382:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125739904 00010000:00010000:1.0:1746155635.357389:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f6205 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1728f expref: 16 pid: 1625 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155635.357399:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8401 00000100:00100000:1.0:1746155635.357403:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1962:x1830976125739392:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155635.357408:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155635.357414:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x844e5faceb5f63a9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173b5 expref: 26 pid: 18270 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.357421:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x844e5faceb5f63a9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173b5 expref: 26 pid: 18270 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.357430:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4fbc00/0x844e5faceb5f63a9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173b5 expref: 26 pid: 18270 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.357436:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.357438:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.357440:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.357446:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.357470:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155635.357486:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1962:x1830976125739392:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 82us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.357491:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8401 00000100:00100000:1.0:1746155635.357500:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8403 00000100:00100000:1.0:1746155635.357517:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125739904:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155635.357522:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155635.357529:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f6205 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1728f expref: 16 pid: 1625 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.357540:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f6205 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1728f expref: 16 pid: 1625 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.357550:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd4d600/0x844e5faceb5f6205 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1728f expref: 16 pid: 1625 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.357556:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.357557:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.357559:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.357565:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.357575:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155635.357704:0:9235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.357712:0:9235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.357725:0:9235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.357730:0:9235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.357736:0:9235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.357740:0:9235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6cde00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155635.357743:0:9235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.357748:0:9235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.357755:0:9235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.357760:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cde00/0x844e5faceb5f64ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155635.357802:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125737600:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 8762us (8939us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155635.357808:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16346 00010000:00010000:0.0:1746155635.357822:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.357849:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976125739904:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 332us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.357854:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8403 00010000:00010000:1.0:1746155635.357866:0:19959:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f649e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.357872:0:19959:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f649e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.357883:0:19959:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f649e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.357892:0:19959:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f649e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.357897:0:19959:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f649e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.357901:0:19959:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6cdc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155635.357904:0:19959:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f649e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.357909:0:19959:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f649e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.357915:0:19959:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f649e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.357920:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f649e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.358024:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.358038:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.358043:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.358048:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.358053:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013143de00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155635.358055:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.358060:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.358068:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.358073:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013143de00/0x844e5faceb5f64b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155635.358099:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125737856:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 8893us (9193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155635.358104:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16347 00000100:00100000:1.0:1746155635.358197:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976125737984:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 9308us (10466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.358205:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16344 00000100:00100000:1.0:1746155635.364127:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976125739648:12345-192.168.202.51@tcp:4:cat.0 Request processed in 7509us (8389us total) trans 17179874092 rc 0/0 00000100:00100000:1.0:1746155635.364137:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1318 00002000:00100000:1.0:1746155635.364147:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3768320->4194303) req@ffff88009b880000 x1830976125739648/t17179874092(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/448 e 0 to 0 dl 1746155646 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.364155:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880000 with x1830976125739648 ext(3768320->4194303) 00010000:00010000:1.0:1746155635.364162:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008ff01400/0x844e5faceb5f6404 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173f4 expref: 26 pid: 18270 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.364173:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008ff01400/0x844e5faceb5f6404 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173f4 expref: 26 pid: 18270 timeout: 864 lvb_type: 0 00002000:00010000:1.0:1746155635.364178:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b880000 00000100:00100000:0.0:1746155635.368356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.368484:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125740032 00000100:00100000:1.0:1746155635.368492:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125740032 00010000:00010000:1.0:1746155635.368713:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff01400/0x844e5faceb5f6404 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3768320->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173f4 expref: 26 pid: 18270 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746155635.368745:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.368893:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125740160 00000100:00100000:1.0:1746155635.368896:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125740160 00010000:00010000:1.0:1746155635.368908:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136a56a00/0x844e5faceb5f640b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3624959) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173fb expref: 27 pid: 18270 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746155635.372049:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.372119:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125740416 00000100:00100000:1.0:1746155635.372124:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125740416 00000100:00100000:1.0:1746155635.372159:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10984 00000100:00100000:1.0:1746155635.372165:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32056:x1830976125740416:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:1.0:1746155635.372200:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155635.372216:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd800/0x844e5faceb5f646d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17433 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.372230:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155635.372233:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155635.372253:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013142aa00/0x844e5faceb5f64c1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.372262:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17329 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.372268:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17330 expref: 11 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.372273:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28a00/0x844e5faceb5f63da lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173d1 expref: 292 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.372278:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013142aa00/0x844e5faceb5f64c1 lrc: 6/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.372298:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28a00/0x844e5faceb5f63da lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173d1 expref: 292 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.372308:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28a00/0x844e5faceb5f63da lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173d1 expref: 292 pid: 15474 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746155635.372318:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125267200:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.372388:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17330 expref: 11 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.372394:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17330 expref: 11 pid: 19870 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746155635.372402:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137120380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125267328:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.372425:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17329 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.372431:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17329 expref: 292 pid: 27374 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746155635.372437:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125267456:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155635.372451:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca299c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155635.374359:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.374360:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125267200:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155635.374367:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137120380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125267328:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155635.374373:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125267456:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155635.374387:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155635.374389:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013142aa00/0x844e5faceb5f64c1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155635.374408:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125740544 00000100:00100000:1.0:1746155635.374411:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125740544 00010000:00010000:1.0:1746155635.374427:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28a00/0x844e5faceb5f63da lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f173d1 expref: 293 pid: 15474 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746155635.374439:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.374685:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8406 00000100:00100000:0.0:1746155635.374692:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125740672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155635.374698:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8407 00010000:00010000:0.0:1746155635.374701:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155635.374703:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1961:x1830976125740800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155635.374706:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17330 expref: 12 pid: 19870 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.374708:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155635.374711:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17329 expref: 294 pid: 27374 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746155635.374714:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17330 expref: 12 pid: 19870 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.374720:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17329 expref: 294 pid: 27374 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746155635.374826:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdd1600/0x844e5faceb5f62de lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17330 expref: 12 pid: 19870 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.374829:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135012200/0x844e5faceb5f62d7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17329 expref: 294 pid: 27374 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.374836:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155635.374840:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013142aa00/0x844e5faceb5f64c1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.374845:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155635.374846:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155635.374848:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013142aa00/0x844e5faceb5f64c1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155635.374852:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155635.374870:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1961:x1830976125740800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 167us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.374875:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8407 00000100:00100000:0.0:1746155635.374932:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125740672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 241us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155635.374937:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8406 00010000:00010000:1.0:1746155635.375079:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013142aa00/0x844e5faceb5f64c1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155635.375085:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013142aa00/0x844e5faceb5f64c1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000040:00080000:1.0:1746155635.375933:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3462, 88 off291560 00000004:00080000:1.0:1746155635.375941:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764525436764ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155635.376081:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3480, 88 off293408 00000004:00080000:1.0:1746155635.376087:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764525583854ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155635.376106:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3481, 88 off293496 00000004:00080000:1.0:1746155635.376109:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764525605948ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155635.376115:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3463, 88 off291648 00000004:00080000:1.0:1746155635.376117:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764525614318ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155635.376124:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3464, 88 off291736 00000004:00080000:1.0:1746155635.376126:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764525623323ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155635.376133:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3482, 88 off293584 00000004:00080000:1.0:1746155635.376136:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764525632881ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155635.376142:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3483, 88 off293672 00000004:00080000:1.0:1746155635.376144:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764525641283ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155635.376150:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3484, 88 off293760 00000004:00080000:1.0:1746155635.376152:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764525648791ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155635.376157:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3465, 88 off291824 00000004:00080000:1.0:1746155635.376158:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764525655545ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155635.376165:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3485, 88 off293848 00000004:00080000:1.0:1746155635.376167:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764525664378ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155635.376186:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3466, 88 off291912 00000004:00080000:1.0:1746155635.376189:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764525685868ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155635.376196:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3486, 88 off293936 00000004:00080000:1.0:1746155635.376198:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764525695183ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155635.376204:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3467, 88 off292000 00000004:00080000:1.0:1746155635.376206:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764525703098ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155635.376212:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3468, 88 off292088 00000004:00080000:1.0:1746155635.376215:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764525711673ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155635.376221:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3469, 88 off292176 00000004:00080000:1.0:1746155635.376224:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764525720738ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155635.376230:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3470, 88 off292264 00000004:00080000:1.0:1746155635.376232:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 764525729541ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155635.376239:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3487, 88 off294024 00000004:00080000:1.0:1746155635.376241:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 764525738471ns, next at 716011101328ns, rc = 0 00000004:00010000:1.0:1746155635.397083:0:27374:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b883800 reply state ffff88008fd8c000 transno 8589945121 ns: mdt-lustre-MDT0000_UUID lock: ffff88013142aa00/0x844e5faceb5f64c1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155635.397094:0:27374:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746155635.397253:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125267712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155635.397288:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155635.397309:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125267584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155635.397321:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155635.397330:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125268224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155635.397341:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155635.397349:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125268736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155635.397359:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155635.397372:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125269248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155635.397383:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155635.397392:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1746155635.397396:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125268096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155635.397407:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155635.397415:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125268608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155635.397426:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155635.397434:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090b4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125269120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155635.397445:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155635.397460:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125269248 00000100:00100000:0.0:1746155635.397462:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125269248 00000100:00100000:0.0:1746155635.397471:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125268096 00000100:00100000:0.0:1746155635.397473:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125268096 00000100:00100000:0.0:1746155635.397478:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125268608 00000100:00100000:0.0:1746155635.397479:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125268608 00000100:00100000:0.0:1746155635.397484:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125269120 00000100:00100000:0.0:1746155635.397486:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125269120 00000100:00100000:0.0:1746155635.397492:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16350 00000100:00100000:0.0:1746155635.397496:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3298:x1830976125267584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155635.397617:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3298:x1830976125267584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (294us total) trans 17179874093 rc 0/0 00000100:00100000:0.0:1746155635.397622:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16350 00000100:00100000:0.0:1746155635.397631:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16352 00000100:00100000:0.0:1746155635.397635:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3298:x1830976125268736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155635.397708:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3298:x1830976125268736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (347us total) trans 17179874094 rc 0/0 00000100:00100000:0.0:1746155635.397713:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16352 00000100:00100000:0.0:1746155635.397721:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16354 00000100:00100000:0.0:1746155635.397725:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3298:x1830976125268096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155635.397796:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3298:x1830976125268096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (387us total) trans 21474841434 rc 0/0 00000100:00100000:0.0:1746155635.397801:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16354 00000100:00100000:0.0:1746155635.397809:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16356 00000100:00100000:0.0:1746155635.397813:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3298:x1830976125269120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155635.397876:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3298:x1830976125269120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (430us total) trans 17179874097 rc 0/0 00000100:00100000:0.0:1746155635.397881:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16356 00000100:00100000:0.0:1746155635.397890:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125267968 00000100:00100000:0.0:1746155635.397892:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125267968 00000100:00100000:0.0:1746155635.397899:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125268480 00000100:00100000:0.0:1746155635.397901:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125268480 00000100:00100000:0.0:1746155635.397907:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125268992 00000100:00100000:0.0:1746155635.397908:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125268992 00000100:00100000:0.0:1746155635.397913:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125269504 00000100:00100000:0.0:1746155635.397915:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125269504 00000100:00100000:0.0:1746155635.397921:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16357 00000100:00100000:0.0:1746155635.397925:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3296:x1830976125267968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155635.398008:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+42:3296:x1830976125267968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (168us total) trans 21474841435 rc 0/0 00000100:00100000:0.0:1746155635.398013:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16357 00000100:00100000:0.0:1746155635.398019:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125268864 00000100:00100000:0.0:1746155635.398021:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125268864 00000100:00100000:0.0:1746155635.398028:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16358 00000100:00100000:0.0:1746155635.398031:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3296:x1830976125268480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155635.398096:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3296:x1830976125268480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (230us total) trans 21474841436 rc 0/0 00000100:00100000:0.0:1746155635.398103:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16358 00000100:00100000:0.0:1746155635.398111:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16361 00000100:00100000:0.0:1746155635.398115:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3296:x1830976125267840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155635.398176:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3296:x1830976125267840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (250us total) trans 21474841437 rc 0/0 00010000:00080000:1.0:1746155635.398222:0:27374:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746155635.398234:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32056:x1830976125740416:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 26068us (26186us total) trans 8589945121 rc 0/0 00000100:00100000:1.0:1746155635.398242:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10984 00000100:00080000:1.0:1746155635.398259:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746155635.398262:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155635.399009:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16361 00000100:00100000:0.0:1746155635.399031:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16362 00000100:00100000:0.0:1746155635.399037:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+44:3296:x1830976125268352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155635.399059:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16364 00000100:00100000:1.0:1746155635.399320:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3296:x1830976125269376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155635.399408:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+50:3296:x1830976125269376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (1415us total) trans 17179874101 rc 0/0 00000100:00100000:1.0:1746155635.399413:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16364 00000100:00100000:0.0:1746155635.399559:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3296:x1830976125268352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 523us (1617us total) trans 21474841439 rc 0/0 00000100:00100000:0.0:1746155635.399565:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16362 00000100:00100000:1.0:1746155635.400702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.402529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.405125:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.405195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.405407:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16367 00000100:00100000:1.0:1746155635.405413:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1962:x1830976125741312:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155635.405420:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155635.405428:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013142a000/0x844e5faceb5f64e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17464 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155635.405440:0:20200:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x68143873, atime: 0x68143873, ctime: 0x68143873, blocks: 0x821 00010000:00010000:1.0:1746155635.405446:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.405448:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.405451:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013142a000/0x844e5faceb5f64e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17464 expref: 7 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.405460:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013142a000/0x844e5faceb5f64e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17464 expref: 7 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155635.405466:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013142a000, rc 0) 00000100:00100000:1.0:1746155635.405479:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976125741312:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 67us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.405484:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16367 00000100:00100000:0.0:1746155635.405917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.406493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.406930:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.406949:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.414707:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.415669:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7747 00000100:00100000:1.0:1746155635.415676:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125742080:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155635.415704:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013142a400/0x844e5faceb5f6507 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.415716:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.415717:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.415721:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013142a400/0x844e5faceb5f6507 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.415731:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013142a400/0x844e5faceb5f6507 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155635.419679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.419751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.421704:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7749 00000100:00100000:0.0:1746155635.421712:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125742336:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155635.421733:0:31252:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f6cc600/0x844e5faceb5f6515 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.421742:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155635.421743:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155635.421746:0:31252:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6cc600/0x844e5faceb5f6515 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.421755:0:31252:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f6cc600/0x844e5faceb5f6515 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155635.423117:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.424291:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125742848 00000100:00100000:1.0:1746155635.424301:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125742848 00000100:00100000:1.0:1746155635.424350:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7750 00000100:00100000:1.0:1746155635.424357:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125742848:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155635.424382:0:10888:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013142a800/0x844e5faceb5f651c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.424399:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.424401:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.424405:0:10888:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013142a800/0x844e5faceb5f651c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.424415:0:10888:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013142a800/0x844e5faceb5f651c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.429345:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125743872 00000100:00100000:1.0:1746155635.429350:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125743872 00000100:00100000:1.0:1746155635.429373:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7752 00000100:00100000:1.0:1746155635.429378:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125742976:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155635.429392:0:25391:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135013000/0x844e5faceb5f652a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.429399:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.429400:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.429403:0:25391:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135013000/0x844e5faceb5f652a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.429411:0:25391:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135013000/0x844e5faceb5f652a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.430396:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7754 00000100:00100000:1.0:1746155635.430402:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976125743872:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155635.430416:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135013800/0x844e5faceb5f6538 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.430422:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.430423:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.430426:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135013800/0x844e5faceb5f6538 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.430434:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135013800/0x844e5faceb5f6538 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.433483:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013142a400/0x844e5faceb5f6507 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.433499:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013142a400/0x844e5faceb5f6507 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.433521:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013142a400/0x844e5faceb5f6507 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.433527:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013142a400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155635.433530:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013142a400/0x844e5faceb5f6507 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.433537:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013142a400/0x844e5faceb5f6507 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.433555:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013142a400/0x844e5faceb5f6507 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.433560:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013142a400/0x844e5faceb5f6507 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.433647:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125742080:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 17967us (18943us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155635.433660:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7747 00010000:00010000:1.0:1746155635.440455:0:31252:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f6cc600/0x844e5faceb5f6515 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.440467:0:31252:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f6cc600/0x844e5faceb5f6515 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.440474:0:31252:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f6cc600/0x844e5faceb5f6515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.440479:0:31252:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6cc600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155635.440482:0:31252:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f6cc600/0x844e5faceb5f6515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.440489:0:31252:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f6cc600/0x844e5faceb5f6515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.440524:0:31252:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f6cc600/0x844e5faceb5f6515 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.440530:0:31252:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f6cc600/0x844e5faceb5f6515 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.440583:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976125742336:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 18868us (20827us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155635.440593:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7749 00010000:00010000:1.0:1746155635.446197:0:10888:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013142a800/0x844e5faceb5f651c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.446212:0:10888:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013142a800/0x844e5faceb5f651c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.446220:0:10888:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013142a800/0x844e5faceb5f651c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.446226:0:10888:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013142a800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155635.446230:0:10888:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013142a800/0x844e5faceb5f651c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.446236:0:10888:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013142a800/0x844e5faceb5f651c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.446250:0:10888:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013142a800/0x844e5faceb5f651c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.446256:0:10888:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013142a800/0x844e5faceb5f651c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.446777:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125742848:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 22416us (23660us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155635.446786:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7750 00010000:00010000:1.0:1746155635.453489:0:25391:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880135013000/0x844e5faceb5f652a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.453529:0:25391:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135013000/0x844e5faceb5f652a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.453542:0:25391:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135013000/0x844e5faceb5f652a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.453548:0:25391:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135013000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155635.453552:0:25391:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135013000/0x844e5faceb5f652a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.453558:0:25391:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135013000/0x844e5faceb5f652a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.453573:0:25391:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135013000/0x844e5faceb5f652a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.453579:0:25391:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135013000/0x844e5faceb5f652a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.453650:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125742976:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 24267us (25358us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155635.453658:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7752 00000100:00100000:0.0:1746155635.466160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.470077:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.470135:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.470156:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.470171:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.470183:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.470404:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16373 00000100:00100000:1.0:1746155635.470411:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125744384:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155635.470528:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155635.470531:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.470533:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.470534:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.470536:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155635.470557:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125744384:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 146us (420us total) trans 21474841440 rc 0/0 00000100:00100000:1.0:1746155635.470562:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16373 00000100:00100000:1.0:1746155635.470573:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16375 00000100:00100000:1.0:1746155635.470578:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125744640:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155635.470654:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155635.470657:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155634 -> 1746155635 00000100:00100000:0.0:1746155635.470694:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:1.0:1746155635.472409:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155634 -> 1746155635 00002000:00010000:1.0:1746155635.472413:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155634 -> 1746155635 00002000:00010000:1.0:1746155635.472415:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155635.472441:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125744640:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 1861us (2267us total) trans 17179874103 rc 0/0 00000100:00100000:1.0:1746155635.472447:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16375 00002000:00010000:1.0:1746155635.472490:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:1.0:1746155635.472492:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.472494:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.472496:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.472497:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5903 -> 5903 00000100:00100000:1.0:1746155635.472523:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125744768:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 1931us (2339us total) trans 17179874104 rc 0/0 00000100:00100000:1.0:1746155635.472528:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16376 00000100:00100000:0.0:1746155635.475491:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.479468:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000004:00010000:0.0:1746155635.527528:0:16646:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f882d80 reply state ffff88012ef7bc00 transno 8589945123 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8ae00/0x844e5faceb5f6546 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16646 initiator: MDT0 00000100:00100000:0.0:1746155635.527540:0:16646:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746155635.527548:0:16646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155635.527551:0:16646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155635.527558:0:16646:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6cd000/0x844e5faceb5f6489 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17448 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.527931:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125270272:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155635.527970:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155635.528015:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125270784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155635.528032:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155635.528047:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746155635.528051:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125270400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155635.528064:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155635.528084:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125270272 00000100:00100000:1.0:1746155635.528089:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125270272 00000100:00100000:1.0:1746155635.528112:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125270784 00000100:00100000:1.0:1746155635.528114:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125270784 00000100:00100000:1.0:1746155635.528125:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125270400 00000100:00100000:1.0:1746155635.528127:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125270400 00000100:00100000:1.0:1746155635.528138:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16378 00000100:00100000:1.0:1746155635.528144:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3297:x1830976125270272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155635.528302:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976125270272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 156us (331us total) trans 21474841443 rc 0/0 00000100:00100000:1.0:1746155635.528310:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16378 00000100:00100000:1.0:1746155635.528333:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125271296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155635.528349:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155635.528360:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125271808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155635.528371:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746155635.528391:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c211500/2, rc 0, transno 21474841443 00000100:00100000:1.0:1746155635.528395:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125270272:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155635.528401:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880137120a80/2, rc 0, transno 21474841444 00000100:00100000:1.0:1746155635.528404:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125270784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155635.528493:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c211880/2, rc 0, transno 21474841445 00000100:00100000:1.0:1746155635.528496:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125270400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155635.528500:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746155635.528520:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125270912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155635.528538:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155635.528551:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125271424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155635.528630:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746155635.528653:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3eca80/2, rc 0, transno 17179874105 00000100:00100000:1.0:1746155635.528659:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125271296:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155635.528664:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ed500/2, rc 0, transno 17179874106 00000100:00100000:1.0:1746155635.528667:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125271808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155635.528679:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16383 00000100:00100000:1.0:1746155635.528684:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125270912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155635.528763:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155635.528765:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.528767:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.528769:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.528770:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746155635.528791:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3297:x1830976125270912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 106us (252us total) trans 17179874107 rc 0/0 00000100:00100000:1.0:1746155635.528796:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16383 00000100:00100000:1.0:1746155635.528806:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16384 00000100:00100000:1.0:1746155635.528810:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125271424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155635.528882:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+54:3297:x1830976125271424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (316us total) trans 17179874108 rc 0/0 00000100:00100000:1.0:1746155635.528887:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16384 00000004:00080000:1.0:1746155635.528920:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ef800/2, rc 0, transno 17179874107 00000100:00100000:1.0:1746155635.528923:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125270912:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155635.528930:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ec000/2, rc 0, transno 17179874108 00000100:00100000:1.0:1746155635.528932:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125271424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155635.528937:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746155635.528941:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125271936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155635.528956:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155635.528986:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125271936 00000100:00100000:1.0:1746155635.528989:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125271936 00000100:00100000:1.0:1746155635.529008:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16385 00000100:00100000:1.0:1746155635.529012:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3297:x1830976125271936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155635.529195:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+55:3297:x1830976125271936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (237us total) trans 17179874109 rc 0/0 00000100:00100000:1.0:1746155635.529200:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16385 00000004:00080000:1.0:1746155635.529219:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c4a80/2, rc 0, transno 17179874109 00000100:00100000:1.0:1746155635.529222:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125271936:0@lo:2:osp-syn-1-0.0 00010000:00080000:0.0:1746155635.529286:0:16646:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746155635.529298:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32056:x1830976125745152:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 53157us (53811us total) trans 8589945123 rc 0/0 00000100:00100000:0.0:1746155635.529305:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4638 00010000:00010000:0.0:1746155635.529325:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8ae00/0x844e5faceb5f6546 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16646 initiator: MDT0 00010000:00010000:0.0:1746155635.529333:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8ae00/0x844e5faceb5f6546 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16646 initiator: MDT0 00010000:00010000:0.0:1746155635.529339:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8ae00/0x844e5faceb5f6546 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16646 initiator: MDT0 00010000:00010000:0.0:1746155635.529344:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc8ae00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155635.529347:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8ae00/0x844e5faceb5f6546 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16646 initiator: MDT0 00010000:00010000:0.0:1746155635.529362:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8ae00/0x844e5faceb5f6546 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16646 initiator: MDT0 00010000:00010000:0.0:1746155635.529373:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155635.529375:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155635.529378:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8ae00/0x844e5faceb5f6546 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16646 initiator: MDT0 00010000:00010000:0.0:1746155635.529382:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc8ae00/0x844e5faceb5f6546 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16646 initiator: MDT0 00000100:00100000:0.0:1746155635.530116:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125269888 00000100:00100000:0.0:1746155635.530120:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125269888 00000100:00100000:0.0:1746155635.530137:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125270016 00000100:00100000:0.0:1746155635.530139:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125270016 00000100:00100000:1.0:1746155635.530189:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125270528 00000100:00100000:1.0:1746155635.530192:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125270528 00000100:00100000:1.0:1746155635.530204:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16386 00000100:00100000:1.0:1746155635.530209:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3298:x1830976125269888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155635.530293:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155635.530296:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530298:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530300:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530302:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155635.530327:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3298:x1830976125269888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (522us total) trans 21474841446 rc 0/0 00000100:00100000:1.0:1746155635.530335:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16386 00000100:00100000:1.0:1746155635.530345:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125271168 00000100:00100000:1.0:1746155635.530347:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125271168 00000100:00100000:1.0:1746155635.530358:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16387 00000100:00100000:1.0:1746155635.530362:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3295:x1830976125270016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155635.530428:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155635.530430:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530432:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530433:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530435:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746155635.530455:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3295:x1830976125270016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (581us total) trans 21474841447 rc 0/0 00000100:00100000:1.0:1746155635.530459:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16387 00000100:00100000:1.0:1746155635.530468:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16389 00000100:00100000:1.0:1746155635.530471:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976125271040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155635.530497:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16391 00000100:00100000:1.0:1746155635.530518:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3295:x1830976125270144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155635.530577:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155635.530579:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530581:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530582:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530584:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746155635.530599:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3295:x1830976125270144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (352us total) trans 21474841449 rc 0/0 00000100:00100000:1.0:1746155635.530608:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16391 00000100:00100000:1.0:1746155635.530617:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16393 00000100:00100000:1.0:1746155635.530620:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976125271168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155635.530694:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:1.0:1746155635.530696:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530698:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530699:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530701:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5903 -> 5903 00000100:00100000:1.0:1746155635.530718:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3295:x1830976125271168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (439us total) trans 17179874111 rc 0/0 00000100:00100000:1.0:1746155635.530723:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16393 00002000:00010000:1.0:1746155635.530806:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155635.530808:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530810:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530812:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.530814:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155635.530832:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3295:x1830976125271040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 359us (623us total) trans 17179874113 rc 0/0 00000100:00100000:1.0:1746155635.530836:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16389 00000100:00100000:0.0:1746155635.532584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.536672:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.536738:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125745664 00000100:00100000:0.0:1746155635.536745:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125745664 00000100:00100000:0.0:1746155635.536776:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4639 00000100:00100000:0.0:1746155635.536781:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32056:x1830976125745664:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:0.0:1746155635.537134:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32056:x1830976125745664:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 259us (374us total) trans 8589945124 rc 0/0 00000100:00100000:0.0:1746155635.537140:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4639 00000100:00100000:0.0:1746155635.552603:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.553841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.559710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.559833:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.559923:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125746560 00000100:00100000:1.0:1746155635.559930:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125746560 00000100:00100000:0.0:1746155635.562268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.564947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.566564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.568151:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.568195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.568208:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125747328 00000100:00100000:0.0:1746155635.568212:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125747328 00000100:00100000:1.0:1746155635.568214:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125746944 00000100:00100000:1.0:1746155635.568219:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125746944 00010000:00010000:0.0:1746155635.568226:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f6569 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1748e expref: 10 pid: 27374 timeout: 864 lvb_type: 0 00000100:00100000:1.0:1746155635.568244:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10992 00000100:00100000:0.0:1746155635.568244:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8411 00000100:00100000:0.0:1746155635.568249:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125747328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155635.568251:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32068:x1830976125746944:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155635.568255:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155635.568259:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f6569 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1748e expref: 10 pid: 27374 timeout: 864 lvb_type: 0 00010000:00010000:1.0:1746155635.568267:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155635.568267:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f6569 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1748e expref: 10 pid: 27374 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746155635.568282:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155635.568286:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45000/0x844e5faceb5f65a8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.568287:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06000/0x844e5faceb5f65b6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f174b1 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.568292:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45000/0x844e5faceb5f65a8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155635.568297:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45000/0x844e5faceb5f65a8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155635.568310:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155635.568328:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06000/0x844e5faceb5f65b6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174b1 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155635.568328:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125747328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 79us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155635.568333:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8411 00010000:00010000:1.0:1746155635.568338:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06000/0x844e5faceb5f65b6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174b1 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.568351:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155635.568353:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155635.568355:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe06000, rc 0) 00000100:00100000:1.0:1746155635.568383:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32068:x1830976125746944:12345-192.168.202.51@tcp:101:cat.0 Request processed in 134us (1821us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.568389:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10992 00000100:00100000:0.0:1746155635.573158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.577826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.578240:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.578562:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125747968 00000100:00100000:0.0:1746155635.578566:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125747968 00000100:00100000:0.0:1746155635.578591:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10994 00000100:00100000:0.0:1746155635.578597:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32065:x1830976125747968:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155635.578607:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155635.578610:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746155635.578631:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013142b800/0x844e5faceb5f65c4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174b8 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.578647:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155635.578651:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155635.578660:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01e00/0x844e5faceb5f65cb lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f174bf expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.578694:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00e00/0x844e5faceb5f65d2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155635.578704:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45e00/0x844e5faceb5f654d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17487 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.578710:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06000/0x844e5faceb5f65b6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174b1 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.578716:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00e00/0x844e5faceb5f65d2 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155635.578739:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06000/0x844e5faceb5f65b6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174b1 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.578749:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06000/0x844e5faceb5f65b6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174b1 expref: 287 pid: 27374 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746155635.578759:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125272320:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155635.578824:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45e00/0x844e5faceb5f654d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17487 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.578831:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45e00/0x844e5faceb5f654d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17487 expref: 7 pid: 27374 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746155635.578839:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125272448:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155635.578856:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155635.587431:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.587471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.587730:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8413 00000100:00100000:0.0:1746155635.587737:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125748224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155635.587745:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155635.587750:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45e00/0x844e5faceb5f654d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17487 expref: 8 pid: 27374 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746155635.587759:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45e00/0x844e5faceb5f654d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17487 expref: 8 pid: 27374 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746155635.587771:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45e00/0x844e5faceb5f654d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17487 expref: 8 pid: 27374 timeout: 864 lvb_type: 0 00010000:00010000:0.0:1746155635.587782:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155635.587786:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00e00/0x844e5faceb5f65d2 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155635.587792:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00e00/0x844e5faceb5f65d2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155635.587797:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00e00/0x844e5faceb5f65d2 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155635.587810:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155635.587828:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125748224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 92us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155635.587834:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8413 00000100:00100000:1.0:1746155635.591273:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.591315:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125748352 00000100:00100000:0.0:1746155635.591323:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125748352 00000100:00100000:0.0:1746155635.591356:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16397 00000100:00100000:0.0:1746155635.591362:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32069:x1830976125748352:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155635.591376:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155635.591390:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe07000/0x844e5faceb5f65d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f174c6 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.591408:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155635.591410:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155635.591416:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe07000/0x844e5faceb5f65d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174c6 expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.591427:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe07000/0x844e5faceb5f65d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174c6 expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.591437:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe07000, rc 0) 00000100:00100000:0.0:1746155635.592076:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32069:x1830976125748352:12345-192.168.202.51@tcp:101:cat.0 Request processed in 712us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155635.592083:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16397 00000100:00100000:0.0:1746155635.597744:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.597829:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125748480 00000100:00100000:0.0:1746155635.597838:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125748480 00000100:00100000:0.0:1746155635.597883:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16398 00000100:00100000:0.0:1746155635.597904:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:32068:x1830976125748480:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155635.597923:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155635.597941:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe07200/0x844e5faceb5f65e0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f174cd expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.597967:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155635.597982:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155635.597993:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe07200/0x844e5faceb5f65e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174cd expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.598008:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe07200/0x844e5faceb5f65e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174cd expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.598019:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe07200, rc 0) 00000100:00100000:0.0:1746155635.598061:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:32068:x1830976125748480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 170us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155635.598066:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16398 00000100:00100000:0.0:1746155635.603968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.604036:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.604058:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125748608 00000100:00100000:0.0:1746155635.604067:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125748608 00000100:00100000:0.0:1746155635.604106:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125748736 00000100:00100000:0.0:1746155635.604110:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125748736 00000100:00100000:0.0:1746155635.604135:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10995 00000100:00100000:0.0:1746155635.604144:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32069:x1830976125748608:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155635.604162:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155635.604179:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07400/0x844e5faceb5f65e7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f174d4 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.604230:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00e00/0x844e5faceb5f65d2 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155635.604240:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07400/0x844e5faceb5f65e7 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174d4 expref: 13 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.604259:0:19870:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00e00/0x844e5faceb5f65d2 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155635.604270:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07400/0x844e5faceb5f65e7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174d4 expref: 13 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.604282:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155635.604284:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155635.604288:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07400/0x844e5faceb5f65e7 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174d4 expref: 13 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.604293:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe07400, rc 0) 00000100:00100000:0.0:1746155635.606085:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32069:x1830976125748608:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1936us (2121us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155635.606093:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10995 00000100:00100000:0.0:1746155635.606123:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10996 00000100:00100000:0.0:1746155635.606132:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32068:x1830976125748736:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155635.606144:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155635.606156:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06c00/0x844e5faceb5f65ee lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f174db expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.606193:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06c00/0x844e5faceb5f65ee lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174db expref: 288 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.606203:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06c00/0x844e5faceb5f65ee lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174db expref: 288 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.606215:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155635.606218:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155635.606221:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07400/0x844e5faceb5f65e7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174d4 expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.606227:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe06c00, rc 0) 00000100:00100000:0.0:1746155635.606257:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32068:x1830976125748736:12345-192.168.202.51@tcp:101:cat.0 Request processed in 127us (2222us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155635.606263:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10996 00000100:00100000:1.0:1746155635.640455:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125274112:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155635.640476:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155635.640488:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125274624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155635.640514:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155635.640525:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746155635.640528:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125274240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155635.640540:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155635.640549:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125274752:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155635.640561:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155635.640574:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125274624 00000100:00100000:1.0:1746155635.640576:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125274624 00000100:00100000:1.0:1746155635.640588:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125274240 00000100:00100000:1.0:1746155635.640590:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125274240 00000100:00100000:1.0:1746155635.640600:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16412 00000100:00100000:1.0:1746155635.640604:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3297:x1830976125274624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155635.640649:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16414 00000100:00100000:1.0:1746155635.640654:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3297:x1830976125274240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155635.640724:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+62:3297:x1830976125274624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (221us total) trans 21474841456 rc 0/0 00000100:00100000:1.0:1746155635.640985:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16412 00002000:00010000:1.0:1746155635.641034:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155635.641036:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.641038:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.641040:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155635 -> 1746155635 00002000:00010000:1.0:1746155635.641041:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746155635.641056:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3297:x1830976125274240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 402us (514us total) trans 21474841458 rc 0/0 00000100:00100000:1.0:1746155635.641060:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16414 00000004:00080000:1.0:1746155635.641076:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0d9180/2, rc 0, transno 21474841458 00000100:00100000:1.0:1746155635.641079:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125274240:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155635.641085:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca95180/2, rc 0, transno 21474841457 00000100:00100000:1.0:1746155635.641087:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125274752:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155635.641097:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0dad80/2, rc 0, transno 21474841455 00000100:00100000:1.0:1746155635.641099:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125274112:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155635.641106:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366d500/2, rc 0, transno 21474841456 00000100:00100000:1.0:1746155635.641109:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125274624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155635.643055:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.643099:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125748864 00000100:00100000:1.0:1746155635.643104:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125748864 00000100:00100000:1.0:1746155635.643135:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4640 00000100:00100000:1.0:1746155635.643141:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32069:x1830976125748864:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:1.0:1746155635.643214:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32069:x1830976125748864:12345-192.168.202.51@tcp:49:cat.0 Request processed in 73us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.643220:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4640 00000100:00100000:0.0:1746155635.643667:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.649788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.649838:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.649913:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125749120 00000100:00100000:1.0:1746155635.649920:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125749120 00000100:00100000:1.0:1746155635.649967:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4642 00000100:00100000:1.0:1746155635.649984:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32065:x1830976125749120:12345-192.168.202.51@tcp:49:multiop.0 00000100:00100000:1.0:1746155635.650079:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32065:x1830976125749120:12345-192.168.202.51@tcp:49:multiop.0 Request processed in 96us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.650085:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4642 00000100:00100000:0.0:1746155635.652808:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.653499:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.653893:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125749760 00000100:00100000:1.0:1746155635.653897:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125749760 00002000:00100000:1.0:1746155635.653914:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88012fef1180 x1830976125749760/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.653920:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef1180 with x1830976125749760 ext(1048576->2097151) 00002000:00010000:1.0:1746155635.653924:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef1180 00000100:00100000:1.0:1746155635.653949:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7758 00000100:00100000:1.0:1746155635.653954:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125749760:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155635.654300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.654326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.654345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.654359:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125750016 00000100:00100000:0.0:1746155635.654362:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125750016 00000100:00100000:0.0:1746155635.654384:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 728 00000100:00100000:0.0:1746155635.654389:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1960:x1830976125750016:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155635.654397:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155635.654416:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b800/0x844e5faceb5f65f5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174e2 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.654435:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155635.654439:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155635.654466:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1960:x1830976125750016:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 76us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155635.654471:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 728 00000100:00100000:0.0:1746155635.660634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.660671:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.660689:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125750272 00000100:00100000:1.0:1746155635.660697:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125750272 00010000:00010000:1.0:1746155635.660724:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136a57000/0x844e5faceb5f64eb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1746b expref: 12 pid: 9235 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155635.660746:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125750400 00000100:00100000:1.0:1746155635.660748:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125750400 00010000:00010000:1.0:1746155635.660756:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136a57600/0x844e5faceb5f6500 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17480 expref: 13 pid: 9235 timeout: 864 lvb_type: 1 00000100:00100000:1.0:1746155635.660769:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8414 00000100:00100000:1.0:1746155635.660775:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125750272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155635.660785:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155635.660804:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136a57000/0x844e5faceb5f64eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1746b expref: 13 pid: 9235 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.660812:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136a57000/0x844e5faceb5f64eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1746b expref: 13 pid: 9235 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.660830:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a57000/0x844e5faceb5f64eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1746b expref: 13 pid: 9235 timeout: 864 lvb_type: 1 00010000:00010000:1.0:1746155635.660842:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.660844:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.660849:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f17a000/0x844e5faceb5f65fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174e9 expref: 29 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.660856:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f17a000/0x844e5faceb5f65fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174e9 expref: 29 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.660884:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f17a000/0x844e5faceb5f65fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1798144->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174e9 expref: 29 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.660895:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125275264:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155635.660939:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155635.664596:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125275264:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155635.664601:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155635.664611:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155635.664639:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125750272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3863us (4012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.664648:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8414 00000100:00100000:0.0:1746155635.666041:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.666688:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125749760:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12731us (13188us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155635.666695:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7758 00002000:00100000:1.0:1746155635.666702:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88012fef1180 x1830976125749760/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.666709:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012fef1180 with x1830976125749760 ext(1048576->2097151) 00002000:00010000:1.0:1746155635.666713:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012fef1180 00000100:00100000:1.0:1746155635.666725:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125750912 00000100:00100000:1.0:1746155635.666729:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125750912 00002000:00100000:1.0:1746155635.666745:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1798144->1802239) req@ffff88009f0d8000 x1830976125750912/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.667250:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8000 with x1830976125750912 ext(1798144->1802239) 00002000:00010000:1.0:1746155635.667253:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0d8000 00000100:00100000:1.0:1746155635.667266:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7761 00000100:00100000:1.0:1746155635.667272:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125750912:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155635.667349:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125750912:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 76us (1308us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155635.667354:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7761 00002000:00100000:1.0:1746155635.667359:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1798144->1802239) req@ffff88009f0d8000 x1830976125750912/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/4536 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.667365:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8000 with x1830976125750912 ext(1798144->1802239) 00002000:00010000:1.0:1746155635.667368:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0d8000 00000100:00100000:0.0:1746155635.672626:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.672676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.685479:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.685637:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.685671:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.688030:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16420 00000100:00100000:0.0:1746155635.688041:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:32068:x1830976125752064:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155635.688051:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155635.688293:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe06e00/0x844e5faceb5f6618 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17505 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.688311:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155635.688316:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6611 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->1441791] (req 1048576->1441791) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174fe expref: 29 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.688321:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155635.688325:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe06e00/0x844e5faceb5f6618 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17505 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.688349:0:8437:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6611 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->1441791] (req 1048576->1441791) gid 0 flags: 0x60000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174fe expref: 29 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.688358:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe06e00/0x844e5faceb5f6618 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17505 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.688366:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe06e00, rc 0) 00000100:00100000:0.0:1746155635.688399:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:32068:x1830976125752064:12345-192.168.202.51@tcp:101:cat.0 Request processed in 362us (2728us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155635.688404:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16420 00000100:00100000:0.0:1746155635.697020:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.697405:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.700155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.700193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.701558:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.716647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.719948:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.720023:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.726403:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.734087:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.734147:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.734860:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.734917:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125754368 00000100:00100000:0.0:1746155635.734921:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125754368 00000100:00100000:0.0:1746155635.734939:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16424 00000100:00100000:0.0:1746155635.734943:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976125754368:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155635.734952:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155635.734960:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a44200/0x844e5faceb5f6634 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1751a expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.734984:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155635.734988:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155635.734993:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a44200/0x844e5faceb5f6634 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1751a expref: 30 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155635.735003:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093a44200/0x844e5faceb5f6634 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1751a expref: 30 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155635.735009:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a44200, rc 0) 00000100:00100000:0.0:1746155635.735035:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976125754368:12345-192.168.202.51@tcp:101:cat.0 Request processed in 90us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155635.735041:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16424 00000100:00100000:1.0:1746155635.737798:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.746602:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.749310:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.749328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.749342:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.749365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.749389:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125755392 00000100:00100000:0.0:1746155635.749395:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125755392 00000100:00100000:1.0:1746155635.749406:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125755648 00000100:00100000:1.0:1746155635.749410:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125755648 00002000:00100000:0.0:1746155635.749420:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009c28f800 x1830976125755392/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.749426:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3162111) req@ffff88009c28fb80 x1830976125755648/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 504/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155635.749428:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28f800 with x1830976125755392 ext(3145728->4194303) 00002000:00100000:1.0:1746155635.749432:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28fb80 with x1830976125755648 ext(2097152->3162111) 00002000:00010000:0.0:1746155635.749433:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28f800 00002000:00010000:1.0:1746155635.749435:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28fb80 00000100:00100000:0.0:1746155635.749447:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125755136 00000100:00100000:0.0:1746155635.749449:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125755136 00000100:00100000:1.0:1746155635.749452:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125755776 00000100:00100000:1.0:1746155635.749455:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125755776 00002000:00100000:0.0:1746155635.749459:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009c28e300 x1830976125755136/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.749464:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (3162112->4194303) req@ffff88009c28d500 x1830976125755776/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155635.749465:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28e300 with x1830976125755136 ext(2097152->3145727) 00002000:00010000:0.0:1746155635.749467:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28e300 00002000:00100000:1.0:1746155635.749470:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28d500 with x1830976125755776 ext(3162112->4194303) 00002000:00010000:1.0:1746155635.749472:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28d500 00000100:00100000:1.0:1746155635.749485:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7766 00000100:00100000:1.0:1746155635.749490:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976125755392:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155635.749490:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7767 00000100:00100000:0.0:1746155635.749495:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976125755648:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155635.750480:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7768 00000100:00100000:1.0:1746155635.750486:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125755136:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155635.750529:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7769 00000100:00100000:0.0:1746155635.750536:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976125755776:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155635.769116:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125755392:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19617us (19802us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155635.769125:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7766 00002000:00100000:1.0:1746155635.769135:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009c28f800 x1830976125755392/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.769144:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28f800 with x1830976125755392 ext(3145728->4194303) 00002000:00010000:1.0:1746155635.769148:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28f800 00000100:00100000:0.0:1746155635.769296:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976125755648:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19799us (19965us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155635.769303:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7767 00002000:00100000:0.0:1746155635.769308:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3162111) req@ffff88009c28fb80 x1830976125755648/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 504/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155635.769315:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28fb80 with x1830976125755648 ext(2097152->3162111) 00002000:00010000:0.0:1746155635.769319:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28fb80 00000100:00100000:1.0:1746155635.771406:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.772377:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125756032 00000100:00100000:0.0:1746155635.772385:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125756032 00000100:00100000:0.0:1746155635.772423:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16426 00000100:00100000:0.0:1746155635.772430:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:32068:x1830976125756032:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155635.772445:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155635.772460:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131207400/0x844e5faceb5f6642 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1752f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.772489:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f17ba00/0x844e5faceb5f6603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->2695167) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174f0 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.772496:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155635.772498:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155635.772531:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131207400/0x844e5faceb5f6642 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1752f expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.772558:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f17ba00/0x844e5faceb5f6603 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->2695167) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174f0 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155635.772569:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f17ba00/0x844e5faceb5f6603 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2678784->2695167) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174f0 expref: 19 pid: 29728 timeout: 864 lvb_type: 0 00000100:00100000:0.0:1746155635.772579:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125276416:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155635.772980:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155635.774672:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1961:x1830976125755136:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24180us (25322us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155635.774681:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7768 00002000:00100000:1.0:1746155635.774690:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009c28e300 x1830976125755136/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.774698:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28e300 with x1830976125755136 ext(2097152->3145727) 00002000:00010000:1.0:1746155635.774702:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28e300 00000100:00100000:0.0:1746155635.781900:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.781981:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125276416:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155635.782005:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131207400/0x844e5faceb5f6642 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1752f expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.782021:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131207400, rc 0) 00000100:00100000:1.0:1746155635.782052:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:32068:x1830976125756032:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9622us (10658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.782060:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16426 00000100:00100000:1.0:1746155635.783092:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125756288 00000100:00100000:1.0:1746155635.783098:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125756288 00000100:00100000:1.0:1746155635.783129:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16427 00000100:00100000:1.0:1746155635.783135:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32069:x1830976125756288:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155635.783146:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155635.783158:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091000600/0x844e5faceb5f6649 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17536 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.783174:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155635.783178:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091000600/0x844e5faceb5f6649 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17536 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.783186:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091000600/0x844e5faceb5f6649 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17536 expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.783192:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091000600, rc 0) 00000100:00100000:1.0:1746155635.783210:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32069:x1830976125756288:12345-192.168.202.51@tcp:101:cat.0 Request processed in 75us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.783214:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16427 00000100:00100000:0.0:1746155635.788841:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.792853:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.792920:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125756672 00000100:00100000:1.0:1746155635.792926:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125756672 00000100:00100000:1.0:1746155635.792965:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 10998 00000100:00100000:1.0:1746155635.792981:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32074:x1830976125756672:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155635.792996:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155635.793009:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091000c00/0x844e5faceb5f6650 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1753d expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.793094:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f6657 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793104:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f6657 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793113:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f6657 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793122:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091001000/0x844e5faceb5f665e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793127:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091001000/0x844e5faceb5f665e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793131:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091001000/0x844e5faceb5f665e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793211:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091001200/0x844e5faceb5f6665 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793218:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091001200/0x844e5faceb5f6665 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793222:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091001200/0x844e5faceb5f6665 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155635.793229:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155635.793296:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f6657 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793301:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f6657 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793309:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f6657 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793314:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091000e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155635.793316:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f6657 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793321:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f6657 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793329:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155635.793331:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155635.793334:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f6657 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793338:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f6657 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793361:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091001000/0x844e5faceb5f665e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793365:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091001000/0x844e5faceb5f665e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793369:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091001000/0x844e5faceb5f665e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793373:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091001000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155635.793375:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091001000/0x844e5faceb5f665e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793379:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091001000/0x844e5faceb5f665e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793388:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fd66d00) 00010000:00010000:1.0:1746155635.793390:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155635.793392:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091001000/0x844e5faceb5f665e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793396:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091001000/0x844e5faceb5f665e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155635.793432:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091000c00/0x844e5faceb5f6650 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1753d expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.793441:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091001200/0x844e5faceb5f6665 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1753d expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.793446:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155635.793447:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155635.793449:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091001200, rc 0) 00000100:00100000:1.0:1746155635.793474:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32074:x1830976125756672:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 503us (623us total) trans 8589945130 rc 0/0 00000100:00100000:1.0:1746155635.793479:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 10998 00000100:00100000:0.0:1746155635.794752:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125756928 00000100:00100000:0.0:1746155635.794756:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125756928 00000100:00100000:0.0:1746155635.794787:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4644 00000100:00100000:0.0:1746155635.794792:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32074:x1830976125756928:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155635.794886:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32074:x1830976125756928:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 93us (208us total) trans 8589945131 rc 0/0 00000100:00100000:0.0:1746155635.794895:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4644 00000100:00100000:0.0:1746155635.797901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.797930:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.797955:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.797988:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.798015:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.798194:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125757696 00000100:00100000:1.0:1746155635.798197:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125757696 00002000:00100000:1.0:1746155635.798213:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009ff69f80 x1830976125757696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.798220:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff69f80 with x1830976125757696 ext(3145728->4194303) 00002000:00010000:1.0:1746155635.798222:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff69f80 00000100:00100000:1.0:1746155635.798234:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7770 00000100:00100000:1.0:1746155635.798239:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976125757312:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155635.798254:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7772 00000100:00100000:1.0:1746155635.798258:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125757696:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155635.817066:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125757696:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18799us (19102us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155635.817076:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7772 00002000:00100000:1.0:1746155635.817084:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009ff69f80 x1830976125757696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.817092:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff69f80 with x1830976125757696 ext(3145728->4194303) 00002000:00010000:1.0:1746155635.817097:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff69f80 00000100:00100000:1.0:1746155635.820084:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976125757312:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21837us (22182us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155635.820094:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7770 00002000:00100000:1.0:1746155635.820104:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009ff68380 x1830976125757312/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:706/0 lens 488/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.820112:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff68380 with x1830976125757312 ext(2097152->3145727) 00002000:00010000:1.0:1746155635.820117:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff68380 00000100:00100000:0.0:1746155635.820827:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.820863:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125758464 00000100:00100000:1.0:1746155635.820870:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125758464 00002000:00100000:1.0:1746155635.820902:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009ff6ad80 x1830976125758464/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/0 e 0 to 0 dl 1746155646 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.820909:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ad80 with x1830976125758464 ext(4194304->5083135) 00002000:00010000:1.0:1746155635.820912:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ad80 00000100:00100000:1.0:1746155635.820983:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7775 00000100:00100000:1.0:1746155635.820990:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1961:x1830976125758464:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155635.828484:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1961:x1830976125758464:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7486us (7649us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155635.828495:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7775 00002000:00100000:1.0:1746155635.828527:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009ff6ad80 x1830976125758464/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:706/0 lens 488/440 e 0 to 0 dl 1746155646 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155635.828535:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6ad80 with x1830976125758464 ext(4194304->5083135) 00002000:00010000:1.0:1746155635.828540:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6ad80 00000100:00100000:0.0:1746155635.833953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.834008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.834027:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125758720 00000100:00100000:1.0:1746155635.834035:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125758720 00000100:00100000:1.0:1746155635.834079:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4645 00000100:00100000:1.0:1746155635.834087:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32069:x1830976125758720:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155635.834284:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32069:x1830976125758720:12345-192.168.202.51@tcp:35:cat.0 Request processed in 196us (336us total) trans 8589945132 rc 0/0 00000100:00100000:1.0:1746155635.834290:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4645 00000100:00100000:0.0:1746155635.886486:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.889849:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.892317:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.900112:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.904079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.907867:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.907942:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.908103:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8424 00000100:00100000:1.0:1746155635.908111:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976125760128:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155635.908119:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155635.908128:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f17b200/0x844e5faceb5f663b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17528 expref: 27 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155635.908139:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f17b200/0x844e5faceb5f663b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17528 expref: 27 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155635.908155:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f17b200/0x844e5faceb5f663b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17528 expref: 27 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155635.908167:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.908169:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155635.908174:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f17b800/0x844e5faceb5f667a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1754b expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.908181:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f17b800/0x844e5faceb5f667a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1754b expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155635.908208:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f17b800/0x844e5faceb5f667a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1754b expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155635.908220:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125277568:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155635.908272:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155635.910023:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125277568:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155635.910039:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155635.910080:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976125760128:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1969us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.910087:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8424 00000100:00100000:0.0:1746155635.913091:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155635.931989:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155635.956423:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125277696 00000100:00100000:1.0:1746155635.956429:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125277696 00000100:00100000:1.0:1746155635.956472:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1746155635.956479:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3295:x1830976125277696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746155635.956530:0:8440:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 619905024 pending 25559040 free 3850371072 avail 3848273920 00000100:00100000:1.0:1746155635.956564:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3295:x1830976125277696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155635.956569:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1746155635.956823:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125277824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746155635.956843:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155635.957114:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125277824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746155636.037416:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:1.0:1746155636.038698:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155636.042204:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.042400:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125760896 00000100:00100000:1.0:1746155636.042406:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125760896 00002000:00100000:1.0:1746155636.042457:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e3:0x0] (1384448->2097151) req@ffff8800910d9f80 x1830976125760896/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.042466:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d9f80 with x1830976125760896 ext(1384448->2097151) 00010000:00010000:1.0:1746155636.042473:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6673 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17544 expref: 26 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.042484:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6673 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17544 expref: 26 pid: 29728 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746155636.042490:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910d9f80 00000100:00100000:1.0:1746155636.042538:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1324 00000100:00100000:1.0:1746155636.042545:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976125760896:12345-192.168.202.51@tcp:4:multiop.0 00000100:00080000:0.0:1746155636.043749:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746155636.053314:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1960:x1830976125760896:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 10762us (11109us total) trans 17179874124 rc 0/0 00000100:00100000:1.0:1746155636.053324:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1324 00002000:00100000:1.0:1746155636.053333:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e3:0x0] (1384448->2097151) req@ffff8800910d9f80 x1830976125760896/t17179874124(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/448 e 0 to 0 dl 1746155647 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.053342:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d9f80 with x1830976125760896 ext(1384448->2097151) 00010000:00010000:1.0:1746155636.053350:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17544 expref: 28 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.053364:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17544 expref: 28 pid: 29728 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746155636.053370:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910d9f80 00000100:00100000:0.0:1746155636.056124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.056582:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125761024 00000100:00100000:1.0:1746155636.056591:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125761024 00000100:00080000:0.0:1746155636.056683:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155636.056719:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11000 00000100:00100000:1.0:1746155636.056726:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32081:x1830976125761024:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155636.056748:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.056762:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009421fc00/0x844e5faceb5f66ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17560 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.056809:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009421fe00/0x844e5faceb5f66b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.056820:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009421fe00/0x844e5faceb5f66b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.056828:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009421fe00/0x844e5faceb5f66b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.056838:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f400/0x844e5faceb5f66b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.056843:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f400/0x844e5faceb5f66b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.056849:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f400/0x844e5faceb5f66b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.056934:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.056943:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45000/0x844e5faceb5f65a8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1749c expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.056950:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.056984:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45000/0x844e5faceb5f65a8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1749c expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.056992:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45000/0x844e5faceb5f65a8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1749c expref: 12 pid: 15474 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.057002:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125278080:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155636.058909:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155636.059455:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.059498:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125761152 00000100:00100000:1.0:1746155636.059517:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125761152 00010000:00010000:1.0:1746155636.059542:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17544 expref: 28 pid: 29728 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746155636.059551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.059580:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8425 00000100:00100000:0.0:1746155636.059587:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125761152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155636.059596:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155636.059613:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6673 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17544 expref: 28 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.059622:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17544 expref: 28 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.059639:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6673 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1384448->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17544 expref: 28 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.059665:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155636.059667:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155636.059671:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f66a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17559 expref: 28 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.059678:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f66a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17559 expref: 28 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.059699:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f66a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17559 expref: 28 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155636.059708:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125278208:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155636.059730:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125761408 00000100:00100000:1.0:1746155636.059733:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125761408 00000100:00100000:0.0:1746155636.059756:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155636.064905:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125278208:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155636.064923:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155636.065232:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.065236:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976125761152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5649us (5783us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.065244:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8425 00000100:00100000:0.0:1746155636.065487:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125761536 00000100:00100000:0.0:1746155636.065491:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125761536 00010000:00010000:0.0:1746155636.065524:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45000/0x844e5faceb5f65a8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1749c expref: 16 pid: 15474 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.065872:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8426 00000100:00100000:1.0:1746155636.065879:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1963:x1830976125761536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155636.065886:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155636.065890:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45000/0x844e5faceb5f65a8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1749c expref: 17 pid: 15474 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.065900:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45000/0x844e5faceb5f65a8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1749c expref: 17 pid: 15474 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.065913:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45000/0x844e5faceb5f65a8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1749c expref: 17 pid: 15474 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.065931:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155636.065935:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.065941:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.065946:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.065960:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155636.065986:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1963:x1830976125761536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 107us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.065991:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8426 00010000:00010000:1.0:1746155636.066008:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066646:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155636.066667:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155636.066671:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155636.066679:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066685:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066691:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009421fe00/0x844e5faceb5f66b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066696:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009421fe00/0x844e5faceb5f66b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066700:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009421fe00/0x844e5faceb5f66b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066704:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009421fe00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155636.066707:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009421fe00/0x844e5faceb5f66b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066711:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009421fe00/0x844e5faceb5f66b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066718:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155636.066720:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155636.066722:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009421fe00/0x844e5faceb5f66b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066730:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009421fe00/0x844e5faceb5f66b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066738:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f400/0x844e5faceb5f66b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066742:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f400/0x844e5faceb5f66b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066746:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f400/0x844e5faceb5f66b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066750:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009421f400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155636.066752:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f400/0x844e5faceb5f66b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066760:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f400/0x844e5faceb5f66b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066766:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fd66d00) 00010000:00010000:1.0:1746155636.066768:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155636.066771:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f400/0x844e5faceb5f66b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066775:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f400/0x844e5faceb5f66b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.066807:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009421fc00/0x844e5faceb5f66ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17560 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.066816:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17560 expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.066826:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155636.066828:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155636.066829:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009421f200, rc 0) 00000100:00100000:1.0:1746155636.066866:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32081:x1830976125761024:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 10140us (10748us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.066872:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11000 00000100:00100000:0.0:1746155636.069348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.070638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.070670:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.070684:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125762560 00000100:00100000:0.0:1746155636.070684:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125762304 00000100:00100000:1.0:1746155636.070691:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125762560 00000100:00100000:0.0:1746155636.070691:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125762304 00000100:00100000:0.0:1746155636.070721:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125762176 00000100:00100000:0.0:1746155636.070724:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125762176 00000100:00100000:1.0:1746155636.070734:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16431 00000100:00100000:0.0:1746155636.070739:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16432 00000100:00100000:1.0:1746155636.070741:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125762304:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00100000:0.0:1746155636.070745:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976125762560:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155636.070753:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155636.070753:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.070766:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009421ea00/0x844e5faceb5f66f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17575 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.070766:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131207a00/0x844e5faceb5f66ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17583 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.070784:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155636.070786:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155636.070792:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131207a00/0x844e5faceb5f66ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17583 expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155636.070807:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125278336:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155636.070807:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131207a00/0x844e5faceb5f66ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17583 expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155636.070817:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131207a00, rc 0) 00000100:00100000:1.0:1746155636.070863:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155636.070878:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16433 00000100:00100000:1.0:1746155636.070884:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976125762176:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155636.070889:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.070896:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009421e200/0x844e5faceb5f66f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1756e expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.070905:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155636.070908:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155636.070912:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009421e200/0x844e5faceb5f66f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1756e expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.070921:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009421e200/0x844e5faceb5f66f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1756e expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.070928:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009421e200, rc 0) 00000100:00100000:0.0:1746155636.071247:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1962:x1830976125762560:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 501us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155636.071253:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16432 00000100:00100000:1.0:1746155636.071754:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976125762176:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 868us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.071759:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16433 00000100:00100000:1.0:1746155636.072219:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125762432 00000100:00100000:1.0:1746155636.072223:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125762432 00000100:00100000:1.0:1746155636.072237:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125762688 00000100:00100000:1.0:1746155636.072239:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125762688 00000100:00100000:1.0:1746155636.072558:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16434 00000100:00100000:1.0:1746155636.072564:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976125762432:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155636.072574:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.072583:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009421ee00/0x844e5faceb5f66ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1757c expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155636.072611:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125278464:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155636.073244:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155636.074824:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.074874:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125763200 00000100:00100000:1.0:1746155636.074880:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125763200 00000100:00100000:1.0:1746155636.074934:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11002 00000100:00100000:1.0:1746155636.074940:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32086:x1830976125763200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155636.074957:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.074982:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4200/0x844e5faceb5f670d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17598 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.075059:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4400/0x844e5faceb5f6714 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075069:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4400/0x844e5faceb5f6714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075077:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4400/0x844e5faceb5f6714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075087:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4600/0x844e5faceb5f671b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075093:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4600/0x844e5faceb5f671b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075098:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4600/0x844e5faceb5f671b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075184:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4800/0x844e5faceb5f6722 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075191:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4800/0x844e5faceb5f6722 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075197:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4800/0x844e5faceb5f6722 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155636.075204:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155636.075263:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4400/0x844e5faceb5f6714 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075273:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4400/0x844e5faceb5f6714 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075278:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4400/0x844e5faceb5f6714 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075282:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130fb4400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155636.075285:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4400/0x844e5faceb5f6714 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075290:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4400/0x844e5faceb5f6714 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075298:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155636.075300:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155636.075303:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4400/0x844e5faceb5f6714 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075307:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4400/0x844e5faceb5f6714 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075316:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4600/0x844e5faceb5f671b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075320:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4600/0x844e5faceb5f671b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075324:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4600/0x844e5faceb5f671b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075327:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130fb4600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155636.075330:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4600/0x844e5faceb5f671b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075337:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4600/0x844e5faceb5f671b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075342:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fd66200) 00010000:00010000:1.0:1746155636.075344:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155636.075345:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4600/0x844e5faceb5f671b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075349:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4600/0x844e5faceb5f671b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.075375:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4200/0x844e5faceb5f670d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17598 expref: 293 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.075384:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4800/0x844e5faceb5f6722 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17598 expref: 292 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.075389:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155636.075391:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155636.075393:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130fb4800, rc 0) 00000100:00100000:1.0:1746155636.075428:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32086:x1830976125763200:12345-192.168.202.51@tcp:101:cat.0 Request processed in 488us (606us total) trans 8589945136 rc 0/0 00000100:00100000:1.0:1746155636.075434:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11002 00002000:00010000:1.0:1746155636.075984:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime: 1746155635 -> 1746155636 00000100:00100000:1.0:1746155636.075997:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125278336:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155636.076013:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009421ea00/0x844e5faceb5f66f1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17575 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.076027:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009421ea00/0x844e5faceb5f66f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17575 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.076034:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009421ea00, rc 0) 00000100:00100000:1.0:1746155636.076053:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976125762304:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 5313us (6710us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155636.076058:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16431 00000100:00100000:0.0:1746155636.076121:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125762816 00000100:00100000:0.0:1746155636.076125:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125762816 00000100:00100000:0.0:1746155636.076149:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 729 00000100:00100000:0.0:1746155636.076154:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1962:x1830976125762816:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155636.076162:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155636.076173:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17bc00/0x844e5faceb5f66dc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17567 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.076185:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155636.076188:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155636.076203:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1962:x1830976125762816:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155636.076209:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 729 00002000:00010000:1.0:1746155636.077244:0:18270:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155635 -> 1746155636 00002000:00010000:1.0:1746155636.077247:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155635 -> 1746155636 00002000:00010000:1.0:1746155636.077249:0:18270:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime: 1746155635 -> 1746155636 00000100:00100000:1.0:1746155636.077260:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125278464:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155636.077275:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009421ee00/0x844e5faceb5f66ff lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1757c expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.077283:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009421ee00/0x844e5faceb5f66ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1757c expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.077290:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009421ee00, rc 0) 00000100:00100000:1.0:1746155636.077325:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125762432:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 4761us (5201us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155636.077331:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16434 00000100:00100000:0.0:1746155636.079263:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.079297:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.079423:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125763584 00000100:00100000:1.0:1746155636.079427:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125763584 00000100:00100000:1.0:1746155636.079447:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4647 00000100:00100000:1.0:1746155636.079452:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0dd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32086:x1830976125763584:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:0.0:1746155636.079950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.080065:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0dd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32086:x1830976125763584:12345-192.168.202.51@tcp:35:cat.0 Request processed in 612us (767us total) trans 8589945137 rc 0/0 00000100:00100000:1.0:1746155636.080070:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4647 00000100:00100000:1.0:1746155636.080120:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125763840 00000100:00100000:1.0:1746155636.080122:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125763840 00000100:00100000:1.0:1746155636.080136:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11003 00000100:00100000:1.0:1746155636.080140:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32081:x1830976125763840:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155636.080147:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.080157:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4a00/0x844e5faceb5f6737 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1759f expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.080200:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4c00/0x844e5faceb5f673e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.080210:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17560 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.080215:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4800/0x844e5faceb5f6722 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17598 expref: 292 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.080220:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4c00/0x844e5faceb5f673e lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.080238:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4800/0x844e5faceb5f6722 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17598 expref: 292 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.080244:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4800/0x844e5faceb5f6722 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17598 expref: 292 pid: 15474 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.080256:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125278848:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155636.080288:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17560 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.080294:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17560 expref: 8 pid: 15474 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.080300:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125278976:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155636.080310:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155636.087374:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125763968 00000100:00100000:0.0:1746155636.087381:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125763968 00010000:00010000:0.0:1746155636.087406:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17560 expref: 9 pid: 15474 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746155636.087425:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125764096 00000100:00100000:0.0:1746155636.087427:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125764096 00010000:00010000:0.0:1746155636.087434:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4800/0x844e5faceb5f6722 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17598 expref: 293 pid: 15474 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746155636.087446:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8427 00000100:00100000:0.0:1746155636.087451:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fe91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125763968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155636.087461:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155636.087467:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17560 expref: 9 pid: 15474 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.087476:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17560 expref: 9 pid: 15474 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.087492:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155636.087496:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4c00/0x844e5faceb5f673e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155636.087520:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4c00/0x844e5faceb5f673e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155636.087525:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155636.087552:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fe91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125763968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 100us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155636.087557:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8427 00000100:00100000:0.0:1746155636.087568:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8428 00000100:00100000:0.0:1746155636.087572:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1960:x1830976125764096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155636.087577:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155636.087580:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4800/0x844e5faceb5f6722 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17598 expref: 293 pid: 15474 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.087587:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4800/0x844e5faceb5f6722 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17598 expref: 293 pid: 15474 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.087594:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155636.087597:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4c00/0x844e5faceb5f673e lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155636.087606:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4c00/0x844e5faceb5f673e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155636.087611:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4c00/0x844e5faceb5f673e lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155636.087622:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155636.087632:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1960:x1830976125764096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 60us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155636.087636:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8428 00000100:00100000:0.0:1746155636.088929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.088999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.089981:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125764608 00000100:00100000:1.0:1746155636.089984:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125764608 00010000:00010000:1.0:1746155636.089999:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f17b800/0x844e5faceb5f667a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1754b expref: 30 pid: 29728 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.090017:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8429 00000100:00100000:1.0:1746155636.090021:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1962:x1830976125764608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155636.090029:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155636.090042:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f17b800/0x844e5faceb5f667a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1754b expref: 30 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.090052:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f17b800/0x844e5faceb5f667a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1754b expref: 30 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.090068:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155636.090070:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155636.090076:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1758a expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.090082:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1758a expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.090104:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1758a expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155636.090113:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125279232:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155636.090153:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746155636.090197:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4800/0x844e5faceb5f6722 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17598 expref: 292 pid: 15474 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.090209:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125278848:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155636.090219:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009421f200/0x844e5faceb5f66c0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17560 expref: 8 pid: 15474 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.090227:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125278976:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155636.090241:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4c00/0x844e5faceb5f673e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.090247:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4c00/0x844e5faceb5f673e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.090252:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4c00/0x844e5faceb5f673e lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155636.090265:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155636.090360:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4a00/0x844e5faceb5f6737 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1759f expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.090370:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4c00/0x844e5faceb5f673e lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1759f expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.090376:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155636.090378:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155636.090381:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130fb4c00, rc 0) 00000100:00100000:1.0:1746155636.090402:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32081:x1830976125763840:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 10260us (10452us total) trans 8589945138 rc 0/0 00000100:00100000:1.0:1746155636.090407:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11003 00010000:00010000:0.0:1746155636.090596:0:29728:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.51@tcp) returned -22 from glimpse AST (req@ffff8800a01d0700 x1830976125279104) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012f17b800/0x844e5faceb5f667a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1754b expref: 30 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.090610:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f17b800/0x844e5faceb5f667a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2183167) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1754b expref: 30 pid: 29728 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746155636.090624:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125279104:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155636.090638:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012da29200/0x844e5faceb5f6745 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175a6 expref: 31 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155636.090646:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da29200/0x844e5faceb5f6745 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175a6 expref: 31 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155636.090652:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da29200, rc 0) 00000100:00100000:0.0:1746155636.091760:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125764224:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4051us (4444us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155636.091767:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16437 00000100:00100000:1.0:1746155636.094138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.094159:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125764864 00000100:00100000:1.0:1746155636.094165:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125764864 00000100:00100000:1.0:1746155636.094206:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11004 00000100:00100000:1.0:1746155636.094213:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32081:x1830976125764864:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155636.094232:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.094235:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746155636.094255:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4c00/0x844e5faceb5f673e lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1759f expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.094268:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155636.094271:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155636.094279:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb5400/0x844e5faceb5f6753 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f175ad expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.094348:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4e00/0x844e5faceb5f675a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.094358:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4e00/0x844e5faceb5f675a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.094366:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4e00/0x844e5faceb5f675a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.094374:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4e00/0x844e5faceb5f675a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.094379:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4e00/0x844e5faceb5f675a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.094384:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4e00/0x844e5faceb5f675a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.094388:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130fb4e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155636.094392:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4e00/0x844e5faceb5f675a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.094397:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4e00/0x844e5faceb5f675a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.094403:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155636.094405:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155636.094407:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4e00/0x844e5faceb5f675a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.094411:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb4e00/0x844e5faceb5f675a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.094429:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb5400/0x844e5faceb5f6753 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175ad expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.094440:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130fb5400/0x844e5faceb5f6753 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175ad expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.094446:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130fb5400, rc 0) 00000100:00100000:1.0:1746155636.094473:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32081:x1830976125764864:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 260us (339us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155636.094478:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11004 00000100:00100000:0.0:1746155636.096664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.099621:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.099697:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125765376 00000100:00100000:1.0:1746155636.099704:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125765376 00000100:00100000:1.0:1746155636.099738:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4648 00000100:00100000:1.0:1746155636.099744:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32081:x1830976125765376:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:1.0:1746155636.099897:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32081:x1830976125765376:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 152us (284us total) trans 8589945139 rc 0/0 00000100:00100000:1.0:1746155636.099903:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4648 00000100:00100000:0.0:1746155636.102288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.103382:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125765632 00000100:00100000:1.0:1746155636.103389:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125765632 00000100:00100000:1.0:1746155636.103425:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4649 00000100:00100000:1.0:1746155636.103431:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32079:x1830976125765632:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155636.103597:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32079:x1830976125765632:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 165us (1313us total) trans 8589945140 rc 0/0 00000100:00100000:1.0:1746155636.103603:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4649 00000100:00100000:0.0:1746155636.107807:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.107841:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.107882:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.108081:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7783 00000100:00100000:0.0:1746155636.108088:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976125766144:12345-192.168.202.51@tcp:3:cat.0 00000100:00080000:1.0:1746155636.108576:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746155636.108589:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7784 00000100:00100000:1.0:1746155636.108595:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976125766400:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155636.116479:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.117161:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976125766144:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9074us (9318us total) trans 0 rc 528384/528384 00000100:00100000:0.0:1746155636.117169:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7783 00002000:00100000:0.0:1746155636.117177:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1576959) req@ffff8800a06a6300 x1830976125766144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 528384/528384 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155636.117185:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a6300 with x1830976125766144 ext(1048576->1576959) 00010000:00010000:0.0:1746155636.117195:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f66a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17559 expref: 32 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.117204:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f66a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1576960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17559 expref: 32 pid: 29728 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746155636.117210:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a06a6300 00000100:00100000:1.0:1746155636.120576:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976125766400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11974us (12686us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155636.120586:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7784 00002000:00100000:1.0:1746155636.120594:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a06a6680 x1830976125766400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.120603:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a6680 with x1830976125766400 ext(1048576->2097151) 00002000:00010000:1.0:1746155636.120608:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a06a6680 00000100:00100000:0.0:1746155636.123854:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.140237:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.140311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.140343:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125767040 00000100:00100000:0.0:1746155636.140350:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125767040 00000100:00100000:0.0:1746155636.140390:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11005 00000100:00100000:0.0:1746155636.140396:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32090:x1830976125767040:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155636.140417:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155636.140439:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091000200/0x844e5faceb5f6768 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f175c2 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.140552:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000a00/0x844e5faceb5f676f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140563:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091000a00/0x844e5faceb5f676f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140573:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091000a00/0x844e5faceb5f676f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140587:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000800/0x844e5faceb5f6776 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140592:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091000800/0x844e5faceb5f6776 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140596:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091000800/0x844e5faceb5f6776 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140686:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f677d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140694:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f677d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140703:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f677d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155636.140710:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155636.140774:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000a00/0x844e5faceb5f676f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140780:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091000a00/0x844e5faceb5f676f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140784:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091000a00/0x844e5faceb5f676f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140789:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091000a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155636.140792:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091000a00/0x844e5faceb5f676f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140797:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091000a00/0x844e5faceb5f676f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140806:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155636.140808:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155636.140811:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091000a00/0x844e5faceb5f676f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140815:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091000a00/0x844e5faceb5f676f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140840:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000800/0x844e5faceb5f6776 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140845:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091000800/0x844e5faceb5f6776 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140852:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091000800/0x844e5faceb5f6776 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140855:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091000800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155636.140857:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091000800/0x844e5faceb5f6776 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140861:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091000800/0x844e5faceb5f6776 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140866:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c700) 00010000:00010000:0.0:1746155636.140868:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155636.140869:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091000800/0x844e5faceb5f6776 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140873:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091000800/0x844e5faceb5f6776 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.140908:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091000200/0x844e5faceb5f6768 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175c2 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.140918:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f677d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175c2 expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.140923:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155636.140925:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155636.140927:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091000e00, rc 0) 00000100:00100000:0.0:1746155636.140960:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32090:x1830976125767040:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 564us (648us total) trans 8589945141 rc 0/0 00000100:00100000:0.0:1746155636.140990:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11005 00000100:00100000:0.0:1746155636.144134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.149282:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.152594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.154914:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125767680 00000100:00100000:1.0:1746155636.154925:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125767680 00002000:00100000:1.0:1746155636.154965:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fc50700 x1830976125767680/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.154984:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc50700 with x1830976125767680 ext(1048576->2097151) 00002000:00010000:1.0:1746155636.154988:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc50700 00000100:00100000:1.0:1746155636.155019:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7786 00000100:00100000:1.0:1746155636.155025:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976125767680:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155636.165633:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976125767680:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10599us (13037us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155636.165644:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7786 00002000:00100000:1.0:1746155636.165654:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fc50700 x1830976125767680/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.165663:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc50700 with x1830976125767680 ext(1048576->2097151) 00002000:00010000:1.0:1746155636.165667:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc50700 00000100:00100000:0.0:1746155636.176217:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.176251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.176291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.176527:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125768320 00000100:00100000:1.0:1746155636.176535:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125768320 00000100:00100000:1.0:1746155636.176570:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16440 00000100:00100000:1.0:1746155636.176577:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:32085:x1830976125768320:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155636.176590:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.176604:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe07800/0x844e5faceb5f6792 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f175c9 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.176626:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1758a expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.176633:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155636.176634:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155636.176637:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe07800/0x844e5faceb5f6792 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175c9 expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.176660:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1758a expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.176669:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6706 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1758a expref: 31 pid: 4461 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.176680:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125279744:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155636.176737:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155636.177641:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1328 00000100:00100000:0.0:1746155636.177648:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976125767936:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155636.181644:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.181703:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125279744:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155636.181724:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe07800/0x844e5faceb5f6792 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175c9 expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.181737:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe07800, rc 0) 00000100:00100000:0.0:1746155636.181759:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:32085:x1830976125768320:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5183us (5467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155636.181766:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16440 00000100:00100000:1.0:1746155636.194116:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976125767936:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16467us (17861us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155636.194122:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1328 00002000:00100000:1.0:1746155636.194127:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2449408->3497983) req@ffff88009fc53100 x1830976125767936/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.194134:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc53100 with x1830976125767936 ext(2449408->3497983) 00010000:00010000:1.0:1746155636.194139:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6706 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1758a expref: 34 pid: 4461 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.194147:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f6706 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1758a expref: 34 pid: 4461 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746155636.194152:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc53100 00000100:00100000:0.0:1746155636.201360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.204614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.204700:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125768704 00000100:00100000:1.0:1746155636.204706:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125768704 00000100:00100000:1.0:1746155636.204886:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16442 00000100:00100000:1.0:1746155636.204892:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:32090:x1830976125768704:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155636.204908:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.204920:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df28000/0x844e5faceb5f67a0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f175d7 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.204996:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155636.205006:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe07800/0x844e5faceb5f6792 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175c9 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.205012:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746155636.205015:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012df28000/0x844e5faceb5f67a0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d7 expref: 31 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.205938:0:29728:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe07800/0x844e5faceb5f6792 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175c9 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.205963:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012df28000/0x844e5faceb5f67a0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d7 expref: 31 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.205981:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df28000, rc 0) 00000100:00100000:1.0:1746155636.206023:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:32090:x1830976125768704:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1130us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.206029:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16442 00000100:00100000:0.0:1746155636.209672:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.215054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.217328:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.217393:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125769344 00000100:00100000:1.0:1746155636.217398:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125769344 00002000:00100000:1.0:1746155636.217423:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009045d180 x1830976125769344/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.217430:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045d180 with x1830976125769344 ext(2097152->3145727) 00010000:00010000:1.0:1746155636.217438:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe07800/0x844e5faceb5f6792 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175c9 expref: 31 pid: 4461 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.217449:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe07800/0x844e5faceb5f6792 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175c9 expref: 31 pid: 4461 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746155636.217456:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009045d180 00000100:00100000:1.0:1746155636.217481:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1330 00000100:00100000:1.0:1746155636.217487:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976125769344:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155636.218697:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.225928:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.228230:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125769856 00000100:00100000:1.0:1746155636.228241:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125769856 00000100:00100000:1.0:1746155636.228292:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11006 00000100:00100000:1.0:1746155636.228301:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32092:x1830976125769856:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155636.228320:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.228335:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28a00/0x844e5faceb5f67a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f175de expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.228416:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df29e00/0x844e5faceb5f67ae lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.228429:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f677d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175c2 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.228435:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df29e00/0x844e5faceb5f67ae lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155636.228462:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f677d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175c2 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.228472:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f677d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175c2 expref: 15 pid: 27374 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.228482:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125280256:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155636.228571:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155636.229488:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1960:x1830976125769344:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12000us (12161us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155636.229496:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1330 00002000:00100000:1.0:1746155636.229521:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009045d180 x1830976125769344/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.229528:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045d180 with x1830976125769344 ext(2097152->3145727) 00010000:00010000:1.0:1746155636.229537:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fe07800/0x844e5faceb5f6792 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175c9 expref: 33 pid: 4461 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.229546:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fe07800/0x844e5faceb5f6792 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175c9 expref: 33 pid: 4461 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746155636.229552:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009045d180 00000100:00100000:0.0:1746155636.234926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.234974:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.235057:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125770112 00000100:00100000:1.0:1746155636.235064:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125770112 00000100:00100000:1.0:1746155636.235091:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16443 00000100:00100000:1.0:1746155636.235097:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:32085:x1830976125770112:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155636.235108:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.235121:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df28800/0x844e5faceb5f67b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f175e5 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.235139:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155636.235141:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155636.235151:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012df28800/0x844e5faceb5f67b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175e5 expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.235164:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012df28800/0x844e5faceb5f67b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175e5 expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.235174:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df28800, rc 0) 00000100:00100000:1.0:1746155636.235197:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:32085:x1830976125770112:12345-192.168.202.51@tcp:101:cat.0 Request processed in 100us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.235202:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16443 00010000:00010000:0.0:1746155636.235557:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012df29e00/0x844e5faceb5f67ae lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155636.235563:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df29e00/0x844e5faceb5f67ae lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155636.235579:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155636.235689:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df28a00/0x844e5faceb5f67a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175de expref: 296 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.235702:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df29e00/0x844e5faceb5f67ae lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175de expref: 295 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.235707:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155636.235709:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155636.235710:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df29e00, rc 0) 00000100:00100000:0.0:1746155636.235731:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:32092:x1830976125769856:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7432us (9812us total) trans 8589945142 rc 0/0 00000100:00100000:0.0:1746155636.235736:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11006 00000100:00100000:0.0:1746155636.240499:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.240891:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.243467:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.247270:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.247304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.247385:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125770880 00000100:00100000:1.0:1746155636.247391:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125770880 00002000:00100000:1.0:1746155636.247427:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009045dc00 x1830976125770880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.247436:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045dc00 with x1830976125770880 ext(4194304->5083135) 00002000:00010000:1.0:1746155636.247440:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045dc00 00000100:00100000:1.0:1746155636.247455:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125771136 00000100:00100000:1.0:1746155636.247457:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125771136 00002000:00100000:1.0:1746155636.247467:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2818048->2822143) req@ffff88009045ca80 x1830976125771136/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.247474:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045ca80 with x1830976125771136 ext(2818048->2822143) 00002000:00010000:1.0:1746155636.247476:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045ca80 00000100:00100000:1.0:1746155636.247493:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7789 00000100:00100000:1.0:1746155636.247500:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976125770880:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155636.258644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.259106:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976125770880:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11605us (11841us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155636.259114:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7789 00002000:00100000:1.0:1746155636.259123:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009045dc00 x1830976125770880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.259131:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045dc00 with x1830976125770880 ext(4194304->5083135) 00002000:00010000:1.0:1746155636.259135:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045dc00 00000100:00080000:0.0:1746155636.259183:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155636.266218:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.267139:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.267162:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.267185:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.267204:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.267655:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16446 00000100:00100000:0.0:1746155636.267661:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1961:x1830976125771776:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155636.267671:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155636.267678:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009421e400/0x844e5faceb5f67d1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17601 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155636.267699:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125281024:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155636.267725:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155636.268857:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125281024:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155636.268873:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009421e400/0x844e5faceb5f67d1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17601 expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.268884:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009421e400/0x844e5faceb5f67d1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17601 expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.271017:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009421e400, rc 0) 00000100:00100000:1.0:1746155636.271058:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976125771776:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3395us (3892us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155636.271066:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16446 00000100:00100000:1.0:1746155636.271351:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125772160 00000100:00100000:1.0:1746155636.271358:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125772160 00002000:00100000:1.0:1746155636.271386:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e2:0x0] (2326528->2330623) req@ffff8800a01d0380 x1830976125772160/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.271394:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d0380 with x1830976125772160 ext(2326528->2330623) 00002000:00010000:1.0:1746155636.271398:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01d0380 00000100:00100000:1.0:1746155636.271422:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7791 00000100:00100000:1.0:1746155636.271428:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976125772160:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155636.271564:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976125772160:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 135us (271us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155636.271569:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7791 00002000:00100000:1.0:1746155636.271575:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e2:0x0] (2326528->2330623) req@ffff8800a01d0380 x1830976125772160/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/4536 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.271581:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d0380 with x1830976125772160 ext(2326528->2330623) 00002000:00010000:1.0:1746155636.271584:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01d0380 00000100:00100000:0.0:1746155636.272728:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.272780:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125772416 00000100:00100000:1.0:1746155636.272784:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125772416 00000100:00100000:0.0:1746155636.272792:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.272869:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125772288 00000100:00100000:1.0:1746155636.272872:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125772288 00000100:00100000:1.0:1746155636.272889:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16448 00000100:00100000:1.0:1746155636.272894:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976125772416:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155636.272903:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.272915:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbcea00/0x844e5faceb5f67df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1760f expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155636.272951:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125281152:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155636.273017:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155636.275554:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125281152:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155636.275579:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbcea00/0x844e5faceb5f67df lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1760f expref: 31 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.275589:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbcea00/0x844e5faceb5f67df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1760f expref: 31 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.275597:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbcea00, rc 0) 00000100:00100000:1.0:1746155636.275626:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976125772416:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2732us (2901us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155636.275633:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16448 00000100:00100000:0.0:1746155636.282657:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.282694:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.282725:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.282747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.282807:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125772672 00000100:00100000:1.0:1746155636.282811:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125772672 00000100:00100000:1.0:1746155636.282836:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4650 00000100:00100000:1.0:1746155636.282841:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32090:x1830976125772672:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155636.283008:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32090:x1830976125772672:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 165us (358us total) trans 8589945143 rc 0/0 00000100:00100000:1.0:1746155636.283014:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4650 00000100:00100000:1.0:1746155636.283034:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125773056 00000100:00100000:1.0:1746155636.283036:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125773056 00000100:00100000:1.0:1746155636.283052:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125773184 00000100:00100000:1.0:1746155636.283054:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125773184 00000100:00100000:1.0:1746155636.283066:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16450 00000100:00100000:1.0:1746155636.283071:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976125773056:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155636.283080:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.283092:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f67ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17616 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.283113:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f67ed lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17616 expref: 35 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.283122:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f67ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17616 expref: 35 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.283130:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbcee00, rc 0) 00000100:00100000:1.0:1746155636.283145:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976125773056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 73us (419us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155636.283150:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16450 00000100:00100000:1.0:1746155636.283159:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16451 00000100:00100000:1.0:1746155636.283163:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125773184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155636.283169:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.283176:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbce400/0x844e5faceb5f67f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1761d expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155636.283208:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125281280:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155636.283253:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155636.287521:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125281280:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155636.287550:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbce400/0x844e5faceb5f67f4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1761d expref: 31 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.287562:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbce400/0x844e5faceb5f67f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1761d expref: 31 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.287573:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbce400, rc 0) 00000100:00100000:1.0:1746155636.287607:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125773184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4443us (4859us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155636.287615:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16451 00000100:00100000:0.0:1746155636.301762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.303355:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125773312 00000100:00100000:1.0:1746155636.303364:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125773312 00000100:00100000:1.0:1746155636.303418:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16452 00000100:00100000:1.0:1746155636.303425:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976125773312:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155636.303441:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.303455:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff00400/0x844e5faceb5f67fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17624 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.303483:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff00400/0x844e5faceb5f67fb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17624 expref: 32 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.303497:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff00400/0x844e5faceb5f67fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17624 expref: 32 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.303555:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff00400, rc 0) 00000100:00100000:1.0:1746155636.303601:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976125773312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 175us (1844us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155636.303606:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16452 00000100:00100000:0.0:1746155636.307750:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155636.307995:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01be200/0x844e5faceb5f6802 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1762b expref: 32 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155636.308022:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01be200, rc 0) 00000100:00100000:3.0:1746155636.308057:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976125773440:12345-192.168.202.51@tcp:101:cat.0 Request processed in 157us (314us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155636.308063:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16453 00000100:00100000:0.0:1746155636.311162:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.311221:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125773696 00000100:00100000:3.0:1746155636.311228:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125773696 00000100:00100000:3.0:1746155636.311267:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4651 00000100:00100000:3.0:1746155636.311274:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32085:x1830976125773696:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155636.311443:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32085:x1830976125773696:12345-192.168.202.51@tcp:35:cat.0 Request processed in 169us (286us total) trans 8589945144 rc 0/0 00000100:00100000:3.0:1746155636.311449:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4651 00000100:00100000:0.0:1746155636.339106:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.339215:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125773824 00000100:00100000:3.0:1746155636.339223:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125773824 00000100:00100000:3.0:1746155636.339847:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16454 00000100:00100000:3.0:1746155636.339855:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fe8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:32092:x1830976125773824:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155636.339871:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155636.339885:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17632 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.339910:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012df28000/0x844e5faceb5f67a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d7 expref: 30 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.339917:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155636.339918:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155636.339921:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.339943:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012df28000/0x844e5faceb5f67a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d7 expref: 30 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.339953:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012df28000/0x844e5faceb5f67a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d7 expref: 30 pid: 29728 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.339963:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125281408:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155636.340046:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155636.342448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.342813:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125281408:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155636.342833:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.342844:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01bfc00, rc 0) 00000100:00100000:3.0:1746155636.342884:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fe8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:32092:x1830976125773824:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3030us (3786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.342891:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16454 00000100:00100000:0.0:1746155636.350793:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.351545:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125774080 00000100:00100000:3.0:1746155636.351553:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125774080 00010000:00010000:3.0:1746155636.351581:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012df28000/0x844e5faceb5f67a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d7 expref: 33 pid: 29728 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.351616:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8437 00000100:00100000:3.0:1746155636.351622:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1961:x1830976125774080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.351633:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155636.351651:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012df28000/0x844e5faceb5f67a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d7 expref: 33 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.351661:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012df28000/0x844e5faceb5f67a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d7 expref: 33 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.351678:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df28000/0x844e5faceb5f67a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2818048->3145727] (req 2818048->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d7 expref: 33 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.351689:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.351691:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.351696:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.351703:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.351730:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155636.351746:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125281536:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155636.352677:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155636.354450:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125281536:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155636.354466:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.354549:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1961:x1830976125774080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2925us (3761us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.354558:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8437 00000100:00100000:0.0:1746155636.354740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.360037:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.362041:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125774464 00000100:00100000:3.0:1746155636.362051:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125774464 00000100:00100000:3.0:1746155636.362110:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16455 00000100:00100000:3.0:1746155636.362117:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:32092:x1830976125774464:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155636.362132:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155636.362147:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17639 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.362173:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da29600/0x844e5faceb5f67ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175f3 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.362180:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155636.362182:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155636.362185:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->2519039] (req 2097152->2519039) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.362210:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da29600/0x844e5faceb5f67ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175f3 expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.362221:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da29600/0x844e5faceb5f67ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175f3 expref: 19 pid: 29728 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.362231:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125281664:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155636.362316:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155636.367675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.367750:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125281664:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155636.367772:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->2519039] (req 2097152->2519039) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.367803:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01bf000, rc 0) 00000100:00100000:3.0:1746155636.367838:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:32092:x1830976125774464:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5721us (7807us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.367845:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16455 00000100:00100000:0.0:1746155636.375865:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.376019:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125774720 00000100:00100000:3.0:1746155636.376026:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125774720 00010000:00010000:3.0:1746155636.376052:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da29600/0x844e5faceb5f67ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175f3 expref: 22 pid: 29728 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.376203:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8438 00000100:00100000:3.0:1746155636.376210:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976125774720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.376220:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155636.376237:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da29600/0x844e5faceb5f67ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175f3 expref: 22 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.376249:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da29600/0x844e5faceb5f67ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175f3 expref: 22 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.376267:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da29600/0x844e5faceb5f67ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2330623) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175f3 expref: 22 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.376293:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.376294:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.376300:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.376311:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.376337:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155636.376347:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125281792:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155636.376410:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155636.379774:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125281792:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155636.379792:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.379828:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976125774720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3618us (3968us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.379837:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8438 00000100:00100000:0.0:1746155636.383977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.402460:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.408428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.408537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.408651:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125775360 00000100:00100000:3.0:1746155636.408659:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125775360 00000100:00100000:1.0:1746155636.408669:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125775488 00000100:00100000:1.0:1746155636.408673:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125775488 00000100:00100000:1.0:1746155636.408699:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11008 00000100:00100000:3.0:1746155636.408702:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 730 00000100:00100000:1.0:1746155636.408705:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32099:x1830976125775488:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:3.0:1746155636.408709:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976125775360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.408719:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155636.408723:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.408735:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00200/0x844e5faceb5f683a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17647 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.408736:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da29600/0x844e5faceb5f682c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17640 expref: 19 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.408749:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155636.408753:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.408782:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976125775360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 74us (360us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155636.408782:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01a00/0x844e5faceb5f6841 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155636.408788:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 730 00010000:00010000:1.0:1746155636.408791:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01a00/0x844e5faceb5f6841 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.408798:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01a00/0x844e5faceb5f6841 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.408807:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f6848 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.408812:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f6848 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.408817:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f6848 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.408900:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.408908:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df29e00/0x844e5faceb5f67ae lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175de expref: 294 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.408913:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.408935:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012df29e00/0x844e5faceb5f67ae lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175de expref: 294 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.408944:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df29e00/0x844e5faceb5f67ae lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175de expref: 294 pid: 15474 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.408953:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125281920:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155636.409031:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155636.410718:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.410777:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125281920:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155636.410783:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125775744 00000100:00100000:3.0:1746155636.410788:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125775744 00010000:00010000:1.0:1746155636.410790:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155636.410815:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4652 00000100:00100000:3.0:1746155636.410820:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:27128:x1830976125775744:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746155636.410958:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:27128:x1830976125775744:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 137us (242us total) trans 8589945146 rc 0/0 00000100:00100000:3.0:1746155636.410973:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4652 00000100:00100000:0.0:1746155636.414497:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.414603:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125775872 00000100:00100000:3.0:1746155636.414610:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125775872 00010000:00010000:3.0:1746155636.414638:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df29e00/0x844e5faceb5f67ae lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175de expref: 296 pid: 15474 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.414662:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8439 00000100:00100000:3.0:1746155636.414674:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:1962:x1830976125775872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.414685:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155636.414689:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012df29e00/0x844e5faceb5f67ae lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175de expref: 296 pid: 15474 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.414699:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012df29e00/0x844e5faceb5f67ae lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175de expref: 296 pid: 15474 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.414716:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df29e00/0x844e5faceb5f67ae lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175de expref: 296 pid: 15474 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.414727:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155636.414732:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.414739:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.414745:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.414761:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.414792:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1962:x1830976125775872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 119us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.414798:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8439 00010000:00010000:1.0:1746155636.415350:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415357:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155636.415393:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155636.415397:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155636.415410:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415418:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415425:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01a00/0x844e5faceb5f6841 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415430:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01a00/0x844e5faceb5f6841 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415434:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01a00/0x844e5faceb5f6841 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415439:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ff01a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155636.415442:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01a00/0x844e5faceb5f6841 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415448:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01a00/0x844e5faceb5f6841 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415456:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155636.415458:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155636.415461:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01a00/0x844e5faceb5f6841 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415465:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01a00/0x844e5faceb5f6841 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415488:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f6848 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415493:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f6848 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415498:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f6848 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415518:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ff01400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155636.415520:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f6848 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415524:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f6848 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415530:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b537e200) 00010000:00010000:1.0:1746155636.415532:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155636.415534:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f6848 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415542:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f6848 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.415573:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00200/0x844e5faceb5f683a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17647 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.415582:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17647 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.415588:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155636.415590:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155636.415592:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff00600, rc 0) 00000100:00100000:1.0:1746155636.415628:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32099:x1830976125775488:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 6923us (7125us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.415635:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11008 00000100:00100000:0.0:1746155636.420653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.420782:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125776000 00000100:00100000:3.0:1746155636.420789:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125776000 00000100:00100000:3.0:1746155636.420835:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16456 00000100:00100000:3.0:1746155636.420842:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976125776000:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155636.420856:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155636.420870:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01bec00/0x844e5faceb5f6856 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1764e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.420887:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.420889:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.420896:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01bec00/0x844e5faceb5f6856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1764e expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155636.420909:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01bec00/0x844e5faceb5f6856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1764e expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155636.420918:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01bec00, rc 0) 00000100:00100000:3.0:1746155636.420974:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125776000:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 123us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.420980:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16456 00000100:00100000:0.0:1746155636.425891:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.425936:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.426032:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125776128 00000100:00100000:1.0:1746155636.426040:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125776128 00000100:00100000:1.0:1746155636.426083:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125776256 00000100:00100000:1.0:1746155636.426086:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125776256 00000100:00100000:1.0:1746155636.426101:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16457 00000100:00100000:1.0:1746155636.426108:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125776128:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155636.426122:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.426136:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff01c00/0x844e5faceb5f685d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17655 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.426163:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff01c00/0x844e5faceb5f685d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17655 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.426173:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff01c00/0x844e5faceb5f685d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17655 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.426183:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff01c00, rc 0) 00000100:00100000:1.0:1746155636.426216:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125776128:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 108us (337us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155636.426221:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16457 00000100:00100000:1.0:1746155636.426234:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16458 00000100:00100000:1.0:1746155636.426238:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125776256:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155636.426245:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.426252:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ff00800/0x844e5faceb5f6864 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1765c expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155636.426288:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125282048:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155636.426339:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155636.430350:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125282048:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155636.430383:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ff00800/0x844e5faceb5f6864 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1765c expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.430395:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ff00800/0x844e5faceb5f6864 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1765c expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.430405:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff00800, rc 0) 00000100:00100000:1.0:1746155636.430445:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125776256:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4204us (4506us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155636.430452:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16458 00000100:00100000:0.0:1746155636.432297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.432446:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125776512 00000100:00100000:1.0:1746155636.432453:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125776512 00000100:00100000:1.0:1746155636.432498:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11009 00000100:00100000:1.0:1746155636.432530:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32099:x1830976125776512:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155636.432545:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.432558:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00000/0x844e5faceb5f686b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17663 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.432645:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f6872 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.432657:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17647 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.432663:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f6872 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155636.432687:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17647 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.432696:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00600/0x844e5faceb5f684f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17647 expref: 10 pid: 27374 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.432706:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125282176:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155636.433926:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155636.438954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.439163:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125282176:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155636.439180:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f6872 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.441190:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f6872 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155636.441196:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f6872 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155636.441212:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155636.441339:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00000/0x844e5faceb5f686b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17663 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.441357:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f6872 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17663 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.441362:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155636.441364:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155636.441365:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff00a00, rc 0) 00000100:00100000:0.0:1746155636.441390:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32099:x1830976125776512:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 8886us (9098us total) trans 8589945147 rc 0/0 00000100:00100000:0.0:1746155636.441395:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11009 00000100:00100000:0.0:1746155636.444885:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.447470:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.448363:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125776896 00000100:00100000:3.0:1746155636.448369:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125776896 00010000:00010000:3.0:1746155636.448396:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f6872 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17663 expref: 12 pid: 27374 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.448425:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8441 00000100:00100000:3.0:1746155636.448432:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976125776896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.448442:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155636.448447:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f6872 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17663 expref: 12 pid: 27374 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.448455:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f6872 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17663 expref: 12 pid: 27374 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.448471:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f6872 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17663 expref: 12 pid: 27374 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.448484:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155636.448488:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012da29c00/0x844e5faceb5f6887 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.448496:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da29c00/0x844e5faceb5f6887 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.448516:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012da29c00/0x844e5faceb5f6887 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.448533:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.448563:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976125776896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 132us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.448569:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8441 00010000:00010000:3.0:1746155636.448593:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012da29c00/0x844e5faceb5f6887 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.448599:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012da29c00/0x844e5faceb5f6887 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155636.449394:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155636.449399:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155636.449412:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012da29c00/0x844e5faceb5f6887 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.449436:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da29e00/0x844e5faceb5f6880 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1766a expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.449447:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012da29c00/0x844e5faceb5f6887 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1766a expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.449452:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155636.449455:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155636.449457:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012da29c00, rc 0) 00000100:00100000:3.0:1746155636.449490:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32099:x1830976125776768:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4453us (4612us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.449495:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11010 00000100:00100000:1.0:1746155636.452651:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125777024 00000100:00100000:1.0:1746155636.452658:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125777024 00000100:00100000:1.0:1746155636.452689:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125777152 00000100:00100000:1.0:1746155636.452691:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125777152 00000100:00100000:1.0:1746155636.452868:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16459 00000100:00100000:1.0:1746155636.452875:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976125777024:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155636.452889:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155636.452933:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16460 00000100:00100000:0.0:1746155636.452940:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125777152:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155636.452947:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155636.452957:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009421e800/0x844e5faceb5f688e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17678 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155636.453011:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125282432:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155636.453063:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332d80 going to sleep for 11 seconds 00010000:00010000:1.0:1746155636.453429:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff00800/0x844e5faceb5f6895 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17671 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.453448:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff00800/0x844e5faceb5f6895 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17671 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.453461:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff00800/0x844e5faceb5f6895 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17671 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155636.453473:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff00800, rc 0) 00000100:00100000:1.0:1746155636.453496:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976125777024:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 623us (1253us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155636.453520:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16459 00000100:00100000:0.0:1746155636.462103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.463313:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125777408 00000100:00100000:3.0:1746155636.463322:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125777408 00000100:00100000:3.0:1746155636.463366:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11011 00000100:00100000:3.0:1746155636.463372:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32099:x1830976125777408:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155636.463387:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155636.463400:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bf800/0x844e5faceb5f689c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1767f expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.463469:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be800/0x844e5faceb5f68a3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.463480:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be800/0x844e5faceb5f68a3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.463489:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be800/0x844e5faceb5f68a3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.463499:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be800/0x844e5faceb5f68a3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.463523:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be800/0x844e5faceb5f68a3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.463528:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be800/0x844e5faceb5f68a3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.463533:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01be800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155636.463536:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be800/0x844e5faceb5f68a3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.463541:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be800/0x844e5faceb5f68a3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.463549:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155636.463551:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155636.463554:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be800/0x844e5faceb5f68a3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.463558:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be800/0x844e5faceb5f68a3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155636.463579:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bf800/0x844e5faceb5f689c lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1767f expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.463585:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bf800/0x844e5faceb5f689c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1767f expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.463591:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01bf800, rc 0) 00000100:00100000:3.0:1746155636.463636:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32099:x1830976125777408:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 263us (1539us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155636.463641:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11011 00000100:00100000:3.0:1746155636.467120:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125777664 00000100:00100000:3.0:1746155636.467127:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125777664 00000100:00100000:3.0:1746155636.467621:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4653 00000100:00100000:3.0:1746155636.467629:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d0dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32099:x1830976125777664:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155636.467792:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d0dd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:32099:x1830976125777664:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 163us (881us total) trans 8589945148 rc 0/0 00000100:00100000:3.0:1746155636.467797:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4653 00000100:00100000:0.0:1746155636.511954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.514399:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.515637:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125282560:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155636.515802:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125282816:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155636.518301:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.518328:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.518344:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.518355:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125778176 00000100:00100000:0.0:1746155636.518359:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.518361:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125778176 00010000:00010000:3.0:1746155636.518387:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f17a000/0x844e5faceb5f6626 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17513 expref: 31 pid: 29728 timeout: 865 lvb_type: 1 00000100:00100000:0.0:1746155636.518390:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.518520:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125778688 00000100:00100000:0.0:1746155636.518520:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125778304 00000100:00100000:3.0:1746155636.518523:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125778688 00000100:00100000:0.0:1746155636.518523:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125778304 00010000:00010000:3.0:1746155636.518535:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012da29c00/0x844e5faceb5f6887 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1766a expref: 11 pid: 27374 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.518543:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009421e200/0x844e5faceb5f66f8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1756e expref: 11 pid: 18270 timeout: 865 lvb_type: 1 00000100:00100000:3.0:1746155636.518550:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8442 00000100:00100000:3.0:1746155636.518556:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976125778176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.518565:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155636.518582:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f17a000/0x844e5faceb5f6626 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17513 expref: 31 pid: 29728 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746155636.518591:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f17a000/0x844e5faceb5f6626 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17513 expref: 32 pid: 29728 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746155636.518608:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f17a000/0x844e5faceb5f6626 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17513 expref: 32 pid: 29728 timeout: 865 lvb_type: 1 00010000:00010000:3.0:1746155636.518623:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.518650:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976125778176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 94us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155636.519189:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8443 00000100:00100000:0.0:1746155636.519196:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125778688:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155636.519204:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155636.519210:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012da29c00/0x844e5faceb5f6887 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1766a expref: 11 pid: 27374 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.519219:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012da29c00/0x844e5faceb5f6887 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1766a expref: 11 pid: 27374 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.519231:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012da29c00/0x844e5faceb5f6887 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1766a expref: 11 pid: 27374 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.519242:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155636.519246:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f68b8 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155636.519253:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f68b8 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155636.519258:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f68b8 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155636.519270:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155636.519286:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125778688:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 91us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155636.519291:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8443 00000100:00100000:0.0:1746155636.519303:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8444 00000100:00100000:0.0:1746155636.519308:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125778304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155636.519313:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155636.519322:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009421e200/0x844e5faceb5f66f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1756e expref: 11 pid: 18270 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746155636.519330:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009421e200/0x844e5faceb5f66f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1756e expref: 11 pid: 18270 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746155636.519340:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009421e200/0x844e5faceb5f66f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1756e expref: 11 pid: 18270 timeout: 865 lvb_type: 1 00010000:00010000:0.0:1746155636.519348:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155636.519361:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125778304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 53us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155636.519365:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8444 00000100:00100000:3.0:1746155636.520108:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8442 00000100:00100000:1.0:1746155636.520657:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125778816 00000100:00100000:1.0:1746155636.520662:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125778816 00010000:00010000:1.0:1746155636.520683:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801303a1000/0x844e5faceb5f660a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174f7 expref: 22 pid: 29728 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.520699:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8445 00000100:00100000:1.0:1746155636.520705:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125778816:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155636.520712:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155636.520721:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801303a1000/0x844e5faceb5f660a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174f7 expref: 22 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.520729:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801303a1000/0x844e5faceb5f660a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174f7 expref: 22 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.520772:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801303a1000/0x844e5faceb5f660a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174f7 expref: 22 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.520793:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155636.520796:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155636.520800:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.520807:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.520831:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 21 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155636.520840:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125283072:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155636.520878:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155636.524646:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125283072:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155636.524664:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155636.524715:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976125778816:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4008us (4322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.524724:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8445 00000100:00100000:0.0:1746155636.525480:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.529697:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.529788:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125779200 00000100:00100000:0.0:1746155636.529794:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125779200 00000100:00100000:0.0:1746155636.529922:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16464 00000100:00100000:0.0:1746155636.529930:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:32105:x1830976125779200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155636.529943:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155636.529957:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009421ea00/0x844e5faceb5f68d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f176a2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.529988:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 20 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.529995:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155636.529996:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155636.530000:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009421ea00/0x844e5faceb5f68d4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a2 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.530022:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 20 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155636.530035:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 20 pid: 29728 timeout: 865 lvb_type: 0 00000100:00100000:0.0:1746155636.530045:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137123480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125283200:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155636.530679:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155636.539198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.539292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.539679:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125779456 00000100:00100000:1.0:1746155636.539683:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125779456 00002000:00100000:1.0:1746155636.539706:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1261568->2097151) req@ffff880137123480 x1830976125779456/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.539714:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123480 with x1830976125779456 ext(1261568->2097151) 00010000:00010000:1.0:1746155636.539720:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 21 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.539729:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 21 pid: 29728 timeout: 865 lvb_type: 0 00002000:00010000:1.0:1746155636.539739:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880137123480 00000100:00100000:1.0:1746155636.540298:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1334 00000100:00100000:1.0:1746155636.540304:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1961:x1830976125779456:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155636.545943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.546076:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125283328:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155636.546085:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125283456:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155636.546092:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125283584:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155636.546116:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1048576->1060863] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.546135:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091001400, rc 0) 00000100:00100000:3.0:1746155636.546168:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:32098:x1830976125779584:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6725us (6876us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.546174:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16465 00000100:00100000:1.0:1746155636.546279:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125779712 00000100:00100000:1.0:1746155636.546284:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125779712 00010000:00010000:1.0:1746155636.546307:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01bec00/0x844e5faceb5f6856 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1764e expref: 10 pid: 8437 timeout: 865 lvb_type: 1 00000100:00100000:1.0:1746155636.546324:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8446 00000100:00100000:1.0:1746155636.546329:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125779712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155636.546338:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155636.546353:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a01bec00/0x844e5faceb5f6856 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1764e expref: 10 pid: 8437 timeout: 865 lvb_type: 1 00010000:00010000:1.0:1746155636.546361:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a01bec00/0x844e5faceb5f6856 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1764e expref: 10 pid: 8437 timeout: 865 lvb_type: 1 00010000:00010000:1.0:1746155636.546376:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01bec00/0x844e5faceb5f6856 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1764e expref: 10 pid: 8437 timeout: 865 lvb_type: 1 00010000:00010000:1.0:1746155636.546388:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155636.546404:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125779712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 75us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.546408:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8446 00000100:00100000:0.0:1746155636.547568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.547616:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125779840 00000100:00100000:3.0:1746155636.547620:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125779840 00010000:00010000:3.0:1746155636.547636:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012da29200/0x844e5faceb5f6761 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175b4 expref: 33 pid: 29728 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.547653:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8447 00000100:00100000:3.0:1746155636.547657:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1960:x1830976125779840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.547664:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155636.547674:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012da29200/0x844e5faceb5f6761 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175b4 expref: 33 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.547682:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012da29200/0x844e5faceb5f6761 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175b4 expref: 33 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.547694:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012da29200/0x844e5faceb5f6761 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175b4 expref: 33 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.547714:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.547730:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125779840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 73us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.547736:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8447 00000100:00100000:0.0:1746155636.548453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.548493:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125779968 00000100:00100000:1.0:1746155636.548497:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125779968 00010000:00010000:1.0:1746155636.548538:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136a57e00/0x844e5faceb5f678b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175bb expref: 35 pid: 29728 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.548563:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8448 00000100:00100000:1.0:1746155636.548568:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1962:x1830976125779968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155636.548574:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155636.548582:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136a57e00/0x844e5faceb5f678b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175bb expref: 35 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.548590:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a57e00/0x844e5faceb5f678b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175bb expref: 35 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.548600:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a57e00/0x844e5faceb5f678b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175bb expref: 35 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.548608:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155636.548609:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155636.548614:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.548620:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.548642:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155636.548656:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125283712:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155636.548716:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155636.553776:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.553982:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125780224 00000100:00100000:3.0:1746155636.553989:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125780224 00000100:00100000:3.0:1746155636.554041:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11013 00000100:00100000:3.0:1746155636.554052:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32108:x1830976125780224:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155636.554069:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155636.554084:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bfe00/0x844e5faceb5f68e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f176b0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.554173:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be000/0x844e5faceb5f68e9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554184:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be000/0x844e5faceb5f68e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554193:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be000/0x844e5faceb5f68e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554207:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bf400/0x844e5faceb5f68f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554215:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bf400/0x844e5faceb5f68f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554221:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bf400/0x844e5faceb5f68f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554303:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bea00/0x844e5faceb5f68f7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554311:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bea00/0x844e5faceb5f68f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554316:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bea00/0x844e5faceb5f68f7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155636.554324:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155636.554386:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be000/0x844e5faceb5f68e9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554392:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be000/0x844e5faceb5f68e9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554397:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be000/0x844e5faceb5f68e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554401:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01be000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155636.554404:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be000/0x844e5faceb5f68e9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554410:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be000/0x844e5faceb5f68e9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554418:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155636.554421:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155636.554424:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be000/0x844e5faceb5f68e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554429:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01be000/0x844e5faceb5f68e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554438:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bf400/0x844e5faceb5f68f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554443:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bf400/0x844e5faceb5f68f0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554447:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bf400/0x844e5faceb5f68f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554454:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01bf400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155636.554456:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bf400/0x844e5faceb5f68f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554461:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bf400/0x844e5faceb5f68f0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554465:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c823a00) 00010000:00010000:3.0:1746155636.554467:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155636.554469:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bf400/0x844e5faceb5f68f0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.554473:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bf400/0x844e5faceb5f68f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155636.554623:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125283712:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155636.554642:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155636.554834:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1962:x1830976125779968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6265us (6381us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155636.554859:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bfe00/0x844e5faceb5f68e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176b0 expref: 21 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155636.555043:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8448 00010000:00010000:3.0:1746155636.555088:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bea00/0x844e5faceb5f68f7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176b0 expref: 20 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.555095:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155636.555096:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155636.555098:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01bea00, rc 0) 00000100:00100000:3.0:1746155636.555130:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32108:x1830976125780224:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1082us (1358us total) trans 8589945150 rc 0/0 00000100:00100000:3.0:1746155636.555136:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11013 00000100:00100000:3.0:1746155636.555154:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125780480 00000100:00100000:3.0:1746155636.555156:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125780480 00002000:00100000:3.0:1746155636.555175:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e3:0x0] (1056768->1060863) req@ffff88012f1f3480 x1830976125780480/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.555184:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3480 with x1830976125780480 ext(1056768->1060863) 00002000:00010000:3.0:1746155636.555188:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3480 00000100:00100000:3.0:1746155636.555810:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7796 00000100:00100000:3.0:1746155636.555817:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1961:x1830976125780480:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155636.556981:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1961:x1830976125780480:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 1162us (3209us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155636.556989:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7796 00002000:00100000:3.0:1746155636.556995:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e3:0x0] (1056768->1060863) req@ffff88012f1f3480 x1830976125780480/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/4536 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.557002:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3480 with x1830976125780480 ext(1056768->1060863) 00002000:00010000:3.0:1746155636.557006:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3480 00000100:00100000:0.0:1746155636.557137:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976125779456:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 16831us (17944us total) trans 21474841462 rc 0/0 00000100:00100000:0.0:1746155636.557144:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1334 00002000:00100000:0.0:1746155636.557149:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1261568->2097151) req@ffff880137123480 x1830976125779456/t21474841462(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/448 e 0 to 0 dl 1746155647 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155636.557155:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137123480 with x1830976125779456 ext(1261568->2097151) 00010000:00010000:0.0:1746155636.557162:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 23 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.557173:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 23 pid: 29728 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746155636.557179:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880137123480 00000100:00100000:0.0:1746155636.559418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.560195:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125780608 00000100:00100000:1.0:1746155636.560203:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125780608 00000100:00100000:1.0:1746155636.560467:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 731 00000100:00100000:1.0:1746155636.560475:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976125780608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155636.560488:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155636.560680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.560714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.560742:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.560753:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125780992 00000100:00100000:3.0:1746155636.560757:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125780992 00000100:00100000:3.0:1746155636.560764:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125781120 00000100:00100000:3.0:1746155636.560765:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125781120 00000100:00100000:0.0:1746155636.560771:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155636.560778:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 24 pid: 29728 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.560794:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8449 00000100:00100000:3.0:1746155636.560799:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976125781120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.560806:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746155636.560820:0:7063:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155636 -> 1746155637 00002000:00010000:3.0:1746155636.560822:0:7063:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155636 -> 1746155637 00010000:00010000:3.0:1746155636.560827:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 24 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.560836:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 24 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.560850:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012da29a00/0x844e5faceb5f68aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1261568->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17686 expref: 24 pid: 29728 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.560862:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.560863:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.560868:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009421ea00/0x844e5faceb5f68d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a2 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.560874:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009421ea00/0x844e5faceb5f68d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a2 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.560899:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009421ea00/0x844e5faceb5f68d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a2 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155636.560909:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125283840:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155636.560979:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155636.560995:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125781248 00000100:00100000:3.0:1746155636.560998:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125781248 00000100:00100000:3.0:1746155636.561017:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16466 00000100:00100000:3.0:1746155636.561021:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125781248:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155636.561032:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155636.561042:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01be400/0x844e5faceb5f6905 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f176be expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.561058:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01be400/0x844e5faceb5f6905 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176be expref: 33 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155636.561065:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01be400/0x844e5faceb5f6905 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176be expref: 33 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155636.561072:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01be400, rc 0) 00000100:00100000:3.0:1746155636.561095:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125781248:12345-192.168.202.51@tcp:101:cat.0 Request processed in 73us (322us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155636.561100:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16466 00010000:00010000:1.0:1746155636.561123:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01bea00/0x844e5faceb5f68f7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176b0 expref: 21 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155636.561125:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16467 00010000:00010000:1.0:1746155636.561138:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155636.561142:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.561145:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976125780992:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155636.561150:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155636.561156:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a01bec00/0x844e5faceb5f690c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f176b7 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155636.561162:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976125780608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 689us (1749us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155636.561164:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.561166:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746155636.561168:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 731 00010000:00010000:3.0:1746155636.561169:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01bec00/0x844e5faceb5f690c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176b7 expref: 24 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155636.561178:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a01bec00/0x844e5faceb5f690c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176b7 expref: 24 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155636.561185:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01bec00, rc 0) 00000100:00100000:1.0:1746155636.561778:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.562626:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1961:x1830976125780992:12345-192.168.202.51@tcp:101:cat.0 Request processed in 69us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.562631:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16467 00000100:00100000:3.0:1746155636.564625:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125283840:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155636.564645:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.564707:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1961:x1830976125781120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3904us (3961us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.564716:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8449 00000100:00100000:0.0:1746155636.566951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.578635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.578667:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.578753:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125781888 00000100:00100000:3.0:1746155636.578762:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125781888 00002000:00100000:3.0:1746155636.578797:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800910c8380 x1830976125781888/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.578806:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8380 with x1830976125781888 ext(1048576->2097151) 00002000:00010000:3.0:1746155636.578811:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c8380 00000100:00100000:3.0:1746155636.578824:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125782144 00000100:00100000:3.0:1746155636.578827:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125782144 00002000:00100000:3.0:1746155636.578838:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e3:0x0] (1060864->2097151) req@ffff8800910cb800 x1830976125782144/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.578843:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cb800 with x1830976125782144 ext(1060864->2097151) 00002000:00010000:3.0:1746155636.578846:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910cb800 00000100:00100000:3.0:1746155636.578863:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7798 00000100:00100000:3.0:1746155636.578871:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125781888:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155636.596058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.597408:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125782144:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18290us (18738us total) trans 0 rc 1036288/1036288 00000100:00100000:3.0:1746155636.597417:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7799 00002000:00100000:3.0:1746155636.597427:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e3:0x0] (1060864->2097151) req@ffff8800910cb800 x1830976125782144/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 1036288/1036288 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.597434:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cb800 with x1830976125782144 ext(1060864->2097151) 00010000:00010000:3.0:1746155636.597441:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 32 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.597452:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 32 pid: 8437 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746155636.597457:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910cb800 00000100:00100000:3.0:1746155636.599427:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125781888:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20551us (20793us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155636.599436:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7798 00002000:00100000:3.0:1746155636.599442:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800910c8380 x1830976125781888/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.599450:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8380 with x1830976125781888 ext(1048576->2097151) 00002000:00010000:3.0:1746155636.599454:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c8380 00000100:00100000:0.0:1746155636.601059:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.601301:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125782400 00000100:00100000:3.0:1746155636.601306:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125782400 00002000:00100000:3.0:1746155636.601334:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1060863) req@ffff8800910daa00 x1830976125782400/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 12776/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.601342:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910daa00 with x1830976125782400 ext(1048576->1060863) 00010000:00010000:3.0:1746155636.601348:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 32 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.601363:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 32 pid: 8437 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746155636.601369:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910daa00 00000100:00100000:3.0:1746155636.601394:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1335 00000100:00100000:3.0:1746155636.601401:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1962:x1830976125782400:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155636.601712:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1962:x1830976125782400:12345-192.168.202.51@tcp:4:cat.0 Request processed in 311us (653us total) trans 17179874129 rc 0/0 00000100:00100000:3.0:1746155636.601719:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1335 00002000:00100000:3.0:1746155636.601724:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1060863) req@ffff8800910daa00 x1830976125782400/t17179874129(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 12776/448 e 0 to 0 dl 1746155647 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.601730:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910daa00 with x1830976125782400 ext(1048576->1060863) 00010000:00010000:3.0:1746155636.601735:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 34 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.601744:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 34 pid: 8437 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746155636.601749:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910daa00 00000100:00100000:0.0:1746155636.606696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.606796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.607882:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125782528 00000100:00100000:3.0:1746155636.607887:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125782528 00010000:00010000:3.0:1746155636.607905:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 35 pid: 8437 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.607936:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8450 00000100:00100000:3.0:1746155636.607940:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1963:x1830976125782528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.607948:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746155636.607960:0:7063:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155636 -> 1746155637 00002000:00010000:3.0:1746155636.607971:0:7063:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155636 -> 1746155637 00010000:00010000:3.0:1746155636.607976:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 35 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.607985:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 35 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.607999:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091001400/0x844e5faceb5f68db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1060863) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a9 expref: 35 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.608020:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.608022:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.608027:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091000c00/0x844e5faceb5f691a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176cc expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.608033:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091000c00/0x844e5faceb5f691a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176cc expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.608039:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.608040:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.608042:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091000600/0x844e5faceb5f6921 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176d3 expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.608051:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091000600/0x844e5faceb5f6921 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176d3 expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.608071:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091000600/0x844e5faceb5f6921 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176d3 expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155636.608080:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125284224:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155636.608149:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091000c00/0x844e5faceb5f691a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176cc expref: 34 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155636.608157:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125284352:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155636.608179:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155636.609293:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125284224:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155636.610693:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.611157:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125284352:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155636.611173:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.611214:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1963:x1830976125782528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3272us (4417us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.611221:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8450 00000100:00100000:0.0:1746155636.612781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.613682:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125783040 00000100:00100000:1.0:1746155636.613687:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125783040 00000100:00100000:1.0:1746155636.613724:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16471 00000100:00100000:1.0:1746155636.613730:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:32103:x1830976125783040:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155636.613739:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.613754:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132b47000/0x844e5faceb5f6928 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f176da expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.613777:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a01be600/0x844e5faceb5f6799 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d0 expref: 37 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.613786:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012df28800/0x844e5faceb5f67b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175e5 expref: 35 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.613792:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746155636.613794:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746155636.613797:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132b47000/0x844e5faceb5f6928 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176da expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.613821:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012df28800/0x844e5faceb5f67b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175e5 expref: 35 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.613831:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012df28800/0x844e5faceb5f67b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175e5 expref: 35 pid: 4461 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.613842:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125284480:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155636.613901:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a01be600/0x844e5faceb5f6799 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d0 expref: 37 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.613913:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a01be600/0x844e5faceb5f6799 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d0 expref: 37 pid: 4461 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.613921:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125284608:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155636.613939:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155636.618606:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.618811:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125284480:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155636.618820:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125284608:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155636.618842:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132b47000/0x844e5faceb5f6928 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [4194304->4829183] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176da expref: 38 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155636.618848:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125783424 00000100:00100000:3.0:1746155636.618853:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125783424 00010000:00010000:1.0:1746155636.618857:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132b47000, rc 0) 00010000:00010000:3.0:1746155636.618874:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012df28800/0x844e5faceb5f67b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175e5 expref: 36 pid: 4461 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.618903:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8451 00000100:00100000:3.0:1746155636.618910:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:1961:x1830976125783424:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.618919:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155636.618935:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012df28800/0x844e5faceb5f67b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175e5 expref: 36 pid: 4461 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.618943:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012df28800/0x844e5faceb5f67b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175e5 expref: 36 pid: 4461 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.618960:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df28800/0x844e5faceb5f67b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175e5 expref: 36 pid: 4461 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.618993:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155636.619969:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:32103:x1830976125783040:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6229us (7179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.619977:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16471 00000100:00100000:3.0:1746155636.619985:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094086680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1961:x1830976125783424:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1074us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.619992:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8451 00000100:00100000:0.0:1746155636.621929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.622317:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125783552 00000100:00100000:3.0:1746155636.622324:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125783552 00010000:00010000:3.0:1746155636.622346:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01be600/0x844e5faceb5f6799 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d0 expref: 38 pid: 4461 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.622379:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8452 00000100:00100000:3.0:1746155636.622386:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1960:x1830976125783552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.622396:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155636.622412:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a01be600/0x844e5faceb5f6799 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d0 expref: 38 pid: 4461 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.622426:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a01be600/0x844e5faceb5f6799 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d0 expref: 38 pid: 4461 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.622444:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01be600/0x844e5faceb5f6799 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f175d0 expref: 38 pid: 4461 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.622455:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.622457:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.622462:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132b47000/0x844e5faceb5f6928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176da expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.622469:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132b47000/0x844e5faceb5f6928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176da expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.622494:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880132b47000/0x844e5faceb5f6928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176da expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155636.622525:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125284736:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155636.622577:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155636.623179:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976125783296:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9637us (9769us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155636.623186:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7801 00002000:00100000:3.0:1746155636.623191:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012f1f3b80 x1830976125783296/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.623204:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3b80 with x1830976125783296 ext(1048576->2097151) 00002000:00010000:3.0:1746155636.623207:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3b80 00000100:00100000:3.0:1746155636.626977:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125284736:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155636.626995:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.627296:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976125783552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4909us (5369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.627304:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8452 00000100:00100000:0.0:1746155636.628342:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.628426:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125783680 00000100:00100000:1.0:1746155636.628431:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125783680 00000100:00100000:1.0:1746155636.628582:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16472 00000100:00100000:1.0:1746155636.628590:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:32105:x1830976125783680:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155636.628604:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.628619:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009421ec00/0x844e5faceb5f692f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f176e1 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.628643:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.628650:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155636.628652:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155636.628655:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009421ec00/0x844e5faceb5f692f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176e1 expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.628678:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.628688:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 36 pid: 8437 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.628698:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125284864:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155636.628760:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155636.631289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.631320:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.632779:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125783808 00000100:00100000:3.0:1746155636.632787:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125783808 00000100:00100000:3.0:1746155636.632830:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125783936 00000100:00100000:3.0:1746155636.632833:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125783936 00000100:00100000:3.0:1746155636.632853:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16473 00000100:00100000:3.0:1746155636.632860:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1962:x1830976125783808:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155636.632874:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155636.632887:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a01be800/0x844e5faceb5f6936 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f176e8 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155636.632937:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125284992:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155636.633006:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43cef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155636.633430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.633493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:3.0:1746155636.635033:0:29728:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155636 -> 1746155637 00002000:00010000:3.0:1746155636.635037:0:29728:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155636 -> 1746155637 00002000:00010000:3.0:1746155636.635038:0:29728:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime: 1746155636 -> 1746155637 00000100:00100000:3.0:1746155636.635047:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125284992:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155636.635064:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a01be800/0x844e5faceb5f6936 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176e8 expref: 34 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155636.635078:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01be800/0x844e5faceb5f6936 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176e8 expref: 34 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155636.635604:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01be800, rc 0) 00000100:00100000:3.0:1746155636.635632:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1962:x1830976125783808:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2772us (4346us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155636.635638:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16473 00000100:00100000:3.0:1746155636.638377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.639144:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976125784192:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5415us (5649us total) trans 17179874130 rc 0/0 00000100:00100000:0.0:1746155636.639151:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1336 00002000:00100000:0.0:1746155636.639158:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2772992->3145727) req@ffff88009c28ca80 x1830976125784192/t17179874130(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/448 e 0 to 0 dl 1746155647 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155636.639165:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28ca80 with x1830976125784192 ext(2772992->3145727) 00010000:00010000:0.0:1746155636.639169:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 38 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.639183:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 38 pid: 8437 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746155636.639189:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c28ca80 00000100:00100000:0.0:1746155636.641860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.641945:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125784576 00000100:00100000:3.0:1746155636.641952:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125784576 00010000:00010000:3.0:1746155636.641987:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 38 pid: 8437 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.642021:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8453 00000100:00100000:3.0:1746155636.642027:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1960:x1830976125784576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.642039:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155636.642056:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 38 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.642066:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 38 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.642085:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a01bfc00/0x844e5faceb5f6809 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2772992->3145727] (req 2772992->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17632 expref: 38 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.642104:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.642106:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.642112:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009421ec00/0x844e5faceb5f692f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176e1 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.642119:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009421ec00/0x844e5faceb5f692f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176e1 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.642125:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.642126:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.642129:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091001e00/0x844e5faceb5f6944 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176f6 expref: 33 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.642135:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091001e00/0x844e5faceb5f6944 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176f6 expref: 33 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.642157:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091001e00/0x844e5faceb5f6944 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176f6 expref: 33 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155636.642167:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125285248:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155636.642938:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009421ec00/0x844e5faceb5f692f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176e1 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155636.642948:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125285376:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155636.642985:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43cef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155636.646090:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125285248:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155636.646101:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125285376:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155636.646117:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.646163:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976125784576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4135us (4308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.646171:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8453 00000100:00100000:0.0:1746155636.646263:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.654584:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.654848:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.655376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.656284:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7805 00000100:00100000:3.0:1746155636.656291:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976125785344:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155636.658464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.658600:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125785856 00000100:00100000:1.0:1746155636.658607:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125785856 00002000:00100000:1.0:1746155636.658632:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3567616->4157439) req@ffff8800936f4000 x1830976125785856/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.658640:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4000 with x1830976125785856 ext(3567616->4157439) 00002000:00010000:1.0:1746155636.658645:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f4000 00000100:00100000:1.0:1746155636.658666:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7807 00000100:00100000:1.0:1746155636.658672:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976125785856:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155636.661955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.662489:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125785984 00000100:00100000:3.0:1746155636.662496:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125785984 00000100:00100000:3.0:1746155636.662566:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16476 00000100:00100000:3.0:1746155636.662572:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:32108:x1830976125785984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155636.662587:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155636.662601:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f694b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f176fd expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.662624:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.662632:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155636.662633:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155636.662636:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f694b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176fd expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.662660:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.662674:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 34 pid: 8437 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.662685:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125285504:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155636.662747:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43cef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155636.665996:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125285504:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155636.666020:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f694b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176fd expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.666034:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbcfa00, rc 0) 00000100:00100000:3.0:1746155636.666072:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:32108:x1830976125785984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3498us (4124us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.666079:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16476 00000100:00100000:0.0:1746155636.670565:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125786112 00000100:00100000:0.0:1746155636.670572:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125786112 00002000:00100000:0.0:1746155636.670596:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->4194303) req@ffff88012f1f0380 x1830976125786112/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 504/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155636.670604:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0380 with x1830976125786112 ext(2097152->4194303) 00010000:00010000:0.0:1746155636.670608:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 33 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:0.0:1746155636.670617:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 33 pid: 8437 timeout: 865 lvb_type: 0 00002000:00010000:0.0:1746155636.670623:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1f0380 00000100:00100000:0.0:1746155636.670647:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1337 00000100:00100000:0.0:1746155636.670653:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976125786112:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155636.671216:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976125785344:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14924us (16366us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155636.671223:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7805 00002000:00100000:3.0:1746155636.671229:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800936f6a00 x1830976125785344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.671236:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6a00 with x1830976125785344 ext(3145728->4194303) 00002000:00010000:3.0:1746155636.671239:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800936f6a00 00000100:00100000:1.0:1746155636.674084:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.674291:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125786240 00000100:00100000:3.0:1746155636.674298:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125786240 00000100:00100000:3.0:1746155636.674343:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16477 00000100:00100000:3.0:1746155636.674350:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:32105:x1830976125786240:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155636.674362:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155636.674375:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbcf800/0x844e5faceb5f6952 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17704 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.674394:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155636.674398:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbcf800/0x844e5faceb5f6952 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17704 expref: 34 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.674408:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbcf800/0x844e5faceb5f6952 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17704 expref: 34 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.674417:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbcf800, rc 0) 00000100:00100000:3.0:1746155636.674443:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:32105:x1830976125786240:12345-192.168.202.51@tcp:101:cat.0 Request processed in 93us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.674448:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16477 00000100:00100000:3.0:1746155636.677999:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976125786112:12345-192.168.202.51@tcp:4:cat.0 Request processed in 7337us (7541us total) trans 21474841463 rc 0/0 00000100:00100000:3.0:1746155636.678010:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1337 00002000:00100000:3.0:1746155636.678019:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->4194303) req@ffff88012f1f0380 x1830976125786112/t21474841463(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 504/448 e 0 to 0 dl 1746155647 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.678027:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0380 with x1830976125786112 ext(2097152->4194303) 00010000:00010000:3.0:1746155636.678040:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 34 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.678051:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 34 pid: 8437 timeout: 865 lvb_type: 0 00002000:00010000:3.0:1746155636.678058:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1f0380 00000100:00100000:0.0:1746155636.681158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.681842:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125786368 00000100:00100000:3.0:1746155636.681850:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125786368 00010000:00010000:3.0:1746155636.681878:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 34 pid: 8437 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.681934:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8454 00000100:00100000:3.0:1746155636.681942:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1962:x1830976125786368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.681953:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155636.681980:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 34 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.681990:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 34 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.682006:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a01bf000/0x844e5faceb5f6810 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2519039) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17639 expref: 34 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.682385:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.682388:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.682394:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f694b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176fd expref: 23 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.682402:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f694b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176fd expref: 23 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.682413:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.682414:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.682417:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbcf800/0x844e5faceb5f6952 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17704 expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.682423:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbcf800/0x844e5faceb5f6952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17704 expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.682447:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbcf800/0x844e5faceb5f6952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17704 expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155636.682458:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125285632:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155636.691818:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.691854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.691889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.691945:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125787008 00000100:00100000:3.0:1746155636.691948:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125787008 00002000:00100000:3.0:1746155636.691976:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a3fc7800 x1830976125787008/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.691986:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc7800 with x1830976125787008 ext(3145728->4194303) 00002000:00010000:3.0:1746155636.691990:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc7800 00000100:00100000:3.0:1746155636.692003:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125787264 00000100:00100000:3.0:1746155636.692005:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125787264 00002000:00100000:3.0:1746155636.692016:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012bdf7800 x1830976125787264/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.692022:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7800 with x1830976125787264 ext(3145728->4194303) 00002000:00010000:3.0:1746155636.692024:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf7800 00000100:00100000:3.0:1746155636.692119:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7809 00000100:00100000:3.0:1746155636.692128:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1962:x1830976125786752:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155636.693588:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7810 00000100:00100000:0.0:1746155636.693597:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1962:x1830976125787264:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155636.694615:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.694632:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125787520 00000100:00100000:0.0:1746155636.694637:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125787520 00002000:00100000:0.0:1746155636.694659:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88012bdf6680 x1830976125787520/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155636.694666:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf6680 with x1830976125787520 ext(3145728->4194303) 00002000:00010000:0.0:1746155636.694671:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf6680 00000100:00100000:0.0:1746155636.694684:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7811 00000100:00100000:0.0:1746155636.694689:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976125787520:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155636.695023:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.695038:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125787392 00000100:00100000:1.0:1746155636.695041:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125787392 00002000:00100000:1.0:1746155636.695055:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800910cbb80 x1830976125787392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.695061:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cbb80 with x1830976125787392 ext(2097152->3145727) 00002000:00010000:1.0:1746155636.695064:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910cbb80 00000100:00100000:1.0:1746155636.695079:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7812 00000100:00100000:1.0:1746155636.695084:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976125787392:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155636.717127:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976125787392:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22035us (22096us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155636.717136:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7812 00002000:00100000:1.0:1746155636.717144:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800910cbb80 x1830976125787392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.717152:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cbb80 with x1830976125787392 ext(2097152->3145727) 00002000:00010000:1.0:1746155636.717156:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910cbb80 00000100:00100000:3.0:1746155636.724589:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1962:x1830976125786752:12345-192.168.202.51@tcp:3:cat.0 Request processed in 32454us (32769us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155636.724599:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7809 00002000:00100000:3.0:1746155636.724607:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a3fc5c00 x1830976125786752/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.724616:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5c00 with x1830976125786752 ext(2097152->3145727) 00002000:00010000:3.0:1746155636.724621:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc5c00 00000100:00100000:0.0:1746155636.731679:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.736307:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.738662:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.738769:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125788032 00000100:00100000:1.0:1746155636.738774:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125788032 00000100:00100000:1.0:1746155636.738798:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16480 00000100:00100000:1.0:1746155636.738803:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:32108:x1830976125788032:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155636.738812:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.738820:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff01000/0x844e5faceb5f6967 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17719 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.738834:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132b47000/0x844e5faceb5f6928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176da expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.738845:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155636.738846:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155636.738849:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff01000/0x844e5faceb5f6967 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [4194304->5083135] (req 4194304->5083135) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17719 expref: 35 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.738869:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132b47000/0x844e5faceb5f6928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176da expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.738877:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132b47000/0x844e5faceb5f6928 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4829183) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176da expref: 36 pid: 8437 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.738886:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880137121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125286144:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155636.739435:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155636.741014:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880137121f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125286144:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155636.741034:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff01000/0x844e5faceb5f6967 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [4194304->5083135] (req 4194304->5083135) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17719 expref: 35 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.741046:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff01000, rc 0) 00000100:00100000:1.0:1746155636.741083:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:32108:x1830976125788032:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2278us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.741311:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16480 00000100:00100000:0.0:1746155636.741978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.742015:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.742259:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125788288 00000100:00100000:1.0:1746155636.742263:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125788288 00000100:00100000:1.0:1746155636.742281:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16481 00000100:00100000:1.0:1746155636.742285:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:32105:x1830976125788288:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155636.742293:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155636.742302:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff00400/0x844e5faceb5f696e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17720 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.742315:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155636.742319:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff00400/0x844e5faceb5f696e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [4829184->5083135] (req 4829184->5083135) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17720 expref: 39 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.742327:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff00400/0x844e5faceb5f696e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [4829184->5083135] (req 4829184->5083135) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17720 expref: 39 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155636.742334:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff00400, rc 0) 00000100:00100000:1.0:1746155636.742364:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:32105:x1830976125788288:12345-192.168.202.51@tcp:101:cat.0 Request processed in 78us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.742369:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16481 00000100:00100000:0.0:1746155636.752492:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.756478:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.756944:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125788672 00000100:00100000:3.0:1746155636.756950:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125788672 00002000:00100000:3.0:1746155636.756994:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e4:0x0] (4829184->5083135) req@ffff8800a62a3100 x1830976125788672/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.757003:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a3100 with x1830976125788672 ext(4829184->5083135) 00002000:00010000:3.0:1746155636.757006:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a3100 00000100:00100000:3.0:1746155636.757033:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7813 00000100:00100000:3.0:1746155636.757040:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976125788672:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155636.757544:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.757557:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125788928 00000100:00100000:1.0:1746155636.757560:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125788928 00002000:00100000:1.0:1746155636.757572:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880137121f80 x1830976125788928/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/0 e 0 to 0 dl 1746155647 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.757577:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121f80 with x1830976125788928 ext(4194304->5083135) 00002000:00010000:1.0:1746155636.757579:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137121f80 00000100:00100000:1.0:1746155636.757587:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7814 00000100:00100000:1.0:1746155636.757590:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1961:x1830976125788928:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155636.757950:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125286400:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155636.757977:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.758002:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1962:x1830976125788416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5015us (5515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.758010:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8455 00000100:00100000:3.0:1746155636.761590:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976125788672:12345-192.168.202.51@tcp:3:cat.0 Request processed in 4542us (5110us total) trans 0 rc 253952/253952 00000100:00100000:3.0:1746155636.761599:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7813 00002000:00100000:3.0:1746155636.761609:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e4:0x0] (4829184->5083135) req@ffff8800a62a3100 x1830976125788672/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 253952/253952 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155636.761617:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a3100 with x1830976125788672 ext(4829184->5083135) 00002000:00010000:3.0:1746155636.761622:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a3100 00000100:00100000:1.0:1746155636.764004:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1961:x1830976125788928:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6405us (6452us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155636.764017:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7814 00002000:00100000:1.0:1746155636.764026:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880137121f80 x1830976125788928/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:707/0 lens 488/440 e 0 to 0 dl 1746155647 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155636.764033:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880137121f80 with x1830976125788928 ext(4194304->5083135) 00002000:00010000:1.0:1746155636.764037:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880137121f80 00000100:00100000:0.0:1746155636.768647:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.783448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.783533:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125789440 00000100:00100000:3.0:1746155636.783541:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125789440 00000100:00100000:3.0:1746155636.783583:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11014 00000100:00100000:3.0:1746155636.783589:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:32113:x1830976125789440:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155636.783607:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155636.783621:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6975 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17727 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.783699:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcee00/0x844e5faceb5f697c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783708:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcee00/0x844e5faceb5f697c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783716:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcee00/0x844e5faceb5f697c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783724:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f6983 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783729:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f6983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783733:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f6983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783815:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce200/0x844e5faceb5f698a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783822:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce200/0x844e5faceb5f698a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783827:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce200/0x844e5faceb5f698a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155636.783834:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155636.783888:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcee00/0x844e5faceb5f697c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783893:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcee00/0x844e5faceb5f697c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783898:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcee00/0x844e5faceb5f697c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783902:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbcee00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155636.783905:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcee00/0x844e5faceb5f697c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783909:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcee00/0x844e5faceb5f697c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783917:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155636.783919:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155636.783921:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcee00/0x844e5faceb5f697c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783925:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcee00/0x844e5faceb5f697c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783937:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f6983 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783944:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f6983 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783948:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f6983 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783951:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbce000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155636.783952:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f6983 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783956:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f6983 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783971:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c823300) 00010000:00010000:3.0:1746155636.783973:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155636.783975:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f6983 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.783979:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f6983 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155636.784004:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6975 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17727 expref: 24 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.784013:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce200/0x844e5faceb5f698a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17727 expref: 23 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.784018:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155636.784019:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155636.784021:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbce200, rc 0) 00000100:00100000:3.0:1746155636.784066:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:32113:x1830976125789440:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 478us (627us total) trans 8589945153 rc 0/0 00000100:00100000:3.0:1746155636.784072:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11014 00000100:00100000:3.0:1746155636.787418:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125789568 00000100:00100000:3.0:1746155636.787425:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125789568 00000100:00100000:3.0:1746155636.787473:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 732 00000100:00100000:3.0:1746155636.787481:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1963:x1830976125789568:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.787494:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155636.787543:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce200/0x844e5faceb5f698a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17727 expref: 23 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.787557:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155636.787560:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155636.810610:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.810770:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125789696 00000100:00100000:3.0:1746155636.810778:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125789696 00000100:00100000:3.0:1746155636.811366:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16482 00000100:00100000:3.0:1746155636.811374:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:32113:x1830976125789696:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155636.811390:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155636.811404:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbce800/0x844e5faceb5f6998 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1772e expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.811431:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ff01000/0x844e5faceb5f6967 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17719 expref: 36 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.811439:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ff00400/0x844e5faceb5f696e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4829184->5083135) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17720 expref: 38 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.811445:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009421ec00/0x844e5faceb5f692f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176e1 expref: 38 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.811452:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091001e00/0x844e5faceb5f6944 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176f6 expref: 36 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.811457:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746155636.811458:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746155636.811461:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbce800/0x844e5faceb5f6998 lrc: 7/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [3223552->3583999] (req 3223552->3583999) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1772e expref: 36 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.811487:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091001e00/0x844e5faceb5f6944 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176f6 expref: 36 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.811496:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091001e00/0x844e5faceb5f6944 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176f6 expref: 36 pid: 29728 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.811588:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125286528:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155636.811669:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009421ec00/0x844e5faceb5f692f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176e1 expref: 38 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.811676:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009421ec00/0x844e5faceb5f692f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176e1 expref: 38 pid: 8437 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.811684:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125286656:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155636.811705:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ff00400/0x844e5faceb5f696e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4829184->5083135) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17720 expref: 38 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.811717:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ff00400/0x844e5faceb5f696e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4829184->5083135) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17720 expref: 38 pid: 18270 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.811724:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125286784:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155636.811742:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ff01000/0x844e5faceb5f6967 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17719 expref: 36 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.811748:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ff01000/0x844e5faceb5f6967 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17719 expref: 36 pid: 18270 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.811754:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125286912:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155636.811766:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43ce780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155636.813911:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125286528:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155636.813922:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125286656:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155636.813928:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125286784:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155636.813934:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125286912:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155636.813957:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbce800/0x844e5faceb5f6998 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [3223552->3583999] (req 3223552->3583999) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1772e expref: 36 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.813981:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbce800, rc 0) 00000100:00100000:3.0:1746155636.814010:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:32113:x1830976125789696:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2637us (3407us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.814020:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16482 00000100:00100000:0.0:1746155636.814688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.814715:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155636.815001:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125789824 00000100:00100000:1.0:1746155636.815004:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125789824 00010000:00010000:1.0:1746155636.815016:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009421ec00/0x844e5faceb5f692f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176e1 expref: 39 pid: 8437 timeout: 865 lvb_type: 0 00000100:00100000:1.0:1746155636.815041:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8456 00000100:00100000:1.0:1746155636.815046:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976125789824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155636.815055:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155636.815069:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009421ec00/0x844e5faceb5f692f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176e1 expref: 39 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.815077:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009421ec00/0x844e5faceb5f692f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176e1 expref: 39 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.815094:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009421ec00/0x844e5faceb5f692f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [2097152->4194303] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176e1 expref: 39 pid: 8437 timeout: 865 lvb_type: 0 00010000:00010000:1.0:1746155636.815111:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155636.815130:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1960:x1830976125789824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 84us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.815138:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8456 00000100:00100000:0.0:1746155636.818538:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.818576:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155636.818676:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125790208 00000100:00100000:3.0:1746155636.818683:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125790208 00010000:00010000:3.0:1746155636.818708:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff01000/0x844e5faceb5f6967 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17719 expref: 35 pid: 18270 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.818737:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125790080 00000100:00100000:3.0:1746155636.818739:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125790080 00010000:00010000:3.0:1746155636.818751:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff00400/0x844e5faceb5f696e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4829184->5083135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17720 expref: 38 pid: 18270 timeout: 865 lvb_type: 0 00000100:00100000:3.0:1746155636.818767:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8458 00000100:00100000:3.0:1746155636.818773:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1961:x1830976125790208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.818783:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155636.818799:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ff01000/0x844e5faceb5f6967 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17719 expref: 35 pid: 18270 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.818808:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ff01000/0x844e5faceb5f6967 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17719 expref: 35 pid: 18270 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.818824:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff01000/0x844e5faceb5f6967 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17719 expref: 35 pid: 18270 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.818840:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.818869:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1961:x1830976125790208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 97us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.818878:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8458 00000100:00100000:3.0:1746155636.818916:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8459 00000100:00100000:3.0:1746155636.818921:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976125790080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155636.818926:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155636.818932:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ff00400/0x844e5faceb5f696e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4829184->5083135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17720 expref: 38 pid: 18270 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.818940:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ff00400/0x844e5faceb5f696e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4829184->5083135) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17720 expref: 38 pid: 18270 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.818950:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff00400/0x844e5faceb5f696e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4829184->5083135) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17720 expref: 38 pid: 18270 timeout: 865 lvb_type: 0 00010000:00010000:3.0:1746155636.818958:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.818969:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155636.818974:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbce800/0x844e5faceb5f6998 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3583999) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1772e expref: 33 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.818981:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbce800/0x844e5faceb5f6998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3583999) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1772e expref: 33 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155636.819005:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbce800/0x844e5faceb5f6998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3583999) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1772e expref: 33 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155636.819014:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125287040:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155636.819768:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155636.822147:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125287040:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155636.822164:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155636.822208:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1963:x1830976125790080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3285us (3629us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.822216:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8459 00000100:00100000:0.0:1746155636.824623:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.829149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155636.833213:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:1.0:1746155636.884255:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155636.884648:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1830976125287424:0@lo:400:kworker.0 00000100:00100000:3.0:1746155636.884724:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125287680 00000100:00100000:3.0:1746155636.884727:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125287680 00000100:00100000:1.0:1746155636.884770:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155636.884785:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746155636.884789:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830976125287808:0@lo:400:kworker.0 00000100:00100000:1.0:1746155636.884804:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155636.884820:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125287424 00000100:00100000:1.0:1746155636.884822:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125287424 00000100:00100000:1.0:1746155636.884840:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125287808 00000100:00100000:1.0:1746155636.884841:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125287808 00000100:00100000:1.0:1746155636.884852:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1746155636.884856:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830976125287424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155636.884881:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090189880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1830976125287424:12345-0@lo:400:kworker.0 Request processed in 24us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155636.884885:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1746155636.884894:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1746155636.884899:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830976125287808:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1746155636.884909:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155636.884916:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1830976125287808:12345-0@lo:400:kworker.0 Request processed in 18us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.885034:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125287552 00000100:00100000:3.0:1746155636.885037:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125287552 00000100:00100000:3.0:1746155636.885055:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1746155636.885058:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3298:x1830976125287680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746155636.885084:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3298:x1830976125287680:12345-0@lo:400:kworker.0 Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.885088:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1746155636.885097:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1746155636.885100:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3298:x1830976125287552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746155636.885113:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+61:3298:x1830976125287552:12345-0@lo:400:kworker.0 Request processed in 13us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155636.885117:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1746155636.885136:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1746155636.885157:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1830976125287808:0@lo:400:kworker.0 00000100:00100000:1.0:1746155636.885165:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1830976125287424:0@lo:400:kworker.0 00000100:00100000:0.0:1746155636.997737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.002326:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.002428:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125791360 00000100:00100000:1.0:1746155637.002436:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125791360 00000100:00100000:1.0:1746155637.002492:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11015 00000100:00100000:1.0:1746155637.002500:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:32125:x1830976125791360:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155637.002548:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.002564:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00200/0x844e5faceb5f69a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1773c expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.002650:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f69ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002660:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f69ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002674:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f69ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002686:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f69b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002692:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f69b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002697:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f69b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002783:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00800/0x844e5faceb5f69bb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002790:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00800/0x844e5faceb5f69bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002795:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00800/0x844e5faceb5f69bb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155637.002802:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155637.002871:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f69ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002877:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f69ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002882:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f69ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002886:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ff01400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.002890:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f69ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002895:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f69ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002904:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155637.002906:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.002909:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f69ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.002914:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff01400/0x844e5faceb5f69ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.003084:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f69b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.003089:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f69b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.003093:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f69b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.003097:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ff00a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.003098:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f69b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.003103:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f69b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.003109:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f535500) 00010000:00010000:1.0:1746155637.003111:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.003113:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f69b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.003117:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00a00/0x844e5faceb5f69b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.003144:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00200/0x844e5faceb5f69a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1773c expref: 26 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.003152:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00800/0x844e5faceb5f69bb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1773c expref: 25 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.003156:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.003158:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155637.003160:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff00800, rc 0) 00000100:00100000:1.0:1746155637.003178:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:32125:x1830976125791360:12345-192.168.202.51@tcp:101:cat.0 Request processed in 681us (859us total) trans 8589945155 rc 0/0 00000100:00100000:1.0:1746155637.003184:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11015 00000100:00100000:0.0:1746155637.009879:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.009967:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125791488 00000100:00100000:3.0:1746155637.009974:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125791488 00000100:00100000:3.0:1746155637.010022:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 733 00000100:00100000:3.0:1746155637.010029:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1961:x1830976125791488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155637.010042:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155637.010061:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00800/0x844e5faceb5f69bb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1773c expref: 25 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.010213:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155637.010217:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.010261:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976125791488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 232us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.010267:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 733 00000100:00100000:0.0:1746155637.011247:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.011494:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125791616 00000100:00100000:3.0:1746155637.011499:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125791616 00000100:00100000:3.0:1746155637.011549:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16484 00000100:00100000:3.0:1746155637.011555:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:32117:x1830976125791616:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155637.011568:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.011580:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f69c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17743 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.011600:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091000c00/0x844e5faceb5f691a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176cc expref: 38 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.011607:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091000600/0x844e5faceb5f6921 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176d3 expref: 33 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.011613:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.011615:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.011618:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f69c9 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1585152->2097151] (req 1585152->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17743 expref: 38 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.011641:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091000600/0x844e5faceb5f6921 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176d3 expref: 33 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.011655:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091000600/0x844e5faceb5f6921 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176d3 expref: 33 pid: 29728 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.011666:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125288064:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155637.011728:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091000c00/0x844e5faceb5f691a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176cc expref: 38 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.011736:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091000c00/0x844e5faceb5f691a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176cc expref: 38 pid: 29728 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.011743:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125288192:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155637.011758:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155637.015601:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125288064:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155637.015782:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125288192:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155637.015810:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f69c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1585152->2097151] (req 1585152->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17743 expref: 38 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.015823:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbcee00, rc 0) 00000100:00100000:0.0:1746155637.015858:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:32117:x1830976125791616:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4303us (4613us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.015865:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16484 00000100:00100000:3.0:1746155637.016326:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125791744 00000100:00100000:3.0:1746155637.016332:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125791744 00010000:00010000:3.0:1746155637.016356:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091000600/0x844e5faceb5f6921 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176d3 expref: 34 pid: 29728 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.016373:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125791872 00000100:00100000:3.0:1746155637.016375:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125791872 00010000:00010000:3.0:1746155637.016382:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091000c00/0x844e5faceb5f691a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176cc expref: 38 pid: 29728 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.016394:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8460 00000100:00100000:3.0:1746155637.016400:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1963:x1830976125791744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155637.016410:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155637.016428:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091000600/0x844e5faceb5f6921 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176d3 expref: 34 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.016438:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091000600/0x844e5faceb5f6921 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176d3 expref: 34 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.016457:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091000600/0x844e5faceb5f6921 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176d3 expref: 34 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.017817:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.017852:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1963:x1830976125791744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1450us (2190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.017860:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8460 00000100:00100000:0.0:1746155637.017970:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125288320:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155637.017983:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155637.017997:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1963:x1830976125791872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1471us (2288us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.018002:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8461 00000100:00100000:3.0:1746155637.019078:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125792128 00000100:00100000:3.0:1746155637.019083:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125792128 00002000:00100000:3.0:1746155637.019111:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1585152->1589247) req@ffff8800a01d0700 x1830976125792128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.019119:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d0700 with x1830976125792128 ext(1585152->1589247) 00002000:00010000:3.0:1746155637.019122:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d0700 00000100:00100000:3.0:1746155637.019136:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7817 00000100:00100000:3.0:1746155637.019142:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976125792128:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155637.019259:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976125792128:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 117us (367us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155637.019265:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7817 00002000:00100000:3.0:1746155637.019270:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1585152->1589247) req@ffff8800a01d0700 x1830976125792128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/4536 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.019276:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d0700 with x1830976125792128 ext(1585152->1589247) 00002000:00010000:3.0:1746155637.019279:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d0700 00000100:00100000:0.0:1746155637.020376:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.024135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.025132:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125792512 00000100:00100000:1.0:1746155637.025138:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125792512 00002000:00100000:1.0:1746155637.025169:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1585151) req@ffff88012c2bdf80 x1830976125792512/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.025177:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bdf80 with x1830976125792512 ext(1048576->1585151) 00010000:00010000:1.0:1746155637.025185:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f69c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17743 expref: 37 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.025195:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f69c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17743 expref: 37 pid: 8437 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746155637.025202:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c2bdf80 00000100:00100000:0.0:1746155637.025448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.025481:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.025763:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125792896 00000100:00100000:1.0:1746155637.025767:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125792896 00002000:00100000:1.0:1746155637.025780:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e3:0x0] (1585152->2097151) req@ffff88012c2be680 x1830976125792896/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.025786:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2be680 with x1830976125792896 ext(1585152->2097151) 00010000:00010000:1.0:1746155637.025791:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f69c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17743 expref: 40 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.025798:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f69c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17743 expref: 40 pid: 8437 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746155637.025803:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c2be680 00000100:00100000:1.0:1746155637.025925:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1339 00000100:00100000:1.0:1746155637.025931:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976125792512:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155637.027656:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125288576:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155637.027672:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131447800/0x844e5faceb5f69d7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->2625535] (req 2097152->2625535) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17751 expref: 42 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.027682:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131447800, rc 0) 00000100:00100000:3.0:1746155637.027701:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:32117:x1830976125792768:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2153us (2254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.027705:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16486 00000100:00100000:0.0:1746155637.027713:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.027728:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125793024 00000100:00100000:0.0:1746155637.027732:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125793024 00002000:00100000:0.0:1746155637.027752:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3223552->3583999) req@ffff88012c2bea00 x1830976125793024/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.027760:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bea00 with x1830976125793024 ext(3223552->3583999) 00010000:00010000:0.0:1746155637.027765:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbce800/0x844e5faceb5f6998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3583999) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1772e expref: 34 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.027774:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbce800/0x844e5faceb5f6998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3223552->3583999) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1772e expref: 34 pid: 29728 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746155637.027780:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c2bea00 00000100:00100000:0.0:1746155637.027803:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1341 00000100:00100000:0.0:1746155637.027809:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1961:x1830976125793024:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155637.032896:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976125792512:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6959us (8755us total) trans 0 rc 536576/536576 00000100:00100000:0.0:1746155637.032906:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1339 00002000:00100000:0.0:1746155637.032916:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1585151) req@ffff88012c2bdf80 x1830976125792512/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:H/200/0 rc 536576/536576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.032924:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bdf80 with x1830976125792512 ext(1048576->1585151) 00010000:00010000:0.0:1746155637.032931:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f69c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17743 expref: 40 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.032942:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f69c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17743 expref: 40 pid: 8437 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746155637.032948:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c2bdf80 00000100:00100000:0.0:1746155637.037647:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.040008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.040139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.040438:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125793408 00000100:00100000:3.0:1746155637.040442:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125793408 00010000:00010000:3.0:1746155637.040455:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f69c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17743 expref: 42 pid: 8437 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.040481:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8463 00000100:00100000:3.0:1746155637.040486:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125793408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155637.040493:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155637.040736:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f69c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17743 expref: 42 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.040745:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f69c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17743 expref: 42 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.040762:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f69c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1585152->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17743 expref: 42 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.040782:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.040783:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.040788:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f69d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1774a expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.040795:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f69d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1774a expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.041399:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f69d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1774a expref: 35 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.041410:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125288960:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155637.041787:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.042678:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125288832:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155637.042695:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131446600/0x844e5faceb5f69de lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17758 expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.042706:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131446600, rc 0) 00000100:00100000:0.0:1746155637.042740:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:32122:x1830976125793280:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2529us (2735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.042747:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16487 00000100:00100000:3.0:1746155637.044850:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125288960:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155637.044869:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.045189:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125793408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4668us (5015us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.045198:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8463 00000100:00100000:0.0:1746155637.045389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.048213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.049206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.049246:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125794176 00000100:00100000:1.0:1746155637.049250:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125794176 00002000:00100000:1.0:1746155637.049266:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->2625535) req@ffff88012c2bf800 x1830976125794176/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.049279:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bf800 with x1830976125794176 ext(2097152->2625535) 00010000:00010000:1.0:1746155637.049286:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131447800/0x844e5faceb5f69d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2625535) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17751 expref: 40 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.049297:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131447800/0x844e5faceb5f69d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2625535) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17751 expref: 40 pid: 8437 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746155637.049302:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c2bf800 00000100:00100000:1.0:1746155637.049314:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1343 00000100:00100000:1.0:1746155637.049318:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125794176:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155637.056890:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125794176:12345-192.168.202.51@tcp:4:cat.0 Request processed in 7563us (7678us total) trans 17179874134 rc 0/0 00000100:00100000:1.0:1746155637.056901:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1343 00002000:00100000:1.0:1746155637.056913:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->2625535) req@ffff88012c2bf800 x1830976125794176/t17179874134(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/448 e 0 to 0 dl 1746155648 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.056921:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bf800 with x1830976125794176 ext(2097152->2625535) 00010000:00010000:1.0:1746155637.056930:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131447800/0x844e5faceb5f69d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2625535) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17751 expref: 42 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.056944:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131447800/0x844e5faceb5f69d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2625535) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17751 expref: 42 pid: 8437 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746155637.056951:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c2bf800 00000100:00100000:3.0:1746155637.057231:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1963:x1830976125793920:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8876us (9022us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155637.057238:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7818 00002000:00100000:3.0:1746155637.057243:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012c2bf480 x1830976125793920/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.057250:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bf480 with x1830976125793920 ext(1048576->2097151) 00002000:00010000:3.0:1746155637.057253:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c2bf480 00000100:00100000:0.0:1746155637.058803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.058884:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125794432 00000100:00100000:1.0:1746155637.058893:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125794432 00000100:00100000:1.0:1746155637.059687:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11016 00000100:00100000:1.0:1746155637.059695:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:32127:x1830976125794432:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155637.059715:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.059730:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00000/0x844e5faceb5f69e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1775f expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.059824:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000600/0x844e5faceb5f69ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.059834:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091000600/0x844e5faceb5f69ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.059844:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091000600/0x844e5faceb5f69ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.059854:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000c00/0x844e5faceb5f69f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.059860:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091000c00/0x844e5faceb5f69f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.059865:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091000c00/0x844e5faceb5f69f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.059949:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091001e00/0x844e5faceb5f69fa lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.059970:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091001e00/0x844e5faceb5f69fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.059976:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091001e00/0x844e5faceb5f69fa lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155637.059987:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155637.060055:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000600/0x844e5faceb5f69ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060061:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091000600/0x844e5faceb5f69ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060066:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091000600/0x844e5faceb5f69ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060071:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091000600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.060074:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091000600/0x844e5faceb5f69ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060079:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091000600/0x844e5faceb5f69ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060088:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155637.060091:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.060094:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091000600/0x844e5faceb5f69ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060098:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091000600/0x844e5faceb5f69ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060126:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000c00/0x844e5faceb5f69f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060131:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091000c00/0x844e5faceb5f69f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060135:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091000c00/0x844e5faceb5f69f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060142:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091000c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.060145:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091000c00/0x844e5faceb5f69f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060149:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091000c00/0x844e5faceb5f69f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060154:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f535e00) 00010000:00010000:1.0:1746155637.060156:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.060158:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091000c00/0x844e5faceb5f69f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060161:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091000c00/0x844e5faceb5f69f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.060192:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00000/0x844e5faceb5f69e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1775f expref: 27 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.060202:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091001e00/0x844e5faceb5f69fa lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1775f expref: 26 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.060386:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.060389:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155637.060391:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091001e00, rc 0) 00000100:00100000:1.0:1746155637.060438:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:32127:x1830976125794432:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 744us (1641us total) trans 8589945156 rc 0/0 00000100:00100000:1.0:1746155637.060444:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11016 00000100:00100000:0.0:1746155637.060606:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.061252:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125794560 00000100:00100000:3.0:1746155637.061257:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125794560 00010000:00010000:3.0:1746155637.061348:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131447800/0x844e5faceb5f69d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2625535) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17751 expref: 42 pid: 8437 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.061375:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8464 00000100:00100000:3.0:1746155637.061382:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1962:x1830976125794560:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155637.061391:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155637.061405:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131447800/0x844e5faceb5f69d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2625535) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17751 expref: 42 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.061413:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131447800/0x844e5faceb5f69d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2625535) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17751 expref: 42 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.061427:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131447800/0x844e5faceb5f69d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2625535) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17751 expref: 42 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.061439:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.061441:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.061446:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131446600/0x844e5faceb5f69de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17758 expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.061453:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131446600/0x844e5faceb5f69de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17758 expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.061482:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131446600/0x844e5faceb5f69de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17758 expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.061493:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125289088:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155637.061570:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.061947:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.067235:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.067561:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125289088:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155637.067579:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.067612:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1962:x1830976125794560:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6230us (7006us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.067620:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8464 00000100:00100000:3.0:1746155637.067669:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125794816 00000100:00100000:3.0:1746155637.067673:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125794816 00000100:00100000:1.0:1746155637.069433:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 734 00000100:00100000:1.0:1746155637.069448:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976125794816:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155637.069462:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155637.069484:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091001e00/0x844e5faceb5f69fa lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1775f expref: 26 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.069522:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.069526:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155637.069556:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976125794816:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 112us (2328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.069706:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 734 00000100:00100000:0.0:1746155637.070855:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.071005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.071129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.071139:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125795072 00000100:00100000:3.0:1746155637.071145:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125795072 00000100:00100000:0.0:1746155637.071152:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:3.0:1746155637.071174:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f4fc700 x1830976125795072/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.071183:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fc700 with x1830976125795072 ext(2097152->3145727) 00002000:00010000:3.0:1746155637.071187:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fc700 00000100:00100000:1.0:1746155637.071367:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125795200 00000100:00100000:1.0:1746155637.071370:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125795200 00002000:00100000:1.0:1746155637.071388:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f4fca80 x1830976125795200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155637.071405:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125795584 00000100:00100000:3.0:1746155637.071407:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125795584 00002000:00100000:3.0:1746155637.071418:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f4fce00 x1830976125795584/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.071424:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fce00 with x1830976125795584 ext(2097152->3145727) 00002000:00010000:3.0:1746155637.071427:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fce00 00000100:00100000:3.0:1746155637.071444:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7819 00000100:00100000:3.0:1746155637.071449:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976125795072:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:1.0:1746155637.071944:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fca80 with x1830976125795200 ext(3145728->4194303) 00002000:00010000:1.0:1746155637.071947:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fca80 00000100:00100000:1.0:1746155637.071968:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7822 00000100:00100000:1.0:1746155637.071974:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125795200:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155637.082332:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1961:x1830976125795200:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10352us (11321us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155637.082340:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7822 00002000:00100000:1.0:1746155637.082347:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f4fca80 x1830976125795200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.082356:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fca80 with x1830976125795200 ext(3145728->4194303) 00002000:00010000:1.0:1746155637.082360:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fca80 00000100:00100000:3.0:1746155637.088907:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1960:x1830976125795072:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17454us (18050us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155637.088916:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7819 00002000:00100000:3.0:1746155637.088922:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f4fc700 x1830976125795072/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.088930:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fc700 with x1830976125795072 ext(2097152->3145727) 00002000:00010000:3.0:1746155637.088934:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fc700 00000100:00100000:0.0:1746155637.098764:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.101226:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.107924:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.121486:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.121592:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125796736 00000100:00100000:3.0:1746155637.121601:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125796736 00000100:00100000:3.0:1746155637.121650:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4657 00000100:00100000:3.0:1746155637.121657:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:32125:x1830976125796736:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155637.121832:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:32125:x1830976125796736:12345-192.168.202.51@tcp:35:cat.0 Request processed in 175us (352us total) trans 8589945157 rc 0/0 00000100:00100000:3.0:1746155637.121838:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4657 00000100:00100000:0.0:1746155637.185737:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.188673:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.188712:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.189048:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125796992 00000100:00100000:1.0:1746155637.189055:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125796992 00010000:00010000:1.0:1746155637.189079:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a01bec00/0x844e5faceb5f690c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176b7 expref: 25 pid: 18270 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746155637.189100:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125797120 00000100:00100000:1.0:1746155637.189102:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125797120 00010000:00010000:1.0:1746155637.189112:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009421ea00/0x844e5faceb5f68d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a2 expref: 33 pid: 8437 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.189125:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8466 00000100:00100000:1.0:1746155637.189129:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976125797120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155637.189135:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155637.189144:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009421ea00/0x844e5faceb5f68d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a2 expref: 33 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.189151:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009421ea00/0x844e5faceb5f68d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a2 expref: 33 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.189182:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009421ea00/0x844e5faceb5f68d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176a2 expref: 33 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.189197:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.189198:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.189204:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131446a00/0x844e5faceb5f6a16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17774 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.189212:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131446a00/0x844e5faceb5f6a16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17774 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.189233:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131446a00/0x844e5faceb5f6a16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17774 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.189243:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125289472:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155637.189276:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.194426:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.194669:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125289472:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155637.194686:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155637.194719:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976125797120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5588us (6006us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.194726:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8466 00000100:00100000:0.0:1746155637.201391:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.203888:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.203939:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125797632 00000100:00100000:1.0:1746155637.203944:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125797632 00010000:00010000:1.0:1746155637.203975:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6a0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1776d expref: 42 pid: 8437 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746155637.204006:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8467 00000100:00100000:1.0:1746155637.204012:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125797632:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155637.204020:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155637.204038:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6a0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1776d expref: 42 pid: 8437 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746155637.204046:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6a0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1776d expref: 42 pid: 8437 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746155637.204065:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6a0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1776d expref: 42 pid: 8437 timeout: 866 lvb_type: 1 00010000:00010000:1.0:1746155637.204078:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155637.204098:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1961:x1830976125797632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 86us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.204102:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8467 00000100:00100000:0.0:1746155637.205780:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.205928:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125797760 00000100:00100000:3.0:1746155637.205933:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125797760 00010000:00010000:3.0:1746155637.205951:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f69d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1774a expref: 37 pid: 8437 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.205991:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8468 00000100:00100000:3.0:1746155637.205997:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+37:1961:x1830976125797760:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155637.206005:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155637.206019:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f69d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1774a expref: 37 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.206028:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f69d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1774a expref: 37 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.206043:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f69d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1774a expref: 37 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.206063:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.206065:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.206070:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131446800/0x844e5faceb5f6a1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1777b expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.206077:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131446800/0x844e5faceb5f6a1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1777b expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.206100:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131446800/0x844e5faceb5f6a1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1777b expref: 36 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.206109:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125289856:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155637.206165:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5010c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155637.209415:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125289856:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155637.209435:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.209479:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:1961:x1830976125797760:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3481us (3701us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.209489:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8468 00000100:00100000:1.0:1746155637.214426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.218628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.236308:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.237047:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125798400 00000100:00100000:1.0:1746155637.237055:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125798400 00000100:00100000:1.0:1746155637.237188:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11017 00000100:00100000:1.0:1746155637.237196:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32132:x1830976125798400:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155637.237215:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.237229:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f400/0x844e5faceb5f6a24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17782 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.237270:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6a2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.237280:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.237288:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.237298:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f6a32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.237302:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f6a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.237307:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f6a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.237383:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.237390:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f68b8 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1768d expref: 296 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.237396:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.237419:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f68b8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1768d expref: 296 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.237427:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f68b8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1768d expref: 296 pid: 15474 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.237436:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125289984:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155637.237515:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.241885:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.241932:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125289984:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155637.241950:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155637.245224:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.245639:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125798784 00000100:00100000:0.0:1746155637.245647:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125798784 00010000:00010000:0.0:1746155637.245674:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f68b8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1768d expref: 298 pid: 15474 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746155637.245713:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8469 00000100:00100000:0.0:1746155637.245719:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1961:x1830976125798784:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155637.245730:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155637.245735:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f68b8 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1768d expref: 298 pid: 15474 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.245745:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f68b8 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1768d expref: 298 pid: 15474 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.245762:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091000e00/0x844e5faceb5f68b8 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1768d expref: 298 pid: 15474 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.246236:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155637.246243:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155637.246251:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155637.246257:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155637.246484:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155637.246540:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1961:x1830976125798784:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 820us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.246547:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8469 00010000:00010000:1.0:1746155637.246618:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246624:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155637.246660:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155637.246664:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155637.246677:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246685:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246693:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6a2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246698:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6a2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246703:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6a2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246707:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa1f200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.246710:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6a2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246715:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6a2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246723:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155637.246725:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.246728:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6a2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246732:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6a2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246752:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f6a32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246757:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f6a32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246761:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f6a32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246764:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa1f000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.246766:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f6a32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246770:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f6a32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246776:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009f535800) 00010000:00010000:1.0:1746155637.246777:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.246779:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f6a32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246783:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f6a32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.246808:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f400/0x844e5faceb5f6a24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17782 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.246817:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17782 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.246822:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.246823:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155637.246825:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1ee00, rc 0) 00000100:00100000:1.0:1746155637.246848:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:32132:x1830976125798400:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 9654us (10548us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.246855:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11017 00000100:00100000:0.0:1746155637.250464:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.250664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.251781:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125799168 00000100:00100000:1.0:1746155637.251785:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125799168 00000100:00100000:1.0:1746155637.251827:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16493 00000100:00100000:1.0:1746155637.251833:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125799168:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155637.251840:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.251849:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f000/0x844e5faceb5f6a47 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17797 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.251861:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.251862:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.251869:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f000/0x844e5faceb5f6a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17797 expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.251881:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f000/0x844e5faceb5f6a47 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17797 expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.251896:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1f000, rc 0) 00000100:00100000:1.0:1746155637.251926:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125799168:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 89us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.251929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.251931:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16493 00000100:00100000:1.0:1746155637.251943:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125799040 00000100:00100000:1.0:1746155637.251945:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125799040 00000100:00100000:1.0:1746155637.251965:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16494 00000100:00100000:1.0:1746155637.251970:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125799040:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155637.251975:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.251982:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f200/0x844e5faceb5f6a4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17790 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155637.251993:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.252004:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125290240:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155637.252019:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125799296 00000100:00100000:0.0:1746155637.252022:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125799296 00000100:00100000:1.0:1746155637.252036:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.252040:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16495 00000100:00100000:0.0:1746155637.252045:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125799296:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155637.252052:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.252070:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6a55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1779e expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.252081:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.252082:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.252086:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6a55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1779e expref: 13 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.252095:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6a55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1779e expref: 13 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.252102:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1e800, rc 0) 00000100:00100000:1.0:1746155637.252115:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125799296:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 70us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.252120:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16495 00002000:00010000:1.0:1746155637.258340:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime: 1746155636 -> 1746155637 00000100:00100000:1.0:1746155637.258359:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125290240:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155637.258379:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f200/0x844e5faceb5f6a4e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17790 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.258390:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f200/0x844e5faceb5f6a4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17790 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.258579:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1f200, rc 0) 00000100:00100000:1.0:1746155637.258611:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125799040:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 6639us (6681us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155637.258619:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16494 00000100:00100000:0.0:1746155637.261304:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.261706:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125799552 00000100:00100000:1.0:1746155637.261713:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125799552 00000100:00100000:1.0:1746155637.262071:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11018 00000100:00100000:1.0:1746155637.262080:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:32132:x1830976125799552:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155637.262096:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.262110:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ec00/0x844e5faceb5f6a5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f177a5 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.263022:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6a63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.263036:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17782 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.263042:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6a63 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.263067:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17782 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.263077:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a39 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17782 expref: 12 pid: 27374 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.263087:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125290368:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155637.263173:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.266275:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.266286:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125290368:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155637.266304:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6a63 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.266523:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6a63 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.266530:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6a63 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155637.266543:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155637.266648:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ec00/0x844e5faceb5f6a5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177a5 expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.266660:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6a63 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177a5 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.266666:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.266668:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155637.266670:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1ea00, rc 0) 00000100:00100000:1.0:1746155637.266700:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32132:x1830976125799552:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4622us (5403us total) trans 8589945160 rc 0/0 00000100:00100000:1.0:1746155637.266706:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11018 00000100:00100000:0.0:1746155637.272071:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.272152:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125799808 00000100:00100000:1.0:1746155637.272160:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125799808 00000100:00100000:1.0:1746155637.272208:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11019 00000100:00100000:1.0:1746155637.272215:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32132:x1830976125799808:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155637.272233:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.272248:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6a71 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f177ac expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.272306:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e200/0x844e5faceb5f6a78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.272318:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6a63 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177a5 expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.272324:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e200/0x844e5faceb5f6a78 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.272346:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6a63 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177a5 expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.272354:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6a63 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177a5 expref: 13 pid: 27374 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.272364:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125290496:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155637.272429:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316300 going to sleep for 11 seconds 00010000:00010000:3.0:1746155637.272656:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746155637.274863:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125290496:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155637.274881:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e200/0x844e5faceb5f6a78 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155637.275150:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155637.276021:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e200/0x844e5faceb5f6a78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.276029:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e200/0x844e5faceb5f6a78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155637.276062:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155637.276067:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155637.276080:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e200/0x844e5faceb5f6a78 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.276106:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6a71 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177ac expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.276118:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e200/0x844e5faceb5f6a78 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177ac expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.276124:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.276127:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155637.276129:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1e200, rc 0) 00000100:00100000:1.0:1746155637.276168:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32132:x1830976125799808:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3953us (4103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.276174:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11019 00000100:00100000:0.0:1746155637.278596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.278625:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125800192 00000100:00100000:1.0:1746155637.278632:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125800192 00000100:00100000:0.0:1746155637.278635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.278706:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125800064 00000100:00100000:1.0:1746155637.278709:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125800064 00000100:00100000:1.0:1746155637.278726:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16496 00000100:00100000:1.0:1746155637.278733:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125800192:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155637.278748:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.278761:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a7f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f177ba expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155637.278793:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16497 00000100:00100000:0.0:1746155637.278799:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125800064:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:1.0:1746155637.278801:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125290624:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155637.278806:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155637.278814:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0800/0x844e5faceb5f6a86 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f177b3 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155637.278833:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125290752:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155637.278861:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.278861:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155637.281224:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125290624:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155637.281250:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a7f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177ba expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.281261:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa1ee00/0x844e5faceb5f6a7f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177ba expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.281270:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1ee00, rc 0) 00000100:00100000:1.0:1746155637.281523:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125800192:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2771us (3265us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155637.281530:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16496 00000100:00100000:0.0:1746155637.285729:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.285835:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125800448 00000100:00100000:1.0:1746155637.285842:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125800448 00000100:00100000:1.0:1746155637.286099:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11020 00000100:00100000:1.0:1746155637.286107:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32132:x1830976125800448:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155637.286120:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.286134:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e600/0x844e5faceb5f6a8d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f177c1 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.286204:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6a94 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.286215:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6a94 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.286223:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6a94 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155637.286233:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155637.286321:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e600/0x844e5faceb5f6a8d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177c1 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.286334:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6a94 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177c1 expref: 14 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.286340:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.286343:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155637.286345:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1f600, rc 0) 00000100:00100000:1.0:1746155637.286388:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:32132:x1830976125800448:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 282us (664us total) trans 8589945161 rc 0/0 00000100:00100000:1.0:1746155637.286394:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11020 00000100:00100000:0.0:1746155637.289309:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.289343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.289372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.289400:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.289416:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.289432:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125800576 00000100:00100000:0.0:1746155637.289438:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125800576 00000100:00100000:0.0:1746155637.289465:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125800832 00000100:00100000:0.0:1746155637.289466:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125800832 00000100:00100000:0.0:1746155637.289475:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125801088 00000100:00100000:0.0:1746155637.289477:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125801088 00000100:00100000:0.0:1746155637.289483:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125800704 00000100:00100000:0.0:1746155637.289485:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125800704 00000100:00100000:0.0:1746155637.289498:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16498 00000100:00100000:0.0:1746155637.289521:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125800576:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155637.289551:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1a00/0x844e5faceb5f6aa2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.289566:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a57800/0x844e5faceb5f64dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1745d expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.289578:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013142ac00/0x844e5faceb5f65af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174aa expref: 40 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.289585:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013142b000/0x844e5faceb5f659a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174a3 expref: 35 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.289590:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.289591:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.289593:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1a00/0x844e5faceb5f6aa2 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.289878:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16501 00000100:00100000:1.0:1746155637.289885:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125800704:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155637.289901:0:10591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6ab7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.289911:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013142a000/0x844e5faceb5f64e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17464 expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.289918:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe07200/0x844e5faceb5f65e0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174cd expref: 31 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.289925:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe07000/0x844e5faceb5f65d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174c6 expref: 23 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.289930:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.289931:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.289934:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6ab7 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.289949:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe07000/0x844e5faceb5f65d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174c6 expref: 23 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.289967:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe07000/0x844e5faceb5f65d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174c6 expref: 23 pid: 8438 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.289975:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125291520:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155637.290004:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe07200/0x844e5faceb5f65e0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174cd expref: 31 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.290011:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe07200/0x844e5faceb5f65e0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174cd expref: 31 pid: 8438 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.290017:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125291648:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155637.290022:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013142b000/0x844e5faceb5f659a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174a3 expref: 35 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.290030:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013142b000/0x844e5faceb5f659a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174a3 expref: 35 pid: 8438 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746155637.290038:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125291776:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155637.290039:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013142a000/0x844e5faceb5f64e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17464 expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.290046:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013142a000/0x844e5faceb5f64e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17464 expref: 12 pid: 20200 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746155637.290053:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125291904:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155637.290065:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013142ac00/0x844e5faceb5f65af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174aa expref: 40 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.290066:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316300 going to sleep for 11 seconds 00010000:00010000:0.0:1746155637.290073:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013142ac00/0x844e5faceb5f65af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174aa expref: 40 pid: 1625 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746155637.290080:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125292032:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155637.290102:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136a57800/0x844e5faceb5f64dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1745d expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.290109:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136a57800/0x844e5faceb5f64dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1745d expref: 12 pid: 9235 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746155637.290117:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125292160:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155637.290127:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.290158:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.290197:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125801216 00000100:00100000:1.0:1746155637.290201:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125801216 00000100:00100000:1.0:1746155637.290228:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16503 00000100:00100000:1.0:1746155637.290233:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125801216:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155637.290247:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6ac5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.290256:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f694b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176fd expref: 23 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.290263:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6a55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1779e expref: 13 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.290269:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbcf800/0x844e5faceb5f6952 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17704 expref: 31 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.290273:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.290274:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.290276:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6ac5 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.290288:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbcf800/0x844e5faceb5f6952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17704 expref: 31 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.290294:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbcf800/0x844e5faceb5f6952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17704 expref: 31 pid: 18270 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.290301:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125292288:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155637.290342:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6a55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1779e expref: 13 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.290349:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6a55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1779e expref: 13 pid: 4461 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746155637.290356:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125292416:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155637.290375:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f694b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176fd expref: 23 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.290381:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f694b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176fd expref: 23 pid: 18270 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.290387:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125292544:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155637.290399:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155637.300752:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125291008:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155637.301341:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.301404:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125291520:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155637.301428:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125291648:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155637.301457:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125291904:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155637.301472:0:10591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6ab7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.301497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.301565:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125292288:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155637.301586:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125292416:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155637.301602:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125292544:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155637.301613:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6ac5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.301630:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.301642:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.301684:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125291776:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155637.301690:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125292032:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155637.301696:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125292160:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155637.301709:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1a00/0x844e5faceb5f6aa2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.301967:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe93100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125291136:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155637.301975:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe93b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125291264:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155637.301991:0:20796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131446400/0x844e5faceb5f6ab0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.302467:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.302723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.302739:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.302750:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.302759:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.302769:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.302781:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125801600 00000100:00100000:1.0:1746155637.302784:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125801600 00002000:00100000:1.0:1746155637.302806:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1499135) req@ffff8800a0ac6d80 x1830976125801600/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.302815:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac6d80 with x1830976125801600 ext(1048576->1499135) 00010000:00010000:1.0:1746155637.302821:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131446800/0x844e5faceb5f6a1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1777b expref: 36 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.302830:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131446800/0x844e5faceb5f6a1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1777b expref: 36 pid: 8437 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746155637.302836:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0ac6d80 00000100:00100000:1.0:1746155637.302850:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125801344 00000100:00100000:1.0:1746155637.302852:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125801344 00002000:00100000:1.0:1746155637.302862:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1605632->2097151) req@ffff88009ff69500 x1830976125801344/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.302869:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff69500 with x1830976125801344 ext(1605632->2097151) 00010000:00010000:1.0:1746155637.302873:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131446a00/0x844e5faceb5f6a16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17774 expref: 24 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.302879:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131446a00/0x844e5faceb5f6a16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17774 expref: 24 pid: 8437 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746155637.302884:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff69500 00000100:00100000:1.0:1746155637.302893:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1344 00000100:00100000:1.0:1746155637.302897:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+37:1962:x1830976125801600:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155637.303250:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1345 00000100:00100000:1.0:1746155637.303256:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1961:x1830976125801344:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155637.303553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.303615:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.303625:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125802752 00000100:00100000:0.0:1746155637.303628:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125802752 00010000:00010000:0.0:1746155637.303639:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131446600/0x844e5faceb5f69de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17758 expref: 40 pid: 8437 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746155637.303652:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8481 00000100:00100000:0.0:1746155637.303657:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125802752:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155637.303662:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155637.303670:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131446600/0x844e5faceb5f69de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17758 expref: 40 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.303677:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131446600/0x844e5faceb5f69de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17758 expref: 40 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.303687:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131446600/0x844e5faceb5f69de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17758 expref: 40 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.303707:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.303708:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.303710:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131446400/0x844e5faceb5f6ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.303716:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131446400/0x844e5faceb5f6ab0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.303726:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155637.303744:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976125802752:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.303753:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8481 00010000:00010000:0.0:1746155637.303770:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1a00/0x844e5faceb5f6aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.303776:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1a00/0x844e5faceb5f6aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.303791:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1a00/0x844e5faceb5f6aa2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.303797:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1a00/0x844e5faceb5f6aa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.303803:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1a00/0x844e5faceb5f6aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.303809:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8f1a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155637.303812:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1a00/0x844e5faceb5f6aa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.303819:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1a00/0x844e5faceb5f6aa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.303827:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1a00/0x844e5faceb5f6aa2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.303832:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1a00/0x844e5faceb5f6aa2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155637.303864:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125800576:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 14343us (14560us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.303870:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16498 00000100:00100000:0.0:1746155637.303906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.303917:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125802880 00000100:00100000:0.0:1746155637.303920:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125802880 00010000:00010000:0.0:1746155637.303930:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f694b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176fd expref: 24 pid: 18270 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746155637.303944:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8482 00000100:00100000:0.0:1746155637.303948:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1962:x1830976125802880:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155637.303954:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155637.303972:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f694b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176fd expref: 24 pid: 18270 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.303978:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f694b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176fd expref: 24 pid: 18270 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.303989:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f694b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f176fd expref: 24 pid: 18270 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.303997:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155637.304009:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1962:x1830976125802880:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 60us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.304013:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8482 00000100:00100000:0.0:1746155637.304065:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.304076:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125803008 00000100:00100000:0.0:1746155637.304079:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125803008 00010000:00010000:0.0:1746155637.304105:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbcf800/0x844e5faceb5f6952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17704 expref: 31 pid: 18270 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746155637.304119:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8483 00000100:00100000:0.0:1746155637.304124:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976125803008:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155637.304132:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155637.304138:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbcf800/0x844e5faceb5f6952 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17704 expref: 31 pid: 18270 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.304145:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbcf800/0x844e5faceb5f6952 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17704 expref: 31 pid: 18270 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.304155:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbcf800/0x844e5faceb5f6952 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17704 expref: 31 pid: 18270 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.304163:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.304164:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.304167:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6ac5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.304173:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f6ac5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.304184:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155637.304195:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976125803008:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.304199:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8483 00010000:00010000:3.0:1746155637.304336:0:20796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131446400/0x844e5faceb5f6ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.304343:0:20796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131446400/0x844e5faceb5f6ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.304355:0:20796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131446400/0x844e5faceb5f6ab0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.304361:0:20796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131446400/0x844e5faceb5f6ab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.304366:0:20796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131446400/0x844e5faceb5f6ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.304371:0:20796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131446400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155637.304374:0:20796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131446400/0x844e5faceb5f6ab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.304384:0:20796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131446400/0x844e5faceb5f6ab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.304392:0:20796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131446400/0x844e5faceb5f6ab0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.304397:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131446400/0x844e5faceb5f6ab0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.304431:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125801088:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 14725us (15058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.304437:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16500 00010000:00010000:1.0:1746155637.305014:0:10591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.305022:0:10591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.305035:0:10591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6ab7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.305041:0:10591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6ab7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.305055:0:10591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6ab7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.305060:0:10591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa1f200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155637.305062:0:10591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6ab7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.305068:0:10591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6ab7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.305077:0:10591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6ab7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.305082:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6ab7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.305628:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125800704:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 15743us (16226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.305634:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16501 00000100:00100000:1.0:1746155637.312412:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:1962:x1830976125801600:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 9506us (10907us total) trans 17179874135 rc 0/0 00000100:00100000:1.0:1746155637.312422:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1344 00002000:00100000:1.0:1746155637.312432:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1499135) req@ffff8800a0ac6d80 x1830976125801600/t17179874135(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/448 e 0 to 0 dl 1746155648 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.312441:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0ac6d80 with x1830976125801600 ext(1048576->1499135) 00010000:00010000:1.0:1746155637.312450:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131446800/0x844e5faceb5f6a1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1777b expref: 36 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.312461:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131446800/0x844e5faceb5f6a1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1777b expref: 36 pid: 8437 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746155637.312468:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0ac6d80 00000100:00100000:1.0:1746155637.314945:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976125801344:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 11683us (12168us total) trans 21474841464 rc 0/0 00000100:00100000:1.0:1746155637.314963:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1345 00002000:00100000:1.0:1746155637.314971:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e1:0x0] (1605632->2097151) req@ffff88009ff69500 x1830976125801344/t21474841464(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/448 e 0 to 0 dl 1746155648 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.314979:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff69500 with x1830976125801344 ext(1605632->2097151) 00010000:00010000:1.0:1746155637.314987:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131446a00/0x844e5faceb5f6a16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17774 expref: 24 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.314997:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131446a00/0x844e5faceb5f6a16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17774 expref: 24 pid: 8437 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746155637.315004:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ff69500 00000100:00100000:0.0:1746155637.315531:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.315622:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125803136 00000100:00100000:1.0:1746155637.315627:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125803136 00010000:00010000:1.0:1746155637.315646:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131446800/0x844e5faceb5f6a1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1777b expref: 36 pid: 8437 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.315667:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8484 00000100:00100000:1.0:1746155637.315672:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:1963:x1830976125803136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155637.315685:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155637.315700:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131446800/0x844e5faceb5f6a1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1777b expref: 36 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.315943:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131446800/0x844e5faceb5f6a1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1777b expref: 36 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.315970:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131446800/0x844e5faceb5f6a1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1499135) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1777b expref: 36 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.316027:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.316029:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.316033:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131447800/0x844e5faceb5f6abe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.316040:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131447800/0x844e5faceb5f6abe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.316120:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155637.316290:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1963:x1830976125803136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 617us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.316296:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8484 00000100:00100000:0.0:1746155637.318007:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.318161:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125803264 00000100:00100000:1.0:1746155637.318166:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125803264 00010000:00010000:1.0:1746155637.318184:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131446a00/0x844e5faceb5f6a16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17774 expref: 24 pid: 8437 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.318202:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8485 00000100:00100000:1.0:1746155637.318207:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976125803264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155637.318219:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155637.318232:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131446a00/0x844e5faceb5f6a16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17774 expref: 24 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.318241:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131446a00/0x844e5faceb5f6a16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17774 expref: 24 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.318255:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131446a00/0x844e5faceb5f6a16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1605632->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17774 expref: 24 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.318264:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.318266:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.318269:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131447a00/0x844e5faceb5f6aa9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.318275:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131447a00/0x844e5faceb5f6aa9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.318338:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155637.318670:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125803264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 462us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.318676:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8485 00000100:00100000:0.0:1746155637.320345:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.320395:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125803520 00000100:00100000:3.0:1746155637.320401:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125803520 00000100:00100000:3.0:1746155637.320490:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11021 00000100:00100000:3.0:1746155637.320497:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:32132:x1830976125803520:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:3.0:1746155637.320618:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155637.320637:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e200/0x844e5faceb5f6a78 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177ac expref: 14 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.320684:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155637.320688:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155637.320710:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.320721:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00e00/0x844e5faceb5f65d2 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174bf expref: 26 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.320729:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07400/0x844e5faceb5f65e7 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174d4 expref: 26 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.320734:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06c00/0x844e5faceb5f65ee lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174db expref: 296 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.320740:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091001200/0x844e5faceb5f6665 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1753d expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.320745:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a400/0x844e5faceb5f6696 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17552 expref: 296 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.320751:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 8/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.320773:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a400/0x844e5faceb5f6696 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17552 expref: 296 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.320783:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a400/0x844e5faceb5f6696 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17552 expref: 296 pid: 27374 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.320986:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125292672:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155637.321331:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091001200/0x844e5faceb5f6665 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1753d expref: 26 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.321340:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091001200/0x844e5faceb5f6665 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1753d expref: 26 pid: 15474 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.321353:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125292800:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155637.321376:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06c00/0x844e5faceb5f65ee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174db expref: 296 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.321382:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06c00/0x844e5faceb5f65ee lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174db expref: 296 pid: 19870 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.321388:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125292928:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155637.321634:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07400/0x844e5faceb5f65e7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174d4 expref: 26 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.321642:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07400/0x844e5faceb5f65e7 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174d4 expref: 26 pid: 19870 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.321648:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125293056:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155637.321673:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00e00/0x844e5faceb5f65d2 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174bf expref: 26 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.321680:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ff00e00/0x844e5faceb5f65d2 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174bf expref: 26 pid: 27374 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.321686:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125293184:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155637.321702:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5010c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.323308:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.323372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.323390:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125803648 00000100:00100000:0.0:1746155637.323395:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125803648 00010000:00010000:0.0:1746155637.323417:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06c00/0x844e5faceb5f65ee lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174db expref: 297 pid: 19870 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746155637.323445:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125803904 00000100:00100000:0.0:1746155637.323447:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125803904 00010000:00010000:0.0:1746155637.323455:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091001200/0x844e5faceb5f6665 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1753d expref: 27 pid: 15474 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746155637.323469:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8486 00000100:00100000:0.0:1746155637.323474:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1961:x1830976125803648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155637.323483:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155637.323486:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06c00/0x844e5faceb5f65ee lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174db expref: 297 pid: 19870 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.323494:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06c00/0x844e5faceb5f65ee lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174db expref: 297 pid: 19870 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.323543:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125292672:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155637.323551:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125292800:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155637.323558:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125292928:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155637.323563:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a2680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125293056:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155637.323569:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125293184:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155637.323601:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155637.323789:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.323836:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.323907:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8488 00000100:00100000:1.0:1746155637.323914:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1961:x1830976125803776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155637.323922:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155637.323926:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a400/0x844e5faceb5f6696 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17552 expref: 298 pid: 27374 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.323934:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a400/0x844e5faceb5f6696 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17552 expref: 298 pid: 27374 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.323944:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a400/0x844e5faceb5f6696 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17552 expref: 298 pid: 27374 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.323965:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.323969:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.323974:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155637.323995:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1961:x1830976125803776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.324000:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8488 00010000:00010000:0.0:1746155637.324136:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06c00/0x844e5faceb5f65ee lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174db expref: 297 pid: 19870 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.324154:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155637.324157:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155637.324162:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155637.324177:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1961:x1830976125803648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 703us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.324183:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8486 00000100:00100000:0.0:1746155637.324704:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155637.324799:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07400/0x844e5faceb5f65e7 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174d4 expref: 25 pid: 19870 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.324810:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07400/0x844e5faceb5f65e7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f174d4 expref: 25 pid: 19870 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.324817:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155637.324820:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155637.324826:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155637.324831:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155637.324854:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155637.324897:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.324903:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155637.325022:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1962:x1830976125804032:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.325029:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8490 00000040:00080000:3.0:1746155637.325436:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3489, 88 off293936 00000004:00080000:3.0:1746155637.325454:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766474950573ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.325830:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3505, 88 off295616 00000004:00080000:3.0:1746155637.325836:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766475332537ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.325856:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3506, 88 off295704 00000004:00080000:3.0:1746155637.325859:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766475356017ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.325866:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3490, 88 off294024 00000004:00080000:3.0:1746155637.325868:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766475365433ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.325874:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3491, 88 off294112 00000004:00080000:3.0:1746155637.325876:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766475373075ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.325882:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3507, 88 off295792 00000004:00080000:3.0:1746155637.325884:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766475381366ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.325890:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3508, 88 off295880 00000004:00080000:3.0:1746155637.325893:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766475390296ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.325899:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3509, 88 off295968 00000004:00080000:3.0:1746155637.325902:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766475398656ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.325907:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3492, 88 off294200 00000004:00080000:3.0:1746155637.325910:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766475407002ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.325915:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3510, 88 off296056 00000004:00080000:3.0:1746155637.325918:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766475414867ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.325924:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3493, 88 off294288 00000004:00080000:3.0:1746155637.325926:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766475423046ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.325932:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3511, 88 off296144 00000004:00080000:3.0:1746155637.325934:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766475431587ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.325940:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3494, 88 off294376 00000004:00080000:3.0:1746155637.325942:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766475439562ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.325948:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3495, 88 off294464 00000004:00080000:3.0:1746155637.325951:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766475447677ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.325967:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3496, 88 off294552 00000004:00080000:3.0:1746155637.325970:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766475466701ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.326178:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3497, 88 off294640 00000004:00080000:3.0:1746155637.326183:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766475680143ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.326191:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3512, 88 off296232 00000004:00080000:3.0:1746155637.326193:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766475690213ns, next at 716011101328ns, rc = 0 00000001:00080000:2.0:1746155637.345239:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945147 is committed 00000001:00080000:2.0:1746155637.345250:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945142 is committed 00000001:00080000:2.0:1746155637.345253:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945141 is committed 00000001:00080000:2.0:1746155637.345259:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945161 is committed 00000001:00080000:2.0:1746155637.345266:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945156 is committed 00000001:00080000:2.0:1746155637.345286:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945159 is committed 00000001:00080000:2.0:1746155637.345289:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945158 is committed 00000001:00080000:2.0:1746155637.345302:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945162 is committed 00000004:00080000:2.0:1746155637.345305:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2697 committed 00000004:00080000:2.0:1746155637.345590:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2677 committed 00000004:00080000:2.0:1746155637.345595:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2676 committed 00000004:00080000:2.0:1746155637.345598:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2675 committed 00000004:00080000:2.0:1746155637.345600:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2674 committed 00000004:00080000:2.0:1746155637.345601:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2696 committed 00000004:00080000:2.0:1746155637.345602:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2673 committed 00000004:00080000:2.0:1746155637.345604:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2695 committed 00000004:00080000:2.0:1746155637.345605:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2672 committed 00000004:00080000:2.0:1746155637.345607:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2694 committed 00000004:00080000:2.0:1746155637.345608:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2693 committed 00000004:00080000:2.0:1746155637.345609:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2692 committed 00000004:00080000:2.0:1746155637.345611:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2671 committed 00000004:00080000:2.0:1746155637.345612:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2670 committed 00000004:00080000:2.0:1746155637.345614:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2691 committed 00000004:00080000:2.0:1746155637.345615:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2690 committed 00000004:00080000:2.0:1746155637.345616:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2669 committed 00000100:00100000:1.0:1746155637.345694:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125293568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.345703:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125293696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155637.345741:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125293312:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746155637.345778:0:15474:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012bdf5f80 reply state ffff880093a71000 transno 8589945162 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155637.345787:0:15474:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746155637.346027:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.346054:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125294208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.346069:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.346079:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125294720:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.346090:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.346099:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125295232:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.346111:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.346146:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125293696 00000100:00100000:2.0:1746155637.346152:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125293696 00000100:00100000:1.0:1746155637.346154:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155637.346167:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125294080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155637.346181:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.346190:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125294208 00000100:00100000:1.0:1746155637.346190:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125294592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.346192:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125294208 00000100:00100000:1.0:1746155637.346202:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.346206:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125294720 00000100:00100000:2.0:1746155637.346208:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125294720 00000100:00100000:1.0:1746155637.346211:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125295104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.346216:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125295232 00000100:00100000:2.0:1746155637.346217:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125295232 00000100:00100000:1.0:1746155637.346222:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.346227:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125293568 00000100:00100000:2.0:1746155637.346228:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125293568 00000100:00100000:1.0:1746155637.346233:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746155637.346234:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125294080 00000100:00100000:2.0:1746155637.346235:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125294080 00000100:00100000:1.0:1746155637.346237:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125293440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.346240:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125294592 00000100:00100000:2.0:1746155637.346242:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125294592 00000100:00100000:2.0:1746155637.346247:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125295104 00000100:00100000:2.0:1746155637.346248:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125295104 00000100:00100000:1.0:1746155637.346248:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.346254:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125293440 00000100:00100000:1.0:1746155637.346254:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801312f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125293952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.346255:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125293440 00000100:00100000:2.0:1746155637.346263:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16504 00000100:00100000:1.0:1746155637.346266:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.346268:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+65:3295:x1830976125293696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155637.346271:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125294464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.346281:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155637.346286:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125294976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.346296:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155637.346309:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125293952 00000100:00100000:1.0:1746155637.346311:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125293952 00000100:00100000:1.0:1746155637.346320:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125294464 00000100:00100000:1.0:1746155637.346322:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125294464 00000100:00100000:1.0:1746155637.346327:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125294976 00000100:00100000:1.0:1746155637.346328:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125294976 00000100:00100000:1.0:1746155637.346335:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16505 00000100:00100000:1.0:1746155637.346339:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+73:3295:x1830976125294208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.346414:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3295:x1830976125293696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (387us total) trans 21474841465 rc 0/0 00000100:00100000:2.0:1746155637.346420:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16504 00000100:00100000:1.0:1746155637.346430:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+74:3295:x1830976125294208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (360us total) trans 17179874136 rc 0/0 00000100:00100000:2.0:1746155637.346431:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16506 00000100:00100000:2.0:1746155637.346435:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+74:3295:x1830976125294720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.346435:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16505 00000100:00100000:1.0:1746155637.346442:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16507 00000100:00100000:1.0:1746155637.346445:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+73:3295:x1830976125295232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.346486:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16508 00000100:00100000:2.0:1746155637.346491:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3298:x1830976125293568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155637.346522:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3295:x1830976125295232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (410us total) trans 17179874138 rc 0/0 00000100:00100000:1.0:1746155637.346527:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16507 00000100:00100000:1.0:1746155637.346535:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16509 00000100:00100000:1.0:1746155637.346539:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3298:x1830976125294080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.346590:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3298:x1830976125293568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (435us total) trans 21474841466 rc 0/0 00000100:00100000:2.0:1746155637.346595:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16508 00000100:00100000:2.0:1746155637.346603:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16510 00000100:00100000:2.0:1746155637.346607:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+74:3298:x1830976125294592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.346678:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+75:3298:x1830976125294592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (474us total) trans 17179874139 rc 0/0 00000100:00100000:2.0:1746155637.346682:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16510 00000100:00100000:2.0:1746155637.346690:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16511 00000100:00100000:2.0:1746155637.346694:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3298:x1830976125295104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.346760:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3298:x1830976125295104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (536us total) trans 21474841468 rc 0/0 00000100:00100000:2.0:1746155637.346765:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16511 00000100:00100000:2.0:1746155637.346772:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16512 00000100:00100000:2.0:1746155637.346776:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3298:x1830976125293440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.346847:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+68:3298:x1830976125293440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (597us total) trans 21474841469 rc 0/0 00000100:00100000:1.0:1746155637.346847:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3298:x1830976125294080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 307us (665us total) trans 21474841467 rc 0/0 00000100:00100000:2.0:1746155637.346851:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16512 00000100:00100000:1.0:1746155637.346854:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16509 00000100:00100000:2.0:1746155637.346859:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16513 00000100:00100000:1.0:1746155637.346861:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16514 00000100:00100000:2.0:1746155637.346863:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f77b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+66:3298:x1830976125293952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155637.346865:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f77b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+74:3298:x1830976125294464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.346928:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f77b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3298:x1830976125293952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (661us total) trans 21474841470 rc 0/0 00000100:00100000:2.0:1746155637.346933:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16513 00000100:00100000:2.0:1746155637.346942:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16515 00000100:00100000:1.0:1746155637.346944:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f77b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3298:x1830976125294464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (657us total) trans 17179874140 rc 0/0 00000100:00100000:2.0:1746155637.346946:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+75:3298:x1830976125294976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.346949:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16514 00000100:00100000:1.0:1746155637.346998:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+74:3295:x1830976125294720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 562us (907us total) trans 17179874137 rc 0/0 00000100:00100000:1.0:1746155637.347003:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16506 00000100:00100000:2.0:1746155637.347026:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+74:3298:x1830976125294976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (729us total) trans 17179874141 rc 0/0 00000004:00080000:1.0:1746155637.347027:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1f2d80/2, rc 0, transno 21474841469 00000100:00100000:2.0:1746155637.347031:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16515 00000100:00100000:1.0:1746155637.347031:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125293440:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155637.347037:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312f6a00/2, rc 0, transno 21474841470 00000100:00100000:1.0:1746155637.347040:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125293952:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1746155637.347044:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1746155637.347046:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe93b80/2, rc 0, transno 17179874140 00000100:00080000:2.0:1746155637.347047:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746155637.347051:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125294464:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155637.347056:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0ac6a00/2, rc 0, transno 17179874141 00000100:00100000:1.0:1746155637.347059:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125294976:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155637.347064:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc52a00/2, rc 0, transno 21474841465 00000004:00080000:1.0:1746155637.347064:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc51880/2, rc 0, transno 21474841466 00000100:00100000:1.0:1746155637.347066:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125293568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.347067:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125293696:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155637.347071:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312f5880/2, rc 0, transno 21474841467 00000004:00080000:2.0:1746155637.347072:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe91500/2, rc 0, transno 17179874136 00000100:00100000:1.0:1746155637.347073:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125294080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.347075:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125294208:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155637.347078:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe93100/2, rc 0, transno 17179874139 00000004:00080000:2.0:1746155637.347079:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe93480/2, rc 0, transno 17179874137 00000100:00100000:1.0:1746155637.347080:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125294592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.347082:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125294720:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155637.347086:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0ac5180/2, rc 0, transno 17179874138 00000100:00100000:2.0:1746155637.347089:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0ac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125295232:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155637.347468:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1746155637.347473:0:15474:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000004:00080000:1.0:1746155637.347482:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801312f4380/2, rc 0, transno 21474841468 00000100:00100000:3.0:1746155637.347484:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32132:x1830976125803520:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 26987us (27140us total) trans 8589945162 rc 0/0 00000100:00100000:1.0:1746155637.347485:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801312f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125295104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155637.347486:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125293824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155637.347493:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11021 00000100:00100000:0.0:1746155637.347513:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155637.347523:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125293312 00000100:00100000:0.0:1746155637.347523:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fe91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125294336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155637.347525:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125293312 00000100:00100000:0.0:1746155637.347536:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155637.347537:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125293824 00000100:00100000:3.0:1746155637.347539:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125293824 00000100:00100000:1.0:1746155637.347539:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746155637.347545:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125295360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155637.347547:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125294336 00000100:00100000:0.0:1746155637.347547:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125294848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155637.347548:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125294336 00000100:00100000:3.0:1746155637.347557:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16516 00000100:00100000:3.0:1746155637.347561:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3296:x1830976125293312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155637.347561:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155637.347576:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125295360 00000100:00100000:0.0:1746155637.347579:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125295360 00000100:00100000:1.0:1746155637.347583:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16517 00000100:00100000:1.0:1746155637.347588:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+68:3296:x1830976125293824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155637.347597:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16518 00000100:00100000:0.0:1746155637.347602:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+75:3296:x1830976125294336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155637.347643:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+70:3296:x1830976125293312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (175us total) trans 21474841471 rc 0/0 00000100:00100000:3.0:1746155637.347648:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16516 00002000:00010000:1.0:1746155637.347651:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:1.0:1746155637.347653:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155637.347655:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1746155637.347657:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16519 00002000:00010000:1.0:1746155637.347657:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155637.347659:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:3.0:1746155637.347661:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+75:3295:x1830976125295360:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.347674:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+69:3296:x1830976125293824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (172us total) trans 21474841472 rc 0/0 00010000:00010000:3.0:1746155637.347676:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155637.347678:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16517 00010000:00010000:3.0:1746155637.347684:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.347689:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.347695:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbce800 already unused, calling callback (ffffffffa135a690) 00000100:00100000:0.0:1746155637.347697:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3296:x1830976125294336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (159us total) trans 17179874142 rc 0/0 00010000:00010000:3.0:1746155637.347698:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155637.347703:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16518 00010000:00010000:3.0:1746155637.347704:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155637.347721:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746155637.347724:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155637.347726:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155637.347729:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.347733:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6acc lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000004:00080000:0.0:1746155637.347738:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff68700/2, rc 0, transno 21474841471 00000100:00100000:0.0:1746155637.347742:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125293312:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155637.347747:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095269f80/2, rc 0, transno 21474841472 00000100:00100000:3.0:1746155637.347748:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125294848 00000100:00100000:0.0:1746155637.347750:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125293824:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155637.347751:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125294848 00000004:00080000:0.0:1746155637.347755:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fe91f80/2, rc 0, transno 17179874142 00000100:00100000:0.0:1746155637.347758:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fe91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125294336:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155637.347764:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16520 00000100:00100000:3.0:1746155637.347768:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3296:x1830976125294848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155637.347853:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3296:x1830976125294848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (130us total) trans 17179874143 rc 0/0 00000100:00100000:3.0:1746155637.347857:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16520 00000004:00080000:0.0:1746155637.347874:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094085c00/2, rc 0, transno 17179874143 00000100:00100000:0.0:1746155637.347886:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125294848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155637.347930:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3295:x1830976125295360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 269us (368us total) trans 17179874144 rc 0/0 00000100:00100000:3.0:1746155637.347934:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16519 00000004:00080000:0.0:1746155637.348000:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fff4000/2, rc 0, transno 17179874144 00000100:00100000:0.0:1746155637.348004:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125295360:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.350088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.350227:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125804288 00000100:00100000:3.0:1746155637.350233:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125804288 00000100:00100000:3.0:1746155637.350274:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11022 00000100:00100000:3.0:1746155637.350280:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32132:x1830976125804288:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155637.350297:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.350310:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6ad3 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f177c8 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.350353:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177c8 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.350368:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177c8 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.350382:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155637.350384:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155637.350387:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1e800, rc 0) 00000100:00100000:3.0:1746155637.350427:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32132:x1830976125804288:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 147us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.350432:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11022 00000100:00100000:0.0:1746155637.353638:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.353843:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125804416 00000100:00100000:3.0:1746155637.353850:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125804416 00000100:00100000:3.0:1746155637.353892:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11023 00000100:00100000:3.0:1746155637.353900:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32132:x1830976125804416:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155637.353912:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.353927:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f6ada lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f177cf expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.353997:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6ae1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.354008:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.354016:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155637.354036:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155637.354129:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155637.354145:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6ae1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.354164:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f6ada lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177cf expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.354175:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6ae1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177cf expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.354181:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155637.354183:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155637.354186:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1e000, rc 0) 00000100:00100000:3.0:1746155637.354229:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32132:x1830976125804416:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 329us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.354235:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11023 00000100:00100000:2.0:1746155637.357657:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.357689:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.357706:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125804544 00000100:00100000:2.0:1746155637.357712:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125804544 00000100:00100000:2.0:1746155637.357735:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125804672 00000100:00100000:2.0:1746155637.357736:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125804672 00000100:00100000:2.0:1746155637.357747:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16521 00000100:00100000:2.0:1746155637.357752:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125804544:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155637.357766:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.357779:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1e00/0x844e5faceb5f6ae8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f177d6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155637.357798:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e1:0x0] initial LVB size: 1048576, mtime: 0x68143873, atime: 0x68143873, ctime: 0x68143873, blocks: 0x7e7 00010000:00010000:2.0:1746155637.357813:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.357814:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.357822:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1e00/0x844e5faceb5f6ae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177d6 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155637.357834:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1e00/0x844e5faceb5f6ae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177d6 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155637.357847:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8f1e00, rc 0) 00000100:00100000:2.0:1746155637.357878:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125804544:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 125us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.357883:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16521 00000100:00100000:2.0:1746155637.357895:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16522 00000100:00100000:2.0:1746155637.357899:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125804672:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155637.357906:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.357914:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0a00/0x844e5faceb5f6aef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f177dd expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155637.357926:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x68143873, atime: 0x68143873, ctime: 0x68143873, blocks: 0x821 00010000:00010000:2.0:1746155637.357933:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.357934:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.357938:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0a00/0x844e5faceb5f6aef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177dd expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155637.357948:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0a00/0x844e5faceb5f6aef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177dd expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155637.357954:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f8f0a00, rc 0) 00000100:00100000:2.0:1746155637.358061:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125804672:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 160us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.358065:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16522 00000100:00100000:3.0:1746155637.358995:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.359012:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.359034:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.359050:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.359101:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125804800 00000100:00100000:1.0:1746155637.359105:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125804800 00000100:00100000:0.0:1746155637.359117:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125805056 00000100:00100000:0.0:1746155637.359120:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125805056 00000100:00100000:1.0:1746155637.359125:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125804928 00000100:00100000:1.0:1746155637.359127:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125804928 00000100:00100000:0.0:1746155637.359137:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125805184 00000100:00100000:0.0:1746155637.359139:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125805184 00000100:00100000:1.0:1746155637.359143:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16523 00000100:00100000:1.0:1746155637.359148:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125804800:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:0.0:1746155637.359152:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16524 00010000:00010000:1.0:1746155637.359155:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155637.359156:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125805056:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155637.359162:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.359164:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ed1a00/0x844e5faceb5f6af6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f177e4 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.359170:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a57800/0x844e5faceb5f6afd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f177f2 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155637.359176:0:20200:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x68143875, atime: 0x68143873, ctime: 0x68143875, blocks: 0x81d 00002000:00010000:0.0:1746155637.359181:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e4:0x0] initial LVB size: 5079552, mtime: 0x68143875, atime: 0x68143875, ctime: 0x68143875, blocks: 0x170f 00010000:00010000:1.0:1746155637.359186:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.359187:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.359188:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.359188:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.359192:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed1a00/0x844e5faceb5f6af6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177e4 expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.359192:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a57800/0x844e5faceb5f6afd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f2 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.359200:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ed1a00/0x844e5faceb5f6af6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177e4 expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.359201:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a57800/0x844e5faceb5f6afd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f2 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.359207:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed1a00, rc 0) 00010000:00010000:0.0:1746155637.359207:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a57800, rc 0) 00000100:00100000:0.0:1746155637.359226:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125805056:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.359230:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16524 00000100:00100000:1.0:1746155637.359233:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125804800:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.359238:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16523 00000100:00100000:0.0:1746155637.359241:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16525 00000100:00100000:0.0:1746155637.359245:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125804928:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:1.0:1746155637.359247:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16526 00010000:00010000:0.0:1746155637.359249:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155637.359251:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125805184:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155637.359254:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f6b04 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f177eb expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.359258:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1746155637.359263:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e3:0x0] initial LVB size: 2097152, mtime: 0x68143875, atime: 0x68143874, ctime: 0x68143875, blocks: 0x821 00010000:00010000:1.0:1746155637.359265:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ed1c00/0x844e5faceb5f6b0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f177f9 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.359267:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.359269:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.359272:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f6b04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177eb expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746155637.359273:0:20200:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e2:0x0] initial LVB size: 4194304, mtime: 0x68143875, atime: 0x68143874, ctime: 0x68143875, blocks: 0x1029 00010000:00010000:1.0:1746155637.359279:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.359279:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f6b04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177eb expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.359280:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.359283:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed1c00/0x844e5faceb5f6b0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f9 expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.359284:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a56c00, rc 0) 00010000:00010000:1.0:1746155637.359290:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ed1c00/0x844e5faceb5f6b0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f9 expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155637.359294:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125804928:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 49us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.359298:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16525 00010000:00010000:1.0:1746155637.359307:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed1c00, rc 0) 00000100:00100000:1.0:1746155637.359971:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125805184:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 73us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.359977:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16526 00000100:00100000:0.0:1746155637.366984:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.367196:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125805440 00000100:00100000:1.0:1746155637.367204:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125805440 00000100:00100000:1.0:1746155637.367257:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7827 00000100:00100000:1.0:1746155637.367264:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976125805440:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:0.0:1746155637.367269:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.367297:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125805696 00010000:00010000:1.0:1746155637.367299:0:2798:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093ed0200/0x844e5faceb5f6b12 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.367301:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125805696 00000100:00100000:0.0:1746155637.367308:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155637.367311:0:2798:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.367313:0:2798:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.367317:0:2798:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed0200/0x844e5faceb5f6b12 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.367325:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125805952 00000100:00100000:2.0:1746155637.367327:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125805952 00010000:00010000:1.0:1746155637.367327:0:2798:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ed0200/0x844e5faceb5f6b12 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.367341:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7828 00000100:00100000:2.0:1746155637.367423:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976125805696:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155637.367440:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0200/0x844e5faceb5f6b19 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.367448:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.367450:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.367457:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0200/0x844e5faceb5f6b19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.367585:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0200/0x844e5faceb5f6b19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155637.367619:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7829 00000100:00100000:0.0:1746155637.367626:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1962:x1830976125805952:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155637.367640:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136a57400/0x844e5faceb5f6b20 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.367647:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.367649:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.367652:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a57400/0x844e5faceb5f6b20 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.367659:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136a57400/0x844e5faceb5f6b20 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.367919:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.367932:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125806208 00000100:00100000:3.0:1746155637.367935:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125806208 00000100:00100000:3.0:1746155637.367954:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7830 00000100:00100000:3.0:1746155637.367975:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976125806208:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155637.367989:0:31252:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fa1ec00/0x844e5faceb5f6b27 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.367996:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.367997:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.368001:0:31252:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa1ec00/0x844e5faceb5f6b27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.368009:0:31252:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa1ec00/0x844e5faceb5f6b27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155637.376145:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.376190:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.376217:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.376247:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.376269:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125806464 00000100:00100000:1.0:1746155637.376277:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125806464 00000100:00100000:1.0:1746155637.376319:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125806720 00000100:00100000:1.0:1746155637.376321:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125806720 00000100:00100000:1.0:1746155637.376334:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125806976 00000100:00100000:1.0:1746155637.376336:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125806976 00000100:00100000:1.0:1746155637.376348:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125807232 00000100:00100000:1.0:1746155637.376350:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125807232 00000100:00100000:1.0:1746155637.376370:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7831 00000100:00100000:1.0:1746155637.376378:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1962:x1830976125806464:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155637.376407:0:31250:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8801303a0c00/0x844e5faceb5f6b2e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.376419:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.376420:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.376424:0:31250:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801303a0c00/0x844e5faceb5f6b2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.376435:0:31250:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801303a0c00/0x844e5faceb5f6b2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155637.376628:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7832 00000100:00100000:0.0:1746155637.376635:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1962:x1830976125806720:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155637.376653:0:25391:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0400/0x844e5faceb5f6b35 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.376661:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.376663:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.376665:0:25391:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0400/0x844e5faceb5f6b35 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.376673:0:25391:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0400/0x844e5faceb5f6b35 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.377485:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7833 00000100:00100000:1.0:1746155637.377491:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1962:x1830976125806976:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155637.377519:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8801303a1200/0x844e5faceb5f6b3c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.377524:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.377525:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.377527:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801303a1200/0x844e5faceb5f6b3c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.377532:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801303a1200/0x844e5faceb5f6b3c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.379040:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7834 00000100:00100000:1.0:1746155637.379048:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1962:x1830976125807232:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155637.379069:0:31253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b43 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.379079:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.379080:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.379083:0:31253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b43 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.379091:0:31253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b43 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.382835:0:2798:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093ed0200/0x844e5faceb5f6b12 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.382849:0:2798:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed0200/0x844e5faceb5f6b12 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.382855:0:2798:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093ed0200/0x844e5faceb5f6b12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.382861:0:2798:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093ed0200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155637.382864:0:2798:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093ed0200/0x844e5faceb5f6b12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.382871:0:2798:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093ed0200/0x844e5faceb5f6b12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.382886:0:2798:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093ed0200/0x844e5faceb5f6b12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.382892:0:2798:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ed0200/0x844e5faceb5f6b12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.383736:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1962:x1830976125805440:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 16467us (16753us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155637.383744:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7827 00010000:00010000:2.0:1746155637.391261:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0200/0x844e5faceb5f6b19 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.391274:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0200/0x844e5faceb5f6b19 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.391280:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0200/0x844e5faceb5f6b19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.391286:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8f0200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155637.391289:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0200/0x844e5faceb5f6b19 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.391296:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0200/0x844e5faceb5f6b19 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.391311:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0200/0x844e5faceb5f6b19 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.391317:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0200/0x844e5faceb5f6b19 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.391390:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1963:x1830976125805696:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 23966us (24118us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155637.391399:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7828 00010000:00010000:3.0:1746155637.397113:0:31252:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fa1ec00/0x844e5faceb5f6b27 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.397127:0:31252:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa1ec00/0x844e5faceb5f6b27 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.397134:0:31252:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fa1ec00/0x844e5faceb5f6b27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.397140:0:31252:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa1ec00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155637.397143:0:31252:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fa1ec00/0x844e5faceb5f6b27 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.397150:0:31252:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fa1ec00/0x844e5faceb5f6b27 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.397166:0:31252:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fa1ec00/0x844e5faceb5f6b27 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.397171:0:31252:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa1ec00/0x844e5faceb5f6b27 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.397235:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1962:x1830976125806208:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 29255us (29312us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155637.397246:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7830 00010000:00010000:1.0:1746155637.398315:0:25394:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136a57400/0x844e5faceb5f6b20 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.398327:0:25394:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136a57400/0x844e5faceb5f6b20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.398333:0:25394:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136a57400/0x844e5faceb5f6b20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.398338:0:25394:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a57400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155637.398340:0:25394:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136a57400/0x844e5faceb5f6b20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.398347:0:25394:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136a57400/0x844e5faceb5f6b20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.398358:0:25394:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136a57400/0x844e5faceb5f6b20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.398363:0:25394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a57400/0x844e5faceb5f6b20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.398497:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1962:x1830976125805952:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 30869us (31185us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155637.398525:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7829 00010000:00010000:1.0:1746155637.407112:0:31250:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8801303a0c00/0x844e5faceb5f6b2e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.407126:0:31250:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801303a0c00/0x844e5faceb5f6b2e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.407133:0:31250:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801303a0c00/0x844e5faceb5f6b2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.407139:0:31250:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801303a0c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155637.407143:0:31250:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801303a0c00/0x844e5faceb5f6b2e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.407150:0:31250:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801303a0c00/0x844e5faceb5f6b2e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.407164:0:31250:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801303a0c00/0x844e5faceb5f6b2e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.407170:0:31250:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801303a0c00/0x844e5faceb5f6b2e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.408725:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8801303a1200/0x844e5faceb5f6b3c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.408736:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801303a1200/0x844e5faceb5f6b3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.408745:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801303a1200/0x844e5faceb5f6b3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.408750:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801303a1200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155637.408752:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801303a1200/0x844e5faceb5f6b3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.408758:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801303a1200/0x844e5faceb5f6b3c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.408768:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801303a1200/0x844e5faceb5f6b3c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.408773:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801303a1200/0x844e5faceb5f6b3c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155637.408834:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1962:x1830976125806976:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 31339us (32611us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155637.408842:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7833 00000100:00100000:1.0:1746155637.409183:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976125806464:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 32803us (33044us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155637.409190:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7831 00010000:00010000:1.0:1746155637.413685:0:31253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b43 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.413701:0:31253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.413942:0:31253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.413949:0:31253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801303a1c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155637.413952:0:31253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.413971:0:31253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.413986:0:31253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.413991:0:31253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.414058:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1962:x1830976125807232:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 35008us (37806us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155637.414066:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7834 00010000:00010000:0.0:1746155637.415952:0:25391:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0400/0x844e5faceb5f6b35 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.416760:0:25391:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0400/0x844e5faceb5f6b35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.416768:0:25391:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0400/0x844e5faceb5f6b35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.416779:0:25391:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f8f0400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155637.416782:0:25391:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0400/0x844e5faceb5f6b35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.416789:0:25391:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0400/0x844e5faceb5f6b35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.416804:0:25391:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0400/0x844e5faceb5f6b35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.416809:0:25391:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0400/0x844e5faceb5f6b35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155637.416882:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976125806720:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 40244us (40692us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155637.416890:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7832 00000100:00100000:1.0:1746155637.425837:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.425903:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125807488 00000100:00100000:2.0:1746155637.425911:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125807488 00000100:00100000:2.0:1746155637.426441:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11024 00000100:00100000:2.0:1746155637.426449:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32132:x1830976125807488:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155637.426487:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155637.426536:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6ae1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177cf expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.426557:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155637.426561:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155637.426589:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6b4a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.426599:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6b4a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.426606:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6b4a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00010000:2.0:1746155637.426756:0:27374:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fff4700 reply state ffff8801362b2000 transno 8589945163 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6b4a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155637.426763:0:27374:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746155637.426831:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32132:x1830976125807488:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 382us (1001us total) trans 8589945163 rc 0/0 00000100:00100000:2.0:1746155637.426837:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11024 00000100:00100000:0.0:1746155637.430805:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.430831:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.431011:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125807616 00000100:00100000:1.0:1746155637.431018:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125807616 00000100:00100000:1.0:1746155637.431050:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125807744 00000100:00100000:1.0:1746155637.431053:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125807744 00000100:00100000:1.0:1746155637.431069:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16527 00000100:00100000:1.0:1746155637.431075:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125807616:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155637.431221:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155637.431224:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155635 -> 1746155637 00002000:00010000:1.0:1746155637.431226:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155635 -> 1746155637 00002000:00010000:1.0:1746155637.431228:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155635 -> 1746155637 00002000:00010000:1.0:1746155637.431229:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746155637.431269:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125807616:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 193us (470us total) trans 17179874145 rc 0/0 00000100:00100000:1.0:1746155637.431275:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16527 00000100:00100000:1.0:1746155637.431289:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16528 00000100:00100000:1.0:1746155637.431293:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125807744:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155637.431369:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155637.431372:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155635 -> 1746155637 00002000:00010000:1.0:1746155637.431374:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155635 -> 1746155637 00002000:00010000:1.0:1746155637.431375:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155635 -> 1746155637 00002000:00010000:1.0:1746155637.431377:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155637.431392:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976125807744:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 98us (560us total) trans 21474841473 rc 0/0 00000100:00100000:1.0:1746155637.431397:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16528 00000100:00100000:0.0:1746155637.432005:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.432056:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125807872 00000100:00100000:2.0:1746155637.432059:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125807872 00000100:00100000:2.0:1746155637.432078:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16529 00000100:00100000:2.0:1746155637.432088:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125807872:12345-192.168.202.51@tcp:2:lfs.0 00010000:00010000:3.0:1746155637.432110:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6b4a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155637.432118:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6b4a lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155637.432123:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6b4a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155637.432128:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948e7800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155637.432132:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6b4a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155637.432136:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6b4a lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155637.432147:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155637.432150:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155637.432152:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6b4a lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155637.432156:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6b4a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00002000:00010000:2.0:1746155637.432160:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155637.432163:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.432164:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155635 -> 1746155637 00002000:00010000:2.0:1746155637.432166:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.432167:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746155637.432193:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125807872:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 110us (189us total) trans 21474841474 rc 0/0 00000100:00100000:2.0:1746155637.432199:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16529 00000100:00100000:0.0:1746155637.433845:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.434372:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.434414:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.434534:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125808000 00000100:00100000:3.0:1746155637.434541:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125808000 00000100:00100000:2.0:1746155637.434557:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125808128 00000100:00100000:2.0:1746155637.434561:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125808128 00000100:00100000:3.0:1746155637.434567:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125808256 00000100:00100000:3.0:1746155637.434569:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125808256 00000100:00100000:2.0:1746155637.434582:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16530 00000100:00100000:3.0:1746155637.434593:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16531 00000100:00100000:2.0:1746155637.434593:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976125808000:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:3.0:1746155637.434599:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976125808128:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:3.0:1746155637.434639:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16532 00000100:00100000:3.0:1746155637.434644:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125808256:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:2.0:1746155637.434724:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155637.434726:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746155637.434727:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:3.0:1746155637.434728:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.434729:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155636 -> 1746155637 00002000:00010000:3.0:1746155637.434730:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155636 -> 1746155637 00002000:00010000:3.0:1746155637.434731:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.434731:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00002000:00010000:3.0:1746155637.434733:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00002000:00010000:2.0:1746155637.434733:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155637.434773:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976125808256:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 128us (358us total) trans 21474841475 rc 0/0 00000100:00100000:3.0:1746155637.434779:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16532 00002000:00010000:3.0:1746155637.434841:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:3.0:1746155637.434844:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:3.0:1746155637.434845:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155637 -> 1746155637 00002000:00010000:3.0:1746155637.434847:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00002000:00010000:3.0:1746155637.434848:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5903 -> 5903 00000100:00100000:3.0:1746155637.434870:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976125808128:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 271us (498us total) trans 17179874147 rc 0/0 00000100:00100000:3.0:1746155637.434876:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16531 00000100:00100000:2.0:1746155637.435145:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125808000:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 555us (1304us total) trans 17179874146 rc 0/0 00000100:00100000:2.0:1746155637.435152:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16530 00000100:00100000:0.0:1746155637.438072:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.438289:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125808512 00000100:00100000:3.0:1746155637.438296:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125808512 00000100:00100000:3.0:1746155637.438590:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4660 00000100:00100000:3.0:1746155637.438598:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32132:x1830976125808512:12345-192.168.202.51@tcp:35:lfs.0 00000004:00010000:3.0:1746155637.438644:0:14235:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x35e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6a94 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177c1 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.438683:0:14235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155637.438693:0:14235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6ad3 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177c8 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.438699:0:14235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155637.438722:0:14235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177c8 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.438733:0:14235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6ad3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177c8 expref: 9 pid: 15474 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.438742:0:14235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14235:1830976125295488:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155637.438863:0:14235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.444074:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.444159:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125808640 00000100:00100000:2.0:1746155637.444166:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125808640 00000100:00100000:3.0:1746155637.444168:0:14235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14235:1830976125295488:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155637.444185:0:14235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00010000:00010000:2.0:1746155637.444193:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6ad3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177c8 expref: 10 pid: 15474 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746155637.444216:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8491 00000100:00100000:2.0:1746155637.444224:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125808640:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155637.444235:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155637.444240:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6ad3 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177c8 expref: 10 pid: 15474 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.444248:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6ad3 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177c8 expref: 10 pid: 15474 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.444265:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6ad3 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177c8 expref: 10 pid: 15474 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.444295:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155637.444299:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00010000:00010000:2.0:1746155637.444305:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14235 initiator: MDT0 00010000:00010000:2.0:1746155637.444312:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14235 initiator: MDT0 00010000:00010000:2.0:1746155637.444334:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155637.444352:0:14235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155637.444357:0:14235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00000100:00100000:2.0:1746155637.444364:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125808640:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 140us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.444370:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8491 00000040:00080000:3.0:1746155637.444859:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3498, 88 off294728 00000004:00080000:3.0:1746155637.444864:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766594360879ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.444916:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3513, 88 off296320 00000004:00080000:3.0:1746155637.444920:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766594416992ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.444940:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3514, 88 off296408 00000004:00080000:3.0:1746155637.444943:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766594440464ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.444950:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3499, 88 off294816 00000004:00080000:3.0:1746155637.444952:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766594449200ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.444990:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3501, 88 off295000 00000004:00080000:3.0:1746155637.444993:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766594489969ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.445001:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3515, 88 off296496 00000004:00080000:3.0:1746155637.445004:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766594500747ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.445010:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3516, 88 off296584 00000004:00080000:3.0:1746155637.445012:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766594509080ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.445018:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3517, 88 off296672 00000004:00080000:3.0:1746155637.445020:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766594517415ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.445027:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3502, 88 off295088 00000004:00080000:3.0:1746155637.445029:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766594526197ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.445035:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3518, 88 off296760 00000004:00080000:3.0:1746155637.445037:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766594533857ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.445051:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3503, 88 off295176 00000004:00080000:3.0:1746155637.445053:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766594550580ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.445059:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3519, 88 off296848 00000004:00080000:3.0:1746155637.445061:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766594557823ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.445067:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3504, 88 off295264 00000004:00080000:3.0:1746155637.445069:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766594565973ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.445074:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3505, 88 off295352 00000004:00080000:3.0:1746155637.445076:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766594572725ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.445080:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3506, 88 off295440 00000004:00080000:3.0:1746155637.445082:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766594579375ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.445087:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3507, 88 off295528 00000004:00080000:3.0:1746155637.445089:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766594585713ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.445094:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3520, 88 off296936 00000004:00080000:3.0:1746155637.445096:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766594593530ns, next at 716011101328ns, rc = 0 00000004:00010000:3.0:1746155637.463105:0:14235:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a01fe680 reply state ffff88013039f400 transno 8589945164 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00000100:00100000:3.0:1746155637.463116:0:14235:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746155637.463124:0:14235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155637.463126:0:14235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155637.463133:0:14235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6a94 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177c1 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746155637.463169:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945163 is committed 00000001:00080000:2.0:1746155637.463182:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945164 is committed 00000004:00080000:2.0:1746155637.463186:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2705 committed 00000004:00080000:2.0:1746155637.463191:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2686 committed 00000004:00080000:2.0:1746155637.463196:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2685 committed 00000004:00080000:2.0:1746155637.463197:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2684 committed 00000004:00080000:2.0:1746155637.463198:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2683 committed 00000004:00080000:2.0:1746155637.463200:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2704 committed 00000004:00080000:2.0:1746155637.463201:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2682 committed 00000004:00080000:2.0:1746155637.463202:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2703 committed 00000004:00080000:2.0:1746155637.463203:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2681 committed 00000004:00080000:2.0:1746155637.463205:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2702 committed 00000004:00080000:2.0:1746155637.463206:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2701 committed 00000004:00080000:2.0:1746155637.463207:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2700 committed 00000004:00080000:2.0:1746155637.463208:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2680 committed 00000004:00080000:2.0:1746155637.463210:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2679 committed 00000004:00080000:2.0:1746155637.463211:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2699 committed 00000004:00080000:2.0:1746155637.463212:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2698 committed 00000004:00080000:2.0:1746155637.463213:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2678 committed 00000100:00100000:0.0:1746155637.463326:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125295872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155637.463383:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1746155637.463401:0:14235:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746155637.463403:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125296384:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155637.463411:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32132:x1830976125808512:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 24815us (25344us total) trans 8589945164 rc 0/0 00000100:00100000:0.0:1746155637.463415:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155637.463419:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4660 00000100:00100000:0.0:1746155637.463423:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125296896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155637.463434:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155637.463447:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125297408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155637.463459:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155637.463469:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1746155637.463472:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125296000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155637.463482:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155637.463491:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125296512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155637.463517:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155637.463527:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125297024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155637.463533:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125295872 00000100:00100000:3.0:1746155637.463538:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125295872 00000100:00100000:0.0:1746155637.463540:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155637.463548:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125297536:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155637.463559:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125296384 00000100:00100000:0.0:1746155637.463560:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155637.463561:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125296384 00000100:00100000:3.0:1746155637.463571:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16533 00000100:00100000:3.0:1746155637.463575:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+70:3295:x1830976125295872:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746155637.463580:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14235 initiator: MDT0 00010000:00010000:0.0:1746155637.463587:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14235 initiator: MDT0 00010000:00010000:0.0:1746155637.463592:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14235 initiator: MDT0 00010000:00010000:0.0:1746155637.463597:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa1fe00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155637.463600:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14235 initiator: MDT0 00010000:00010000:0.0:1746155637.463608:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14235 initiator: MDT0 00010000:00010000:0.0:1746155637.463618:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155637.463619:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155637.463622:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14235 initiator: MDT0 00010000:00010000:0.0:1746155637.463626:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b51 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14235 initiator: MDT0 00000100:00100000:0.0:1746155637.463640:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125296896 00000100:00100000:0.0:1746155637.463643:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125296896 00000100:00100000:0.0:1746155637.463656:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125297408 00000100:00100000:0.0:1746155637.463658:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125297408 00000100:00100000:0.0:1746155637.463666:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125296000 00000100:00100000:0.0:1746155637.463667:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125296000 00000100:00100000:0.0:1746155637.463673:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125296512 00000100:00100000:0.0:1746155637.463674:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125296512 00000100:00100000:0.0:1746155637.463678:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125297024 00000100:00100000:0.0:1746155637.463680:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125297024 00000100:00100000:0.0:1746155637.463685:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125297536 00000100:00100000:0.0:1746155637.463686:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125297536 00000100:00100000:0.0:1746155637.463693:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16534 00000100:00100000:0.0:1746155637.463697:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+74:3295:x1830976125296384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155637.463715:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155637.463718:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:3.0:1746155637.463719:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155637 -> 1746155637 00002000:00010000:3.0:1746155637.463721:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00002000:00010000:3.0:1746155637.463723:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746155637.463746:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+74:3295:x1830976125295872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (362us total) trans 21474841476 rc 0/0 00000100:00100000:3.0:1746155637.463754:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16533 00000100:00100000:3.0:1746155637.463763:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16535 00000100:00100000:3.0:1746155637.463767:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+74:3295:x1830976125296896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155637.463767:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:0.0:1746155637.463769:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155637.463771:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155637.463772:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155637.463774:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155637.463791:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+74:3295:x1830976125296384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (374us total) trans 21474841477 rc 0/0 00000100:00100000:0.0:1746155637.463796:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16534 00000100:00100000:0.0:1746155637.463804:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16536 00000100:00100000:0.0:1746155637.463808:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+79:3295:x1830976125297408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155637.463835:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f779c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+74:3295:x1830976125296896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (400us total) trans 21474841478 rc 0/0 00000100:00100000:3.0:1746155637.463839:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16535 00000100:00100000:3.0:1746155637.463848:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16537 00000100:00100000:3.0:1746155637.463852:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+73:3295:x1830976125296000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155637.463898:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+80:3295:x1830976125297408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (437us total) trans 17179874148 rc 0/0 00000100:00100000:0.0:1746155637.463903:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16536 00002000:00010000:3.0:1746155637.463908:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746155637.463910:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00000100:00100000:0.0:1746155637.463911:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16538 00002000:00010000:3.0:1746155637.463912:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155637 -> 1746155637 00002000:00010000:3.0:1746155637.463913:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00002000:00010000:3.0:1746155637.463915:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155637.463915:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f77b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+74:3295:x1830976125296512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155637.463930:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+74:3295:x1830976125296000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (446us total) trans 21474841479 rc 0/0 00000100:00100000:3.0:1746155637.463934:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16537 00000100:00100000:3.0:1746155637.463943:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16539 00000100:00100000:3.0:1746155637.463946:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f77b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+79:3295:x1830976125297024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155637.463995:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f77b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+74:3295:x1830976125296512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (476us total) trans 21474841480 rc 0/0 00000100:00100000:0.0:1746155637.463999:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16538 00000100:00100000:0.0:1746155637.464008:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16540 00000100:00100000:0.0:1746155637.464012:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801312f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+80:3295:x1830976125297536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155637.464026:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f77b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+80:3295:x1830976125297024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (485us total) trans 17179874149 rc 0/0 00000100:00100000:3.0:1746155637.464031:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16539 00000100:00100000:1.0:1746155637.464094:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125295616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.464739:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.464751:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125295616 00000100:00100000:2.0:1746155637.464755:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125295616 00000100:00100000:1.0:1746155637.464756:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125296128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.464771:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.464774:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16541 00000100:00100000:2.0:1746155637.464778:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+81:3297:x1830976125295616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.464780:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125296640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155637.464791:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155637.464799:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125297152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.464809:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155637.464819:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746155637.464823:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125295744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155637.464835:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155637.464842:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125296256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155637.464853:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746155637.464858:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:1.0:1746155637.464859:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125296768:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155637.464861:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.464862:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.464864:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.464866:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746155637.464868:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155637.464874:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125297280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.464894:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.464895:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+82:3297:x1830976125295616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (155us total) trans 17179874151 rc 0/0 00000100:00100000:2.0:1746155637.464899:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16541 00000100:00100000:2.0:1746155637.464907:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125296128 00000100:00100000:2.0:1746155637.464909:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125296128 00000004:00080000:1.0:1746155637.464913:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fed80/2, rc 0, transno 17179874151 00000100:00100000:2.0:1746155637.464915:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125296640 00000100:00100000:2.0:1746155637.464916:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125296640 00000100:00100000:1.0:1746155637.464921:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125295616:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.464922:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125297152 00000100:00100000:2.0:1746155637.464923:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125297152 00000100:00100000:2.0:1746155637.464930:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125295744 00000100:00100000:2.0:1746155637.464931:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125295744 00000100:00100000:2.0:1746155637.464937:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125296256 00000100:00100000:1.0:1746155637.464937:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125296768 00000100:00100000:2.0:1746155637.464938:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125296256 00000100:00100000:1.0:1746155637.464939:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125296768 00000100:00100000:2.0:1746155637.464943:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125297280 00000100:00100000:2.0:1746155637.464944:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125297280 00000100:00100000:1.0:1746155637.464949:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16542 00000100:00100000:2.0:1746155637.464953:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16543 00000100:00100000:1.0:1746155637.464953:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+85:3297:x1830976125296128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.464969:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+76:3297:x1830976125296640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155637.465032:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155637.465035:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:1.0:1746155637.465037:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155637 -> 1746155637 00002000:00010000:1.0:1746155637.465038:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00000100:00100000:2.0:1746155637.465040:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3297:x1830976125296640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (248us total) trans 21474841481 rc 0/0 00002000:00010000:1.0:1746155637.465040:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155637.465045:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16543 00000100:00100000:1.0:1746155637.465053:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+86:3297:x1830976125296128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (281us total) trans 17179874152 rc 0/0 00000100:00100000:2.0:1746155637.465054:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16544 00000100:00100000:2.0:1746155637.465058:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3297:x1830976125297152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.465058:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16542 00000100:00100000:1.0:1746155637.465064:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16545 00000100:00100000:1.0:1746155637.465068:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3297:x1830976125295744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155637.465121:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746155637.465123:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3297:x1830976125297152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (312us total) trans 17179874153 rc 0/0 00002000:00010000:1.0:1746155637.465123:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:1.0:1746155637.465125:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155637 -> 1746155637 00002000:00010000:1.0:1746155637.465127:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00000100:00100000:2.0:1746155637.465128:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16544 00002000:00010000:1.0:1746155637.465128:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155637.465137:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16546 00000100:00100000:2.0:1746155637.465141:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3297:x1830976125296256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155637.465141:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3297:x1830976125295744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (305us total) trans 21474841482 rc 0/0 00000100:00100000:1.0:1746155637.465145:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16545 00000100:00100000:1.0:1746155637.465155:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16547 00000100:00100000:1.0:1746155637.465158:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+85:3297:x1830976125296768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155637.465210:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00000100:00100000:2.0:1746155637.465212:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+77:3297:x1830976125296256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (357us total) trans 21474841483 rc 0/0 00002000:00010000:1.0:1746155637.465212:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:1.0:1746155637.465214:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155637 -> 1746155637 00002000:00010000:1.0:1746155637.465216:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00000100:00100000:2.0:1746155637.465217:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16546 00002000:00010000:1.0:1746155637.465218:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5903 -> 5903 00000100:00100000:2.0:1746155637.465225:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16548 00000100:00100000:2.0:1746155637.465229:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3297:x1830976125297280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.465231:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+86:3297:x1830976125296768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (361us total) trans 17179874154 rc 0/0 00000100:00100000:1.0:1746155637.465235:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16547 00000100:00100000:2.0:1746155637.465291:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3297:x1830976125297280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (396us total) trans 17179874155 rc 0/0 00000100:00100000:2.0:1746155637.465296:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16548 00000100:00100000:0.0:1746155637.465341:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801312f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3295:x1830976125297536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1328us (1779us total) trans 17179874150 rc 0/0 00000100:00100000:0.0:1746155637.465346:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16540 00000100:00100000:2.0:1746155637.465351:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125297664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.465367:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155637.465372:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01ff100/2, rc 0, transno 21474841479 00000100:00100000:0.0:1746155637.465376:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125296000:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155637.465381:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01fea00/2, rc 0, transno 21474841482 00000004:00080000:0.0:1746155637.465382:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01ffb80/2, rc 0, transno 21474841480 00000100:00100000:2.0:1746155637.465383:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125295744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155637.465385:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125296512:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155637.465388:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01ff480/2, rc 0, transno 21474841483 00000100:00100000:2.0:1746155637.465391:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125296256:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155637.465391:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fdf80/2, rc 0, transno 17179874149 00000100:00100000:0.0:1746155637.465393:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125297024:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155637.465396:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fd500/2, rc 0, transno 17179874154 00000100:00100000:2.0:1746155637.465398:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125296768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155637.465401:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4ff100/2, rc 0, transno 17179874150 00000004:00080000:2.0:1746155637.465403:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fe300/2, rc 0, transno 17179874155 00000100:00100000:0.0:1746155637.465403:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125297536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.465405:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125297280:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155637.465409:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4ff800/2, rc 0, transno 17179874152 00000004:00080000:0.0:1746155637.465409:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fe680/2, rc 0, transno 17179874148 00000100:00100000:2.0:1746155637.465411:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125296128:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155637.465411:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125297408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155637.465417:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01fed80/2, rc 0, transno 21474841476 00000004:00080000:2.0:1746155637.465418:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01fd500/2, rc 0, transno 21474841481 00000100:00100000:0.0:1746155637.465419:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125295872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.465420:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125296640:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155637.465424:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01ff800/2, rc 0, transno 21474841477 00000004:00080000:2.0:1746155637.465425:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fc000/2, rc 0, transno 17179874153 00000100:00100000:2.0:1746155637.465427:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125297152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155637.465427:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125296384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155637.465431:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01fd880/2, rc 0, transno 21474841478 00000100:00100000:0.0:1746155637.465434:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125296896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155637.465442:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125297664 00000100:00100000:0.0:1746155637.465444:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125297664 00000100:00100000:0.0:1746155637.465455:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16549 00000100:00100000:0.0:1746155637.465459:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+85:3297:x1830976125297664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155637.465543:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+86:3297:x1830976125297664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (174us total) trans 17179874156 rc 0/0 00000100:00100000:0.0:1746155637.465547:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16549 00000004:00080000:2.0:1746155637.465738:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4ff480/2, rc 0, transno 17179874156 00000100:00100000:2.0:1746155637.465742:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125297664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155637.467456:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.467531:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125808768 00000100:00100000:3.0:1746155637.467536:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125808768 00000100:00100000:3.0:1746155637.467572:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11025 00000100:00100000:3.0:1746155637.467577:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32132:x1830976125808768:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155637.467595:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.467607:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6b58 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17800 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.467647:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6b58 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17800 expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.467657:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6b58 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17800 expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.467668:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155637.467670:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155637.467672:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1e000, rc 0) 00000100:00100000:3.0:1746155637.467707:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32132:x1830976125808768:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 130us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.467712:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11025 00000100:00100000:0.0:1746155637.470203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.470276:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125809024 00000100:00100000:3.0:1746155637.470283:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125809024 00000100:00100000:3.0:1746155637.470459:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4661 00000100:00100000:3.0:1746155637.470466:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32132:x1830976125809024:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155637.470693:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32132:x1830976125809024:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 226us (495us total) trans 8589945165 rc 0/0 00000100:00100000:3.0:1746155637.470699:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4661 00000100:00100000:0.0:1746155637.488629:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.488675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.489092:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125809280 00000100:00100000:2.0:1746155637.489100:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125809280 00000100:00100000:2.0:1746155637.489146:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125809536 00000100:00100000:2.0:1746155637.489148:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125809536 00000100:00100000:3.0:1746155637.489171:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11026 00000100:00100000:3.0:1746155637.489180:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32138:x1830976125809280:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155637.489202:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.489218:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6b5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17807 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.489303:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6b66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489313:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6b66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489321:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6b66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489332:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6b6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489336:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6b6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489340:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6b6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489421:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b74 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489428:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489433:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b74 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155637.489440:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155637.489528:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6b66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489535:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6b66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489540:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6b66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489545:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa1e800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155637.489548:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6b66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489553:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6b66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489561:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155637.489563:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155637.489566:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6b66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489570:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6b66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489579:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6b6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489583:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6b6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489587:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6b6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489590:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa1f600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155637.489592:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6b6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489596:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6b6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489604:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c823300) 00010000:00010000:3.0:1746155637.489606:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155637.489608:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6b6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489611:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6b6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.489639:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f6b5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17807 expref: 289 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.489649:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b74 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17807 expref: 288 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.489655:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155637.489656:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155637.489658:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1fe00, rc 0) 00000100:00100000:2.0:1746155637.489768:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11027 00000100:00100000:2.0:1746155637.489774:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32144:x1830976125809536:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155637.489782:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.489787:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1800/0x844e5faceb5f6b82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1780e expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.489857:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32138:x1830976125809280:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 678us (1236us total) trans 8589945166 rc 0/0 00000100:00100000:3.0:1746155637.489863:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11026 00010000:00010000:2.0:1746155637.489912:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6b89 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.489919:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.489924:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.489932:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a0a00/0x844e5faceb5f6b90 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.489936:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a0a00/0x844e5faceb5f6b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.489941:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a0a00/0x844e5faceb5f6b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490000:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b97 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490006:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490012:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b97 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155637.490016:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155637.490050:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6b89 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490055:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6b89 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490059:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6b89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490063:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801303a1200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155637.490065:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6b89 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490070:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6b89 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490076:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155637.490078:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155637.490080:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6b89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490088:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6b89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490109:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a0a00/0x844e5faceb5f6b90 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490114:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a0a00/0x844e5faceb5f6b90 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490119:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a0a00/0x844e5faceb5f6b90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490123:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801303a0a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155637.490125:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a0a00/0x844e5faceb5f6b90 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490129:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a0a00/0x844e5faceb5f6b90 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490135:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d55ab00) 00010000:00010000:2.0:1746155637.490137:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155637.490138:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a0a00/0x844e5faceb5f6b90 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490142:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a0a00/0x844e5faceb5f6b90 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.490162:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1800/0x844e5faceb5f6b82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1780e expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.490169:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b97 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1780e expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.490178:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155637.490179:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155637.490181:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801303a1c00, rc 0) 00000100:00100000:2.0:1746155637.490210:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32144:x1830976125809536:12345-192.168.202.51@tcp:101:cat.0 Request processed in 436us (1533us total) trans 8589945167 rc 0/0 00000100:00100000:2.0:1746155637.490214:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11027 00000100:00100000:0.0:1746155637.493236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.493286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.493319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.493369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.493439:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125809920 00000100:00100000:3.0:1746155637.493447:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125809920 00000100:00100000:3.0:1746155637.493478:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125810048 00000100:00100000:3.0:1746155637.493480:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125810048 00000100:00100000:2.0:1746155637.493494:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125809792 00000100:00100000:3.0:1746155637.493495:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16550 00000100:00100000:2.0:1746155637.493497:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125809792 00000100:00100000:3.0:1746155637.493514:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:32144:x1830976125809920:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155637.493528:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.493542:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f6ba5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1781c expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.493546:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125810304 00000100:00100000:2.0:1746155637.493548:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125810304 00000100:00100000:2.0:1746155637.493561:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11028 00010000:00010000:3.0:1746155637.493562:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.493563:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746155637.493566:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32142:x1830976125809792:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155637.493569:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f6ba5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1781c expref: 36 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.493576:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.493579:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f6ba5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1781c expref: 36 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.493584:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7600/0x844e5faceb5f6bac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17815 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.493588:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbcee00, rc 0) 00000100:00100000:3.0:1746155637.493618:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:32144:x1830976125809920:12345-192.168.202.51@tcp:101:cat.0 Request processed in 117us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.493622:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16550 00000100:00100000:3.0:1746155637.493635:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16551 00000100:00100000:3.0:1746155637.493639:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:32143:x1830976125810048:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155637.493644:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.493646:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155637.493648:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbcf200/0x844e5faceb5f6bba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17823 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.493656:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b74 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17807 expref: 288 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.493657:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.493658:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.493661:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbcf200/0x844e5faceb5f6bba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17823 expref: 40 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.493662:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b97 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1780e expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.493667:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155637.493669:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbcf200/0x844e5faceb5f6bba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17823 expref: 40 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.493679:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbcf200, rc 0) 00000100:00100000:3.0:1746155637.493691:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:32143:x1830976125810048:12345-192.168.202.51@tcp:101:cat.0 Request processed in 52us (372us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155637.493693:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b97 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1780e expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.493695:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16551 00010000:00010000:2.0:1746155637.493702:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b97 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1780e expref: 9 pid: 27374 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746155637.493711:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125297792:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155637.493715:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11029 00000100:00100000:3.0:1746155637.493718:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32138:x1830976125810304:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155637.493725:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.493727:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746155637.493738:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155637.493742:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155637.493746:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155637.493750:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155637.493754:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6bc1 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1782a expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.493764:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f6b74 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17807 expref: 289 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.493773:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155637.493773:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501f00 going to sleep for 11 seconds 00010000:00010000:3.0:1746155637.493780:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6b58 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17800 expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.493784:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.493800:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6b58 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17800 expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.493808:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6b58 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17800 expref: 7 pid: 15474 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.493814:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125298048:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155637.493832:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b780 going to sleep for 11 seconds 00000100:00100000:2.0:1746155637.495208:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125297792:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155637.495223:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155637.495279:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125298048:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155637.495291:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155637.495660:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.495690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.495745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.495838:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125810560 00000100:00100000:1.0:1746155637.495844:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125810560 00010000:00010000:1.0:1746155637.495867:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b97 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1780e expref: 10 pid: 27374 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.495892:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125810688 00000100:00100000:1.0:1746155637.495894:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125810688 00010000:00010000:1.0:1746155637.495901:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6b58 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17800 expref: 8 pid: 15474 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.495914:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8492 00000100:00100000:1.0:1746155637.495919:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1963:x1830976125810560:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155637.495930:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155637.495934:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b97 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1780e expref: 10 pid: 27374 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.495941:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8493 00010000:00010000:1.0:1746155637.495942:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b97 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1780e expref: 10 pid: 27374 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.495949:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976125810688:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155637.495964:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155637.495969:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6b58 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17800 expref: 8 pid: 15474 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.495970:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303a1c00/0x844e5faceb5f6b97 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1780e expref: 10 pid: 27374 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.495977:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6b58 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17800 expref: 8 pid: 15474 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.495988:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e000/0x844e5faceb5f6b58 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17800 expref: 8 pid: 15474 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.495989:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.495993:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.496000:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.496005:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155637.496010:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.496015:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.496018:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155637.496029:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125810432 00000100:00100000:2.0:1746155637.496037:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125810432 00000100:00100000:2.0:1746155637.496062:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11030 00000100:00100000:2.0:1746155637.496067:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32143:x1830976125810432:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155637.496130:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.496144:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17831 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.496188:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155637.496192:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155637.496203:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.496232:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1963:x1830976125810688:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 284us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.496232:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1963:x1830976125810560:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 311us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.496237:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8493 00000100:00100000:1.0:1746155637.496240:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8492 00010000:00010000:3.0:1746155637.496258:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155637.496264:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155637.496665:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155637.496673:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.496685:0:14234:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155637.496693:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.496702:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155637.496704:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155637.496706:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.496711:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e6800, rc 0) 00000100:00100000:2.0:1746155637.496825:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32143:x1830976125810432:12345-192.168.202.51@tcp:101:cat.0 Request processed in 756us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.496831:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11030 00010000:00010000:2.0:1746155637.496847:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155637.496852:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155637.496864:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155637.496949:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7600/0x844e5faceb5f6bac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17815 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.496974:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17815 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.496983:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155637.496985:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155637.496987:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e7800, rc 0) 00000040:00080000:3.0:1746155637.497658:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3508, 88 off295616 00000004:00080000:3.0:1746155637.497664:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766647160814ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.497701:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3521, 88 off297024 00000004:00080000:3.0:1746155637.497704:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766647201472ns, next at 716011101328ns, rc = 0 00000100:00100000:2.0:1746155637.497745:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32142:x1830976125809792:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4177us (4514us total) trans 8589945168 rc 0/0 00000100:00100000:2.0:1746155637.497751:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11028 00000100:00100000:0.0:1746155637.498040:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.498192:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125810816 00000100:00100000:2.0:1746155637.498196:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125810816 00000100:00100000:2.0:1746155637.498218:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11031 00000100:00100000:2.0:1746155637.498223:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32144:x1830976125810816:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155637.498232:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.498241:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17838 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1746155637.498448:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3522, 88 off297112 00000004:00080000:3.0:1746155637.498453:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766647949548ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.498462:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3509, 88 off295704 00000004:00080000:3.0:1746155637.498465:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766647961642ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.498831:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3510, 88 off295792 00000004:00080000:3.0:1746155637.498835:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766648331969ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.498843:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3523, 88 off297200 00000004:00080000:3.0:1746155637.498846:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766648343362ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.498853:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3524, 88 off297288 00000004:00080000:3.0:1746155637.498855:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766648351813ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.498860:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3525, 88 off297376 00000004:00080000:3.0:1746155637.498863:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766648360128ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.498869:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3511, 88 off295880 00000004:00080000:3.0:1746155637.498872:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766648369342ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.498878:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3526, 88 off297464 00000004:00080000:3.0:1746155637.498881:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766648378425ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.498888:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3512, 88 off295968 00000004:00080000:3.0:1746155637.498890:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766648387492ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.498896:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3527, 88 off297552 00000004:00080000:3.0:1746155637.498898:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766648395473ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155637.498904:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3513, 88 off296056 00000004:00080000:3.0:1746155637.498906:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766648403568ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.498912:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3514, 88 off296144 00000004:00080000:3.0:1746155637.498914:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766648411537ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.498921:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3515, 88 off296232 00000004:00080000:3.0:1746155637.498923:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766648420155ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.498929:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3516, 88 off296320 00000004:00080000:3.0:1746155637.498931:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 766648428169ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155637.498937:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3528, 88 off297640 00000004:00080000:3.0:1746155637.498939:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 766648436324ns, next at 716011101328ns, rc = 0 00010000:00010000:2.0:1746155637.499262:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17838 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.499273:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17838 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.499282:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155637.499284:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155637.499286:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.499292:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e6a00, rc 0) 00000100:00100000:2.0:1746155637.499318:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32144:x1830976125810816:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1095us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.499323:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11031 00000001:00080000:2.0:1746155637.526616:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945168 is committed 00000001:00080000:2.0:1746155637.526629:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945169 is committed 00000004:00080000:2.0:1746155637.526633:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2713 committed 00000004:00080000:2.0:1746155637.526639:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2695 committed 00000004:00080000:2.0:1746155637.526643:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2694 committed 00000004:00080000:2.0:1746155637.526644:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2693 committed 00000004:00080000:2.0:1746155637.526646:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2692 committed 00000004:00080000:2.0:1746155637.526647:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2712 committed 00000004:00080000:2.0:1746155637.526648:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2691 committed 00000004:00080000:2.0:1746155637.526650:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2711 committed 00000004:00080000:2.0:1746155637.526651:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2690 committed 00000004:00080000:2.0:1746155637.526653:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2710 committed 00000004:00080000:2.0:1746155637.526654:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2709 committed 00000004:00080000:2.0:1746155637.526656:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2708 committed 00000004:00080000:2.0:1746155637.526657:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2689 committed 00000004:00080000:2.0:1746155637.526658:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2688 committed 00000004:00080000:2.0:1746155637.526660:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2707 committed 00000004:00080000:2.0:1746155637.526661:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2706 committed 00000004:00080000:2.0:1746155637.526662:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2687 committed 00000001:00080000:2.0:1746155637.526668:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945165 is committed 00000100:00100000:2.0:1746155637.526852:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125298560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.526902:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.526941:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125299072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.526976:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.526993:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125299584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.527008:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527020:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012fef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125300096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.527032:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527048:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1746155637.527052:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125298176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.527064:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527074:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125298688:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.527084:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527093:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125299200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.527104:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527114:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125299712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.527124:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527140:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125298304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.527153:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527162:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125298816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.527172:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527182:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125299328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.527195:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527204:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125299840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.527215:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527226:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1746155637.527230:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125298432:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.527243:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527250:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125298944:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.527262:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527268:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125299456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.527280:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527286:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125299968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.527297:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155637.527318:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125298560 00000100:00100000:2.0:1746155637.527323:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125298560 00000100:00100000:2.0:1746155637.527345:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125299072 00000100:00100000:2.0:1746155637.527347:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125299072 00000100:00100000:2.0:1746155637.527354:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125299584 00000100:00100000:2.0:1746155637.527356:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125299584 00000100:00100000:2.0:1746155637.527363:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125300096 00000100:00100000:2.0:1746155637.527364:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125300096 00000100:00100000:2.0:1746155637.527370:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125298176 00000100:00100000:2.0:1746155637.527372:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125298176 00000100:00100000:2.0:1746155637.527377:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125298688 00000100:00100000:2.0:1746155637.527378:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125298688 00000100:00100000:2.0:1746155637.527384:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125299200 00000100:00100000:2.0:1746155637.527385:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125299200 00000100:00100000:2.0:1746155637.527391:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125299712 00000100:00100000:2.0:1746155637.527393:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125299712 00000100:00100000:2.0:1746155637.527398:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125298304 00000100:00100000:2.0:1746155637.527399:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125298304 00000100:00100000:2.0:1746155637.527404:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125298816 00000100:00100000:2.0:1746155637.527405:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125298816 00000100:00100000:2.0:1746155637.527413:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125299328 00000100:00100000:2.0:1746155637.527415:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125299328 00000100:00100000:2.0:1746155637.527420:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125299840 00000100:00100000:2.0:1746155637.527422:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125299840 00000100:00100000:2.0:1746155637.527427:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125298432 00000100:00100000:2.0:1746155637.527428:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125298432 00000100:00100000:2.0:1746155637.527434:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125298944 00000100:00100000:2.0:1746155637.527435:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125298944 00000100:00100000:2.0:1746155637.527441:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125299456 00000100:00100000:2.0:1746155637.527442:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125299456 00000100:00100000:2.0:1746155637.527450:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16552 00000100:00100000:2.0:1746155637.527456:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3297:x1830976125298560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.527635:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3297:x1830976125298560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 179us (733us total) trans 21474841484 rc 0/0 00000100:00100000:2.0:1746155637.527641:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16552 00000100:00100000:2.0:1746155637.527652:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125299968 00000100:00100000:2.0:1746155637.527654:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125299968 00000100:00100000:2.0:1746155637.527663:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16553 00000100:00100000:2.0:1746155637.527668:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3297:x1830976125299072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155637.527744:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3297:x1830976125299072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (767us total) trans 21474841485 rc 0/0 00000100:00100000:2.0:1746155637.527749:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16553 00000100:00100000:2.0:1746155637.527760:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16554 00000100:00100000:2.0:1746155637.527764:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+93:3297:x1830976125299584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.527849:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+94:3297:x1830976125299584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (839us total) trans 17179874157 rc 0/0 00000100:00100000:2.0:1746155637.527854:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16554 00000100:00100000:2.0:1746155637.527862:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16555 00000100:00100000:2.0:1746155637.527865:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+93:3297:x1830976125300096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.527929:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+94:3297:x1830976125300096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (895us total) trans 17179874158 rc 0/0 00000100:00100000:2.0:1746155637.527934:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16555 00000100:00100000:2.0:1746155637.527942:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16556 00000100:00100000:2.0:1746155637.527946:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3297:x1830976125298176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155637.528021:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155637.528024:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528026:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528027:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528029:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155637.528045:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3297:x1830976125298176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (980us total) trans 21474841486 rc 0/0 00000100:00100000:2.0:1746155637.528050:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16556 00000100:00100000:2.0:1746155637.528058:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16557 00000100:00100000:2.0:1746155637.528062:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3297:x1830976125298688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155637.528117:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:2.0:1746155637.528119:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:2.0:1746155637.528120:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155637.528122:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:2.0:1746155637.528123:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:2.0:1746155637.528139:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3297:x1830976125298688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (1054us total) trans 21474841487 rc 0/0 00000100:00100000:2.0:1746155637.528143:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16557 00000100:00100000:2.0:1746155637.528151:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16558 00000100:00100000:2.0:1746155637.528155:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+93:3297:x1830976125299200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.528211:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16559 00000100:00100000:1.0:1746155637.528217:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3297:x1830976125299712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155637.528218:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155637.528220:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528221:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528223:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528224:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:2.0:1746155637.528241:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+94:3297:x1830976125299200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (1136us total) trans 17179874159 rc 0/0 00000100:00100000:2.0:1746155637.528246:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16558 00000100:00100000:2.0:1746155637.528257:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16560 00000100:00100000:2.0:1746155637.528261:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3295:x1830976125298304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155637.528298:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3297:x1830976125299712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (1172us total) trans 17179874160 rc 0/0 00000100:00100000:1.0:1746155637.528303:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16559 00000100:00100000:1.0:1746155637.528311:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16561 00000100:00100000:1.0:1746155637.528315:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+85:3295:x1830976125298816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155637.528317:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155637.528319:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528320:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528322:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528323:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746155637.528343:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+85:3295:x1830976125298304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (1189us total) trans 21474841488 rc 0/0 00000100:00100000:2.0:1746155637.528347:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16560 00000100:00100000:2.0:1746155637.528355:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16562 00000100:00100000:2.0:1746155637.528359:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+93:3295:x1830976125299328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.528381:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+85:3295:x1830976125298816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (1207us total) trans 21474841489 rc 0/0 00000100:00100000:1.0:1746155637.528385:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16561 00000100:00100000:1.0:1746155637.528394:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16563 00000100:00100000:1.0:1746155637.528397:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:3295:x1830976125299840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155637.528416:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155637.528419:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528420:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528422:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528424:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155637.528441:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+95:3295:x1830976125299328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (1245us total) trans 17179874161 rc 0/0 00000100:00100000:2.0:1746155637.528445:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16562 00000100:00100000:2.0:1746155637.528454:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16564 00000100:00100000:1.0:1746155637.528457:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3295:x1830976125299840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (1241us total) trans 17179874162 rc 0/0 00000100:00100000:2.0:1746155637.528458:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+84:3295:x1830976125298432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155637.528461:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16563 00000100:00100000:1.0:1746155637.528469:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16565 00000100:00100000:1.0:1746155637.528473:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+84:3295:x1830976125298944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155637.528537:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16566 00000100:00100000:1.0:1746155637.528542:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+93:3295:x1830976125299456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155637.528543:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746155637.528545:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528546:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528548:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00002000:00010000:2.0:1746155637.528549:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746155637.528567:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+86:3295:x1830976125298432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (1323us total) trans 21474841490 rc 0/0 00000100:00100000:2.0:1746155637.528572:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16564 00000100:00100000:2.0:1746155637.528580:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16567 00000100:00100000:2.0:1746155637.528584:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+93:3295:x1830976125299968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155637.528606:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:1.0:1746155637.528608:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155637 -> 1746155637 00002000:00010000:1.0:1746155637.528610:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155637 -> 1746155637 00002000:00010000:1.0:1746155637.528612:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155637 -> 1746155637 00002000:00010000:1.0:1746155637.528613:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5903 -> 5903 00000100:00100000:1.0:1746155637.528630:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+95:3295:x1830976125299456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (1349us total) trans 17179874163 rc 0/0 00000100:00100000:1.0:1746155637.528635:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16566 00000100:00100000:2.0:1746155637.528648:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+94:3295:x1830976125299968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (1350us total) trans 17179874164 rc 0/0 00000100:00100000:2.0:1746155637.528652:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16567 00000004:00080000:2.0:1746155637.528684:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094084380/2, rc 0, transno 21474841490 00000100:00100000:2.0:1746155637.528688:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125298432:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155637.528696:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a1880/2, rc 0, transno 17179874163 00000100:00100000:2.0:1746155637.528701:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125299456:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155637.528706:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b881c00/2, rc 0, transno 17179874164 00000100:00100000:2.0:1746155637.528709:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125299968:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155637.528715:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf4700/2, rc 0, transno 21474841488 00000100:00100000:2.0:1746155637.528717:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125298304:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155637.528722:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca94a80/2, rc 0, transno 21474841489 00000100:00100000:2.0:1746155637.528724:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125298816:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155637.528729:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a2a00/2, rc 0, transno 17179874161 00000100:00100000:2.0:1746155637.528732:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125299328:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155637.528738:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26dc00/2, rc 0, transno 17179874162 00000100:00100000:2.0:1746155637.528740:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125299840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.528741:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+85:3295:x1830976125298944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 268us (1478us total) trans 21474841491 rc 0/0 00000100:00100000:1.0:1746155637.528746:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16565 00000004:00080000:2.0:1746155637.528747:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01d3800/2, rc 0, transno 21474841491 00000100:00100000:2.0:1746155637.528749:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125298944:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155637.528784:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf5180/2, rc 0, transno 21474841486 00000100:00100000:2.0:1746155637.528787:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125298176:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155637.528792:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910caa00/2, rc 0, transno 21474841487 00000100:00100000:2.0:1746155637.528794:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125298688:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155637.528798:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a2680/2, rc 0, transno 17179874159 00000100:00100000:2.0:1746155637.528800:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125299200:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155637.528805:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a1f80/2, rc 0, transno 17179874160 00000100:00100000:2.0:1746155637.528807:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125299712:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155637.528812:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094086680/2, rc 0, transno 21474841484 00000100:00100000:2.0:1746155637.528814:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125298560:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155637.528819:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a1500/2, rc 0, transno 21474841485 00000100:00100000:2.0:1746155637.528821:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125299072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155637.528826:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a0700/2, rc 0, transno 17179874157 00000100:00100000:2.0:1746155637.528828:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125299584:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155637.528833:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012fef2680/2, rc 0, transno 17179874158 00000100:00100000:2.0:1746155637.528835:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012fef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125300096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.528840:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746155637.528844:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125300224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155637.528861:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155637.528872:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125300224 00000100:00100000:1.0:1746155637.528875:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125300224 00000100:00100000:1.0:1746155637.528890:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16568 00000100:00100000:1.0:1746155637.528894:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+94:3297:x1830976125300224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155637.528980:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+95:3297:x1830976125300224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (118us total) trans 17179874165 rc 0/0 00010000:00010000:3.0:1746155637.528985:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1782a expref: 289 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.528985:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16568 00010000:00010000:3.0:1746155637.528995:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155637.528998:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746155637.529002:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 289 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.529011:0:15474:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 289 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.529018:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 289 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.529028:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17838 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.529033:0:15474:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17838 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.529038:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17838 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.529056:0:15474:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17838 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.529065:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125300352:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155637.529125:0:15474:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 289 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.529133:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125300480:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155637.529148:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece3c0 going to sleep for 11 seconds 00000004:00080000:2.0:1746155637.529716:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f583100/2, rc 0, transno 17179874165 00000100:00100000:2.0:1746155637.529721:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125300224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155637.530865:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.530897:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.530938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.530998:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125810944 00000100:00100000:2.0:1746155637.531003:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125810944 00000100:00100000:2.0:1746155637.531024:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125811200 00000100:00100000:2.0:1746155637.531025:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125811200 00000100:00100000:2.0:1746155637.531037:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4662 00000100:00100000:2.0:1746155637.531043:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32144:x1830976125810944:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:2.0:1746155637.531114:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32144:x1830976125810944:12345-192.168.202.51@tcp:49:cat.0 Request processed in 71us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.531119:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4662 00000100:00100000:2.0:1746155637.531129:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4663 00000100:00100000:2.0:1746155637.531134:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32143:x1830976125811200:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:2.0:1746155637.531163:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32143:x1830976125811200:12345-192.168.202.51@tcp:49:cat.0 Request processed in 29us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.531167:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4663 00000100:00100000:2.0:1746155637.531180:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125811072 00000100:00100000:2.0:1746155637.531182:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125811072 00000100:00100000:2.0:1746155637.531198:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11032 00000100:00100000:2.0:1746155637.531201:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32142:x1830976125811072:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155637.531209:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.531221:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013142b000/0x844e5faceb5f6be4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1783f expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.531252:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013142b000/0x844e5faceb5f6be4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1783f expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.531261:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013142b000/0x844e5faceb5f6be4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1783f expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.531274:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155637.531276:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155637.531279:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013142b000, rc 0) 00000100:00100000:2.0:1746155637.531291:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32142:x1830976125811072:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 89us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.531295:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11032 00000100:00100000:3.0:1746155637.531411:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125300352:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155637.531420:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125300480:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155637.531441:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce800/0x844e5faceb5f6bc1 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1782a expref: 289 pid: 15474 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746155637.531467:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1782a expref: 288 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.531485:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbcf000, rc 0) 00000100:00100000:3.0:1746155637.531528:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32138:x1830976125810304:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 37808us (38158us total) trans 8589945169 rc 0/0 00000100:00100000:3.0:1746155637.531534:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11029 00000100:00100000:0.0:1746155637.538107:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.538201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.538224:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125811584 00000100:00100000:0.0:1746155637.538231:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125811584 00002000:00100000:0.0:1746155637.538267:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880094e34e00 x1830976125811584/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.538276:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e34e00 with x1830976125811584 ext(0->1048575) 00002000:00010000:0.0:1746155637.538281:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e34e00 00000100:00100000:0.0:1746155637.538297:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7835 00000100:00100000:0.0:1746155637.538304:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:1960:x1830976125811584:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155637.539592:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125811328 00000100:00100000:3.0:1746155637.539598:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125811328 00000100:00100000:3.0:1746155637.539625:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16569 00000100:00100000:3.0:1746155637.539630:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:32142:x1830976125811328:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155637.539641:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.539653:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17846 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.539674:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0a00/0x844e5faceb5f6aef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177dd expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155637.539681:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.539683:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.539686:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1949696->2097151] (req 1949696->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.539710:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0a00/0x844e5faceb5f6aef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177dd expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155637.539721:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0a00/0x844e5faceb5f6aef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177dd expref: 14 pid: 8437 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746155637.539736:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125300608:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155637.539779:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.545558:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.545593:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.545608:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125811712 00000100:00100000:3.0:1746155637.545615:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125811712 00000100:00100000:0.0:1746155637.545619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.545627:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125811968 00000100:00100000:1.0:1746155637.545631:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125811968 00000100:00100000:0.0:1746155637.545645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.545652:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125812224 00002000:00100000:1.0:1746155637.545652:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880094e35500 x1830976125811968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746155637.545654:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125812224 00002000:00100000:1.0:1746155637.545661:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35500 with x1830976125811968 ext(0->1048575) 00010000:00010000:3.0:1746155637.545664:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0a00/0x844e5faceb5f6aef lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177dd expref: 15 pid: 8437 timeout: 866 lvb_type: 1 00002000:00010000:1.0:1746155637.545666:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35500 00000100:00100000:3.0:1746155637.545678:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8494 00000100:00100000:1.0:1746155637.545678:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7836 00000100:00100000:3.0:1746155637.545683:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125812224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155637.545683:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125811968:12345-192.168.202.51@tcp:3:multiop.0 00010000:00010000:3.0:1746155637.545694:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155637.545711:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0a00/0x844e5faceb5f6aef lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177dd expref: 15 pid: 8437 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746155637.545720:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0a00/0x844e5faceb5f6aef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177dd expref: 15 pid: 8437 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746155637.545738:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.545739:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.545745:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.545751:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.545779:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.545788:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125300736:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155637.545836:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155637.545849:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 735 00000100:00100000:3.0:1746155637.545854:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976125811712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155637.545861:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155637.545871:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013142b000/0x844e5faceb5f6be4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1783f expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.545884:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155637.545887:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.545901:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976125811712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 47us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.545906:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 735 00000100:00100000:0.0:1746155637.545975:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125812096 00000100:00100000:0.0:1746155637.545979:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125812096 00000100:00100000:0.0:1746155637.545998:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16570 00000100:00100000:0.0:1746155637.546003:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:32138:x1830976125812096:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155637.546011:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155637.546023:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1784d expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.546038:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a57800/0x844e5faceb5f6afd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f2 expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.546044:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.546045:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.546048:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2584576->2658303] (req 2584576->2658303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 42 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.546051:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f8f0a00/0x844e5faceb5f6aef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177dd expref: 15 pid: 8437 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746155637.546063:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125300608:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155637.546064:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136a57800/0x844e5faceb5f6afd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f2 expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.546073:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136a57800/0x844e5faceb5f6afd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f2 expref: 13 pid: 18270 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746155637.546079:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 24 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155637.546082:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125300864:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155637.546086:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbcfa00, rc 0) 00000100:00100000:2.0:1746155637.546108:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:32142:x1830976125811328:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6478us (8009us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.546108:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53373c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155637.546113:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16569 00000100:00100000:0.0:1746155637.546446:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:1960:x1830976125811584:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8142us (8244us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155637.546453:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7835 00002000:00100000:0.0:1746155637.546458:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880094e34e00 x1830976125811584/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.546466:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e34e00 with x1830976125811584 ext(0->1048575) 00002000:00010000:0.0:1746155637.546469:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e34e00 00000100:00100000:3.0:1746155637.549857:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125300736:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155637.549859:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155637.549875:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.549909:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125812224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4225us (4263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.549918:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8494 00000100:00100000:3.0:1746155637.549940:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125812352 00000100:00100000:3.0:1746155637.549944:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125812352 00010000:00010000:3.0:1746155637.549971:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136a57800/0x844e5faceb5f6afd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f2 expref: 14 pid: 18270 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746155637.549996:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8495 00000100:00100000:3.0:1746155637.550001:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125812352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155637.550011:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155637.550036:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136a57800/0x844e5faceb5f6afd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f2 expref: 14 pid: 18270 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746155637.550049:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a57800/0x844e5faceb5f6afd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f2 expref: 14 pid: 18270 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746155637.550069:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.550070:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.550076:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 43 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.550082:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a57800/0x844e5faceb5f6afd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f2 expref: 14 pid: 18270 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746155637.550083:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 43 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.550105:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 43 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.550115:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125300992:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155637.550116:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e35f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125300864:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155637.550137:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 43 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.550146:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed0600, rc 0) 00000100:00100000:1.0:1746155637.550167:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:32138:x1830976125812096:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4163us (4547us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.550168:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155637.550173:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16570 00000100:00100000:0.0:1746155637.554379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.554431:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125812608 00000100:00100000:2.0:1746155637.554438:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125812608 00002000:00100000:2.0:1746155637.554473:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1949696->1953791) req@ffff880094e36680 x1830976125812608/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.554482:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36680 with x1830976125812608 ext(1949696->1953791) 00002000:00010000:2.0:1746155637.554487:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e36680 00000100:00100000:2.0:1746155637.554544:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7837 00000100:00100000:2.0:1746155637.554551:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976125812608:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155637.554694:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976125812608:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 143us (320us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155637.554700:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7837 00002000:00100000:2.0:1746155637.555662:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1949696->1953791) req@ffff880094e36680 x1830976125812608/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/4536 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.555670:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36680 with x1830976125812608 ext(1949696->1953791) 00002000:00010000:2.0:1746155637.555674:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e36680 00000100:00100000:3.0:1746155637.558311:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125300992:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155637.558330:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.558363:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976125812352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8361us (8505us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.558371:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8495 00000100:00100000:1.0:1746155637.559069:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1961:x1830976125811968:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13384us (13473us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155637.559077:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7836 00002000:00100000:1.0:1746155637.559084:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880094e35500 x1830976125811968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.559092:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35500 with x1830976125811968 ext(0->1048575) 00002000:00010000:1.0:1746155637.559096:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35500 00000100:00100000:2.0:1746155637.560065:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.560106:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.560484:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125812864 00000100:00100000:3.0:1746155637.560490:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125812864 00002000:00100000:3.0:1746155637.560539:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f583800 x1830976125812864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 504/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.560546:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f583800 with x1830976125812864 ext(1048576->2097151) 00002000:00010000:3.0:1746155637.560550:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f583800 00000100:00100000:3.0:1746155637.560564:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125813120 00000100:00100000:3.0:1746155637.560566:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125813120 00002000:00100000:3.0:1746155637.560577:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (2584576->2588671) req@ffff88009f583b80 x1830976125813120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.560583:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f583b80 with x1830976125813120 ext(2584576->2588671) 00002000:00010000:3.0:1746155637.560585:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f583b80 00000100:00100000:3.0:1746155637.560595:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7838 00000100:00100000:3.0:1746155637.560600:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976125812864:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155637.561062:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7839 00000100:00100000:1.0:1746155637.561070:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1961:x1830976125813120:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155637.561172:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1961:x1830976125813120:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 103us (1065us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155637.561178:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7839 00002000:00100000:1.0:1746155637.561310:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2584576->2588671) req@ffff88009f583b80 x1830976125813120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/4536 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.561319:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f583b80 with x1830976125813120 ext(2584576->2588671) 00002000:00010000:1.0:1746155637.561322:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f583b80 00000100:00100000:0.0:1746155637.565397:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.566061:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125813376 00000100:00100000:2.0:1746155637.566070:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125813376 00002000:00100000:2.0:1746155637.566105:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2654208->2658303) req@ffff880094e36a00 x1830976125813376/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.566115:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36a00 with x1830976125813376 ext(2654208->2658303) 00002000:00010000:2.0:1746155637.566120:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36a00 00000100:00100000:2.0:1746155637.566139:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7840 00000100:00100000:2.0:1746155637.566145:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1960:x1830976125813376:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155637.566288:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1960:x1830976125813376:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 142us (898us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155637.566294:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7840 00002000:00100000:2.0:1746155637.566299:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2654208->2658303) req@ffff880094e36a00 x1830976125813376/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/4536 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.566305:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36a00 with x1830976125813376 ext(2654208->2658303) 00002000:00010000:2.0:1746155637.566308:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36a00 00000100:00100000:3.0:1746155637.568589:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976125812864:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7982us (8522us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746155637.568598:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7838 00002000:00100000:3.0:1746155637.568607:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f583800 x1830976125812864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 504/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.568614:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f583800 with x1830976125812864 ext(1048576->2097151) 00002000:00010000:3.0:1746155637.568619:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f583800 00000100:00100000:0.0:1746155637.568735:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.568833:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125813504 00000100:00100000:2.0:1746155637.568840:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125813504 00000100:00100000:2.0:1746155637.568867:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16571 00000100:00100000:2.0:1746155637.568873:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:32143:x1830976125813504:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155637.568883:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.568896:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090414600/0x844e5faceb5f6bf9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17854 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.568919:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.568925:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155637.568927:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155637.568929:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090414600/0x844e5faceb5f6bf9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17854 expref: 31 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.568965:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.568977:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 23 pid: 29728 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746155637.568993:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125301120:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155637.569058:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155637.569532:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.569584:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125813760 00000100:00100000:0.0:1746155637.569587:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125813760 00000100:00100000:0.0:1746155637.569619:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4664 00000100:00100000:0.0:1746155637.569625:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32138:x1830976125813760:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155637.569844:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32138:x1830976125813760:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 219us (312us total) trans 8589945170 rc 0/0 00000100:00100000:0.0:1746155637.569850:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4664 00000100:00100000:1.0:1746155637.573815:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.573865:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.573877:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125813888 00000100:00100000:0.0:1746155637.573883:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125813888 00000100:00100000:3.0:1746155637.573908:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125814016 00000100:00100000:3.0:1746155637.573912:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125814016 00000100:00100000:2.0:1746155637.573914:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125301120:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155637.573921:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16572 00000100:00100000:0.0:1746155637.573927:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:32142:x1830976125813888:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:3.0:1746155637.573934:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16573 00000100:00100000:3.0:1746155637.573939:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:32144:x1830976125814016:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155637.573939:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090414600/0x844e5faceb5f6bf9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17854 expref: 31 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.573939:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.573944:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155637.573947:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155637.573951:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1785b expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.573952:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6c07 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17862 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.573952:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090414600, rc 0) 00010000:00010000:0.0:1746155637.573981:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ed1a00/0x844e5faceb5f6af6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177e4 expref: 13 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.573987:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.573989:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.573992:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->1196031] (req 1048576->1196031) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.573998:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.574001:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->1196031] (req 1048576->1196031) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.574006:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1746155637.574006:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:32143:x1830976125813504:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5132us (5270us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155637.574008:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6c07 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17862 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.574012:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16571 00010000:00010000:0.0:1746155637.574024:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ed1a00/0x844e5faceb5f6af6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177e4 expref: 13 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155637.574027:0:4461:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1048576->1196031] (req 1048576->1196031) gid 0 flags: 0x60000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.574034:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ed1a00/0x844e5faceb5f6af6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177e4 expref: 13 pid: 20200 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746155637.574041:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6c07 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17862 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155637.574043:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125301376:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155637.574048:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801303a1200, rc 0) 00000100:00100000:3.0:1746155637.574068:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:32144:x1830976125814016:12345-192.168.202.51@tcp:101:cat.0 Request processed in 128us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.574073:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16573 00000100:00100000:0.0:1746155637.574080:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53373c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155637.574092:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125814144 00000100:00100000:3.0:1746155637.574094:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125814144 00002000:00100000:3.0:1746155637.574113:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1949696->2097151) req@ffff88009fff4e00 x1830976125814144/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.574121:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4e00 with x1830976125814144 ext(1949696->2097151) 00010000:00010000:3.0:1746155637.574126:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 27 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.574133:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 27 pid: 29728 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746155637.574138:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff4e00 00000100:00100000:3.0:1746155637.574148:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1346 00000100:00100000:3.0:1746155637.574152:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1963:x1830976125814144:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155637.576832:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e34000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125301376:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155637.576856:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->1196031] (req 1048576->1196031) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 28 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.576869:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009feb0e00, rc 0) 00000100:00100000:2.0:1746155637.576961:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:32142:x1830976125813888:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3025us (3146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.576969:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16572 00000100:00100000:0.0:1746155637.577475:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.577588:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125814272 00000100:00100000:2.0:1746155637.577593:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125814272 00010000:00010000:2.0:1746155637.577614:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed1a00/0x844e5faceb5f6af6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177e4 expref: 14 pid: 20200 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746155637.577636:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8496 00000100:00100000:2.0:1746155637.577642:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125814272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155637.577650:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155637.577666:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ed1a00/0x844e5faceb5f6af6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177e4 expref: 14 pid: 20200 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746155637.577675:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ed1a00/0x844e5faceb5f6af6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177e4 expref: 14 pid: 20200 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746155637.577692:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ed1a00/0x844e5faceb5f6af6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177e4 expref: 14 pid: 20200 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746155637.577918:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.577921:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.577927:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.577933:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.577969:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 27 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.577978:0:7063:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 27 pid: 29728 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746155637.577993:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125301504:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155637.578056:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155637.578587:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1963:x1830976125814144:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 4432us (4638us total) trans 21474841492 rc 0/0 00000100:00100000:3.0:1746155637.579216:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1346 00002000:00100000:3.0:1746155637.579226:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1949696->2097151) req@ffff88009fff4e00 x1830976125814144/t21474841492(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/448 e 0 to 0 dl 1746155648 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.579234:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4e00 with x1830976125814144 ext(1949696->2097151) 00010000:00010000:3.0:1746155637.579241:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 28 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.579250:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 28 pid: 29728 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746155637.579256:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff4e00 00000100:00100000:2.0:1746155637.580552:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125301504:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155637.580567:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155637.580605:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125814272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2963us (3130us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.580613:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8496 00000100:00100000:3.0:1746155637.580839:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.581029:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125814528 00000100:00100000:0.0:1746155637.581034:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125814528 00002000:00100000:0.0:1746155637.581063:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1191936->1196031) req@ffff88009045df80 x1830976125814528/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.581071:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045df80 with x1830976125814528 ext(1191936->1196031) 00010000:00010000:0.0:1746155637.581078:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 28 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.581087:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 28 pid: 29728 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746155637.581092:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009045df80 00000100:00100000:0.0:1746155637.581222:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1347 00000100:00100000:0.0:1746155637.581228:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125814528:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155637.581356:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125814528:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 127us (516us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155637.581362:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1347 00002000:00100000:0.0:1746155637.581367:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1191936->1196031) req@ffff88009045df80 x1830976125814528/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/4536 e 0 to 0 dl 1746155648 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.581373:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045df80 with x1830976125814528 ext(1191936->1196031) 00010000:00010000:0.0:1746155637.581378:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 28 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.581384:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 28 pid: 29728 timeout: 866 lvb_type: 0 00002000:00010000:0.0:1746155637.581389:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009045df80 00000100:00100000:0.0:1746155637.582837:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.583009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.583068:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125814656 00000100:00100000:3.0:1746155637.583070:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125814912 00000100:00100000:3.0:1746155637.583073:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125814912 00000100:00100000:2.0:1746155637.583073:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125814656 00010000:00010000:2.0:1746155637.583093:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 29 pid: 29728 timeout: 866 lvb_type: 0 00002000:00100000:3.0:1746155637.583095:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1196031) req@ffff880094e37100 x1830976125814912/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.583102:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37100 with x1830976125814912 ext(1048576->1196031) 00010000:00010000:3.0:1746155637.583107:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 29 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.583115:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 29 pid: 29728 timeout: 866 lvb_type: 0 00002000:00010000:3.0:1746155637.583120:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094e37100 00000100:00100000:2.0:1746155637.583123:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8497 00000100:00100000:2.0:1746155637.583129:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1962:x1830976125814656:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155637.583138:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746155637.583150:0:7063:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155637 -> 1746155638 00002000:00010000:2.0:1746155637.583152:0:7063:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155637 -> 1746155638 00002000:00010000:2.0:1746155637.583154:0:7063:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155637 -> 1746155638 00010000:00010000:2.0:1746155637.583158:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 29 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.583166:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 29 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.583188:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbcfa00/0x844e5faceb5f6beb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1949696->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17846 expref: 29 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.583200:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.583202:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.583207:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090414600/0x844e5faceb5f6bf9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17854 expref: 30 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155637.583227:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1348 00000100:00100000:0.0:1746155637.583233:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1960:x1830976125814912:12345-192.168.202.51@tcp:4:multiop.0 00010000:00010000:2.0:1746155637.583367:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090414600/0x844e5faceb5f6bf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17854 expref: 30 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.583392:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090414600/0x844e5faceb5f6bf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17854 expref: 30 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.583402:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125301632:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155637.583456:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155637.586227:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125301632:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155637.586244:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.586286:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1962:x1830976125814656:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3155us (3450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.586295:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8497 00000100:00100000:2.0:1746155637.587499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.587869:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125815168 00000100:00100000:3.0:1746155637.587875:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125815168 00002000:00100000:3.0:1746155637.587902:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f580380 x1830976125815168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.587910:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580380 with x1830976125815168 ext(1048576->2097151) 00002000:00010000:3.0:1746155637.587914:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f580380 00000100:00100000:3.0:1746155637.587940:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7841 00000100:00100000:3.0:1746155637.587946:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976125815168:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155637.588129:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976125814912:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 4895us (5119us total) trans 21474841493 rc 0/0 00000100:00100000:1.0:1746155637.588135:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1348 00002000:00100000:1.0:1746155637.588140:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1196031) req@ffff880094e37100 x1830976125814912/t21474841493(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/448 e 0 to 0 dl 1746155648 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.588146:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37100 with x1830976125814912 ext(1048576->1196031) 00010000:00010000:1.0:1746155637.588153:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 29 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.588164:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 29 pid: 29728 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746155637.588169:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094e37100 00000100:00100000:0.0:1746155637.592555:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.592822:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125815296 00000100:00100000:3.0:1746155637.592831:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125815296 00010000:00010000:3.0:1746155637.592869:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 29 pid: 29728 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.592901:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8498 00000100:00100000:3.0:1746155637.592908:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1962:x1830976125815296:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155637.592920:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746155637.592936:0:7063:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155637 -> 1746155638 00002000:00010000:3.0:1746155637.592938:0:7063:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155637 -> 1746155638 00010000:00010000:3.0:1746155637.592943:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 29 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.592963:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 29 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.592982:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009feb0e00/0x844e5faceb5f6c00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1196031) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1785b expref: 29 pid: 29728 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.593002:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.593004:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.593009:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6c07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17862 expref: 28 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.593017:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6c07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17862 expref: 28 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.593041:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6c07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17862 expref: 28 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.593052:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125301760:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155637.593116:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155637.595088:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125301760:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155637.595103:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155637.595141:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1962:x1830976125815296:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2233us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.595149:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8498 00000100:00100000:3.0:1746155637.595383:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976125815168:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7436us (7885us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155637.595390:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7841 00002000:00100000:3.0:1746155637.595397:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f580380 x1830976125815168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.595406:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580380 with x1830976125815168 ext(1048576->2097151) 00002000:00010000:3.0:1746155637.595410:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f580380 00000100:00100000:0.0:1746155637.600608:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.600660:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.600670:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125815552 00000100:00100000:3.0:1746155637.600678:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125815552 00002000:00100000:3.0:1746155637.600714:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880094e37800 x1830976125815552/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.600723:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37800 with x1830976125815552 ext(1048576->2097151) 00002000:00010000:3.0:1746155637.600727:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e37800 00000100:00100000:2.0:1746155637.601274:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125815680 00000100:00100000:2.0:1746155637.601278:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125815680 00000100:00100000:3.0:1746155637.601292:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7842 00000100:00100000:3.0:1746155637.601300:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125815552:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155637.601593:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16574 00000100:00100000:2.0:1746155637.601600:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:32143:x1830976125815680:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155637.601610:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.601624:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ed0200/0x844e5faceb5f6c0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17869 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.601641:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.601643:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.601649:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed0200/0x844e5faceb5f6c0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17869 expref: 32 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.601661:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ed0200/0x844e5faceb5f6c0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17869 expref: 32 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.601670:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed0200, rc 0) 00000100:00100000:2.0:1746155637.601707:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:32143:x1830976125815680:12345-192.168.202.51@tcp:101:cat.0 Request processed in 109us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.601712:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16574 00000100:00100000:0.0:1746155637.606754:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.607475:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125815936 00000100:00100000:2.0:1746155637.607482:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125815936 00002000:00100000:2.0:1746155637.607544:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880094e35180 x1830976125815936/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.607553:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35180 with x1830976125815936 ext(1048576->2097151) 00002000:00010000:2.0:1746155637.607557:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e35180 00000100:00100000:2.0:1746155637.607578:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7843 00000100:00100000:2.0:1746155637.607584:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976125815936:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155637.608552:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125815552:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7250us (7949us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155637.608561:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7842 00002000:00100000:3.0:1746155637.608568:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880094e37800 x1830976125815552/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.608580:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37800 with x1830976125815552 ext(1048576->2097151) 00002000:00010000:3.0:1746155637.608583:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e37800 00000100:00100000:0.0:1746155637.613007:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.613224:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125816064 00000100:00100000:2.0:1746155637.613231:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125816064 00000100:00100000:2.0:1746155637.613275:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16575 00000100:00100000:2.0:1746155637.613282:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:32144:x1830976125816064:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155637.613297:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.613310:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6c15 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17870 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.613330:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.613332:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.613337:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6c15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17870 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.613349:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6c15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17870 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.613359:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131446000, rc 0) 00000100:00100000:2.0:1746155637.613423:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+37:32144:x1830976125816064:12345-192.168.202.51@tcp:101:cat.0 Request processed in 142us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.613429:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16575 00000100:00100000:2.0:1746155637.614621:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976125815936:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7034us (7872us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155637.614629:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7843 00002000:00100000:2.0:1746155637.614638:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880094e35180 x1830976125815936/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.614645:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35180 with x1830976125815936 ext(1048576->2097151) 00002000:00010000:2.0:1746155637.614650:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e35180 00000100:00100000:0.0:1746155637.619840:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.619921:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125816320 00000100:00100000:2.0:1746155637.619930:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125816320 00002000:00100000:2.0:1746155637.619982:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880094e36300 x1830976125816320/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.619992:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36300 with x1830976125816320 ext(1048576->2097151) 00000100:00100000:0.0:1746155637.620050:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.620109:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125816448 00000100:00100000:1.0:1746155637.620114:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125816448 00000100:00100000:1.0:1746155637.620157:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16576 00000100:00100000:1.0:1746155637.620164:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:32143:x1830976125816448:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155637.620177:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.620191:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801373dc000/0x844e5faceb5f6c1c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17877 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.620211:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.620213:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.620220:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801373dc000/0x844e5faceb5f6c1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17877 expref: 42 pid: 29728 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155637.620230:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36300 00010000:00010000:1.0:1746155637.620232:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801373dc000/0x844e5faceb5f6c1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17877 expref: 42 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.620241:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373dc000, rc 0) 00000100:00100000:2.0:1746155637.620247:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7844 00000100:00100000:2.0:1746155637.620253:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+37:1963:x1830976125816320:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155637.620288:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:32143:x1830976125816448:12345-192.168.202.51@tcp:101:cat.0 Request processed in 125us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.620294:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16576 00000100:00100000:0.0:1746155637.629033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.629075:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125816704 00000100:00100000:3.0:1746155637.629083:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125816704 00002000:00100000:3.0:1746155637.629116:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880094e34000 x1830976125816704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.629125:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e34000 with x1830976125816704 ext(1048576->2097151) 00002000:00010000:3.0:1746155637.629129:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e34000 00000100:00100000:3.0:1746155637.629158:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7845 00000100:00100000:3.0:1746155637.629165:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125816704:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155637.631038:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+37:1963:x1830976125816320:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10779us (11200us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155637.631047:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7844 00002000:00100000:3.0:1746155637.631053:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880094e36300 x1830976125816320/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.631061:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36300 with x1830976125816320 ext(1048576->2097151) 00002000:00010000:3.0:1746155637.631065:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36300 00000100:00100000:3.0:1746155637.637514:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125816704:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8328us (8467us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155637.637525:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7845 00002000:00100000:3.0:1746155637.637535:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880094e34000 x1830976125816704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.637550:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e34000 with x1830976125816704 ext(1048576->2097151) 00002000:00010000:3.0:1746155637.637554:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e34000 00000100:00100000:0.0:1746155637.638144:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.638700:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.638716:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125816832 00000100:00100000:1.0:1746155637.638724:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125816832 00000100:00100000:0.0:1746155637.638729:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.638791:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125816960 00000100:00100000:1.0:1746155637.638794:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125816960 00000100:00100000:2.0:1746155637.638795:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125817088 00000100:00100000:2.0:1746155637.638799:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125817088 00000100:00100000:1.0:1746155637.638820:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16577 00000100:00100000:3.0:1746155637.638846:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16578 00000100:00100000:3.0:1746155637.638856:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+37:1960:x1830976125816960:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155637.638870:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.638884:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe07600/0x844e5faceb5f6c23 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17885 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.638922:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125301888:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155637.638985:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155637.639017:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1961:x1830976125816832:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155637.639020:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16579 00010000:00010000:1.0:1746155637.639026:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155637.639027:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976125817088:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155637.639035:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801373dde00/0x844e5faceb5f6c2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1787e expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.639035:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155637.639043:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f6c31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1788c expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.639045:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.639047:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.639053:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.639054:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801373dde00/0x844e5faceb5f6c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1787e expref: 31 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.639054:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.639058:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f6c31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1788c expref: 31 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.639066:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801373dde00/0x844e5faceb5f6c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1787e expref: 31 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.639068:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f6c31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1788c expref: 31 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.639074:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373dde00, rc 0) 00010000:00010000:0.0:1746155637.639074:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc69a00, rc 0) 00000100:00100000:1.0:1746155637.639144:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976125816832:12345-192.168.202.51@tcp:101:cat.0 Request processed in 317us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.639146:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976125817088:12345-192.168.202.51@tcp:101:cat.0 Request processed in 119us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.639150:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16577 00000100:00100000:0.0:1746155637.639153:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16579 00002000:00010000:1.0:1746155637.646963:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155637 -> 1746155638 00002000:00010000:1.0:1746155637.646970:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155637 -> 1746155638 00002000:00010000:1.0:1746155637.646972:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime: 1746155637 -> 1746155638 00000100:00100000:1.0:1746155637.646993:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125301888:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155637.647658:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe07600/0x844e5faceb5f6c23 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17885 expref: 38 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.647672:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe07600/0x844e5faceb5f6c23 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17885 expref: 38 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.647694:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe07600, rc 0) 00000100:00100000:1.0:1746155637.648473:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+37:1960:x1830976125816960:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9617us (9770us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155637.648482:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16578 00000100:00100000:1.0:1746155637.648591:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.648613:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125817344 00000100:00100000:1.0:1746155637.648618:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125817344 00002000:00100000:1.0:1746155637.648646:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009fff5500 x1830976125817344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 504/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.648654:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5500 with x1830976125817344 ext(2097152->3145727) 00002000:00010000:1.0:1746155637.648659:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff5500 00000100:00100000:1.0:1746155637.648673:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7846 00000100:00100000:1.0:1746155637.648679:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1963:x1830976125817344:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155637.659533:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.661134:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125817472 00000100:00100000:1.0:1746155637.661142:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125817472 00000100:00100000:1.0:1746155637.661178:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16580 00000100:00100000:1.0:1746155637.661186:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+37:32144:x1830976125817472:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155637.661200:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.661214:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f800/0x844e5faceb5f6c38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17893 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.661236:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 43 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.661243:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155637.661245:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155637.661248:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f800/0x844e5faceb5f6c38 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17893 expref: 38 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.661271:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 43 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.661285:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 43 pid: 9235 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.661296:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125302016:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155637.661357:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155637.661671:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1963:x1830976125817344:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12991us (13080us total) trans 0 rc 974848/974848 00000100:00100000:1.0:1746155637.661679:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7846 00002000:00100000:1.0:1746155637.661687:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009fff5500 x1830976125817344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 504/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 974848/974848 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.661695:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5500 with x1830976125817344 ext(2097152->3145727) 00010000:00010000:1.0:1746155637.661700:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 42 pid: 9235 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.661708:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 42 pid: 9235 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746155637.661713:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff5500 00000100:00100000:2.0:1746155637.666431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.666470:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125302016:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155637.666493:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f800/0x844e5faceb5f6c38 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17893 expref: 38 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.666520:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1f800, rc 0) 00000100:00100000:2.0:1746155637.666554:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+38:32144:x1830976125817472:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5369us (7025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.666561:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16580 00000100:00100000:2.0:1746155637.666588:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125817600 00000100:00100000:2.0:1746155637.666593:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125817600 00002000:00100000:2.0:1746155637.666619:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (2584576->2658303) req@ffff88009f580700 x1830976125817600/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.666628:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580700 with x1830976125817600 ext(2584576->2658303) 00010000:00010000:2.0:1746155637.666633:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 42 pid: 9235 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.666648:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 42 pid: 9235 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746155637.666654:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f580700 00000100:00100000:2.0:1746155637.666666:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1349 00000100:00100000:2.0:1746155637.666672:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125817600:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155637.669091:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.669113:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125817728 00000100:00100000:1.0:1746155637.669119:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125817728 00000100:00100000:1.0:1746155637.669144:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16581 00000100:00100000:1.0:1746155637.669150:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:32143:x1830976125817728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155637.669161:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.669174:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6c3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1789a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.669192:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.669194:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.669200:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6c3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1789a expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.669213:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6c3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1789a expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.669221:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1e400, rc 0) 00000100:00100000:1.0:1746155637.669249:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:32143:x1830976125817728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 100us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.669255:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16581 00000100:00100000:1.0:1746155637.669930:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976125817600:12345-192.168.202.51@tcp:4:cat.0 Request processed in 3256us (3504us total) trans 17179874166 rc 0/0 00000100:00100000:1.0:1746155637.669938:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1349 00002000:00100000:1.0:1746155637.669946:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (2584576->2658303) req@ffff88009f580700 x1830976125817600/t17179874166(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/448 e 0 to 0 dl 1746155648 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.669963:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580700 with x1830976125817600 ext(2584576->2658303) 00010000:00010000:1.0:1746155637.669970:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 44 pid: 9235 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.669980:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 44 pid: 9235 timeout: 866 lvb_type: 0 00002000:00010000:1.0:1746155637.669991:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f580700 00000100:00100000:3.0:1746155637.683323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.683400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.683638:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125818112 00000100:00100000:2.0:1746155637.683646:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125818112 00000100:00100000:1.0:1746155637.683649:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125817984 00000100:00100000:1.0:1746155637.683652:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125817984 00010000:00010000:2.0:1746155637.683673:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 44 pid: 9235 timeout: 866 lvb_type: 0 00002000:00100000:1.0:1746155637.683677:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009045ce00 x1830976125817984/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.683684:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045ce00 with x1830976125817984 ext(2097152->3145727) 00002000:00010000:1.0:1746155637.683688:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009045ce00 00000100:00100000:2.0:1746155637.684369:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8499 00000100:00100000:2.0:1746155637.684377:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1962:x1830976125818112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155637.684388:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155637.684403:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 44 pid: 9235 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.684414:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 44 pid: 9235 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.684429:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ed0600/0x844e5faceb5f6bf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2584576->2658303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1784d expref: 44 pid: 9235 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.684440:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.684442:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.684447:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f800/0x844e5faceb5f6c38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17893 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.684454:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f800/0x844e5faceb5f6c38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17893 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.684478:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f800/0x844e5faceb5f6c38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17893 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.684488:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125302144:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155637.684555:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155637.685004:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7847 00000100:00100000:1.0:1746155637.685011:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976125817984:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155637.690313:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125302144:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155637.690329:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155637.690783:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1962:x1830976125818112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6404us (7380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.690793:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8499 00000100:00100000:1.0:1746155637.692401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.692424:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125818368 00000100:00100000:1.0:1746155637.692429:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125818368 00000100:00100000:1.0:1746155637.692461:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11033 00000100:00100000:1.0:1746155637.692467:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32148:x1830976125818368:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155637.692484:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.692498:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76e00/0x844e5faceb5f6c46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178a1 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.692591:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76a00/0x844e5faceb5f6c4d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692601:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76a00/0x844e5faceb5f6c4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692610:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76a00/0x844e5faceb5f6c4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692624:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76c00/0x844e5faceb5f6c54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692629:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76c00/0x844e5faceb5f6c54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692633:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76c00/0x844e5faceb5f6c54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692711:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76800/0x844e5faceb5f6c5b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692718:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76800/0x844e5faceb5f6c5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692723:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76800/0x844e5faceb5f6c5b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155637.692729:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155637.692788:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76a00/0x844e5faceb5f6c4d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692794:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76a00/0x844e5faceb5f6c4d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692799:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76a00/0x844e5faceb5f6c4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692804:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f76a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.692807:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76a00/0x844e5faceb5f6c4d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692812:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76a00/0x844e5faceb5f6c4d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692822:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155637.692825:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.692828:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76a00/0x844e5faceb5f6c4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692832:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76a00/0x844e5faceb5f6c4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692840:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76c00/0x844e5faceb5f6c54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692844:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76c00/0x844e5faceb5f6c54 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692848:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76c00/0x844e5faceb5f6c54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692852:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f76c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.692854:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76c00/0x844e5faceb5f6c54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692859:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76c00/0x844e5faceb5f6c54 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692864:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58ca00) 00010000:00010000:1.0:1746155637.692866:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.692868:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76c00/0x844e5faceb5f6c54 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692871:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76c00/0x844e5faceb5f6c54 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155637.692899:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76e00/0x844e5faceb5f6c46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a1 expref: 292 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.692908:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76800/0x844e5faceb5f6c5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a1 expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.692913:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.692915:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155637.692917:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f76800, rc 0) 00000100:00100000:1.0:1746155637.692943:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32148:x1830976125818368:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 476us (545us total) trans 8589945171 rc 0/0 00000100:00100000:1.0:1746155637.692948:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11033 00000100:00100000:3.0:1746155637.701489:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.701961:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.701976:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.701997:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.702065:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125818880 00000100:00100000:0.0:1746155637.702065:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125819136 00000100:00100000:2.0:1746155637.702072:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125818880 00000100:00100000:0.0:1746155637.702072:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125819136 00002000:00100000:2.0:1746155637.702101:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880131495500 x1830976125818880/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.702101:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880131494700 x1830976125819136/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.702109:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495500 with x1830976125818880 ext(3145728->4194303) 00002000:00100000:0.0:1746155637.702109:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494700 with x1830976125819136 ext(2097152->3145727) 00002000:00010000:2.0:1746155637.702113:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495500 00002000:00010000:0.0:1746155637.702113:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131494700 00000100:00100000:2.0:1746155637.702133:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125818624 00000100:00100000:0.0:1746155637.702134:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125819264 00000100:00100000:2.0:1746155637.702136:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125818624 00000100:00100000:0.0:1746155637.702136:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125819264 00002000:00100000:2.0:1746155637.702144:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012c2bca80 x1830976125818624/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.702144:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88012c2bce00 x1830976125819264/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.702150:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bce00 with x1830976125819264 ext(3145728->4194303) 00002000:00010000:0.0:1746155637.702153:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c2bce00 00002000:00100000:2.0:1746155637.702155:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bca80 with x1830976125818624 ext(2097152->3145727) 00002000:00010000:2.0:1746155637.702157:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c2bca80 00000100:00100000:0.0:1746155637.702162:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7848 00000100:00100000:2.0:1746155637.702166:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7849 00000100:00100000:0.0:1746155637.702168:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+39:1961:x1830976125818880:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155637.702169:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976125819136:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155637.702571:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7850 00000100:00100000:2.0:1746155637.702576:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976125819264:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155637.703598:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7851 00000100:00100000:2.0:1746155637.703603:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+40:1961:x1830976125818624:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155637.703633:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976125817984:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18622us (20313us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155637.703639:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7847 00002000:00100000:1.0:1746155637.703644:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009045ce00 x1830976125817984/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.703651:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045ce00 with x1830976125817984 ext(2097152->3145727) 00002000:00010000:1.0:1746155637.703654:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009045ce00 00000100:00100000:0.0:1746155637.715615:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+40:1961:x1830976125818880:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13439us (14123us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155637.715625:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7848 00002000:00100000:0.0:1746155637.715636:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880131495500 x1830976125818880/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.715645:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495500 with x1830976125818880 ext(3145728->4194303) 00002000:00010000:0.0:1746155637.715651:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495500 00000100:00100000:2.0:1746155637.721928:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1961:x1830976125819264:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19344us (19923us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155637.721938:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7850 00002000:00100000:2.0:1746155637.721947:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88012c2bce00 x1830976125819264/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.721971:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bce00 with x1830976125819264 ext(3145728->4194303) 00002000:00010000:2.0:1746155637.721976:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c2bce00 00000100:00100000:1.0:1746155637.723190:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+38:1961:x1830976125818624:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19583us (21209us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155637.723198:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7851 00002000:00100000:1.0:1746155637.723204:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012c2bca80 x1830976125818624/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.723211:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bca80 with x1830976125818624 ext(2097152->3145727) 00002000:00010000:1.0:1746155637.723215:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c2bca80 00000100:00100000:0.0:1746155637.729137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.729378:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125819520 00000100:00100000:1.0:1746155637.729385:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125819520 00000100:00100000:1.0:1746155637.729417:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16582 00000100:00100000:1.0:1746155637.729424:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:32143:x1830976125819520:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155637.729436:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.729450:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff00e00/0x844e5faceb5f6c69 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178a8 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.729470:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.729471:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.729477:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff00e00/0x844e5faceb5f6c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a8 expref: 44 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.729489:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff00e00/0x844e5faceb5f6c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a8 expref: 44 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.729498:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff00e00, rc 0) 00000100:00100000:1.0:1746155637.729547:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:32143:x1830976125819520:12345-192.168.202.51@tcp:101:cat.0 Request processed in 123us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.729552:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16582 00000100:00100000:3.0:1746155637.729623:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1961:x1830976125819136:12345-192.168.202.51@tcp:3:cat.0 Request processed in 27451us (27669us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155637.729630:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7849 00002000:00100000:3.0:1746155637.729638:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880131494700 x1830976125819136/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.729646:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494700 with x1830976125819136 ext(2097152->3145727) 00002000:00010000:3.0:1746155637.729650:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131494700 00000001:00080000:2.0:1746155637.734748:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841480 is committed 00000001:00080000:2.0:1746155637.734769:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841430 is committed 00000001:00080000:2.0:1746155637.734785:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841387 is committed 00000001:00080000:2.0:1746155637.734792:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841493 is committed 00000001:00080000:2.0:1746155637.734799:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841491 is committed 00000001:00080000:2.0:1746155637.734807:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841473 is committed 00000001:00080000:2.0:1746155637.734855:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841474 is committed 00000001:00080000:2.0:1746155637.734872:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841463 is committed 00000001:00080000:2.0:1746155637.734923:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841475 is committed 00000100:00100000:0.0:1746155637.739025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.739067:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.739581:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125819776 00000100:00100000:1.0:1746155637.739589:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125819776 00002000:00100000:1.0:1746155637.739627:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880099efb850 x1830976125819776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.739636:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099efb850 with x1830976125819776 ext(3145728->4194303) 00002000:00010000:1.0:1746155637.739641:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099efb850 00000100:00100000:1.0:1746155637.739662:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125820032 00000100:00100000:1.0:1746155637.739664:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125820032 00002000:00100000:1.0:1746155637.739677:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a0d4c700 x1830976125820032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.739684:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4c700 with x1830976125820032 ext(3145728->4194303) 00002000:00010000:1.0:1746155637.739687:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4c700 00000100:00100000:1.0:1746155637.739697:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7852 00000100:00100000:1.0:1746155637.739702:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1960:x1830976125819776:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155637.740736:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7853 00000100:00100000:0.0:1746155637.740744:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976125820032:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155637.744828:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.744991:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125820288 00000100:00100000:0.0:1746155637.744999:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125820288 00002000:00100000:0.0:1746155637.745033:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f580a80 x1830976125820288/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.745041:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580a80 with x1830976125820288 ext(4194304->5083135) 00002000:00010000:0.0:1746155637.745047:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f580a80 00000100:00100000:3.0:1746155637.746182:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7854 00000100:00100000:3.0:1746155637.746193:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+38:1962:x1830976125820288:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155637.750899:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1960:x1830976125819776:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11188us (11873us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155637.750910:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7852 00002000:00100000:2.0:1746155637.750920:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880099efb850 x1830976125819776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.750928:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099efb850 with x1830976125819776 ext(3145728->4194303) 00002000:00010000:2.0:1746155637.750932:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099efb850 00000100:00100000:0.0:1746155637.758736:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.759043:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125820416 00000100:00100000:1.0:1746155637.759051:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125820416 00000100:00100000:1.0:1746155637.759083:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16583 00000100:00100000:1.0:1746155637.759089:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:32148:x1830976125820416:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155637.759102:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.759115:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178af expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.759136:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ed1c00/0x844e5faceb5f6b0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f9 expref: 6 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.759144:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6c3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1789a expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.759151:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f6c31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1788c expref: 7 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.759157:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.759158:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.759162:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2592768->3145727] (req 2592768->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.759185:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f6c31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1788c expref: 7 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.759195:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f6c31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1788c expref: 7 pid: 10591 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746155637.759205:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125302272:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155637.759278:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6c3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1789a expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.759286:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6c3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1789a expref: 16 pid: 8437 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.759294:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125302400:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155637.760260:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976125820032:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19512us (21186us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155637.760268:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7853 00002000:00100000:2.0:1746155637.760276:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a0d4c700 x1830976125820032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.760283:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4c700 with x1830976125820032 ext(3145728->4194303) 00010000:00010000:2.0:1746155637.760288:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6c3f lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1789a expref: 15 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.760297:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6c3f lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1789a expref: 15 pid: 8437 timeout: 866 lvb_type: 0 00002000:00010000:2.0:1746155637.760302:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0d4c700 00010000:00010000:1.0:1746155637.760369:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ed1c00/0x844e5faceb5f6b0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f9 expref: 6 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.760377:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ed1c00/0x844e5faceb5f6b0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f9 expref: 6 pid: 20200 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746155637.760385:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125302528:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155637.760403:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155637.762864:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125302272:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155637.762873:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125302400:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155637.763163:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+38:1962:x1830976125820288:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16972us (18341us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155637.763171:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7854 00002000:00100000:3.0:1746155637.763178:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f580a80 x1830976125820288/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.763186:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580a80 with x1830976125820288 ext(4194304->5083135) 00002000:00010000:3.0:1746155637.763190:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f580a80 00000100:00100000:2.0:1746155637.763340:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125302528:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155637.763362:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2592768->3145727] (req 2592768->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.763380:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090415000, rc 0) 00000100:00100000:2.0:1746155637.763400:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:32148:x1830976125820416:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4312us (4672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.763406:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16583 00000100:00100000:0.0:1746155637.765484:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.765599:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125820544 00000100:00100000:2.0:1746155637.765606:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125820544 00010000:00010000:2.0:1746155637.765634:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed1c00/0x844e5faceb5f6b0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f9 expref: 7 pid: 20200 timeout: 866 lvb_type: 1 00000100:00100000:2.0:1746155637.765671:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8500 00000100:00100000:2.0:1746155637.765678:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125820544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155637.765690:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155637.765707:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ed1c00/0x844e5faceb5f6b0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f9 expref: 7 pid: 20200 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746155637.765717:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ed1c00/0x844e5faceb5f6b0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f9 expref: 7 pid: 20200 timeout: 866 lvb_type: 1 00010000:00010000:2.0:1746155637.765739:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ed1c00/0x844e5faceb5f6b0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177f9 expref: 7 pid: 20200 timeout: 866 lvb_type: 1 00000100:00100000:1.0:1746155637.765748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155637.765758:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.765779:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125820672 00000100:00100000:3.0:1746155637.765784:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125820672 00000100:00100000:2.0:1746155637.765788:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976125820544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 111us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.765794:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8500 00010000:00010000:3.0:1746155637.765799:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f6c31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1788c expref: 8 pid: 10591 timeout: 866 lvb_type: 1 00000100:00100000:3.0:1746155637.765819:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8501 00000100:00100000:3.0:1746155637.765825:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976125820672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155637.765831:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155637.765839:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f6c31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1788c expref: 8 pid: 10591 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746155637.765848:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f6c31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1788c expref: 8 pid: 10591 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746155637.765859:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f6c31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1788c expref: 8 pid: 10591 timeout: 866 lvb_type: 1 00010000:00010000:3.0:1746155637.765884:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.765914:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976125820672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 89us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.765920:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8501 00000100:00100000:0.0:1746155637.771420:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.771461:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.771482:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125820928 00000100:00100000:2.0:1746155637.771490:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125820928 00000100:00100000:0.0:1746155637.771496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.771542:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125820800 00000100:00100000:2.0:1746155637.771544:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125820800 00000100:00100000:0.0:1746155637.771550:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16584 00000100:00100000:3.0:1746155637.771551:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125821056 00000100:00100000:3.0:1746155637.771555:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125821056 00000100:00100000:0.0:1746155637.771559:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976125820928:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155637.771571:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16585 00010000:00010000:0.0:1746155637.771573:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.771574:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6c3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1789a expref: 15 pid: 8437 timeout: 866 lvb_type: 0 00000100:00100000:2.0:1746155637.771576:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1963:x1830976125820800:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155637.771584:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155637.771586:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009421ec00/0x844e5faceb5f6c77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178bd expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.771590:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5f6c7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178b6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.771593:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8502 00000100:00100000:3.0:1746155637.771598:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976125821056:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155637.771603:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.771605:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155637.771829:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.771840:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009421ec00/0x844e5faceb5f6c77 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178bd expref: 16 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155637.771842:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6c3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1789a expref: 16 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.771842:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5f6c7e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 8 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178b6 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.771850:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009421ec00/0x844e5faceb5f6c77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178bd expref: 16 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155637.771853:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6c3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1789a expref: 16 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:2.0:1746155637.771861:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136b1d200/0x844e5faceb5f6c7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178b6 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155637.771868:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6c3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1789a expref: 15 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.771871:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009421ec00, rc 0) 00010000:00010000:2.0:1746155637.771872:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d200, rc 0) 00010000:00010000:3.0:1746155637.771880:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.771882:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155637.771887:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.771898:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.771912:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1963:x1830976125820800:12345-192.168.202.51@tcp:101:cat.0 Request processed in 335us (414us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155637.771912:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976125820928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 355us (503us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155637.771917:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16584 00000100:00100000:2.0:1746155637.771920:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16585 00010000:00010000:3.0:1746155637.771924:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.771934:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125302656:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155637.771999:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.776323:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.776381:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125821312 00000100:00100000:2.0:1746155637.776388:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125821312 00002000:00100000:2.0:1746155637.776423:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (2592768->2596863) req@ffff8800a0d4dc00 x1830976125821312/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.776431:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4dc00 with x1830976125821312 ext(2592768->2596863) 00002000:00010000:2.0:1746155637.776435:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4dc00 00000100:00100000:2.0:1746155637.776451:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7855 00000100:00100000:2.0:1746155637.776458:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976125821312:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155637.776591:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125302656:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155637.776608:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.776639:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976125821056:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5040us (5177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.776653:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8502 00000100:00100000:2.0:1746155637.777361:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976125821312:12345-192.168.202.51@tcp:3:cat.0 Request processed in 903us (1044us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155637.777368:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7855 00002000:00100000:2.0:1746155637.777372:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (2592768->2596863) req@ffff8800a0d4dc00 x1830976125821312/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/4536 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.777379:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4dc00 with x1830976125821312 ext(2592768->2596863) 00002000:00010000:2.0:1746155637.777383:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4dc00 00000100:00100000:0.0:1746155637.779008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.779043:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125821440 00000100:00100000:3.0:1746155637.779050:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125821440 00000100:00100000:3.0:1746155637.779229:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16586 00000100:00100000:3.0:1746155637.779236:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1962:x1830976125821440:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155637.779246:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.779259:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6c85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178c4 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.779296:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125302784:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155637.779351:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155637.781115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.782749:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125821696 00000100:00100000:3.0:1746155637.782757:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125821696 00002000:00100000:3.0:1746155637.782789:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f583b80 x1830976125821696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.782797:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f583b80 with x1830976125821696 ext(4194304->5083135) 00002000:00010000:3.0:1746155637.782801:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f583b80 00000100:00100000:3.0:1746155637.782826:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7856 00000100:00100000:3.0:1746155637.782832:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976125821696:12345-192.168.202.51@tcp:3:cat.0 00002000:00010000:0.0:1746155637.790250:0:20796:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime: 1746155637 -> 1746155638 00002000:00010000:0.0:1746155637.790256:0:20796:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime: 1746155637 -> 1746155638 00002000:00010000:0.0:1746155637.790257:0:20796:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime: 1746155637 -> 1746155638 00000100:00100000:0.0:1746155637.790275:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125302784:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155637.790298:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6c85 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178c4 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.790310:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e800/0x844e5faceb5f6c85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178c4 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.790321:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1e800, rc 0) 00000100:00100000:0.0:1746155637.790353:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1962:x1830976125821440:12345-192.168.202.51@tcp:101:cat.0 Request processed in 11117us (11348us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155637.790359:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16586 00000100:00100000:3.0:1746155637.790435:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976125821696:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7602us (9321us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155637.790442:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7856 00002000:00100000:3.0:1746155637.790449:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f583b80 x1830976125821696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.790457:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f583b80 with x1830976125821696 ext(4194304->5083135) 00002000:00010000:3.0:1746155637.790461:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f583b80 00000100:00100000:0.0:1746155637.796033:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.796059:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125821824 00000100:00100000:0.0:1746155637.796067:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125821824 00000100:00100000:0.0:1746155637.796101:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16587 00000100:00100000:0.0:1746155637.796107:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:32148:x1830976125821824:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155637.796122:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155637.796136:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178cb expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.796159:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f800/0x844e5faceb5f6c38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17893 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.796166:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ff00e00/0x844e5faceb5f6c69 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a8 expref: 45 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.796172:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.796173:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.796177:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->3158015] (req 3145728->3158015) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 45 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.796200:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ff00e00/0x844e5faceb5f6c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a8 expref: 45 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.796210:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ff00e00/0x844e5faceb5f6c69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a8 expref: 45 pid: 10591 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746155637.796219:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125302912:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155637.796343:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f800/0x844e5faceb5f6c38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17893 expref: 37 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.796351:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f800/0x844e5faceb5f6c38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17893 expref: 37 pid: 8437 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746155637.796358:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125303040:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155637.796377:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155637.796810:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.797138:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125822080 00000100:00100000:2.0:1746155637.797142:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125822080 00000100:00100000:2.0:1746155637.798631:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4665 00000100:00100000:2.0:1746155637.798641:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32144:x1830976125822080:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155637.798791:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32144:x1830976125822080:12345-192.168.202.51@tcp:35:cat.0 Request processed in 151us (1981us total) trans 8589945172 rc 0/0 00000100:00100000:2.0:1746155637.798797:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4665 00000100:00100000:0.0:1746155637.799983:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d4e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125302912:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155637.799993:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125303040:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155637.800018:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->3158015] (req 3145728->3158015) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 45 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.800030:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbea600, rc 0) 00000100:00100000:0.0:1746155637.800051:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:32148:x1830976125821824:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3944us (4024us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.800060:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16587 00000100:00100000:2.0:1746155637.802935:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.803039:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125822208 00000100:00100000:3.0:1746155637.803046:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125822208 00010000:00010000:3.0:1746155637.803074:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff00e00/0x844e5faceb5f6c69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a8 expref: 45 pid: 10591 timeout: 866 lvb_type: 0 00000100:00100000:3.0:1746155637.803099:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8503 00000100:00100000:3.0:1746155637.803105:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1963:x1830976125822208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155637.803116:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155637.803135:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ff00e00/0x844e5faceb5f6c69 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a8 expref: 45 pid: 10591 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.803150:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ff00e00/0x844e5faceb5f6c69 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a8 expref: 45 pid: 10591 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.803168:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff00e00/0x844e5faceb5f6c69 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a8 expref: 45 pid: 10591 timeout: 866 lvb_type: 0 00010000:00010000:3.0:1746155637.803190:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.803221:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1963:x1830976125822208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 116us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.803231:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8503 00000100:00100000:1.0:1746155637.805852:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.805911:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125822336 00000100:00100000:1.0:1746155637.805918:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125822336 00010000:00010000:1.0:1746155637.805942:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f800/0x844e5faceb5f6c38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17893 expref: 38 pid: 8437 timeout: 866 lvb_type: 0 00000100:00100000:1.0:1746155637.805979:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8504 00000100:00100000:1.0:1746155637.805985:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+38:1962:x1830976125822336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155637.805996:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155637.806013:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f800/0x844e5faceb5f6c38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17893 expref: 38 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.806024:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f800/0x844e5faceb5f6c38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17893 expref: 38 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.806042:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f800/0x844e5faceb5f6c38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17893 expref: 38 pid: 8437 timeout: 866 lvb_type: 0 00010000:00010000:1.0:1746155637.806053:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.806054:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.806060:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 43 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.806066:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 43 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.806096:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 43 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.806106:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125303168:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155637.806161:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155637.809079:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125303168:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155637.809094:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155637.809261:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+37:1962:x1830976125822336:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3137us (3275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.809271:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8504 00000100:00100000:1.0:1746155637.810232:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.810702:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125822592 00000100:00100000:3.0:1746155637.810709:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125822592 00002000:00100000:3.0:1746155637.810873:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3153920->3158015) req@ffff88009fff7100 x1830976125822592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.810882:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7100 with x1830976125822592 ext(3153920->3158015) 00002000:00010000:3.0:1746155637.810887:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff7100 00000100:00100000:3.0:1746155637.810942:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7857 00000100:00100000:3.0:1746155637.810949:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976125822592:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155637.811074:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976125822592:12345-192.168.202.51@tcp:3:cat.0 Request processed in 126us (844us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155637.811080:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7857 00002000:00100000:3.0:1746155637.811084:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3153920->3158015) req@ffff88009fff7100 x1830976125822592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/4536 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.811091:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7100 with x1830976125822592 ext(3153920->3158015) 00002000:00010000:3.0:1746155637.811094:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff7100 00000100:00100000:0.0:1746155637.820183:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.820243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.820307:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125823104 00000100:00100000:1.0:1746155637.820314:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125823104 00000100:00100000:1.0:1746155637.820351:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11034 00000100:00100000:1.0:1746155637.820358:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32150:x1830976125823104:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155637.820376:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.820390:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090415e00/0x844e5faceb5f6c93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178d2 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.820468:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090414800/0x844e5faceb5f6c9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.820478:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090414800/0x844e5faceb5f6c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.820487:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090414800/0x844e5faceb5f6c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.820497:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090414c00/0x844e5faceb5f6ca1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.820518:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090414c00/0x844e5faceb5f6ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.820523:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090414c00/0x844e5faceb5f6ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.822873:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090414a00/0x844e5faceb5f6ca8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.822887:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090414a00/0x844e5faceb5f6ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.822895:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090414a00/0x844e5faceb5f6ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155637.822903:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155637.822984:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090414800/0x844e5faceb5f6c9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.822989:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090414800/0x844e5faceb5f6c9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.822994:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090414800/0x844e5faceb5f6c9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.822998:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090414800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.823001:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090414800/0x844e5faceb5f6c9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.823006:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090414800/0x844e5faceb5f6c9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.823015:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155637.823017:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.823020:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090414800/0x844e5faceb5f6c9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.823024:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090414800/0x844e5faceb5f6c9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.823032:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090414c00/0x844e5faceb5f6ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.823036:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090414c00/0x844e5faceb5f6ca1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.823040:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090414c00/0x844e5faceb5f6ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.823043:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090414c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.823045:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090414c00/0x844e5faceb5f6ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.823049:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090414c00/0x844e5faceb5f6ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.823054:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c400) 00010000:00010000:1.0:1746155637.823056:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.823057:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090414c00/0x844e5faceb5f6ca1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.823061:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090414c00/0x844e5faceb5f6ca1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.823097:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090415e00/0x844e5faceb5f6c93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d2 expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.823108:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090414a00/0x844e5faceb5f6ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d2 expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.823113:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.823115:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155637.823117:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090414a00, rc 0) 00000100:00100000:1.0:1746155637.823163:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32150:x1830976125823104:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2805us (2986us total) trans 8589945173 rc 0/0 00000100:00100000:1.0:1746155637.823170:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11034 00000100:00100000:2.0:1746155637.823180:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125822848 00000100:00100000:2.0:1746155637.823186:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125822848 00000100:00100000:2.0:1746155637.823208:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4666 00000100:00100000:2.0:1746155637.823214:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32148:x1830976125822848:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155637.823302:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32148:x1830976125822848:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 89us (3058us total) trans 8589945174 rc 0/0 00000100:00100000:2.0:1746155637.823307:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4666 00000100:00100000:0.0:1746155637.829628:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.829768:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125823360 00000100:00100000:3.0:1746155637.829776:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125823360 00000100:00100000:3.0:1746155637.829806:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4667 00000100:00100000:3.0:1746155637.829813:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32150:x1830976125823360:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155637.829981:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32150:x1830976125823360:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 167us (360us total) trans 8589945175 rc 0/0 00000100:00100000:3.0:1746155637.829987:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4667 00000100:00100000:0.0:1746155637.844767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.844791:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125823488 00000100:00100000:0.0:1746155637.844797:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125823488 00000100:00100000:0.0:1746155637.844827:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16588 00000100:00100000:0.0:1746155637.844833:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32150:x1830976125823488:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155637.844846:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155637.844861:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178d9 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.844883:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090414600/0x844e5faceb5f6bf9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17854 expref: 12 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.844891:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801373dde00/0x844e5faceb5f6c2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1787e expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.844896:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.844897:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.844900:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1081344->1380351] (req 1081344->1380351) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 8 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.844929:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801373dde00/0x844e5faceb5f6c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1787e expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155637.844943:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801373dde00/0x844e5faceb5f6c2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1787e expref: 8 pid: 29728 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746155637.844965:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125303296:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155637.845031:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090414600/0x844e5faceb5f6bf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17854 expref: 12 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.845038:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090414600/0x844e5faceb5f6bf9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17854 expref: 12 pid: 9235 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746155637.845045:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125303424:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155637.845061:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.847380:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125303296:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155637.847391:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d4f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125303424:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155637.847411:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1081344->1380351] (req 1081344->1380351) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 8 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.847423:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012de0bc00, rc 0) 00000100:00100000:0.0:1746155637.847450:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32150:x1830976125823488:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2617us (2689us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.847457:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16588 00000100:00100000:0.0:1746155637.848825:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.848845:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125823616 00000100:00100000:0.0:1746155637.848851:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125823616 00010000:00010000:0.0:1746155637.848873:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801373dde00/0x844e5faceb5f6c2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1787e expref: 8 pid: 29728 timeout: 866 lvb_type: 1 00000100:00100000:0.0:1746155637.848894:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8505 00000100:00100000:0.0:1746155637.848900:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1963:x1830976125823616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155637.848909:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155637.848925:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801373dde00/0x844e5faceb5f6c2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1787e expref: 8 pid: 29728 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746155637.848935:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801373dde00/0x844e5faceb5f6c2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1787e expref: 8 pid: 29728 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746155637.850526:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801373dde00/0x844e5faceb5f6c2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1787e expref: 8 pid: 29728 timeout: 866 lvb_type: 1 00010000:00010000:0.0:1746155637.850546:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155637.850637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.850653:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125823744 00000100:00100000:0.0:1746155637.850656:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125823744 00010000:00010000:0.0:1746155637.850671:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090414600/0x844e5faceb5f6bf9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17854 expref: 13 pid: 9235 timeout: 866 lvb_type: 0 00000100:00100000:0.0:1746155637.850688:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8506 00000100:00100000:0.0:1746155637.850693:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976125823744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155637.850701:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155637.850710:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880090414600/0x844e5faceb5f6bf9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17854 expref: 13 pid: 9235 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.850720:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090414600/0x844e5faceb5f6bf9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17854 expref: 13 pid: 9235 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.850735:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090414600/0x844e5faceb5f6bf9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17854 expref: 13 pid: 9235 timeout: 866 lvb_type: 0 00010000:00010000:0.0:1746155637.850742:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.850744:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155637.850750:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 7 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.850757:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 7 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.850780:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 7 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155637.850791:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125303552:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155637.850850:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.850915:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1963:x1830976125823616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2015us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.850921:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8505 00000100:00100000:1.0:1746155637.853647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.853913:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125303552:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155637.853928:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155637.853972:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1960:x1830976125823744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3278us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.853980:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8506 00000100:00100000:3.0:1746155637.854032:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125824000 00000100:00100000:3.0:1746155637.854040:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125824000 00002000:00100000:3.0:1746155637.854071:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1081344->1085439) req@ffff88009fff7480 x1830976125824000/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.854079:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7480 with x1830976125824000 ext(1081344->1085439) 00002000:00010000:3.0:1746155637.854084:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fff7480 00000100:00100000:3.0:1746155637.854098:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7858 00000100:00100000:3.0:1746155637.854103:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1962:x1830976125824000:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155637.854247:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1962:x1830976125824000:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 143us (603us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155637.854252:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7858 00002000:00100000:3.0:1746155637.854258:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1081344->1085439) req@ffff88009fff7480 x1830976125824000/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/4536 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.854264:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7480 with x1830976125824000 ext(1081344->1085439) 00002000:00010000:3.0:1746155637.854266:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fff7480 00000100:00100000:2.0:1746155637.857920:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.857985:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125824256 00000100:00100000:0.0:1746155637.857992:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125824256 00002000:00100000:0.0:1746155637.858021:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1376256->1380351) req@ffff88009f580380 x1830976125824256/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.858029:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580380 with x1830976125824256 ext(1376256->1380351) 00002000:00010000:0.0:1746155637.858033:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f580380 00000100:00100000:0.0:1746155637.858224:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7859 00000100:00100000:0.0:1746155637.858232:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1963:x1830976125824256:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155637.858608:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1963:x1830976125824256:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 376us (690us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155637.858614:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7859 00002000:00100000:0.0:1746155637.858619:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1376256->1380351) req@ffff88009f580380 x1830976125824256/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/4536 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.858626:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580380 with x1830976125824256 ext(1376256->1380351) 00002000:00010000:0.0:1746155637.858629:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f580380 00000001:00080000:3.0:1746155637.890873:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874156 is committed 00000001:00080000:3.0:1746155637.890889:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874130 is committed 00000001:00080000:3.0:1746155637.890916:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874044 is committed 00000001:00080000:3.0:1746155637.890922:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874166 is committed 00000001:00080000:3.0:1746155637.890928:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874165 is committed 00000001:00080000:3.0:1746155637.890943:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874145 is committed 00000001:00080000:3.0:1746155637.890964:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874135 is committed 00000001:00080000:3.0:1746155637.891168:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874146 is committed 00000001:00080000:3.0:1746155637.891232:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874147 is committed 00000100:00100000:0.0:1746155637.921156:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.921219:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125824512 00000100:00100000:1.0:1746155637.921226:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125824512 00000100:00100000:1.0:1746155637.921275:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11035 00000100:00100000:1.0:1746155637.921282:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32159:x1830976125824512:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155637.921302:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.921315:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f6cbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178e0 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.921402:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921412:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921427:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921439:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ccb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921453:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921459:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921586:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6cd2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921595:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921601:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155637.921608:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155637.921671:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921677:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921682:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921687:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012df5f600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.921690:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921695:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921703:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155637.921705:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.921708:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921712:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921730:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921734:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ccb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921737:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921741:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012df5fc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.921743:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921747:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ccb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921752:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c400) 00010000:00010000:1.0:1746155637.921753:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.921755:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ccb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921758:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ccb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.921787:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f6cbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178e0 expref: 295 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.921800:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178e0 expref: 294 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.921806:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.921808:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155637.921810:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df5ec00, rc 0) 00000100:00100000:1.0:1746155637.921855:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32159:x1830976125824512:12345-192.168.202.51@tcp:101:cat.0 Request processed in 573us (705us total) trans 8589945176 rc 0/0 00000100:00100000:1.0:1746155637.921860:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11035 00000100:00100000:0.0:1746155637.931097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.931145:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.931156:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125824768 00000100:00100000:2.0:1746155637.931163:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125824768 00000100:00100000:1.0:1746155637.931241:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125824896 00000100:00100000:1.0:1746155637.931248:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125824896 00000100:00100000:2.0:1746155637.931274:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4668 00000100:00100000:2.0:1746155637.931282:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:32159:x1830976125824768:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155637.931287:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 736 00000100:00100000:1.0:1746155637.931293:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1961:x1830976125824896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155637.931304:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155637.931323:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6cd2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178e0 expref: 295 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.931342:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.931346:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155637.931379:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1961:x1830976125824896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 86us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.931385:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 736 00000100:00100000:2.0:1746155637.931468:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32159:x1830976125824768:12345-192.168.202.51@tcp:35:cat.0 Request processed in 187us (377us total) trans 8589945177 rc 0/0 00000100:00100000:2.0:1746155637.931474:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4668 00000100:00100000:0.0:1746155637.932806:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.932846:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125825152 00000100:00100000:1.0:1746155637.932850:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125825152 00000100:00100000:1.0:1746155637.932881:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11036 00000100:00100000:1.0:1746155637.932887:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32160:x1830976125825152:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155637.932901:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.932912:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f6ce0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178e7 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.932990:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ce7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933000:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933007:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933017:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933021:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933026:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933092:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f6cf5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933098:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f6cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933103:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f6cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155637.933109:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155637.933155:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933163:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ce7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933168:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933172:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012df5fc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.933175:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933180:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933188:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155637.933190:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.933193:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ce7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933197:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f6ce7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933204:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933208:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933212:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933215:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012df5f600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155637.933216:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933224:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933228:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c800) 00010000:00010000:1.0:1746155637.933230:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155637.933232:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933236:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f600/0x844e5faceb5f6cee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155637.933263:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f6ce0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178e7 expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.933272:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f6cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178e7 expref: 14 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.933278:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155637.933279:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155637.933281:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df5ee00, rc 0) 00000100:00100000:1.0:1746155637.933892:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32160:x1830976125825152:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1003us (1085us total) trans 8589945178 rc 0/0 00000100:00100000:1.0:1746155637.933899:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11036 00000100:00100000:0.0:1746155637.937097:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.938021:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125825280 00000100:00100000:1.0:1746155637.938046:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.938066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.938094:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.938108:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125825536 00000100:00100000:1.0:1746155637.938111:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125825536 00000100:00100000:1.0:1746155637.938132:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125825664 00000100:00100000:1.0:1746155637.938133:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125825664 00000100:00100000:0.0:1746155637.938144:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125825408 00000100:00100000:1.0:1746155637.938151:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16589 00000100:00100000:1.0:1746155637.938156:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976125825536:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155637.938170:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155637.938173:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16590 00000100:00100000:3.0:1746155637.938180:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976125825664:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155637.938181:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012df5e400/0x844e5faceb5f6d03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178f5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155637.938188:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.938196:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6d0a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178fc expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155637.938216:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125303680:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155637.938219:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125303808:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155637.938250:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125825408 00000100:00100000:1.0:1746155637.938261:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.938275:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 737 00000100:00100000:0.0:1746155637.938280:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125825408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155637.938288:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155637.938303:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f6cf5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178e7 expref: 14 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.938319:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155637.938322:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155637.938574:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005480 going to sleep for 11 seconds 00000100:00100000:2.0:1746155637.938608:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125825280 00000100:00100000:2.0:1746155637.938626:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16591 00000100:00100000:2.0:1746155637.938631:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1961:x1830976125825280:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155637.938636:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.938642:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca58400/0x844e5faceb5f6d11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f178ee expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.938662:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125303936:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155637.938680:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.938830:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976125825408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 549us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.938835:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 737 00002000:00010000:1.0:1746155637.939303:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5903 -> 5905 00000100:00100000:1.0:1746155637.939310:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125303680:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155637.939326:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012df5e400/0x844e5faceb5f6d03 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178f5 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.939336:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012df5e400/0x844e5faceb5f6d03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178f5 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.939344:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df5e400, rc 0) 00000100:00100000:1.0:1746155637.939374:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976125825536:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1217us (1306us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155637.939380:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16589 00000100:00100000:3.0:1746155637.939813:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125303808:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155637.939827:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6d0a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178fc expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155637.939836:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f6d0a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178fc expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155637.939845:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1f600, rc 0) 00000100:00100000:3.0:1746155637.939877:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976125825664:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1698us (1782us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155637.939882:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16590 00000100:00100000:2.0:1746155637.940292:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125303936:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155637.940308:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca58400/0x844e5faceb5f6d11 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178ee expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155637.940317:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca58400/0x844e5faceb5f6d11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178ee expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155637.940327:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca58400, rc 0) 00000100:00100000:2.0:1746155637.940346:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1961:x1830976125825280:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1714us (3256us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155637.940351:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16591 00000100:00100000:0.0:1746155637.947368:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.947440:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125825792 00000100:00100000:2.0:1746155637.947447:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125825792 00000100:00100000:2.0:1746155637.947490:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16592 00000100:00100000:2.0:1746155637.947497:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:32159:x1830976125825792:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155637.947536:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.947549:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f6d18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17903 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.947571:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 6 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.947578:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155637.947579:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155637.947582:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f6d18 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17903 expref: 13 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.947604:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 6 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.947614:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 6 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155637.947677:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125304064:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155637.947836:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.949661:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.949720:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125826048 00000100:00100000:2.0:1746155637.949724:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125826048 00002000:00100000:2.0:1746155637.949758:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f3edf80 x1830976125826048/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 504/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.949766:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3edf80 with x1830976125826048 ext(1048576->2097151) 00010000:00010000:2.0:1746155637.949773:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 7 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155637.949783:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125304064:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155637.949784:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 7 pid: 20796 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746155637.949790:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f3edf80 00010000:00010000:3.0:1746155637.949804:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f6d18 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17903 expref: 13 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.949809:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1350 00010000:00010000:3.0:1746155637.949815:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca58e00, rc 0) 00000100:00100000:2.0:1746155637.949815:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976125826048:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155637.949855:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:32159:x1830976125825792:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2354us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155637.949861:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16592 00000100:00100000:0.0:1746155637.950131:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.950265:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125826176 00000100:00100000:1.0:1746155637.950269:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125826176 00002000:00100000:1.0:1746155637.950286:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1081344->1380351) req@ffff88009f3efb80 x1830976125826176/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155637.950293:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3efb80 with x1830976125826176 ext(1081344->1380351) 00010000:00010000:1.0:1746155637.950298:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 8 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155637.950307:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 8 pid: 20796 timeout: 867 lvb_type: 0 00002000:00010000:1.0:1746155637.950312:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f3efb80 00000100:00100000:1.0:1746155637.950335:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1351 00000100:00100000:1.0:1746155637.950341:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976125826176:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155637.954380:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125826176:12345-192.168.202.51@tcp:4:cat.0 Request processed in 4031us (4241us total) trans 21474841494 rc 0/0 00000100:00100000:2.0:1746155637.954390:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1351 00002000:00100000:2.0:1746155637.954400:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1081344->1380351) req@ffff88009f3efb80 x1830976125826176/t21474841494(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/448 e 0 to 0 dl 1746155648 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.954409:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3efb80 with x1830976125826176 ext(1081344->1380351) 00010000:00010000:2.0:1746155637.954418:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 11 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155637.954432:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 11 pid: 20796 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746155637.954443:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f3efb80 00000100:00100000:2.0:1746155637.958008:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125826048:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8180us (8337us total) trans 0 rc 749568/749568 00000100:00100000:2.0:1746155637.958021:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1350 00002000:00100000:2.0:1746155637.958030:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f3edf80 x1830976125826048/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 504/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:H/200/0 rc 749568/749568 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.958039:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3edf80 with x1830976125826048 ext(1048576->2097151) 00010000:00010000:2.0:1746155637.958049:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 9 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155637.958062:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 9 pid: 20796 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746155637.958068:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f3edf80 00000100:00100000:0.0:1746155637.964739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.964856:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125826304 00000100:00100000:2.0:1746155637.964864:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125826304 00010000:00010000:2.0:1746155637.964898:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 9 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155637.965359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.966372:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.966393:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125826432 00000100:00100000:3.0:1746155637.966398:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125826432 00000100:00100000:3.0:1746155637.966427:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125826560 00000100:00100000:0.0:1746155637.966443:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16593 00000100:00100000:2.0:1746155637.966473:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8507 00000100:00100000:2.0:1746155637.966481:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976125826304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155637.966494:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155637.966530:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 10 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155637.966546:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 10 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155637.966565:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f6cb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1081344->1380351) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d9 expref: 10 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155637.966580:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.966582:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.966591:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f6d18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17903 expref: 12 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.966598:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f6d18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17903 expref: 12 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.966625:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f6d18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17903 expref: 12 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.966635:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125304192:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155637.966659:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125826560 00000100:00100000:2.0:1746155637.966685:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155637.966901:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.966971:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125826432:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155637.966983:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.966992:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6d1f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1790a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.967003:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.967005:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.967009:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6d1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1790a expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.967019:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6d1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1790a expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155637.967026:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df5ec00, rc 0) 00000100:00100000:3.0:1746155637.967044:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125826688 00000100:00100000:3.0:1746155637.967047:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125826688 00000100:00100000:1.0:1746155637.967050:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125826432:12345-192.168.202.51@tcp:101:cat.0 Request processed in 191us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.967055:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16593 00000100:00100000:2.0:1746155637.967073:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16594 00000100:00100000:2.0:1746155637.967079:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976125826560:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155637.967086:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.967095:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801303a0200/0x844e5faceb5f6d26 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17911 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.967119:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125304320:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155637.967140:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25480 going to sleep for 11 seconds 00000100:00100000:3.0:1746155637.967141:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16595 00000100:00100000:3.0:1746155637.967148:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125826688:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155637.967156:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155637.967162:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6d2d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17918 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155637.967185:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125304448:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155637.967209:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005480 going to sleep for 11 seconds 00000100:00100000:2.0:1746155637.970395:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125304192:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155637.970416:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155637.970460:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976125826304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3979us (5727us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.970469:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8507 00000100:00100000:3.0:1746155637.970652:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125304448:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155637.970674:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6d2d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17918 expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155637.970686:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f6d2d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17918 expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155637.970709:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1e400, rc 0) 00000100:00100000:3.0:1746155637.970735:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125826688:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3587us (3834us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155637.970741:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16595 00000100:00100000:2.0:1746155637.970843:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125304320:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155637.970857:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801303a0200/0x844e5faceb5f6d26 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17911 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155637.970867:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801303a0200/0x844e5faceb5f6d26 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17911 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155637.970874:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801303a0200, rc 0) 00000100:00100000:2.0:1746155637.970895:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976125826560:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3817us (4525us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155637.970900:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16594 00000100:00100000:0.0:1746155637.972623:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.972753:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125826944 00000100:00100000:2.0:1746155637.972760:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125826944 00002000:00100000:2.0:1746155637.972793:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800936f5c00 x1830976125826944/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.972802:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5c00 with x1830976125826944 ext(1048576->2097151) 00002000:00010000:2.0:1746155637.972806:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f5c00 00000100:00100000:2.0:1746155637.972825:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7860 00000100:00100000:2.0:1746155637.972831:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1962:x1830976125826944:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155637.979025:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.979433:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125827072 00000100:00100000:2.0:1746155637.979441:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125827072 00000100:00100000:2.0:1746155637.979494:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16596 00000100:00100000:2.0:1746155637.979528:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32160:x1830976125827072:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155637.979544:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155637.979560:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1791f expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.979590:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.979597:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155637.979598:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155637.979602:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 8 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.979626:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.979636:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 19 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155637.979647:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125304576:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155637.979708:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25480 going to sleep for 11 seconds 00000100:00100000:2.0:1746155637.981224:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1962:x1830976125826944:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8387us (8600us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155637.981234:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7860 00002000:00100000:2.0:1746155637.981241:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800936f5c00 x1830976125826944/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155637.981250:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5c00 with x1830976125826944 ext(1048576->2097151) 00002000:00010000:2.0:1746155637.981255:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f5c00 00000100:00100000:0.0:1746155637.982743:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125304576:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155637.982768:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 8 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155637.982782:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801303a1400, rc 0) 00000100:00100000:0.0:1746155637.982816:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32160:x1830976125827072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3315us (3797us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155637.982826:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16596 00000100:00100000:0.0:1746155637.983044:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155637.983234:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125827200 00000100:00100000:3.0:1746155637.983240:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125827200 00002000:00100000:3.0:1746155637.983270:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3158015) req@ffff8800936f5180 x1830976125827200/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 12776/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.983277:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5180 with x1830976125827200 ext(3145728->3158015) 00010000:00010000:3.0:1746155637.983283:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 20 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155637.983293:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 20 pid: 20796 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746155637.983299:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936f5180 00000100:00100000:3.0:1746155637.983324:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1352 00000100:00100000:3.0:1746155637.983330:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976125827200:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155637.983769:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976125827200:12345-192.168.202.51@tcp:4:cat.0 Request processed in 438us (724us total) trans 17179874167 rc 0/0 00000100:00100000:3.0:1746155637.983775:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1352 00002000:00100000:3.0:1746155637.983779:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3158015) req@ffff8800936f5180 x1830976125827200/t17179874167(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:708/0 lens 12776/448 e 0 to 0 dl 1746155648 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155637.983790:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5180 with x1830976125827200 ext(3145728->3158015) 00010000:00010000:3.0:1746155637.983794:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 22 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155637.983803:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 22 pid: 20796 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746155637.983808:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936f5180 00000100:00100000:0.0:1746155637.991917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155637.992061:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125827328 00000100:00100000:2.0:1746155637.992070:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125827328 00010000:00010000:2.0:1746155637.992101:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 22 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155637.992142:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8508 00000100:00100000:2.0:1746155637.992149:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976125827328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155637.992162:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155637.992183:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 22 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155637.992194:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 22 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155637.992214:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbea600/0x844e5faceb5f6c8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3158015) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178cb expref: 22 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155637.992231:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.992233:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155637.992239:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 7 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.992250:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 7 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155637.992278:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 7 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155637.992289:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125304704:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155637.992368:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155637.994698:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125304704:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155637.994717:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155637.994754:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976125827328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2605us (2843us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155637.994764:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8508 00000100:00100000:0.0:1746155637.995595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155637.997335:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125827456 00000100:00100000:1.0:1746155637.997344:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125827456 00000100:00100000:1.0:1746155637.997403:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16597 00000100:00100000:1.0:1746155637.997411:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:32159:x1830976125827456:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155637.997426:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155637.997442:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17926 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.997463:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.997465:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155637.997471:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17926 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.997483:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17926 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155637.997493:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090414400, rc 0) 00000100:00100000:1.0:1746155637.997573:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32159:x1830976125827456:12345-192.168.202.51@tcp:101:cat.0 Request processed in 162us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155637.997579:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16597 00000100:00100000:3.0:1746155637.998820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155637.998876:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125827712 00000100:00100000:0.0:1746155637.998880:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125827712 00002000:00100000:0.0:1746155637.998908:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012c2be300 x1830976125827712/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/0 e 0 to 0 dl 1746155648 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155637.998917:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2be300 with x1830976125827712 ext(2097152->3145727) 00002000:00010000:0.0:1746155637.998921:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c2be300 00000100:00100000:0.0:1746155637.998947:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7861 00000100:00100000:0.0:1746155637.998964:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976125827712:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155638.008424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.008554:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125827968 00000100:00100000:2.0:1746155638.008562:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125827968 00000100:00100000:1.0:1746155638.008565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:2.0:1746155638.008603:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009fff6a00 x1830976125827968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.008612:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6a00 with x1830976125827968 ext(2097152->3145727) 00002000:00010000:2.0:1746155638.008617:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff6a00 00000100:00100000:3.0:1746155638.008711:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125828096 00000100:00100000:3.0:1746155638.008715:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125828096 00000100:00100000:2.0:1746155638.008715:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7862 00000100:00100000:2.0:1746155638.008721:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976125827968:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:3.0:1746155638.008729:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009fff6680 x1830976125828096/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.008735:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6680 with x1830976125828096 ext(3145728->4194303) 00002000:00010000:3.0:1746155638.008737:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff6680 00000100:00100000:3.0:1746155638.008748:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7863 00000100:00100000:3.0:1746155638.008752:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976125828096:12345-192.168.202.51@tcp:3:cat.0 00000100:00080000:2.0:1746155638.009261:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155638.009319:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976125827712:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10354us (10499us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155638.009327:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7861 00002000:00100000:0.0:1746155638.009333:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012c2be300 x1830976125827712/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:708/0 lens 488/440 e 0 to 0 dl 1746155648 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155638.009340:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2be300 with x1830976125827712 ext(2097152->3145727) 00002000:00010000:0.0:1746155638.009342:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c2be300 00000100:00100000:0.0:1746155638.009585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.009635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.009699:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125828480 00000100:00100000:0.0:1746155638.009702:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125828480 00002000:00100000:0.0:1746155638.009728:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3698687) req@ffff8800936f5500 x1830976125828480/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 504/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155638.009741:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5500 with x1830976125828480 ext(2097152->3698687) 00002000:00010000:0.0:1746155638.009744:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f5500 00000100:00080000:2.0:1746155638.009747:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155638.009886:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125828736 00000100:00100000:0.0:1746155638.009889:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125828736 00000100:00100000:1.0:1746155638.009901:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7864 00002000:00100000:0.0:1746155638.009902:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3698688->4194303) req@ffff8800936f6300 x1830976125828736/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155638.009908:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976125828480:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:0.0:1746155638.009909:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6300 with x1830976125828736 ext(3698688->4194303) 00002000:00010000:0.0:1746155638.009911:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f6300 00000100:00100000:0.0:1746155638.009923:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7865 00000100:00100000:0.0:1746155638.009928:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976125828736:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155638.014468:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.014707:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125828864 00000100:00100000:3.0:1746155638.014715:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125828864 00000100:00100000:3.0:1746155638.014785:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16598 00000100:00100000:3.0:1746155638.014793:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32160:x1830976125828864:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155638.014809:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.014824:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5f6d42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1792d expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.014853:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.014860:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155638.014862:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155638.014865:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5f6d42 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1792d expref: 10 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.014889:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.014899:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 16 pid: 8437 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.014909:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125304832:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.014980:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005480 going to sleep for 11 seconds 00000100:00080000:2.0:1746155638.015055:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746155638.017568:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125304832:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.017591:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5f6d42 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1792d expref: 10 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.017607:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136867800, rc 0) 00000100:00100000:2.0:1746155638.017640:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32160:x1830976125828864:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2848us (3179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.017648:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16598 00000100:00100000:3.0:1746155638.018777:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976125828096:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10022us (10209us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.018787:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7863 00002000:00100000:3.0:1746155638.018795:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009fff6680 x1830976125828096/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.018804:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6680 with x1830976125828096 ext(3145728->4194303) 00002000:00010000:3.0:1746155638.018808:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff6680 00000100:00100000:1.0:1746155638.019120:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976125828736:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9189us (9482us total) trans 0 rc 495616/495616 00000100:00100000:1.0:1746155638.019126:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7865 00002000:00100000:1.0:1746155638.019133:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3698688->4194303) req@ffff8800936f6300 x1830976125828736/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 495616/495616 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155638.019139:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6300 with x1830976125828736 ext(3698688->4194303) 00010000:00010000:1.0:1746155638.019146:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 15 pid: 8437 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.019158:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 15 pid: 8437 timeout: 867 lvb_type: 0 00002000:00010000:1.0:1746155638.019163:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936f6300 00000100:00100000:0.0:1746155638.022855:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.023543:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125828992 00000100:00100000:1.0:1746155638.023552:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125828992 00002000:00100000:1.0:1746155638.023587:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (2592768->3145727) req@ffff8800936f4a80 x1830976125828992/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155638.023597:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4a80 with x1830976125828992 ext(2592768->3145727) 00010000:00010000:1.0:1746155638.023605:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 15 pid: 8437 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.023617:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 15 pid: 8437 timeout: 867 lvb_type: 0 00002000:00010000:1.0:1746155638.023624:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936f4a80 00000100:00100000:1.0:1746155638.023656:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1353 00000100:00100000:1.0:1746155638.023662:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976125828992:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155638.024948:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976125827968:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16222us (16526us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155638.024967:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7862 00002000:00100000:2.0:1746155638.024975:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009fff6a00 x1830976125827968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.024983:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff6a00 with x1830976125827968 ext(2097152->3145727) 00002000:00010000:2.0:1746155638.024987:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff6a00 00000100:00100000:2.0:1746155638.026812:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976125828480:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16899us (17222us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155638.026819:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7864 00000100:00100000:0.0:1746155638.028448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:2.0:1746155638.028860:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3698687) req@ffff8800936f5500 x1830976125828480/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 504/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.028873:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5500 with x1830976125828480 ext(2097152->3698687) 00010000:00010000:2.0:1746155638.028884:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 15 pid: 8437 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.028895:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 15 pid: 8437 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746155638.028902:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936f5500 00000100:00100000:2.0:1746155638.028930:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125829120 00000100:00100000:2.0:1746155638.028935:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125829120 00000100:00100000:2.0:1746155638.028972:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16599 00000100:00100000:2.0:1746155638.028978:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:32159:x1830976125829120:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.028990:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.029003:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b407d400/0x844e5faceb5f6d49 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17934 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.029020:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155638.029025:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b407d400/0x844e5faceb5f6d49 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17934 expref: 16 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.029035:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b407d400/0x844e5faceb5f6d49 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17934 expref: 16 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.029043:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b407d400, rc 0) 00000100:00100000:2.0:1746155638.029071:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32159:x1830976125829120:12345-192.168.202.51@tcp:101:cat.0 Request processed in 94us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.029076:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16599 00000100:00100000:2.0:1746155638.033157:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976125828992:12345-192.168.202.51@tcp:4:cat.0 Request processed in 9487us (10300us total) trans 21474841495 rc 0/0 00000100:00100000:2.0:1746155638.033168:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1353 00002000:00100000:2.0:1746155638.033176:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (2592768->3145727) req@ffff8800936f4a80 x1830976125828992/t21474841495(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/448 e 0 to 0 dl 1746155649 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.033190:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4a80 with x1830976125828992 ext(2592768->3145727) 00010000:00010000:2.0:1746155638.033198:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 16 pid: 8437 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.033211:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 16 pid: 8437 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746155638.033217:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936f4a80 00000100:00100000:0.0:1746155638.039102:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.039181:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125829248 00000100:00100000:2.0:1746155638.039188:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125829248 00010000:00010000:2.0:1746155638.039212:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 16 pid: 8437 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.039892:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8509 00000100:00100000:2.0:1746155638.039900:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976125829248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.039913:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.039929:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 16 pid: 8437 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.039939:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 16 pid: 8437 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.039969:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090415000/0x844e5faceb5f6c70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2592768->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178af expref: 16 pid: 8437 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.040032:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.040035:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.040041:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5f6d42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1792d expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.040049:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5f6d42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1792d expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.040119:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.040121:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.040125:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b407d400/0x844e5faceb5f6d49 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17934 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.040131:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b407d400/0x844e5faceb5f6d49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17934 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.040156:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b407d400/0x844e5faceb5f6d49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17934 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.040166:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125304960:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155638.040363:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5f6d42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1792d expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.040371:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125305088:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155638.040390:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.043213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.043342:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125829504 00000100:00100000:1.0:1746155638.043347:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125829504 00000100:00100000:3.0:1746155638.043355:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125305088:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155638.043406:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11037 00000100:00100000:1.0:1746155638.043413:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32162:x1830976125829504:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155638.043430:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155638.043444:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090415c00/0x844e5faceb5f6d50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1793b expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.043554:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090415400/0x844e5faceb5f6d57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043564:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090415400/0x844e5faceb5f6d57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043572:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090415400/0x844e5faceb5f6d57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043582:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090415e00/0x844e5faceb5f6d5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043586:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090415e00/0x844e5faceb5f6d5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043590:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090415e00/0x844e5faceb5f6d5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00080000:2.0:1746155638.043647:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746155638.043680:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090414e00/0x844e5faceb5f6d65 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043687:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090414e00/0x844e5faceb5f6d65 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043692:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090414e00/0x844e5faceb5f6d65 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155638.043698:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155638.043764:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090415400/0x844e5faceb5f6d57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043769:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090415400/0x844e5faceb5f6d57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043774:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090415400/0x844e5faceb5f6d57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043779:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090415400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155638.043782:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090415400/0x844e5faceb5f6d57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043788:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090415400/0x844e5faceb5f6d57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043797:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155638.043800:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155638.043803:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090415400/0x844e5faceb5f6d57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043807:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090415400/0x844e5faceb5f6d57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043833:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090415e00/0x844e5faceb5f6d5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043838:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090415e00/0x844e5faceb5f6d5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043842:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090415e00/0x844e5faceb5f6d5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043845:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090415e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155638.043847:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090415e00/0x844e5faceb5f6d5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043851:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090415e00/0x844e5faceb5f6d5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043857:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c500) 00010000:00010000:1.0:1746155638.043858:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155638.043860:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090415e00/0x844e5faceb5f6d5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043864:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090415e00/0x844e5faceb5f6d5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.043898:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090415c00/0x844e5faceb5f6d50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1793b expref: 297 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.043907:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090414e00/0x844e5faceb5f6d65 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1793b expref: 296 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.043912:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155638.043914:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155638.043916:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090414e00, rc 0) 00000100:00100000:1.0:1746155638.043965:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32162:x1830976125829504:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 552us (758us total) trans 8589945179 rc 0/0 00000100:00100000:1.0:1746155638.043971:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11037 00000100:00100000:2.0:1746155638.047119:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.047150:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.047157:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125829888 00000100:00100000:0.0:1746155638.047163:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125829888 00000100:00100000:3.0:1746155638.047164:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125304960:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155638.047164:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125829760 00000100:00100000:2.0:1746155638.047167:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125829760 00010000:00010000:3.0:1746155638.047183:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746155638.047193:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f581c00 x1830976125829760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155638.047194:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f581880 x1830976125829888/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.047199:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f581c00 with x1830976125829760 ext(2097152->3145727) 00002000:00100000:0.0:1746155638.047200:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f581880 with x1830976125829888 ext(3145728->4194303) 00002000:00010000:2.0:1746155638.047202:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f581c00 00002000:00010000:0.0:1746155638.047203:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f581880 00000100:00100000:0.0:1746155638.047219:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7866 00000100:00100000:3.0:1746155638.047224:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1962:x1830976125829248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7324us (8127us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.047224:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7867 00000100:00100000:2.0:1746155638.047227:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976125829760:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155638.047227:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976125829888:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155638.047232:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8509 00000100:00100000:0.0:1746155638.053476:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.053540:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.053541:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125830144 00000100:00100000:3.0:1746155638.053549:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125830144 00000100:00100000:3.0:1746155638.053592:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 738 00000100:00100000:3.0:1746155638.053598:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:1963:x1830976125830144:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155638.053610:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155638.053630:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090414e00/0x844e5faceb5f6d65 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1793b expref: 296 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.053646:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.053650:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155638.053683:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1963:x1830976125830144:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.053689:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 738 00000100:00100000:2.0:1746155638.053796:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125830400 00000100:00100000:2.0:1746155638.053803:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125830400 00002000:00100000:2.0:1746155638.053832:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800936f7b80 x1830976125830400/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.053840:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f7b80 with x1830976125830400 ext(2097152->3145727) 00002000:00010000:2.0:1746155638.054048:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f7b80 00000100:00100000:2.0:1746155638.054064:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7868 00000100:00100000:2.0:1746155638.054070:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976125830400:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155638.054864:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.055063:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125830656 00000100:00100000:1.0:1746155638.055065:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.055067:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125830656 00002000:00100000:3.0:1746155638.055085:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009fff4e00 x1830976125830656/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.055092:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4e00 with x1830976125830656 ext(3145728->4194303) 00002000:00010000:3.0:1746155638.055094:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fff4e00 00000100:00100000:3.0:1746155638.055105:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125830912 00000100:00100000:3.0:1746155638.055107:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125830912 00000100:00100000:1.0:1746155638.055119:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7869 00002000:00100000:3.0:1746155638.055125:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009fff5500 x1830976125830912/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155638.055127:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976125830656:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:3.0:1746155638.055131:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5500 with x1830976125830912 ext(3145728->4194303) 00002000:00010000:3.0:1746155638.055134:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fff5500 00000100:00100000:3.0:1746155638.055143:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7870 00000100:00100000:3.0:1746155638.055148:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976125830912:12345-192.168.202.51@tcp:3:cat.0 00000100:00080000:2.0:1746155638.055889:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155638.058476:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976125829760:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11240us (11316us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155638.058485:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7867 00002000:00100000:2.0:1746155638.058494:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f581c00 x1830976125829760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.058527:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f581c00 with x1830976125829760 ext(2097152->3145727) 00002000:00010000:2.0:1746155638.058532:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f581c00 00000100:00100000:1.0:1746155638.060350:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976125829888:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13118us (13229us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155638.060359:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7866 00002000:00100000:1.0:1746155638.060366:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f581880 x1830976125829888/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155638.060374:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f581880 with x1830976125829888 ext(3145728->4194303) 00002000:00010000:1.0:1746155638.060378:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f581880 00000100:00100000:0.0:1746155638.065675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.066816:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125831040 00000100:00100000:2.0:1746155638.066825:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125831040 00000100:00100000:2.0:1746155638.066866:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16600 00000100:00100000:2.0:1746155638.066873:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32162:x1830976125831040:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155638.066887:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.066902:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17942 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.066925:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.066932:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17926 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.067628:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.067629:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.067634:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->3416063] (req 3145728->3416063) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.067661:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17926 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.067671:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17926 expref: 23 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.067681:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125305216:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.067701:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976125830400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13629us (14158us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.067710:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7868 00002000:00100000:3.0:1746155638.067717:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800936f7b80 x1830976125830400/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.067725:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f7b80 with x1830976125830400 ext(2097152->3145727) 00002000:00010000:3.0:1746155638.067729:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f7b80 00010000:00010000:2.0:1746155638.067738:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.067748:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 9 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.067755:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125305344:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.067770:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.071101:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.071177:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125831296 00000100:00100000:3.0:1746155638.071185:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125831296 00002000:00100000:3.0:1746155638.071220:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800936f6d80 x1830976125831296/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.071228:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6d80 with x1830976125831296 ext(4194304->5083135) 00010000:00010000:3.0:1746155638.071235:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17926 expref: 24 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.071246:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17926 expref: 24 pid: 9235 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746155638.071252:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936f6d80 00000100:00100000:3.0:1746155638.071286:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1354 00000100:00100000:3.0:1746155638.071293:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125831296:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155638.072128:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976125830912:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16975us (17060us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155638.072137:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7870 00002000:00100000:2.0:1746155638.072144:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009fff5500 x1830976125830912/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.072150:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5500 with x1830976125830912 ext(3145728->4194303) 00010000:00010000:2.0:1746155638.072158:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 8 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.072167:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 8 pid: 9235 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746155638.072172:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff5500 00000100:00100000:1.0:1746155638.074519:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976125830656:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19369us (19631us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155638.074528:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7869 00002000:00100000:1.0:1746155638.074536:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009fff4e00 x1830976125830656/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155638.074545:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4e00 with x1830976125830656 ext(3145728->4194303) 00002000:00010000:1.0:1746155638.074550:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fff4e00 00000100:00100000:2.0:1746155638.079820:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125305216:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155638.080033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.080078:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125305344:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.080103:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->3416063] (req 3145728->3416063) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.080122:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092873800, rc 0) 00000100:00100000:2.0:1746155638.080168:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32162:x1830976125831040:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 13294us (14498us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.080176:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16600 00000100:00100000:2.0:1746155638.080197:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125831424 00000100:00100000:2.0:1746155638.080201:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125831424 00000100:00100000:2.0:1746155638.080225:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16601 00000100:00100000:2.0:1746155638.080231:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32160:x1830976125831424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.080242:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.080253:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f6d7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17949 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.080266:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.080268:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->3416063] (req 3145728->3416063) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 24 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.080272:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155638.080274:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f6d7a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17949 expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.080294:0:9235:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->3416063] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 24 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.080299:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f6d7a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17949 expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.080306:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801315ea400, rc 0) 00000100:00100000:2.0:1746155638.080317:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32160:x1830976125831424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 88us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.080320:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16601 00000100:00100000:0.0:1746155638.080564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.080613:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125831552 00000100:00100000:2.0:1746155638.080616:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125831552 00010000:00010000:2.0:1746155638.080630:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 9 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.080663:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8510 00000100:00100000:2.0:1746155638.080668:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125831552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.080675:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.080689:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 9 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.080697:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 9 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.080711:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801303a1400/0x844e5faceb5f6d34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1791f expref: 9 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.080731:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.080761:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976125831552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 92us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.080767:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8510 00000100:00100000:3.0:1746155638.083716:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976125831296:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12416us (12614us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155638.083725:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1354 00002000:00100000:3.0:1746155638.083735:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800936f6d80 x1830976125831296/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:H/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.083743:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6d80 with x1830976125831296 ext(4194304->5083135) 00010000:00010000:3.0:1746155638.083751:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17926 expref: 23 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.083763:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17926 expref: 23 pid: 9235 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746155638.083770:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936f6d80 00000100:00100000:0.0:1746155638.089098:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.089268:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125831680 00000100:00100000:2.0:1746155638.089276:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125831680 00000100:00100000:2.0:1746155638.089314:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16602 00000100:00100000:2.0:1746155638.089322:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976125831680:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.089338:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.089353:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6d81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17950 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.089373:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.089383:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6d81 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17950 expref: 24 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.089391:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6d81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17950 expref: 24 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.089425:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801315ea800, rc 0) 00000100:00100000:2.0:1746155638.089465:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976125831680:12345-192.168.202.51@tcp:101:cat.0 Request processed in 144us (373us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155638.089471:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16602 00000100:00100000:0.0:1746155638.089694:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.089847:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125831808 00000100:00100000:3.0:1746155638.089851:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125831808 00010000:00010000:3.0:1746155638.089867:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17926 expref: 23 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.089886:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8511 00000100:00100000:3.0:1746155638.089891:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976125831808:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155638.089899:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155638.089914:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17926 expref: 23 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.089927:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17926 expref: 23 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.089941:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090414400/0x844e5faceb5f6d3b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17926 expref: 23 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.089964:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.089965:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.089971:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.089977:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.090000:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.090009:0:7063:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 22 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.090019:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125305600:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155638.090716:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.092906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.093044:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125832064 00000100:00100000:2.0:1746155638.093052:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125832064 00000100:00100000:2.0:1746155638.093097:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11038 00000100:00100000:2.0:1746155638.093104:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32164:x1830976125832064:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155638.093124:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.093139:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092872000/0x844e5faceb5f6d88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17957 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.093225:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6d8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093236:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6d8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093245:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6d8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093255:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092873a00/0x844e5faceb5f6d96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093260:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092873a00/0x844e5faceb5f6d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093264:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092873a00/0x844e5faceb5f6d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093347:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092873200/0x844e5faceb5f6d9d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093355:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092873200/0x844e5faceb5f6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093361:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092873200/0x844e5faceb5f6d9d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155638.093368:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155638.093433:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6d8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093439:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6d8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093445:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6d8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093453:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092872400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155638.093456:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6d8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093461:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6d8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093470:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155638.093472:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155638.093475:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6d8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093480:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6d8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093490:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092873a00/0x844e5faceb5f6d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093495:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092873a00/0x844e5faceb5f6d96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093499:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092873a00/0x844e5faceb5f6d96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093525:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092873a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155638.093527:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092873a00/0x844e5faceb5f6d96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093532:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092873a00/0x844e5faceb5f6d96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093538:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fca6a00) 00010000:00010000:2.0:1746155638.093539:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155638.093542:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092873a00/0x844e5faceb5f6d96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093546:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092873a00/0x844e5faceb5f6d96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.093574:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872000/0x844e5faceb5f6d88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17957 expref: 16 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.093584:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092873200/0x844e5faceb5f6d9d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17957 expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.093589:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155638.093591:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155638.093593:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092873200, rc 0) 00000100:00100000:2.0:1746155638.093631:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32164:x1830976125832064:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 527us (731us total) trans 8589945180 rc 0/0 00000100:00100000:2.0:1746155638.093637:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11038 00000100:00080000:2.0:1746155638.093655:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155638.093910:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125305600:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155638.093924:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155638.093944:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976125831808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4052us (4250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.093959:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8511 00000100:00100000:0.0:1746155638.094495:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.094554:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.094592:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125832320 00000100:00100000:3.0:1746155638.094596:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125832320 00002000:00100000:3.0:1746155638.094617:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3149823) req@ffff88012f1f0a80 x1830976125832320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.094626:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0a80 with x1830976125832320 ext(3145728->3149823) 00010000:00010000:3.0:1746155638.094632:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 22 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.094642:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 22 pid: 9235 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746155638.094648:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1f0a80 00000100:00100000:3.0:1746155638.094661:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1355 00000100:00100000:3.0:1746155638.094665:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976125832320:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155638.094773:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976125832320:12345-192.168.202.51@tcp:3:cat.0 Request processed in 106us (278us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155638.094778:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1355 00002000:00100000:3.0:1746155638.094783:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3149823) req@ffff88012f1f0a80 x1830976125832320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/4536 e 0 to 0 dl 1746155649 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.094790:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0a80 with x1830976125832320 ext(3145728->3149823) 00010000:00010000:3.0:1746155638.094794:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 22 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.094807:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 22 pid: 9235 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746155638.094812:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1f0a80 00000100:00100000:1.0:1746155638.094937:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125832448 00000100:00100000:1.0:1746155638.094944:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125832448 00000100:00100000:1.0:1746155638.094974:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16603 00000100:00100000:1.0:1746155638.094979:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32159:x1830976125832448:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155638.094986:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155638.094995:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f9d200/0x844e5faceb5f6dab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1795e expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.095014:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155638.095016:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155638.095019:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f9d200/0x844e5faceb5f6dab lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [5079040->5242879] (req 5079040->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1795e expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.095032:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f9d200/0x844e5faceb5f6dab lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [5079040->5242879] (req 5079040->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1795e expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.095046:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f9d200, rc 0) 00000100:00100000:1.0:1746155638.095082:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32159:x1830976125832448:12345-192.168.202.51@tcp:101:cat.0 Request processed in 101us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.095090:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16603 00000100:00100000:2.0:1746155638.097729:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.097771:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.097834:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125832576 00000100:00100000:3.0:1746155638.097839:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125832576 00000100:00100000:0.0:1746155638.097865:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125832832 00000100:00100000:0.0:1746155638.097869:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125832832 00000100:00100000:3.0:1746155638.097871:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 739 00000100:00100000:3.0:1746155638.097877:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125832576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155638.097887:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155638.097888:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4669 00000100:00100000:0.0:1746155638.097892:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32164:x1830976125832832:12345-192.168.202.51@tcp:35:multiop.0 00010000:00010000:3.0:1746155638.097905:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092873200/0x844e5faceb5f6d9d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17957 expref: 16 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.098024:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.098028:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155638.098045:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32164:x1830976125832832:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 153us (274us total) trans 8589945181 rc 0/0 00000100:00100000:3.0:1746155638.098046:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125832576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 169us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155638.098050:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4669 00000100:00100000:3.0:1746155638.098051:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 739 00000100:00100000:0.0:1746155638.098659:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.099022:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125833088 00000100:00100000:3.0:1746155638.099027:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125833088 00002000:00100000:3.0:1746155638.099050:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3411968->3416063) req@ffff88012f1f0700 x1830976125833088/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.099059:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0700 with x1830976125833088 ext(3411968->3416063) 00010000:00010000:3.0:1746155638.099066:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 23 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.099083:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 23 pid: 9235 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746155638.099089:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1f0700 00000100:00100000:3.0:1746155638.099113:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1356 00000100:00100000:3.0:1746155638.099120:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125833088:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155638.100086:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125833088:12345-192.168.202.51@tcp:3:cat.0 Request processed in 965us (1425us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155638.100094:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1356 00002000:00100000:3.0:1746155638.100100:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3411968->3416063) req@ffff88012f1f0700 x1830976125833088/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/4536 e 0 to 0 dl 1746155649 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.100108:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0700 with x1830976125833088 ext(3411968->3416063) 00010000:00010000:3.0:1746155638.100113:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 23 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.100127:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 23 pid: 9235 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746155638.100133:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1f0700 00000100:00100000:0.0:1746155638.103551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.103595:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125833344 00000100:00100000:3.0:1746155638.103608:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125833344 00002000:00100000:3.0:1746155638.103642:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3416063) req@ffff88012f1f2680 x1830976125833344/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.103649:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2680 with x1830976125833344 ext(3145728->3416063) 00010000:00010000:3.0:1746155638.103657:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 23 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.103668:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 23 pid: 9235 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746155638.103673:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1f2680 00000100:00100000:3.0:1746155638.103689:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1357 00000100:00100000:3.0:1746155638.103695:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125833344:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155638.103968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.104050:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125833600 00000100:00100000:2.0:1746155638.104054:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125833600 00000100:00100000:2.0:1746155638.104084:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4670 00000100:00100000:2.0:1746155638.104090:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:32162:x1830976125833600:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155638.104550:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32162:x1830976125833600:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 458us (580us total) trans 8589945182 rc 0/0 00000100:00100000:2.0:1746155638.104555:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4670 00000100:00100000:3.0:1746155638.110099:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976125833344:12345-192.168.202.51@tcp:4:cat.0 Request processed in 6396us (6548us total) trans 17179874168 rc 0/0 00000100:00100000:3.0:1746155638.110109:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1357 00002000:00100000:3.0:1746155638.110118:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3416063) req@ffff88012f1f2680 x1830976125833344/t17179874168(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/448 e 0 to 0 dl 1746155649 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.110126:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2680 with x1830976125833344 ext(3145728->3416063) 00010000:00010000:3.0:1746155638.110134:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 25 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.110147:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 25 pid: 9235 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746155638.110153:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1f2680 00000100:00100000:0.0:1746155638.113811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.114148:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125833728 00000100:00100000:3.0:1746155638.114155:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125833728 00010000:00010000:3.0:1746155638.114184:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 25 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.114227:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8512 00000100:00100000:3.0:1746155638.114234:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976125833728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155638.114247:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155638.114265:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 25 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.114276:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 25 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.114296:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092873800/0x844e5faceb5f6d73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3416063) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17942 expref: 25 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.114323:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.114325:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.114331:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f6d7a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17949 expref: 7 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.114338:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f6d7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17949 expref: 7 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.114345:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.114347:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.114349:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f9d200/0x844e5faceb5f6dab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5079040->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1795e expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.114356:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f9d200/0x844e5faceb5f6dab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5079040->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1795e expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.114382:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094f9d200/0x844e5faceb5f6dab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5079040->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1795e expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.114394:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125305728:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155638.114477:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f6d7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17949 expref: 7 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.114485:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125305856:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155638.114535:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0056c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155638.116794:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125305728:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155638.117364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.117413:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125833984 00000100:00100000:3.0:1746155638.117419:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125833984 00002000:00100000:3.0:1746155638.117458:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (5079040->5083135) req@ffff88012f1f1c00 x1830976125833984/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.117466:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1c00 with x1830976125833984 ext(5079040->5083135) 00002000:00010000:3.0:1746155638.117470:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f1c00 00000100:00100000:3.0:1746155638.117486:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7871 00000100:00100000:3.0:1746155638.117493:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125833984:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155638.117660:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125833984:12345-192.168.202.51@tcp:3:cat.0 Request processed in 167us (296us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155638.117667:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7871 00002000:00100000:3.0:1746155638.117673:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (5079040->5083135) req@ffff88012f1f1c00 x1830976125833984/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/4536 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.117687:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1c00 with x1830976125833984 ext(5079040->5083135) 00002000:00010000:3.0:1746155638.117689:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f1c00 00000100:00100000:2.0:1746155638.117771:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125305856:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155638.117790:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.117823:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976125833728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3589us (4019us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.117830:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8512 00000100:00100000:0.0:1746155638.120381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.121173:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125834240 00000100:00100000:3.0:1746155638.121181:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125834240 00002000:00100000:3.0:1746155638.121216:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012f1f3480 x1830976125834240/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.121226:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3480 with x1830976125834240 ext(3145728->4194303) 00002000:00010000:3.0:1746155638.121231:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3480 00000100:00100000:3.0:1746155638.122318:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7872 00000100:00100000:3.0:1746155638.122329:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1963:x1830976125834240:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155638.134833:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1963:x1830976125834240:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12500us (14450us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.134843:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7872 00002000:00100000:3.0:1746155638.134851:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012f1f3480 x1830976125834240/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.134859:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3480 with x1830976125834240 ext(3145728->4194303) 00002000:00010000:3.0:1746155638.134865:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3480 00000100:00100000:0.0:1746155638.143857:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.143966:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125834496 00000100:00100000:3.0:1746155638.143975:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125834496 00002000:00100000:3.0:1746155638.144014:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012f1f3b80 x1830976125834496/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.144024:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3b80 with x1830976125834496 ext(4194304->5083135) 00002000:00010000:3.0:1746155638.144030:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3b80 00000100:00100000:0.0:1746155638.145199:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7873 00000100:00100000:1.0:1746155638.145311:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976125834496:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155638.157927:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976125834496:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12712us (14069us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155638.157938:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7873 00002000:00100000:1.0:1746155638.157947:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012f1f3b80 x1830976125834496/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155638.157970:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3b80 with x1830976125834496 ext(4194304->5083135) 00002000:00010000:1.0:1746155638.157975:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3b80 00000100:00100000:0.0:1746155638.167313:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.167406:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125834752 00000100:00100000:2.0:1746155638.167415:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125834752 00000100:00100000:2.0:1746155638.167448:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4671 00000100:00100000:2.0:1746155638.167454:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32160:x1830976125834752:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155638.167645:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32160:x1830976125834752:12345-192.168.202.51@tcp:35:cat.0 Request processed in 190us (339us total) trans 8589945183 rc 0/0 00000100:00100000:2.0:1746155638.167651:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4671 00000100:00100000:0.0:1746155638.246977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.248605:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125835008 00000100:00100000:3.0:1746155638.248615:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125835008 00000100:00100000:3.0:1746155638.248667:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11039 00000100:00100000:3.0:1746155638.248675:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32172:x1830976125835008:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155638.248692:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.248882:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c1200/0x844e5faceb5f6db2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17965 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.248988:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0600/0x844e5faceb5f6db9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.248999:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0600/0x844e5faceb5f6db9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249008:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0600/0x844e5faceb5f6db9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249020:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0800/0x844e5faceb5f6dc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249025:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0800/0x844e5faceb5f6dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249030:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0800/0x844e5faceb5f6dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249110:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0a00/0x844e5faceb5f6dc7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249117:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0a00/0x844e5faceb5f6dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249122:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0a00/0x844e5faceb5f6dc7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155638.249130:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155638.249202:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0600/0x844e5faceb5f6db9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249208:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0600/0x844e5faceb5f6db9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249213:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0600/0x844e5faceb5f6db9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249218:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3c0600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155638.249221:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0600/0x844e5faceb5f6db9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249226:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0600/0x844e5faceb5f6db9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249235:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155638.249237:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155638.249241:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0600/0x844e5faceb5f6db9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249245:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0600/0x844e5faceb5f6db9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249271:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0800/0x844e5faceb5f6dc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249276:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0800/0x844e5faceb5f6dc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249280:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0800/0x844e5faceb5f6dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249288:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f3c0800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155638.249290:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0800/0x844e5faceb5f6dc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249294:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0800/0x844e5faceb5f6dc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249300:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c823300) 00010000:00010000:3.0:1746155638.249301:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155638.249303:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0800/0x844e5faceb5f6dc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249307:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0800/0x844e5faceb5f6dc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.249341:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c1200/0x844e5faceb5f6db2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17965 expref: 299 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.249352:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0a00/0x844e5faceb5f6dc7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17965 expref: 298 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.249358:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.249360:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155638.249362:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f3c0a00, rc 0) 00000100:00100000:3.0:1746155638.249416:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:32172:x1830976125835008:12345-192.168.202.51@tcp:101:cat.0 Request processed in 742us (2472us total) trans 8589945184 rc 0/0 00000100:00100000:3.0:1746155638.249423:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11039 00000100:00100000:0.0:1746155638.254396:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.254479:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.254640:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125835264 00000100:00100000:2.0:1746155638.254648:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125835264 00000100:00100000:2.0:1746155638.254693:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4672 00000100:00100000:2.0:1746155638.254701:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:32172:x1830976125835264:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155638.254871:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:32172:x1830976125835264:12345-192.168.202.51@tcp:35:cat.0 Request processed in 170us (481us total) trans 8589945185 rc 0/0 00000100:00100000:2.0:1746155638.254878:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4672 00000100:00100000:3.0:1746155638.255358:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125835392 00000100:00100000:3.0:1746155638.255362:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125835392 00000100:00100000:3.0:1746155638.255399:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 740 00000100:00100000:3.0:1746155638.255404:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1963:x1830976125835392:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155638.255413:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155638.255432:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f3c0a00/0x844e5faceb5f6dc7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17965 expref: 299 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.255445:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.255448:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155638.255480:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1963:x1830976125835392:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 75us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.255485:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 740 00000100:00100000:0.0:1746155638.275335:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.275383:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155638.275449:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746155638.275760:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125835776 00000100:00100000:2.0:1746155638.275767:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125835776 00002000:00100000:2.0:1746155638.275798:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800910c8380 x1830976125835776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.275807:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8380 with x1830976125835776 ext(3145728->4194303) 00002000:00010000:2.0:1746155638.275812:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910c8380 00000100:00100000:2.0:1746155638.275971:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125835648 00000100:00100000:2.0:1746155638.275975:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125835648 00002000:00100000:2.0:1746155638.275988:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800910cbb80 x1830976125835648/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.275995:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cbb80 with x1830976125835648 ext(2097152->3145727) 00002000:00010000:2.0:1746155638.275997:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910cbb80 00000100:00100000:2.0:1746155638.276020:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7874 00000100:00100000:2.0:1746155638.276026:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976125835776:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155638.276064:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7875 00000100:00100000:1.0:1746155638.276071:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976125835648:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155638.295336:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.295452:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125836032 00000100:00100000:0.0:1746155638.295459:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125836032 00000100:00100000:0.0:1746155638.295498:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16604 00000100:00100000:0.0:1746155638.295519:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32164:x1830976125836032:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155638.295532:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155638.295546:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1796c expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.295569:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f6d18 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17903 expref: 14 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.295577:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6d1f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1790a expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155638.295582:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155638.295583:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155638.295586:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1523712->2097151] (req 1523712->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.295609:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6d1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1790a expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155638.295619:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6d1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1790a expref: 11 pid: 8437 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746155638.295634:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125305984:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155638.295693:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f6d18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17903 expref: 14 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.295701:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f6d18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17903 expref: 14 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.295708:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125306112:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155638.295723:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155638.296269:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976125835648:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20195us (20882us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155638.296278:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7875 00002000:00100000:1.0:1746155638.296287:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800910cbb80 x1830976125835648/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155638.296296:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cbb80 with x1830976125835648 ext(2097152->3145727) 00002000:00010000:1.0:1746155638.296300:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910cbb80 00000100:00100000:2.0:1746155638.297040:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976125835776:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21012us (21712us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155638.297047:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7874 00002000:00100000:2.0:1746155638.297052:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800910c8380 x1830976125835776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.297059:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8380 with x1830976125835776 ext(3145728->4194303) 00002000:00010000:2.0:1746155638.297062:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910c8380 00000100:00100000:2.0:1746155638.300545:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125305984:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.300556:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125306112:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.300578:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1523712->2097151] (req 1523712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.300591:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7dc00, rc 0) 00000100:00100000:2.0:1746155638.300634:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32164:x1830976125836032:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5117us (5305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.300641:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16604 00000100:00100000:0.0:1746155638.300920:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.301767:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125836160 00000100:00100000:2.0:1746155638.301774:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125836160 00010000:00010000:2.0:1746155638.301800:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6d1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1790a expref: 11 pid: 8437 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746155638.301833:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8513 00000100:00100000:2.0:1746155638.301839:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125836160:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.301850:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.301867:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6d1f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1790a expref: 11 pid: 8437 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.301876:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6d1f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1790a expref: 11 pid: 8437 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.301893:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f6d1f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1790a expref: 11 pid: 8437 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.303288:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.303341:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125836160:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1499us (2516us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.303349:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8513 00000100:00100000:0.0:1746155638.304437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.305417:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125836288 00000100:00100000:2.0:1746155638.305424:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125836288 00010000:00010000:2.0:1746155638.305450:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f6d18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17903 expref: 15 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.305637:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.305668:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125836544 00000100:00100000:0.0:1746155638.305671:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125836544 00002000:00100000:0.0:1746155638.305697:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5079039) req@ffff88012bdf4380 x1830976125836544/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155638.305706:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4380 with x1830976125836544 ext(4194304->5079039) 00002000:00010000:0.0:1746155638.305709:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf4380 00000100:00100000:0.0:1746155638.305734:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7876 00000100:00100000:2.0:1746155638.305775:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8514 00000100:00100000:2.0:1746155638.305782:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976125836288:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.305794:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.305812:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f6d18 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17903 expref: 15 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.305823:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f6d18 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17903 expref: 15 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.306322:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f6d18 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17903 expref: 15 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.306337:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.306338:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.306343:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.306350:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.306376:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.306387:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125306240:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155638.306407:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976125836544:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155638.307036:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.310292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.310332:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125836800 00000100:00100000:0.0:1746155638.310339:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125836800 00002000:00100000:0.0:1746155638.311305:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e0:0x0] (1523712->1527807) req@ffff88012bdf5500 x1830976125836800/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155638.311316:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5500 with x1830976125836800 ext(1523712->1527807) 00002000:00010000:0.0:1746155638.311321:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf5500 00000100:00100000:2.0:1746155638.311446:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125306240:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155638.311463:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.311492:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976125836288:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5710us (7055us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.311500:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8514 00000100:00100000:1.0:1746155638.311622:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7877 00000100:00100000:1.0:1746155638.311631:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125836800:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155638.311752:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125836800:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 123us (1466us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155638.311758:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7877 00002000:00100000:1.0:1746155638.311763:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e0:0x0] (1523712->1527807) req@ffff88012bdf5500 x1830976125836800/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/4536 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155638.311770:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5500 with x1830976125836800 ext(1523712->1527807) 00002000:00010000:1.0:1746155638.311773:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf5500 00000100:00100000:0.0:1746155638.315451:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.315750:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125836928 00000100:00100000:2.0:1746155638.315758:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125836928 00000100:00100000:2.0:1746155638.315807:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16605 00000100:00100000:2.0:1746155638.315815:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976125836928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.315828:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.315842:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092873800/0x844e5faceb5f6ddc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17973 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.315891:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125306368:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155638.315974:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.317428:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976125836544:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11685us (11788us total) trans 0 rc 884736/884736 00000100:00100000:0.0:1746155638.317436:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7876 00002000:00100000:0.0:1746155638.317443:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5079039) req@ffff88012bdf4380 x1830976125836544/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 884736/884736 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155638.317452:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4380 with x1830976125836544 ext(4194304->5079039) 00002000:00010000:0.0:1746155638.317456:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf4380 00000100:00100000:2.0:1746155638.319536:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125306368:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155638.319563:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092873800/0x844e5faceb5f6ddc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17973 expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.319574:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092873800/0x844e5faceb5f6ddc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17973 expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.319589:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092873800, rc 0) 00000100:00100000:2.0:1746155638.319629:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976125836928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3815us (4185us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155638.319635:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16605 00000100:00100000:0.0:1746155638.323924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.324611:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125837056 00000100:00100000:2.0:1746155638.324617:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125837056 00000100:00100000:2.0:1746155638.324662:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16606 00000100:00100000:2.0:1746155638.324670:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32164:x1830976125837056:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155638.324684:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.324698:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1797a expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.324723:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6c07 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17862 expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.324731:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ed0200/0x844e5faceb5f6c0e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17869 expref: 13 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.324737:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.324739:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.324741:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->1511423] (req 1048576->1511423) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.324765:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ed0200/0x844e5faceb5f6c0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17869 expref: 13 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.324775:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ed0200/0x844e5faceb5f6c0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17869 expref: 13 pid: 29728 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.324786:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125306496:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155638.325521:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.325648:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125837184 00000100:00100000:1.0:1746155638.325652:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125837184 00000100:00100000:1.0:1746155638.325672:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16607 00000100:00100000:1.0:1746155638.325678:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976125837184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155638.325689:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155638.325697:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f6dea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17981 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.325709:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6c07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17862 expref: 11 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.325717:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6c07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17862 expref: 11 pid: 4461 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.325720:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125306752:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155638.325724:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125306624:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.325753:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155638.325816:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155638.328586:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125306496:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155638.330157:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125306752:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155638.330188:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f6dea lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17981 expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155638.330197:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125306624:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.330201:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f6dea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17981 expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.330215:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->1511423] (req 1048576->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.330226:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092873600, rc 0) 00010000:00010000:1.0:1746155638.330230:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0e200, rc 0) 00000100:00100000:2.0:1746155638.330261:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32164:x1830976125837056:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5592us (6343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.330268:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16606 00000100:00100000:1.0:1746155638.330567:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976125837184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4888us (5046us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155638.330573:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16607 00000100:00100000:0.0:1746155638.333406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.333795:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125837312 00000100:00100000:2.0:1746155638.333802:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125837312 00010000:00010000:2.0:1746155638.333828:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed0200/0x844e5faceb5f6c0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17869 expref: 14 pid: 29728 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.333880:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.335456:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.335482:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.335530:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125837696 00000100:00100000:0.0:1746155638.335535:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125837696 00000100:00100000:0.0:1746155638.335557:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125837568 00000100:00100000:0.0:1746155638.335559:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125837568 00000100:00100000:0.0:1746155638.335572:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16608 00000100:00100000:0.0:1746155638.335578:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976125837696:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155638.335592:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155638.335603:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f6df1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1798f expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.335621:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155638.335631:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f6df1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1798f expref: 17 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155638.335641:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f6df1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1798f expref: 17 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155638.335655:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7ce00, rc 0) 00000100:00100000:0.0:1746155638.335688:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976125837696:12345-192.168.202.51@tcp:101:cat.0 Request processed in 110us (233us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155638.335693:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16608 00000100:00100000:0.0:1746155638.335706:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16609 00000100:00100000:0.0:1746155638.335711:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976125837568:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155638.335716:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155638.335722:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c400/0x844e5faceb5f6df8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17988 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155638.335755:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125306880:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155638.335794:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155638.336759:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125837440 00000100:00100000:2.0:1746155638.336765:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125837440 00000100:00100000:1.0:1746155638.336820:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8515 00000100:00100000:1.0:1746155638.336828:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976125837312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.336839:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.336858:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ed0200/0x844e5faceb5f6c0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17869 expref: 16 pid: 29728 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.336860:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6c07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17862 expref: 11 pid: 4461 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.336869:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ed0200/0x844e5faceb5f6c0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17869 expref: 16 pid: 29728 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.336883:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ed0200/0x844e5faceb5f6c0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17869 expref: 16 pid: 29728 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.336888:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8516 00010000:00010000:1.0:1746155638.336893:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.336894:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125837440:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.336901:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.336910:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6c07 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17862 expref: 11 pid: 4461 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.336917:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976125837312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 90us (3514us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155638.336919:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6c07 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17862 expref: 11 pid: 4461 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.336922:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8515 00010000:00010000:2.0:1746155638.336931:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801303a1200/0x844e5faceb5f6c07 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17862 expref: 11 pid: 4461 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.336943:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.336945:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.336963:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 10 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.336971:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 10 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.336992:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 10 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.337000:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125307008:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155638.337035:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.346209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.346863:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125306880:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155638.346889:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c400/0x844e5faceb5f6df8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17988 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155638.346905:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c400/0x844e5faceb5f6df8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17988 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155638.347679:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125837952 00000100:00100000:3.0:1746155638.347685:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125837952 00010000:00010000:0.0:1746155638.347703:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7c400, rc 0) 00000100:00100000:0.0:1746155638.347742:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976125837568:12345-192.168.202.51@tcp:101:cat.0 Request processed in 12030us (12258us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155638.347750:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16609 00000100:00100000:3.0:1746155638.348355:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11040 00000100:00100000:3.0:1746155638.348362:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:32174:x1830976125837952:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:1.0:1746155638.348376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155638.348378:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.348389:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbe00/0x844e5faceb5f6dff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17996 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.348453:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125307008:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155638.348464:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155638.348469:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348478:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155638.348484:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125837440:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 11591us (14605us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155638.348486:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155638.348491:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8516 00010000:00010000:3.0:1746155638.348496:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348515:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348521:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155638.348555:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125838208 00000100:00100000:0.0:1746155638.348559:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125838208 00002000:00100000:0.0:1746155638.348578:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1507328->1511423) req@ffff88009fff4380 x1830976125838208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155638.348586:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4380 with x1830976125838208 ext(1507328->1511423) 00002000:00010000:0.0:1746155638.348589:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fff4380 00000100:00100000:0.0:1746155638.348601:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7878 00010000:00010000:3.0:1746155638.348605:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbc00/0x844e5faceb5f6e14 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155638.348605:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976125838208:12345-192.168.202.51@tcp:3:multiop.0 00010000:00010000:3.0:1746155638.348612:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbc00/0x844e5faceb5f6e14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348618:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbc00/0x844e5faceb5f6e14 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155638.348624:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155638.348688:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348693:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e06 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348697:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348701:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801303bb400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155638.348704:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348709:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348717:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155638.348720:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155638.348723:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155638.348726:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976125838208:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 120us (350us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1746155638.348727:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155638.348731:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7878 00002000:00100000:0.0:1746155638.348736:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1507328->1511423) req@ffff88009fff4380 x1830976125838208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/4536 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746155638.348738:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348743:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e0d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00002000:00100000:0.0:1746155638.348743:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4380 with x1830976125838208 ext(1507328->1511423) 00002000:00010000:0.0:1746155638.348745:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fff4380 00010000:00010000:3.0:1746155638.348747:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348750:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801303bb200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155638.348752:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348757:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e0d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348762:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c823300) 00010000:00010000:3.0:1746155638.348764:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155638.348766:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e0d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348770:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.348798:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbe00/0x844e5faceb5f6dff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17996 expref: 301 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.348810:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbc00/0x844e5faceb5f6e14 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17996 expref: 300 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.348815:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.348817:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155638.348819:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801303bbc00, rc 0) 00000100:00100000:3.0:1746155638.348835:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:32174:x1830976125837952:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 474us (2635us total) trans 8589945186 rc 0/0 00000100:00100000:3.0:1746155638.348840:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11040 00000100:00100000:0.0:1746155638.350927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.351416:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125838336 00000100:00100000:3.0:1746155638.351422:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125838336 00000100:00100000:3.0:1746155638.351471:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 741 00000100:00100000:3.0:1746155638.351478:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1960:x1830976125838336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155638.351489:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155638.351530:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbc00/0x844e5faceb5f6e14 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17996 expref: 300 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.351544:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.351548:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155638.351587:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1960:x1830976125838336:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 109us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.351593:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 741 00000100:00100000:0.0:1746155638.356481:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.356619:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125838464 00000100:00100000:2.0:1746155638.356627:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125838464 00000100:00100000:2.0:1746155638.356670:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16610 00000100:00100000:2.0:1746155638.356677:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32174:x1830976125838464:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155638.356692:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.356707:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1799d expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.356733:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1e00/0x844e5faceb5f6ae8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177d6 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.356741:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbcf200/0x844e5faceb5f6bba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17823 expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.356747:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f6ba5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1781c expref: 7 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.356753:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.356755:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.356758:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [753664->892927] (req 753664->892927) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 25 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.356782:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f6ba5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1781c expref: 7 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.356793:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f6ba5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1781c expref: 7 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.356807:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125307136:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.356876:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbcf200/0x844e5faceb5f6bba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17823 expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.356884:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbcf200/0x844e5faceb5f6bba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17823 expref: 25 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.356891:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125307264:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.356913:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1e00/0x844e5faceb5f6ae8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177d6 expref: 6 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.358602:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1e00/0x844e5faceb5f6ae8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177d6 expref: 6 pid: 8437 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746155638.358614:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125307392:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.359077:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155638.362322:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125307136:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.363198:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125307264:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155638.363664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.363713:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.364348:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125838592 00000100:00100000:1.0:1746155638.364354:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125838592 00010000:00010000:1.0:1746155638.364382:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f6ba5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1781c expref: 8 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.364403:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125838720 00000100:00100000:1.0:1746155638.364405:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125838720 00010000:00010000:1.0:1746155638.364413:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1e00/0x844e5faceb5f6ae8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177d6 expref: 7 pid: 8437 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746155638.364426:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8517 00000100:00100000:1.0:1746155638.364432:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976125838592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.364443:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746155638.364459:0:7063:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2023 -> 2025 00010000:00010000:1.0:1746155638.364464:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f6ba5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1781c expref: 8 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.364473:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f6ba5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1781c expref: 8 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.364490:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbcee00/0x844e5faceb5f6ba5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1781c expref: 8 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.364523:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.364554:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1962:x1830976125838592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 121us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.364558:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8517 00000100:00100000:1.0:1746155638.364570:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8518 00000100:00100000:1.0:1746155638.364575:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976125838720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.364579:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.364591:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1e00/0x844e5faceb5f6ae8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177d6 expref: 7 pid: 8437 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746155638.364599:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1e00/0x844e5faceb5f6ae8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177d6 expref: 7 pid: 8437 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746155638.364608:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.364620:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976125838720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 46us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.364625:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8518 00010000:00010000:3.0:1746155638.364818:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f8f1e00/0x844e5faceb5f6ae8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177d6 expref: 6 pid: 8437 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746155638.364830:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125307392:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.364856:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [753664->892927] (req 753664->892927) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 25 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.364864:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092872400, rc 0) 00000100:00100000:3.0:1746155638.364887:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32174:x1830976125838464:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8211us (8414us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.364892:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16610 00000100:00100000:0.0:1746155638.365612:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.366249:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125838848 00000100:00100000:2.0:1746155638.366253:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125838848 00010000:00010000:2.0:1746155638.366270:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbcf200/0x844e5faceb5f6bba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17823 expref: 25 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.366296:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8519 00000100:00100000:2.0:1746155638.366302:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976125838848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.366309:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.366319:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbcf200/0x844e5faceb5f6bba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17823 expref: 25 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.366327:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbcf200/0x844e5faceb5f6bba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17823 expref: 25 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.366340:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbcf200/0x844e5faceb5f6bba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17823 expref: 25 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.366362:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.366363:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.366369:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.366376:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.366400:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.366410:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125307520:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155638.366468:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.368221:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.368329:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125839104 00000100:00100000:2.0:1746155638.368334:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125839104 00002000:00100000:2.0:1746155638.368361:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e1:0x0] (753664->757759) req@ffff8800a62a3b80 x1830976125839104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.368369:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a3b80 with x1830976125839104 ext(753664->757759) 00002000:00010000:2.0:1746155638.368373:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a3b80 00000100:00100000:2.0:1746155638.368398:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7879 00000100:00100000:2.0:1746155638.368404:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125839104:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155638.368561:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125839104:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 157us (342us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155638.368567:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7879 00002000:00100000:2.0:1746155638.368572:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e1:0x0] (753664->757759) req@ffff8800a62a3b80 x1830976125839104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/4536 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.368579:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a3b80 with x1830976125839104 ext(753664->757759) 00002000:00010000:2.0:1746155638.368581:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a3b80 00000100:00100000:3.0:1746155638.369081:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125307520:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155638.369093:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155638.369120:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976125838848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2819us (3510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.369126:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8519 00000100:00100000:0.0:1746155638.371735:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.371888:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125839360 00000100:00100000:2.0:1746155638.371895:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125839360 00002000:00100000:2.0:1746155638.371932:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (888832->892927) req@ffff8800a62a3800 x1830976125839360/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.371940:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a3800 with x1830976125839360 ext(888832->892927) 00002000:00010000:2.0:1746155638.371945:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a3800 00000100:00100000:2.0:1746155638.371980:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7880 00000100:00100000:2.0:1746155638.371986:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976125839360:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155638.372117:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976125839360:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 130us (387us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155638.372122:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7880 00002000:00100000:2.0:1746155638.372127:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (888832->892927) req@ffff8800a62a3800 x1830976125839360/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/4536 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.372133:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a3800 with x1830976125839360 ext(888832->892927) 00002000:00010000:2.0:1746155638.372136:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a3800 00000100:00100000:0.0:1746155638.373747:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.374066:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125839616 00000100:00100000:2.0:1746155638.374072:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125839616 00000100:00100000:2.0:1746155638.374100:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4673 00000100:00100000:2.0:1746155638.374105:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:32174:x1830976125839616:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155638.374253:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:32174:x1830976125839616:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 146us (509us total) trans 8589945187 rc 0/0 00000100:00100000:2.0:1746155638.374258:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4673 00000100:00100000:0.0:1746155638.386001:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.386301:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125839744 00000100:00100000:3.0:1746155638.386308:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125839744 00000100:00100000:3.0:1746155638.386435:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11041 00000100:00100000:3.0:1746155638.386443:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32179:x1830976125839744:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.386463:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.386478:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbe00/0x844e5faceb5f6e29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179a4 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.386544:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.386558:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.386565:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.386575:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.386579:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.386584:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.386660:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.386667:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17815 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.386673:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.386695:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17815 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.386704:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17815 expref: 15 pid: 27374 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.386713:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125307648:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.386759:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005240 going to sleep for 11 seconds 00000100:00080000:2.0:1746155638.387428:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155638.387811:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125307648:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.387825:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155638.388468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.388860:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125840000 00000100:00100000:2.0:1746155638.388866:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125840000 00000100:00100000:2.0:1746155638.388902:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4674 00000100:00100000:2.0:1746155638.388908:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:7661:x1830976125840000:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746155638.389073:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:7661:x1830976125840000:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 164us (606us total) trans 8589945188 rc 0/0 00000100:00100000:2.0:1746155638.389078:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4674 00000100:00100000:0.0:1746155638.390907:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.390992:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125840128 00000100:00100000:3.0:1746155638.390998:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125840128 00010000:00010000:3.0:1746155638.391023:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17815 expref: 17 pid: 27374 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.391042:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8520 00000100:00100000:3.0:1746155638.391048:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125840128:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155638.391057:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155638.391062:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17815 expref: 17 pid: 27374 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.391072:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17815 expref: 17 pid: 27374 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.391089:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e7800/0x844e5faceb5f6bb3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17815 expref: 17 pid: 27374 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.391266:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.391271:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.391279:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.391285:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.391305:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155638.391405:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391411:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155638.391440:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:0.0:1746155638.391443:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155638.391454:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391462:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391469:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391473:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391478:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391485:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801303bb200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155638.391488:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391493:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391500:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155638.391523:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155638.391526:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391530:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6e30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391541:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391545:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391549:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391553:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801303bb400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155638.391554:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391559:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391564:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c823d00) 00010000:00010000:0.0:1746155638.391566:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155638.391568:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391572:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bb400/0x844e5faceb5f6e37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.391599:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbe00/0x844e5faceb5f6e29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179a4 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.391609:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179a4 expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.391614:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155638.391616:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155638.391617:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801303ba400, rc 0) 00000100:00100000:3.0:1746155638.391715:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125840128:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 665us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.391721:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8520 00000100:00100000:0.0:1746155638.391884:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32179:x1830976125839744:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5441us (5889us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155638.391890:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11041 00000100:00100000:0.0:1746155638.396573:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.397144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.397608:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.397630:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125840256 00000100:00100000:0.0:1746155638.397637:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125840256 00000100:00100000:0.0:1746155638.397667:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125840384 00000100:00100000:0.0:1746155638.397669:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125840384 00000100:00100000:3.0:1746155638.398013:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125840512 00000100:00100000:3.0:1746155638.398016:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125840512 00000100:00080000:2.0:1746155638.398251:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746155638.398293:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16611 00000100:00100000:3.0:1746155638.398300:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1963:x1830976125840256:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.398315:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.398329:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801303bba00/0x844e5faceb5f6e45 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179ab expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.398372:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125307776:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155638.398425:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.398482:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16612 00000100:00100000:0.0:1746155638.398488:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976125840512:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155638.398495:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155638.398521:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c800/0x844e5faceb5f6e4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179b9 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155638.398550:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125307904:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155638.398579:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.398593:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16613 00000100:00100000:0.0:1746155638.398598:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125840384:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155638.398604:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155638.398610:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c000/0x844e5faceb5f6e53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179b2 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155638.398628:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125308032:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155638.398645:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.398677:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.398731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.398958:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125840640 00000100:00100000:1.0:1746155638.398962:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125840640 00000100:00100000:1.0:1746155638.398978:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125840768 00000100:00100000:1.0:1746155638.398980:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125840768 00000100:00100000:1.0:1746155638.398991:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16614 00000100:00100000:1.0:1746155638.398995:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125840640:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155638.399001:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155638.399008:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5f6e5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179c0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.399018:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.399020:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.399027:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5f6e5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c0 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155638.399049:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5f6e5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c0 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155638.399059:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0e200, rc 0) 00000100:00100000:1.0:1746155638.399080:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125840640:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 84us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.399085:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16614 00000100:00100000:1.0:1746155638.399097:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16615 00000100:00100000:1.0:1746155638.399101:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976125840768:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155638.399107:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155638.399112:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f6e61 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179c7 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.399121:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.399122:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.399126:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f6e61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c7 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155638.399134:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f6e61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c7 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155638.399140:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0fa00, rc 0) 00000100:00100000:1.0:1746155638.399153:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976125840768:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 51us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.399157:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16615 00000100:00100000:0.0:1746155638.401614:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125308032:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155638.401639:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c000/0x844e5faceb5f6e53 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179b2 expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155638.401650:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c000/0x844e5faceb5f6e53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179b2 expref: 10 pid: 29728 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746155638.402014:0:10591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime: 1746155637 -> 1746155638 00000100:00100000:1.0:1746155638.402025:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125307904:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155638.402437:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c800/0x844e5faceb5f6e4c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179b9 expref: 9 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155638.402449:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7c800/0x844e5faceb5f6e4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179b9 expref: 9 pid: 10591 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746155638.402519:0:20796:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime: 1746155637 -> 1746155638 00002000:00010000:3.0:1746155638.402522:0:20796:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime: 1746155637 -> 1746155638 00002000:00010000:3.0:1746155638.402524:0:20796:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime: 1746155637 -> 1746155638 00000100:00100000:3.0:1746155638.402534:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125307776:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155638.402550:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801303bba00/0x844e5faceb5f6e45 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ab expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.402558:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801303bba00/0x844e5faceb5f6e45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ab expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155638.402682:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7c000, rc 0) 00010000:00010000:1.0:1746155638.402846:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7c800, rc 0) 00010000:00010000:3.0:1746155638.402876:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801303bba00, rc 0) 00000100:00100000:0.0:1746155638.402955:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125840384:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4346us (5801us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155638.402962:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16613 00000100:00100000:1.0:1746155638.403002:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976125840512:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4514us (5393us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155638.403007:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16612 00000100:00100000:3.0:1746155638.403062:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1963:x1830976125840256:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4761us (6495us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155638.403067:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16611 00000100:00100000:0.0:1746155638.407266:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.407528:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125841024 00000100:00100000:2.0:1746155638.407536:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125841024 00000100:00100000:2.0:1746155638.407582:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11042 00000100:00100000:2.0:1746155638.407588:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32179:x1830976125841024:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155638.407605:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.407619:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea800/0x844e5faceb5f6e68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179ce expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.407692:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155638.407703:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179a4 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.407709:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155638.407732:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179a4 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.407741:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179a4 expref: 8 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.407750:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125308160:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.408673:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.410652:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.410776:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125841152 00000100:00100000:3.0:1746155638.410782:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125841152 00010000:00010000:3.0:1746155638.410805:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179a4 expref: 9 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.410824:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8521 00000100:00100000:3.0:1746155638.410829:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125841152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155638.410837:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155638.410842:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179a4 expref: 9 pid: 15474 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.410850:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179a4 expref: 9 pid: 15474 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.410867:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.410871:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.410878:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.410884:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.410896:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155638.410935:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125841152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 105us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.410944:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8521 00010000:00010000:2.0:1746155638.411294:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e3e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179a4 expref: 8 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.411308:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125308160:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.411322:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155638.411327:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155638.411331:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155638.411345:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155638.411448:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea800/0x844e5faceb5f6e68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ce expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.411464:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ce expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.411470:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155638.411472:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155638.411474:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbcf200, rc 0) 00000100:00100000:2.0:1746155638.411495:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32179:x1830976125841024:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3907us (4236us total) trans 8589945189 rc 0/0 00000100:00100000:2.0:1746155638.411520:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11042 00000100:00100000:0.0:1746155638.414317:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.414791:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125841280 00000100:00100000:2.0:1746155638.414799:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125841280 00000100:00100000:2.0:1746155638.414840:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11043 00000100:00100000:2.0:1746155638.414846:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32179:x1830976125841280:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155638.414865:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.414879:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124400/0x844e5faceb5f6e7d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179d5 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.414936:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f6e84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155638.414958:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ce expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.414964:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f6e84 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155638.414986:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ce expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.414995:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ce expref: 9 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.415003:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125308288:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.415065:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c9ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.417962:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.417985:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125841408 00000100:00100000:0.0:1746155638.417991:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125841408 00010000:00010000:0.0:1746155638.418015:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ce expref: 10 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.418036:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8522 00000100:00100000:0.0:1746155638.418041:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125841408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155638.418051:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155638.418056:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ce expref: 10 pid: 15474 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746155638.418065:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ce expref: 10 pid: 15474 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746155638.418081:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155638.418085:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f6e84 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.418094:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f6e84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.418099:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f6e84 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.418112:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155638.418141:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125841408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 99us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155638.418149:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8522 00010000:00010000:3.0:1746155638.418287:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf200/0x844e5faceb5f6e6f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ce expref: 9 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.418304:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125308288:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.418318:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f6e84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.418324:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f6e84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.418328:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f6e84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155638.418357:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155638.418359:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155638.418370:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f6e84 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.418390:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124400/0x844e5faceb5f6e7d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179d5 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.418399:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f6e84 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179d5 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.418405:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.418407:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155638.418408:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a125400, rc 0) 00000100:00100000:3.0:1746155638.418428:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32179:x1830976125841280:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3582us (4117us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.418433:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11043 00000100:00100000:0.0:1746155638.420799:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.420829:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.420863:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.420879:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125841536 00000100:00100000:0.0:1746155638.420885:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125841536 00000100:00100000:0.0:1746155638.420921:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125841792 00000100:00100000:0.0:1746155638.420923:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125841792 00000100:00100000:0.0:1746155638.420933:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125841664 00000100:00100000:0.0:1746155638.420935:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125841664 00000100:00100000:0.0:1746155638.420958:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16616 00000100:00100000:0.0:1746155638.420965:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125841536:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155638.420979:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155638.420991:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6e8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179dc expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155638.421029:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125308416:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155638.421055:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16617 00000100:00100000:3.0:1746155638.421062:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125841792:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.421068:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.421076:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179ea expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155638.421079:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155638.421097:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125308544:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155638.421118:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005240 going to sleep for 11 seconds 00000100:00100000:3.0:1746155638.421132:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16618 00000100:00100000:3.0:1746155638.421137:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125841664:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.421143:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.421148:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801303bb600/0x844e5faceb5f6e99 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179e3 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.421166:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125308672:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155638.421187:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155638.422704:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125308544:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155638.422704:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125308416:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155638.422721:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e92 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ea expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.422721:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6e8b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179dc expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.422730:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801303ba400/0x844e5faceb5f6e92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ea expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.422730:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6e8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179dc expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.422751:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7cc00, rc 0) 00010000:00010000:3.0:1746155638.422752:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801303ba400, rc 0) 00000100:00100000:2.0:1746155638.422778:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125841536:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1812us (1984us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155638.422784:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16616 00000100:00100000:3.0:1746155638.422829:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125841792:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1767us (1998us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155638.422834:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16617 00000100:00100000:3.0:1746155638.423398:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125308672:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155638.423410:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801303bb600/0x844e5faceb5f6e99 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179e3 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.423418:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801303bb600/0x844e5faceb5f6e99 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179e3 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.423424:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801303bb600, rc 0) 00000100:00100000:3.0:1746155638.423448:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125841664:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2311us (2585us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155638.423453:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16618 00000100:00100000:0.0:1746155638.426631:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.427059:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125842048 00000100:00100000:3.0:1746155638.427066:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125842048 00000100:00100000:3.0:1746155638.427111:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11044 00000100:00100000:3.0:1746155638.427118:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32179:x1830976125842048:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.427131:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.427145:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbe00/0x844e5faceb5f6ea0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179f1 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.427219:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbc00/0x844e5faceb5f6ea7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.427230:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbc00/0x844e5faceb5f6ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155638.427238:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbc00/0x844e5faceb5f6ea7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:3.0:1746155638.427247:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155638.427336:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbe00/0x844e5faceb5f6ea0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179f1 expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.427349:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbc00/0x844e5faceb5f6ea7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179f1 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.427356:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.427358:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155638.427360:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801303bbc00, rc 0) 00000100:00100000:3.0:1746155638.427455:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32179:x1830976125842048:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 336us (829us total) trans 8589945190 rc 0/0 00000100:00100000:3.0:1746155638.427460:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11044 00000100:00100000:0.0:1746155638.429892:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.430014:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.430358:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125842176 00000100:00100000:3.0:1746155638.430365:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125842176 00000100:00100000:0.0:1746155638.430367:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.430476:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125842432 00000100:00100000:3.0:1746155638.430478:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125842432 00000100:00100000:0.0:1746155638.430480:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.430494:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.430917:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125842688 00000100:00100000:3.0:1746155638.430920:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125842688 00000100:00100000:3.0:1746155638.430935:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125842304 00000100:00100000:3.0:1746155638.430936:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125842304 00000100:00100000:0.0:1746155638.430936:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.430958:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125842560 00000100:00100000:3.0:1746155638.430959:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125842560 00000100:00100000:0.0:1746155638.430960:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125842816 00000100:00100000:0.0:1746155638.430963:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125842816 00000100:00100000:3.0:1746155638.430974:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16619 00000100:00100000:3.0:1746155638.430980:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125842176:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155638.431012:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.431027:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.431034:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155638.431036:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155638.431038:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.431064:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.431076:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 23 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.431087:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125308800:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.431139:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.431180:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16620 00000100:00100000:1.0:1746155638.431187:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16621 00000100:00100000:0.0:1746155638.431187:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125842432:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:1.0:1746155638.431194:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125842688:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155638.431203:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.431211:0:10591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.431214:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.431219:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f6d7a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17949 expref: 6 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.431219:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155638.431220:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155638.431223:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.431226:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5f6e5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c0 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155638.431236:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f9d200/0x844e5faceb5f6dab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5079040->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1795e expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.431236:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.431241:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.431243:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155638.431244:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 9 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.431245:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155638.431252:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125308928:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.431262:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094f9d200/0x844e5faceb5f6dab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5079040->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1795e expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.431268:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094f9d200/0x844e5faceb5f6dab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5079040->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1795e expref: 23 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.431270:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155638.431275:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125309056:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.431297:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5f6e5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c0 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155638.431304:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5f6e5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c0 expref: 9 pid: 9235 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746155638.431311:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125309184:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.431331:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f6d7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17949 expref: 6 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.431338:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f6d7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17949 expref: 6 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.431345:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125309312:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155638.431362:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155638.431375:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16622 00000100:00100000:1.0:1746155638.431381:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125842304:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155638.431395:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.431433:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16623 00000100:00100000:2.0:1746155638.431442:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125842560:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:3.0:1746155638.431445:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16624 00000100:00100000:3.0:1746155638.431452:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976125842816:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155638.431456:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.431465:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f6b04 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177eb expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.431475:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801373dc000/0x844e5faceb5f6c1c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17877 expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.431481:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6c15 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17870 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.431486:0:9235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.431486:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.431487:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.431489:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.431497:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5f6d42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1792d expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.431530:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6c15 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17870 expref: 6 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.431531:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f6e61 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c7 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.431537:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b407d400/0x844e5faceb5f6d49 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17934 expref: 12 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.431538:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6c15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17870 expref: 6 pid: 8437 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.431542:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746155638.431545:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125309440:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.431556:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.431559:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.431575:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b407d400/0x844e5faceb5f6d49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17934 expref: 12 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.431583:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b407d400/0x844e5faceb5f6d49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17934 expref: 12 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.431584:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801373dc000/0x844e5faceb5f6c1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17877 expref: 23 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.431591:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125309568:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.431591:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801373dc000/0x844e5faceb5f6c1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17877 expref: 23 pid: 29728 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.431598:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125309696:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.431617:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f6e61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c7 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.431619:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f6b04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177eb expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.431624:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f6e61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c7 expref: 9 pid: 9235 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.431626:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f6b04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177eb expref: 9 pid: 18270 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746155638.431632:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125309824:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.431633:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125309952:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.431644:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c9a780 going to sleep for 11 seconds 00010000:00010000:3.0:1746155638.431673:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5f6d42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1792d expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.431680:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5f6d42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1792d expref: 9 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.431688:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125310080:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.431703:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b005c00 going to sleep for 11 seconds 00010000:00010000:1.0:1746155638.431927:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.431933:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155638.431934:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155638.431936:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.431961:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.431967:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 9 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.431974:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125310208:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155638.432052:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012dc2bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.439817:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125308928:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155638.439837:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155638.439874:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.439890:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125842944 00000100:00100000:0.0:1746155638.439895:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125842944 00002000:00100000:0.0:1746155638.439927:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e1:0x0] (753664->892927) req@ffff88009ff6b800 x1830976125842944/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155638.439935:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6b800 with x1830976125842944 ext(753664->892927) 00010000:00010000:0.0:1746155638.439941:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 24 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746155638.439962:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 24 pid: 20796 timeout: 867 lvb_type: 0 00002000:00010000:0.0:1746155638.439968:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6b800 00000100:00100000:3.0:1746155638.440003:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125308800:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.440016:0:20200:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155638.440584:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125309056:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155638.440591:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125309184:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155638.440597:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125309312:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.440611:0:10591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155638.442161:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1358 00000100:00100000:0.0:1746155638.442172:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125842944:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155638.442655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.442689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.442701:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.442782:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125310208:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.442796:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155638.442817:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.442828:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125843200 00000100:00100000:1.0:1746155638.442831:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125843200 00010000:00010000:1.0:1746155638.442848:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094f9d200/0x844e5faceb5f6dab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5079040->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1795e expref: 26 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.442864:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125843072 00000100:00100000:1.0:1746155638.442866:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125843072 00010000:00010000:1.0:1746155638.442873:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5f6e5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c0 expref: 10 pid: 9235 timeout: 867 lvb_type: 1 00000100:00100000:1.0:1746155638.442883:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125843584 00000100:00100000:1.0:1746155638.442884:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125843584 00010000:00010000:1.0:1746155638.442893:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6c15 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17870 expref: 7 pid: 8437 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.442905:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8523 00000100:00100000:1.0:1746155638.442909:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976125843200:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.442916:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.442930:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094f9d200/0x844e5faceb5f6dab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5079040->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1795e expref: 26 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.442931:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8524 00000100:00100000:2.0:1746155638.442937:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125843072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.442943:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.442943:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094f9d200/0x844e5faceb5f6dab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 5079040->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1795e expref: 26 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.442961:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5f6e5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c0 expref: 10 pid: 9235 timeout: 867 lvb_type: 1 00010000:00010000:1.0:1746155638.442970:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f9d200/0x844e5faceb5f6dab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 5079040->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1795e expref: 26 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.442999:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5f6e5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c0 expref: 10 pid: 9235 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.443010:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0e200/0x844e5faceb5f6e5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c0 expref: 10 pid: 9235 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.443025:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.443050:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125843072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 113us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.443056:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8524 00000100:00100000:2.0:1746155638.443069:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8525 00000100:00100000:2.0:1746155638.443074:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1962:x1830976125843584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.443081:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.443090:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6c15 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17870 expref: 7 pid: 8437 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.443097:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6c15 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17870 expref: 7 pid: 8437 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.443108:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.443121:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1962:x1830976125843584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 47us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.443126:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8525 00000100:00100000:3.0:1746155638.443143:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125309568:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.443145:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131446000/0x844e5faceb5f6c15 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17870 expref: 6 pid: 8437 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.443150:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125309824:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.443152:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125309440:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.443156:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125310080:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.443159:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125309696:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.443165:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125309952:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.443172:0:9235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.443177:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.443188:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125843328 00000100:00100000:2.0:1746155638.443190:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125843328 00002000:00100000:2.0:1746155638.443207:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1511423) req@ffff88009fff5180 x1830976125843328/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.443215:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5180 with x1830976125843328 ext(1048576->1511423) 00010000:00010000:2.0:1746155638.443220:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 10 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.443228:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 10 pid: 9235 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746155638.443233:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff5180 00000100:00100000:2.0:1746155638.443245:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1359 00000100:00100000:2.0:1746155638.443250:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976125843328:12345-192.168.202.51@tcp:4:multiop.0 00010000:00010000:1.0:1746155638.443960:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.443981:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976125843200:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1070us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.443988:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8523 00000100:00100000:1.0:1746155638.444566:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.444588:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125843456 00000100:00100000:1.0:1746155638.444591:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125843456 00010000:00010000:1.0:1746155638.444606:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f6d7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17949 expref: 6 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.444620:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8526 00000100:00100000:1.0:1746155638.444624:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1962:x1830976125843456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.444632:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.444644:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f6d7a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17949 expref: 6 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.444652:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f6d7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17949 expref: 6 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.444667:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f6d7a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17949 expref: 6 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.444679:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.444681:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.444684:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.444690:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.444706:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.444722:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+5:1962:x1830976125843456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 97us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.444728:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8526 00010000:00010000:1.0:1746155638.444764:0:10591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.444770:0:10591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.444785:0:10591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.444790:0:10591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.444800:0:10591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.444805:0:10591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cf0fe00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155638.444808:0:10591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.444813:0:10591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.444821:0:10591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.444826:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6ec3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155638.444859:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125842688:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 13666us (14493us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.444866:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16621 00000100:00100000:1.0:1746155638.444990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.445004:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125844096 00000100:00100000:1.0:1746155638.445007:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125844096 00010000:00010000:1.0:1746155638.445018:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801373dc000/0x844e5faceb5f6c1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17877 expref: 25 pid: 29728 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.445032:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8527 00000100:00100000:1.0:1746155638.445037:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976125844096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.445044:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.445052:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801373dc000/0x844e5faceb5f6c1c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17877 expref: 25 pid: 29728 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.445060:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801373dc000/0x844e5faceb5f6c1c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17877 expref: 25 pid: 29728 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.445071:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801373dc000/0x844e5faceb5f6c1c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17877 expref: 25 pid: 29728 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.445079:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.445093:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976125844096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 56us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.445098:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8527 00000100:00100000:3.0:1746155638.445750:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.445979:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.445992:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125843840 00000100:00100000:0.0:1746155638.445995:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125843840 00010000:00010000:0.0:1746155638.446008:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f6b04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177eb expref: 8 pid: 18270 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746155638.446022:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8528 00000100:00100000:0.0:1746155638.446026:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125843840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155638.446032:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155638.446041:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f6b04 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177eb expref: 8 pid: 18270 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746155638.446053:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f6b04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177eb expref: 8 pid: 18270 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746155638.446066:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f6b04 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f177eb expref: 8 pid: 18270 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746155638.446080:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155638.446082:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155638.446084:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.446090:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.446104:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.446112:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.446118:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125843840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 92us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.446122:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125843712 00000100:00100000:0.0:1746155638.446123:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8528 00000100:00100000:1.0:1746155638.446124:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125843712 00010000:00010000:1.0:1746155638.446135:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b407d400/0x844e5faceb5f6d49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17934 expref: 13 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.446148:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.446153:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125843968 00000100:00100000:1.0:1746155638.446155:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125843968 00000100:00100000:0.0:1746155638.446157:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8529 00000100:00100000:0.0:1746155638.446161:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976125843712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.446163:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f6e61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c7 expref: 10 pid: 9235 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746155638.446167:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155638.446176:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8530 00010000:00010000:0.0:1746155638.446177:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b407d400/0x844e5faceb5f6d49 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17934 expref: 13 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.446180:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125843968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.446185:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155638.446185:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b407d400/0x844e5faceb5f6d49 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17934 expref: 13 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.446191:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f6e61 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c7 expref: 10 pid: 9235 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746155638.446195:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b407d400/0x844e5faceb5f6d49 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17934 expref: 13 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.446198:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f6e61 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c7 expref: 10 pid: 9235 timeout: 867 lvb_type: 1 00010000:00010000:0.0:1746155638.446203:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155638.446207:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f6e61 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179c7 expref: 10 pid: 9235 timeout: 867 lvb_type: 1 00000100:00100000:0.0:1746155638.446214:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1961:x1830976125843712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 53us (102us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155638.446215:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155638.446219:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8529 00000100:00100000:1.0:1746155638.446224:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125843968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 45us (78us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.446229:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8530 00000100:00100000:0.0:1746155638.446245:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.446264:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125844352 00000100:00100000:1.0:1746155638.446267:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125844352 00010000:00010000:1.0:1746155638.446277:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5f6d42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1792d expref: 12 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.446285:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155638.446289:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8531 00010000:00010000:2.0:1746155638.446293:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.446311:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.446316:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.446322:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.446327:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801315ea800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155638.446329:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.446339:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.446347:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.446352:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801315ea800/0x844e5faceb5f6ed1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.446387:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1962:x1830976125842560:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 14946us (15891us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.446393:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16623 00000100:00100000:2.0:1746155638.446410:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125844224 00000100:00100000:2.0:1746155638.446413:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125844224 00002000:00100000:2.0:1746155638.446429:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e0:0x0] (1523712->2097151) req@ffff88012c2bc000 x1830976125844224/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.446437:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bc000 with x1830976125844224 ext(1523712->2097151) 00010000:00010000:2.0:1746155638.446442:0:2798:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 13 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.446450:0:2798:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 13 pid: 9235 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746155638.446456:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c2bc000 00000100:00100000:2.0:1746155638.446472:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1360 00000100:00100000:2.0:1746155638.446478:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976125844224:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155638.446541:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1961:x1830976125844352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.446547:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.446555:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5f6d42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1792d expref: 13 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.446562:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5f6d42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1792d expref: 13 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.446574:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136867800/0x844e5faceb5f6d42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1792d expref: 13 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.446581:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.446582:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.446585:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.446590:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.446603:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.446617:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125844352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 79us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.446983:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8531 00000100:00100000:3.0:1746155638.449019:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125842944:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 6846us (9140us total) trans 17179874169 rc 0/0 00000100:00100000:3.0:1746155638.449028:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1358 00002000:00100000:3.0:1746155638.449036:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e1:0x0] (753664->892927) req@ffff88009ff6b800 x1830976125842944/t17179874169(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/448 e 0 to 0 dl 1746155649 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.449050:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6b800 with x1830976125842944 ext(753664->892927) 00010000:00010000:3.0:1746155638.449057:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 24 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.449067:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 24 pid: 20796 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746155638.449074:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ff6b800 00010000:00010000:3.0:1746155638.449098:0:9235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.449104:0:9235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.449120:0:9235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.449126:0:9235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.449132:0:9235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.449137:0:9235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094c9fa00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155638.449140:0:9235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.449150:0:9235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.449164:0:9235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.449169:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f6ed8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.451402:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125842816:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 19943us (20458us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.451413:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16624 00000100:00100000:0.0:1746155638.454469:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.455826:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976125843328:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 12572us (13119us total) trans 21474841496 rc 0/0 00000100:00100000:2.0:1746155638.455836:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1359 00002000:00100000:2.0:1746155638.455846:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1511423) req@ffff88009fff5180 x1830976125843328/t21474841496(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/448 e 0 to 0 dl 1746155649 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.455854:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5180 with x1830976125843328 ext(1048576->1511423) 00010000:00010000:2.0:1746155638.455862:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 13 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.455874:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 13 pid: 9235 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746155638.455880:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff5180 00000100:00100000:1.0:1746155638.456966:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125844480 00000100:00100000:1.0:1746155638.456974:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125844480 00010000:00010000:1.0:1746155638.456996:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 24 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.457014:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8532 00000100:00100000:1.0:1746155638.457019:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976125844480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.457029:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.457043:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 24 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.457056:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 24 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.457073:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092872400/0x844e5faceb5f6e22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 753664->892927) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1799d expref: 24 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.457085:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.457087:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.457091:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.457098:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.457114:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.457138:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976125844480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 118us (2675us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.457143:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8532 00010000:00010000:3.0:1746155638.457331:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.457338:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.457353:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.457359:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.457365:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.457375:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a124400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155638.457378:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.457384:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.457393:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.457398:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a124400/0x844e5faceb5f6eb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.457432:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+5:1962:x1830976125842176:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 26451us (27543us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.457438:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16619 00000100:00100000:0.0:1746155638.460199:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.460427:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125844608 00000100:00100000:1.0:1746155638.460434:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125844608 00010000:00010000:1.0:1746155638.460457:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 13 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.460479:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8533 00000100:00100000:1.0:1746155638.460486:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1963:x1830976125844608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.460496:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.460526:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 13 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.460535:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 13 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.460551:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092873600/0x844e5faceb5f6de3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1511423) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1797a expref: 13 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.460562:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.460564:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.460567:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.460574:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.460590:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.460616:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1963:x1830976125844608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 131us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.460621:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8533 00010000:00010000:0.0:1746155638.460939:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.460955:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.460969:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.460975:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.460980:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.460985:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff7cc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155638.460988:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.460997:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.461005:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.461009:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f6ebc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155638.461043:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976125842432:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 29857us (31029us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155638.461049:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16620 00000100:00100000:2.0:1746155638.462271:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976125844224:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 15789us (16518us total) trans 21474841497 rc 0/0 00000100:00100000:2.0:1746155638.462280:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1360 00002000:00100000:2.0:1746155638.462288:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1523712->2097151) req@ffff88012c2bc000 x1830976125844224/t21474841497(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/448 e 0 to 0 dl 1746155649 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.462296:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bc000 with x1830976125844224 ext(1523712->2097151) 00010000:00010000:2.0:1746155638.462303:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 12 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.462314:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 12 pid: 9235 timeout: 867 lvb_type: 0 00002000:00010000:2.0:1746155638.462320:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012c2bc000 00000100:00100000:0.0:1746155638.465018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.465105:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125844736 00000100:00100000:2.0:1746155638.465113:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125844736 00010000:00010000:2.0:1746155638.465139:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 12 pid: 9235 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.465173:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8534 00000100:00100000:2.0:1746155638.465180:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976125844736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.465192:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.465207:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 12 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.465217:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 12 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.465235:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f6dd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1523712->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1796c expref: 12 pid: 9235 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.465245:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.465247:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.465250:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.465257:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.465354:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.465387:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976125844736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 208us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.465393:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8534 00010000:00010000:0.0:1746155638.465432:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.465439:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.465454:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.465461:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.465467:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.465473:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095243400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155638.465476:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.465482:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.465491:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.465496:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095243400/0x844e5faceb5f6eca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155638.465552:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1962:x1830976125842304:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 34171us (35072us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155638.465558:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16622 00000100:00100000:1.0:1746155638.470720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.470744:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125844992 00000100:00100000:1.0:1746155638.470750:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125844992 00000100:00100000:1.0:1746155638.471022:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11045 00000100:00100000:1.0:1746155638.471029:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32179:x1830976125844992:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:1.0:1746155638.471067:0:14234:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.471088:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125400/0x844e5faceb5f6e84 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179d5 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.471100:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155638.471104:0:14234:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155638.471126:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.471135:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1782a expref: 299 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.471141:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.471146:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17838 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.471151:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76800/0x844e5faceb5f6c5b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a1 expref: 299 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.471156:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090414a00/0x844e5faceb5f6ca8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d2 expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.471160:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 8/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.471183:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090414a00/0x844e5faceb5f6ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d2 expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.471191:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090414a00/0x844e5faceb5f6ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d2 expref: 15 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.471205:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125310336:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.471877:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76800/0x844e5faceb5f6c5b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a1 expref: 299 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.471884:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76800/0x844e5faceb5f6c5b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a1 expref: 299 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.471890:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125310464:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.472237:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17838 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.472244:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17838 expref: 15 pid: 27374 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.472250:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125310592:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.472272:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.472278:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 299 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.472283:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125310720:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.472297:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1782a expref: 299 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.472308:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1782a expref: 299 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.472314:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125310848:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155638.472328:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a596b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.474639:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.474668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.474680:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.474692:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.474709:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125845120 00000100:00100000:0.0:1746155638.474715:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125845120 00010000:00010000:0.0:1746155638.474739:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090414a00/0x844e5faceb5f6ca8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d2 expref: 16 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.474770:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125845376 00000100:00100000:0.0:1746155638.474773:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125845376 00010000:00010000:0.0:1746155638.474782:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17838 expref: 17 pid: 27374 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.474793:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125845632 00000100:00100000:0.0:1746155638.474794:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125845632 00010000:00010000:0.0:1746155638.474802:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1782a expref: 300 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.474809:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125845248 00000100:00100000:0.0:1746155638.474810:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125845248 00010000:00010000:0.0:1746155638.474816:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76800/0x844e5faceb5f6c5b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a1 expref: 301 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.474827:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8535 00000100:00100000:0.0:1746155638.474833:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125845120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155638.474843:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155638.474847:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090414a00/0x844e5faceb5f6ca8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d2 expref: 17 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746155638.474857:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090414a00/0x844e5faceb5f6ca8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d2 expref: 17 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746155638.474874:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155638.474878:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155638.474885:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155638.474915:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125845120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 83us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155638.474924:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8535 00000100:00100000:0.0:1746155638.474937:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8536 00000100:00100000:0.0:1746155638.474942:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125845376:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155638.474962:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155638.474966:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17838 expref: 16 pid: 27374 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746155638.474973:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17838 expref: 16 pid: 27374 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746155638.474985:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155638.474988:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155638.474992:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155638.475005:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125845376:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 63us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155638.475010:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8536 00000100:00100000:0.0:1746155638.475024:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8537 00000100:00100000:0.0:1746155638.475028:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1961:x1830976125845632:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155638.475051:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8538 00000100:00100000:1.0:1746155638.475058:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1961:x1830976125845248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.475065:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.475069:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76800/0x844e5faceb5f6c5b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a1 expref: 301 pid: 15474 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.475078:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76800/0x844e5faceb5f6c5b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a1 expref: 301 pid: 15474 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.475089:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155638.475092:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.475098:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.475113:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1961:x1830976125845248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 56us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.475118:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8538 00010000:00010000:0.0:1746155638.475140:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155638.475146:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1782a expref: 300 pid: 15474 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746155638.475153:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1782a expref: 300 pid: 15474 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.475157:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090414a00/0x844e5faceb5f6ca8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178d2 expref: 15 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746155638.475165:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00000100:00100000:1.0:1746155638.475167:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125310336:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155638.475168:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155638.475172:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155638.475176:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f76800/0x844e5faceb5f6c5b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f178a1 expref: 300 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.475184:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125310464:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155638.475186:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1961:x1830976125845632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 157us (505us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155638.475188:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6a00/0x844e5faceb5f6bdd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17838 expref: 14 pid: 27374 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.475190:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8537 00000100:00100000:1.0:1746155638.475193:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125310592:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155638.475196:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125310720:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.475200:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f6bc8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1782a expref: 298 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.475205:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125310848:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.475225:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155638.475267:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.475300:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125845504 00000100:00100000:2.0:1746155638.475303:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125845504 00010000:00010000:2.0:1746155638.475315:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 298 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.475333:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8539 00000100:00100000:2.0:1746155638.475338:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1961:x1830976125845504:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.475345:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.475348:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 298 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.475355:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 298 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.475365:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e6800/0x844e5faceb5f6bcf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17831 expref: 298 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.475373:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155638.475376:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.475382:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.475390:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.475413:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.475433:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1961:x1830976125845504:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 94us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.475438:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8539 00010000:00010000:1.0:1746155638.475486:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.475492:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000040:00080000:1.0:1746155638.475992:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3517, 88 off296408 00000004:00080000:1.0:1746155638.475999:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767625496022ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155638.476048:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3529, 88 off297728 00000004:00080000:1.0:1746155638.476054:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767625550839ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155638.476150:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3530, 88 off297816 00000004:00080000:1.0:1746155638.476155:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767625651994ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155638.476179:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3518, 88 off296496 00000004:00080000:1.0:1746155638.476182:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767625678920ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155638.476190:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3519, 88 off296584 00000004:00080000:1.0:1746155638.476193:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767625689965ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155638.476200:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3531, 88 off297904 00000004:00080000:1.0:1746155638.476202:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767625699114ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155638.476207:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3532, 88 off297992 00000004:00080000:1.0:1746155638.476210:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767625706720ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155638.476215:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3533, 88 off298080 00000004:00080000:1.0:1746155638.476218:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767625714651ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155638.476225:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3520, 88 off296672 00000004:00080000:1.0:1746155638.476227:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767625724395ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155638.476233:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3534, 88 off298168 00000004:00080000:1.0:1746155638.476235:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767625731795ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155638.476241:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3521, 88 off296760 00000004:00080000:1.0:1746155638.476243:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767625740282ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155638.476248:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3535, 88 off298256 00000004:00080000:1.0:1746155638.476250:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767625747234ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155638.476256:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3522, 88 off296848 00000004:00080000:1.0:1746155638.476258:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767625755212ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155638.476265:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3523, 88 off296936 00000004:00080000:1.0:1746155638.476267:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767625763667ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155638.476274:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3524, 88 off297024 00000004:00080000:1.0:1746155638.476276:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767625773010ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155638.476281:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3525, 88 off297112 00000004:00080000:1.0:1746155638.476283:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767625779972ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155638.476290:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3536, 88 off298344 00000004:00080000:1.0:1746155638.476291:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767625788564ns, next at 716011101328ns, rc = 0 00000001:00080000:2.0:1746155638.502277:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945181 is committed 00000001:00080000:2.0:1746155638.502288:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945170 is committed 00000001:00080000:2.0:1746155638.502295:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945191 is committed 00000004:00080000:2.0:1746155638.502303:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2721 committed 00000004:00080000:2.0:1746155638.502309:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2704 committed 00000004:00080000:2.0:1746155638.502314:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2703 committed 00000004:00080000:2.0:1746155638.502316:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2702 committed 00000004:00080000:2.0:1746155638.502317:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2701 committed 00000004:00080000:2.0:1746155638.502318:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2720 committed 00000004:00080000:2.0:1746155638.502320:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2700 committed 00000004:00080000:2.0:1746155638.502321:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2719 committed 00000004:00080000:2.0:1746155638.502323:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2699 committed 00000004:00080000:2.0:1746155638.502324:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2718 committed 00000004:00080000:2.0:1746155638.502325:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2717 committed 00000004:00080000:2.0:1746155638.502327:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2716 committed 00000004:00080000:2.0:1746155638.502328:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2698 committed 00000004:00080000:2.0:1746155638.502329:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2697 committed 00000004:00080000:2.0:1746155638.502331:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2715 committed 00000004:00080000:2.0:1746155638.502332:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2714 committed 00000004:00080000:2.0:1746155638.502334:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2696 committed 00000001:00080000:2.0:1746155638.502339:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945179 is committed 00000001:00080000:2.0:1746155638.502352:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945188 is committed 00000001:00080000:2.0:1746155638.502355:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945187 is committed 00000004:00010000:1.0:1746155638.502534:0:14234:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009fff4a80 reply state ffff88009f894800 transno 8589945191 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155638.502544:0:14234:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746155638.502623:0:14234:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746155638.502637:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32179:x1830976125844992:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 31604us (31919us total) trans 8589945191 rc 0/0 00000100:00100000:1.0:1746155638.502644:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11045 00000100:00100000:0.0:1746155638.502766:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125311360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.502777:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125310976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.502807:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.502808:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125311104:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.502828:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.502833:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125311872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.502843:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125311616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.502847:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.502857:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.502860:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746155638.502865:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125311232:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.503039:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125312128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.503059:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125312256:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746155638.503069:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.503077:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.503082:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.503087:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cf0f800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155638.503090:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155638.503243:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.503271:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125311744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.503287:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746155638.503367:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.503378:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.503381:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155638.503385:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.503389:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6edf lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155638.503451:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125312384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.503468:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.503640:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125312896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.503655:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.503671:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125311360 00000100:00100000:2.0:1746155638.503676:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125311360 00000100:00100000:2.0:1746155638.503698:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125311104 00000100:00100000:2.0:1746155638.503700:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125311104 00000100:00100000:2.0:1746155638.503709:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125311872 00000100:00100000:2.0:1746155638.503710:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125311872 00000100:00100000:2.0:1746155638.503717:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125311616 00000100:00100000:2.0:1746155638.503719:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125311616 00000100:00100000:2.0:1746155638.503727:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125311232 00000100:00100000:2.0:1746155638.503729:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125311232 00000100:00100000:2.0:1746155638.503737:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125311744 00000100:00100000:2.0:1746155638.503738:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125311744 00000100:00100000:2.0:1746155638.503744:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125312384 00000100:00100000:2.0:1746155638.503745:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125312384 00000100:00100000:2.0:1746155638.503753:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16625 00000100:00100000:2.0:1746155638.503759:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3298:x1830976125311360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.503914:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3298:x1830976125311360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 154us (1106us total) trans 21474841498 rc 0/0 00000100:00100000:2.0:1746155638.503920:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16625 00000100:00100000:2.0:1746155638.503932:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16626 00000100:00100000:2.0:1746155638.503936:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3296:x1830976125311104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.504053:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3296:x1830976125311104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (1224us total) trans 17179874170 rc 0/0 00000100:00100000:2.0:1746155638.504058:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16626 00000100:00100000:2.0:1746155638.504066:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16627 00000100:00100000:2.0:1746155638.504069:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3298:x1830976125311872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.504155:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3298:x1830976125311872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (1307us total) trans 17179874171 rc 0/0 00000100:00100000:2.0:1746155638.504160:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16627 00000100:00100000:2.0:1746155638.504167:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16628 00000100:00100000:2.0:1746155638.504170:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3296:x1830976125311616:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.504235:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3296:x1830976125311616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (1377us total) trans 17179874172 rc 0/0 00000100:00100000:2.0:1746155638.504239:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16628 00000100:00100000:2.0:1746155638.504246:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16629 00000100:00100000:2.0:1746155638.504250:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3298:x1830976125311232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.504307:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3298:x1830976125311232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (1064us total) trans 17179874173 rc 0/0 00000100:00100000:2.0:1746155638.504311:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16629 00000100:00100000:2.0:1746155638.504317:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16630 00000100:00100000:2.0:1746155638.504320:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3298:x1830976125311744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.504374:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3298:x1830976125311744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (1086us total) trans 17179874174 rc 0/0 00000100:00100000:2.0:1746155638.504378:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16630 00000100:00100000:2.0:1746155638.504385:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16631 00000100:00100000:2.0:1746155638.504388:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3298:x1830976125312384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.504470:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+7:3298:x1830976125312384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (1001us total) trans 21474841499 rc 0/0 00000100:00100000:2.0:1746155638.504475:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16631 00000100:00100000:3.0:1746155638.504645:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125312896 00000100:00100000:3.0:1746155638.504650:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125312896 00000100:00100000:3.0:1746155638.504667:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16632 00000100:00100000:3.0:1746155638.504672:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3298:x1830976125312896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.504672:0:3298:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874165 gen 2 00000004:00080000:0.0:1746155638.504676:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366f800, transno 17179874046 00000004:00080000:0.0:1746155638.504681:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131495f80, transno 17179874047 00000004:00080000:0.0:1746155638.504684:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131494a80, transno 17179874048 00000004:00080000:0.0:1746155638.504686:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131496d80, transno 17179874049 00000004:00080000:0.0:1746155638.504688:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131495180, transno 17179874050 00000004:00080000:0.0:1746155638.504690:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131497b80, transno 17179874051 00000004:00080000:0.0:1746155638.504691:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131497100, transno 17179874052 00000004:00080000:0.0:1746155638.504693:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366f480, transno 17179874053 00000004:00080000:0.0:1746155638.504695:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6d9c00, transno 17179874054 00000004:00080000:0.0:1746155638.504697:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6d9880, transno 17179874055 00000004:00080000:0.0:1746155638.504699:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526a680, transno 17179874056 00000004:00080000:0.0:1746155638.504701:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6d8380, transno 17179874057 00000004:00080000:0.0:1746155638.504703:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6daa00, transno 17179874058 00000004:00080000:0.0:1746155638.504705:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526b100, transno 17179874059 00000004:00080000:0.0:1746155638.504707:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6d8000, transno 17179874060 00000004:00080000:0.0:1746155638.504708:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095268380, transno 17179874061 00000004:00080000:0.0:1746155638.504710:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090b49c00, transno 17179874062 00000004:00080000:0.0:1746155638.504712:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526a300, transno 17179874063 00000004:00080000:0.0:1746155638.504714:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb68a80, transno 17179874071 00000004:00080000:0.0:1746155638.504716:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb6bb80, transno 17179874072 00000004:00080000:0.0:1746155638.504718:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910c8e00, transno 17179874073 00000004:00080000:0.0:1746155638.504720:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb6ad80, transno 17179874074 00000004:00080000:0.0:1746155638.504722:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910c9f80, transno 17179874075 00000004:00080000:0.0:1746155638.504724:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb6a300, transno 17179874076 00000004:00080000:0.0:1746155638.504725:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910c8000, transno 17179874077 00000004:00080000:0.0:1746155638.504727:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb6a680, transno 17179874078 00000004:00080000:0.0:1746155638.504729:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0ac6300, transno 17179874079 00000004:00080000:0.0:1746155638.504731:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b6c0000, transno 17179874080 00000004:00080000:0.0:1746155638.504733:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b6c3480, transno 17179874081 00000004:00080000:0.0:1746155638.504735:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b6c3800, transno 17179874082 00000004:00080000:0.0:1746155638.504737:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910c8a80, transno 17179874083 00000004:00080000:0.0:1746155638.504739:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b6c2a00, transno 17179874084 00000004:00080000:0.0:1746155638.504741:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b6c1880, transno 17179874085 00000004:00080000:0.0:1746155638.504743:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b6c0380, transno 17179874086 00000004:00080000:0.0:1746155638.504745:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910c9180, transno 17179874087 00000004:00080000:0.0:1746155638.504747:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0ac7480, transno 17179874088 00000004:00080000:0.0:1746155638.504749:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090b49180, transno 17179874093 00000004:00080000:0.0:1746155638.504751:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090b48a80, transno 17179874094 00000004:00080000:0.0:1746155638.504753:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090b49880, transno 17179874095 00000004:00080000:0.0:1746155638.504754:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090b4bb80, transno 17179874096 00000004:00080000:0.0:1746155638.504756:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090b4b800, transno 17179874097 00000004:00080000:0.0:1746155638.504758:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090b4ad80, transno 17179874098 00000004:00080000:0.0:1746155638.504760:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090b48700, transno 17179874099 00000004:00080000:0.0:1746155638.504762:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01d1c00, transno 17179874100 00000004:00080000:0.0:1746155638.504765:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090b4a300, transno 17179874101 00000004:00080000:0.0:1746155638.504766:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3eca80, transno 17179874105 00000004:00080000:0.0:1746155638.504768:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ed500, transno 17179874106 00000100:00100000:3.0:1746155638.504769:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3298:x1830976125312896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (1111us total) trans 21474841500 rc 0/0 00000004:00080000:0.0:1746155638.504770:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ef800, transno 17179874107 00000004:00080000:0.0:1746155638.504771:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ec000, transno 17179874108 00000004:00080000:0.0:1746155638.504773:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c4a80, transno 17179874109 00000100:00100000:3.0:1746155638.504774:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16632 00000004:00080000:0.0:1746155638.504775:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ef480, transno 17179874110 00000004:00080000:0.0:1746155638.504776:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ed880, transno 17179874111 00000004:00080000:0.0:1746155638.504778:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ef100, transno 17179874112 00000004:00080000:0.0:1746155638.504780:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ec700, transno 17179874113 00000004:00080000:0.0:1746155638.504782:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366df80, transno 17179874114 00000004:00080000:0.0:1746155638.504783:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6061880, transno 17179874115 00000004:00080000:0.0:1746155638.504785:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366c700, transno 17179874116 00000004:00080000:0.0:1746155638.504787:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6060700, transno 17179874117 00000004:00080000:0.0:1746155638.504788:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6062a00, transno 17179874118 00000004:00080000:0.0:1746155638.504789:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6060000, transno 17179874119 00000004:00080000:0.0:1746155638.504791:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6060380, transno 17179874120 00000004:00080000:0.0:1746155638.504792:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6061500, transno 17179874121 00000004:00080000:0.0:1746155638.504795:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1f1500, transno 17179874122 00000004:00080000:0.0:1746155638.504797:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe91500, transno 17179874136 00000004:00080000:0.0:1746155638.504798:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe93480, transno 17179874137 00000004:00080000:0.0:1746155638.504800:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0ac5180, transno 17179874138 00000004:00080000:0.0:1746155638.504802:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe93100, transno 17179874139 00000004:00080000:0.0:1746155638.504804:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe93b80, transno 17179874140 00000004:00080000:0.0:1746155638.504805:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0ac6a00, transno 17179874141 00000004:00080000:0.0:1746155638.504807:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fe91f80, transno 17179874142 00000004:00080000:0.0:1746155638.504809:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094085c00, transno 17179874143 00000004:00080000:0.0:1746155638.504810:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fff4000, transno 17179874144 00000004:00080000:0.0:1746155638.504812:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fe680, transno 17179874148 00000004:00080000:0.0:1746155638.504814:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fdf80, transno 17179874149 00000004:00080000:0.0:1746155638.504816:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4ff100, transno 17179874150 00000004:00080000:0.0:1746155638.504817:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fed80, transno 17179874151 00000004:00080000:0.0:1746155638.504818:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4ff800, transno 17179874152 00000004:00080000:0.0:1746155638.504825:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fc000, transno 17179874153 00000004:00080000:0.0:1746155638.504826:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fd500, transno 17179874154 00000004:00080000:0.0:1746155638.504828:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fe300, transno 17179874155 00000004:00080000:0.0:1746155638.504830:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4ff480, transno 17179874156 00000004:00080000:0.0:1746155638.504831:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a0700, transno 17179874157 00000004:00080000:0.0:1746155638.504833:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012fef2680, transno 17179874158 00000004:00080000:0.0:1746155638.504835:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a2680, transno 17179874159 00000004:00080000:0.0:1746155638.504837:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a1f80, transno 17179874160 00000004:00080000:0.0:1746155638.504838:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a2a00, transno 17179874161 00000004:00080000:0.0:1746155638.504840:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26dc00, transno 17179874162 00000004:00080000:0.0:1746155638.504842:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a1880, transno 17179874163 00000004:00080000:0.0:1746155638.504844:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b881c00, transno 17179874164 00000004:00080000:0.0:1746155638.504846:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f583100, transno 17179874165 00000100:00100000:0.0:1746155638.504850:0:3298:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009f581f80 x1830976125311232/t17179874173(17179874173) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746155654 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:0.0:1746155638.504864:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f581f80/2, rc 0, transno 17179874173 00000100:00100000:0.0:1746155638.504868:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125311232:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155638.504877:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f583800/2, rc 0, transno 17179874174 00000100:00100000:0.0:1746155638.504879:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125311744:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155638.504885:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f580000/2, rc 0, transno 17179874171 00000100:00100000:0.0:1746155638.504887:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125311872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.504892:0:3298:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841491 gen 2 00000004:00080000:0.0:1746155638.504894:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090188a80, transno 21474841390 00000004:00080000:0.0:1746155638.504938:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009018bb80, transno 21474841391 00000004:00080000:0.0:1746155638.504941:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090189180, transno 21474841392 00000004:00080000:0.0:1746155638.504942:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009018a300, transno 21474841393 00000004:00080000:0.0:1746155638.504952:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090188e00, transno 21474841394 00000004:00080000:0.0:1746155638.504954:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090188700, transno 21474841395 00000004:00080000:0.0:1746155638.504955:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009018a680, transno 21474841396 00000004:00080000:0.0:1746155638.504957:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090189c00, transno 21474841397 00000004:00080000:0.0:1746155638.504959:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090189500, transno 21474841398 00000004:00080000:0.0:1746155638.504961:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312f6300, transno 21474841399 00000004:00080000:0.0:1746155638.504963:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090188380, transno 21474841400 00000004:00080000:0.0:1746155638.504965:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312f6680, transno 21474841401 00000004:00080000:0.0:1746155638.504966:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312f4000, transno 21474841402 00000004:00080000:0.0:1746155638.504968:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312f4e00, transno 21474841403 00000004:00080000:0.0:1746155638.504969:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009018ad80, transno 21474841404 00000004:00080000:0.0:1746155638.504971:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312f7800, transno 21474841405 00000004:00080000:0.0:1746155638.504973:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094085f80, transno 21474841412 00000004:00080000:0.0:1746155638.504975:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094084e00, transno 21474841413 00000004:00080000:0.0:1746155638.504976:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094087800, transno 21474841414 00000004:00080000:0.0:1746155638.504979:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094087b80, transno 21474841415 00000004:00080000:0.0:1746155638.504981:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094085180, transno 21474841416 00000004:00080000:0.0:1746155638.504983:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094085880, transno 21474841417 00000004:00080000:0.0:1746155638.504984:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094086d80, transno 21474841418 00000004:00080000:0.0:1746155638.504986:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094087100, transno 21474841419 00000004:00080000:0.0:1746155638.504988:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130898380, transno 21474841420 00000004:00080000:0.0:1746155638.504990:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130899180, transno 21474841421 00000004:00080000:0.0:1746155638.504992:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130899500, transno 21474841422 00000004:00080000:0.0:1746155638.504994:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130898a80, transno 21474841423 00000004:00080000:0.0:1746155638.504995:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013089aa00, transno 21474841424 00000004:00080000:0.0:1746155638.504997:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130899c00, transno 21474841425 00000004:00080000:0.0:1746155638.504999:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130899880, transno 21474841426 00000004:00080000:0.0:1746155638.505001:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130898700, transno 21474841427 00000004:00080000:0.0:1746155638.505003:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b880380, transno 21474841432 00000004:00080000:0.0:1746155638.505005:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b882680, transno 21474841433 00000004:00080000:0.0:1746155638.505007:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b883b80, transno 21474841434 00000004:00080000:0.0:1746155638.505009:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b882300, transno 21474841435 00000004:00080000:0.0:1746155638.505010:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b881500, transno 21474841436 00000004:00080000:0.0:1746155638.505012:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b881880, transno 21474841437 00000004:00080000:0.0:1746155638.505014:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a4700, transno 21474841438 00000004:00080000:0.0:1746155638.505016:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b880e00, transno 21474841439 00000004:00080000:0.0:1746155638.505018:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c211500, transno 21474841443 00000004:00080000:0.0:1746155638.505020:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880137120a80, transno 21474841444 00000004:00080000:0.0:1746155638.505022:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c211880, transno 21474841445 00000004:00080000:0.0:1746155638.505024:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c211c00, transno 21474841446 00000004:00080000:0.0:1746155638.505026:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c210a80, transno 21474841447 00000004:00080000:0.0:1746155638.505028:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c212a00, transno 21474841448 00000004:00080000:0.0:1746155638.505030:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c210700, transno 21474841449 00000004:00080000:0.0:1746155638.505032:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c213b80, transno 21474841450 00000004:00080000:0.0:1746155638.505034:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0da300, transno 21474841451 00000004:00080000:0.0:1746155638.505037:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366f100, transno 21474841452 00000004:00080000:0.0:1746155638.505038:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366dc00, transno 21474841453 00000004:00080000:0.0:1746155638.505040:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca97b80, transno 21474841454 00000004:00080000:0.0:1746155638.505042:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0dad80, transno 21474841455 00000004:00080000:0.0:1746155638.505044:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366d500, transno 21474841456 00000004:00080000:0.0:1746155638.505046:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca95180, transno 21474841457 00000004:00080000:0.0:1746155638.505048:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0d9180, transno 21474841458 00000004:00080000:0.0:1746155638.505050:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc52a00, transno 21474841465 00000004:00080000:0.0:1746155638.505052:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc51880, transno 21474841466 00000004:00080000:0.0:1746155638.505053:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312f5880, transno 21474841467 00000004:00080000:0.0:1746155638.505055:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312f4380, transno 21474841468 00000004:00080000:0.0:1746155638.505057:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1f2d80, transno 21474841469 00000004:00080000:0.0:1746155638.505058:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801312f6a00, transno 21474841470 00000004:00080000:0.0:1746155638.505060:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff68700, transno 21474841471 00000004:00080000:0.0:1746155638.505062:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095269f80, transno 21474841472 00000004:00080000:0.0:1746155638.505064:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01fed80, transno 21474841476 00000004:00080000:0.0:1746155638.505066:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01ff800, transno 21474841477 00000004:00080000:0.0:1746155638.505067:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01fd880, transno 21474841478 00000004:00080000:0.0:1746155638.505069:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01ff100, transno 21474841479 00000004:00080000:0.0:1746155638.505070:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01ffb80, transno 21474841480 00000004:00080000:0.0:1746155638.505072:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01fd500, transno 21474841481 00000004:00080000:0.0:1746155638.505073:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01fea00, transno 21474841482 00000004:00080000:0.0:1746155638.505075:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01ff480, transno 21474841483 00000004:00080000:0.0:1746155638.505077:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094086680, transno 21474841484 00000004:00080000:0.0:1746155638.505079:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a1500, transno 21474841485 00000004:00080000:0.0:1746155638.505080:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf5180, transno 21474841486 00000004:00080000:0.0:1746155638.505082:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910caa00, transno 21474841487 00000004:00080000:0.0:1746155638.505084:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf4700, transno 21474841488 00000004:00080000:0.0:1746155638.505086:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca94a80, transno 21474841489 00000004:00080000:0.0:1746155638.505087:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094084380, transno 21474841490 00000004:00080000:0.0:1746155638.505090:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01d3800, transno 21474841491 00000100:00100000:0.0:1746155638.505094:0:3298:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012c2bdc00 x1830976125311360/t21474841498(21474841498) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746155654 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746155638.505101:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c2bdc00/2, rc 0, transno 21474841498 00000100:00100000:0.0:1746155638.505103:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125311360:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155638.505117:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c2bd880/2, rc 0, transno 21474841499 00000100:00100000:0.0:1746155638.505120:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125312384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155638.505125:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c2be680/2, rc 0, transno 21474841500 00000100:00100000:0.0:1746155638.505127:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125312896:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155638.505527:0:14274:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 5 in flight, 80 done 00000100:00100000:3.0:1746155638.505659:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.506472:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125312256 00000100:00100000:0.0:1746155638.506476:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125312256 00000100:00100000:0.0:1746155638.506494:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16633 00000100:00100000:0.0:1746155638.506499:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3297:x1830976125312256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.506592:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155638.506599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.506614:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125310976 00000100:00100000:2.0:1746155638.506615:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155638.506617:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125310976 00000100:00100000:1.0:1746155638.506631:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125312128 00000100:00100000:1.0:1746155638.506639:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125312128 00000100:00100000:2.0:1746155638.506694:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16634 00000100:00100000:3.0:1746155638.506696:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125312768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.506702:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3295:x1830976125310976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155638.506721:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155638.506741:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125312768 00000100:00100000:3.0:1746155638.506744:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125312768 00000100:00100000:3.0:1746155638.506756:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16635 00000100:00100000:3.0:1746155638.506760:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3296:x1830976125312128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.506821:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3295:x1830976125310976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (229us total) trans 17179874175 rc 0/0 00000100:00100000:2.0:1746155638.506827:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16634 00000100:00100000:2.0:1746155638.506839:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16636 00000100:00100000:2.0:1746155638.506843:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3297:x1830976125312768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155638.506854:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976125312128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (238us total) trans 21474841501 rc 0/0 00000100:00100000:3.0:1746155638.506862:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16635 00000100:00100000:2.0:1746155638.506935:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3297:x1830976125312768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (212us total) trans 21474841502 rc 0/0 00000100:00100000:2.0:1746155638.506941:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16636 00000004:00080000:2.0:1746155638.506979:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f581500/2, rc 0, transno 17179874175 00000100:00100000:2.0:1746155638.506983:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125310976:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.506988:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125311488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.507002:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.507015:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125312000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.507027:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.507040:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125312512:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.507052:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.507062:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746155638.507066:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125312640:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.507077:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746155638.507098:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c2bed80/2, rc 0, transno 21474841501 00000100:00100000:2.0:1746155638.507101:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125312128:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155638.507108:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f580e00/2, rc 0, transno 17179874170 00000100:00100000:2.0:1746155638.507111:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125311104:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155638.507123:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f580700/2, rc 0, transno 17179874172 00000100:00100000:2.0:1746155638.507126:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125311616:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155638.507149:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125311488 00000100:00100000:1.0:1746155638.507155:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125311488 00000100:00100000:1.0:1746155638.507167:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125312000 00000100:00100000:1.0:1746155638.507172:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125312000 00000100:00100000:1.0:1746155638.507181:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125312512 00000100:00100000:1.0:1746155638.507183:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125312512 00000100:00100000:1.0:1746155638.507192:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125312640 00000100:00100000:1.0:1746155638.507193:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125312640 00000100:00100000:1.0:1746155638.507200:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16637 00000100:00100000:1.0:1746155638.507204:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976125311488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155638.507308:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125311488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (304us total) trans 17179874176 rc 0/0 00000100:00100000:1.0:1746155638.507314:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16637 00000100:00100000:1.0:1746155638.507322:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16638 00000100:00100000:1.0:1746155638.507326:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976125312000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155638.507406:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125312000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (378us total) trans 17179874177 rc 0/0 00000100:00100000:1.0:1746155638.507411:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16638 00000100:00100000:1.0:1746155638.507418:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16639 00000100:00100000:1.0:1746155638.507422:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976125312512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155638.507532:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:1.0:1746155638.507535:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155638.507537:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746155638.507539:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155638.507540:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746155638.507560:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125312512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (507us total) trans 21474841503 rc 0/0 00000100:00100000:1.0:1746155638.507565:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16639 00000100:00100000:1.0:1746155638.507575:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16640 00000100:00100000:1.0:1746155638.507579:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976125312640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155638.507650:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125312640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (571us total) trans 21474841504 rc 0/0 00000100:00100000:1.0:1746155638.507654:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16640 00000100:00100000:1.0:1746155638.507672:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125845760 00000100:00100000:1.0:1746155638.507675:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125845760 00000100:00100000:1.0:1746155638.507693:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11046 00000100:00100000:1.0:1746155638.507697:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32179:x1830976125845760:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155638.507710:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155638.507724:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f6ee6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179f8 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.507767:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f6ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179f8 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.507779:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f6ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179f8 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.507793:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155638.507795:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155638.507798:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc02000, rc 0) 00000100:00100000:1.0:1746155638.507826:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32179:x1830976125845760:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 127us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.507830:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11046 00000100:00100000:0.0:1746155638.508151:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976125312256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1651us (2490us total) trans 21474841505 rc 0/0 00000100:00100000:0.0:1746155638.508155:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16633 00000004:00080000:2.0:1746155638.508497:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c2bc700/2, rc 0, transno 21474841504 00000100:00100000:2.0:1746155638.508515:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125312640:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155638.508525:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c2bc380/2, rc 0, transno 21474841503 00000100:00100000:2.0:1746155638.508528:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125312512:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155638.508534:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f581180/2, rc 0, transno 17179874176 00000100:00100000:2.0:1746155638.508537:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125311488:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155638.508542:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f582300/2, rc 0, transno 17179874177 00000100:00100000:2.0:1746155638.508545:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125312000:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155638.508635:0:14277:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 0 in flight, 90 done 00000004:00080000:3.0:1746155638.508839:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c2bd500/2, rc 0, transno 21474841505 00000100:00100000:2.0:1746155638.508840:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125313024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155638.508843:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125312256:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155638.508849:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c2bdf80/2, rc 0, transno 21474841502 00000100:00100000:3.0:1746155638.508851:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125312768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.508863:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155638.508877:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125313024 00000100:00100000:3.0:1746155638.508880:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125313024 00000100:00100000:3.0:1746155638.509108:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16641 00000100:00100000:3.0:1746155638.509113:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125313024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155638.509282:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3295:x1830976125313024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (418us total) trans 17179874178 rc 0/0 00000100:00100000:3.0:1746155638.509287:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16641 00000004:00080000:2.0:1746155638.509337:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012c2bf800/2, rc 0, transno 17179874178 00000100:00100000:2.0:1746155638.509340:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125313024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.509572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.509630:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125845888 00000100:00100000:1.0:1746155638.509633:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125845888 00000100:00100000:1.0:1746155638.509652:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11047 00000100:00100000:1.0:1746155638.509656:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32179:x1830976125845888:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155638.509664:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155638.509676:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02200/0x844e5faceb5f6eed lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f179ff expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.510041:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f6ef4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.510052:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f6ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.510060:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f6ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155638.510083:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155638.510086:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155638.510097:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f6ef4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.510114:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02200/0x844e5faceb5f6eed lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ff expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.510414:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f6ef4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ff expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.510421:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155638.510423:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155638.510425:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc03c00, rc 0) 00000100:00100000:1.0:1746155638.510576:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32179:x1830976125845888:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 917us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.510581:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11047 00000100:00100000:1.0:1746155638.513797:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.513830:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.513856:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.514024:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.514138:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.514152:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125846016 00000100:00100000:0.0:1746155638.514153:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125846144 00000100:00100000:3.0:1746155638.514158:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125846016 00000100:00100000:0.0:1746155638.514158:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125846144 00000100:00100000:3.0:1746155638.514185:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125846400 00000100:00100000:3.0:1746155638.514187:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125846400 00000100:00100000:0.0:1746155638.514188:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125846656 00000100:00100000:0.0:1746155638.514190:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125846656 00000100:00100000:3.0:1746155638.514201:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16642 00000100:00100000:0.0:1746155638.514206:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16643 00000100:00100000:3.0:1746155638.514207:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1960:x1830976125846016:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:0.0:1746155638.514212:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125846144:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.514220:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155638.514220:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.514235:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b000/0x844e5faceb5f6f02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a06 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.514235:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6efb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a0d expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155638.514254:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e1:0x0] initial LVB size: 1048576, mtime: 0x68143876, atime: 0x68143875, ctime: 0x68143876, blocks: 0x7e9 00002000:00010000:0.0:1746155638.514254:0:20200:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x68143876, atime: 0x68143876, ctime: 0x68143876, blocks: 0x821 00010000:00010000:3.0:1746155638.514267:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155638.514267:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.514269:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155638.514269:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.514275:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b000/0x844e5faceb5f6f02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a06 expref: 7 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155638.514275:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6efb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a0d expref: 8 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.514287:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b000/0x844e5faceb5f6f02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a06 expref: 7 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155638.514287:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6efb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a0d expref: 8 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.514295:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4b000, rc 0) 00010000:00010000:0.0:1746155638.514295:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801303bb200, rc 0) 00000100:00100000:0.0:1746155638.514326:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125846144:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 115us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.514327:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125846016:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 120us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155638.514332:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16643 00000100:00100000:3.0:1746155638.515121:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16642 00000100:00100000:3.0:1746155638.515134:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125846272 00000100:00100000:3.0:1746155638.515137:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125846272 00000100:00100000:3.0:1746155638.515153:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16644 00000100:00100000:3.0:1746155638.515158:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976125846400:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.515165:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.515174:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5f6f09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a1b expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155638.515186:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e3:0x0] initial LVB size: 2097152, mtime: 0x68143875, atime: 0x68143875, ctime: 0x68143875, blocks: 0x821 00000100:00100000:1.0:1746155638.515194:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155638.515195:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.515197:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.515201:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5f6f09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a1b expref: 7 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.515210:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5f6f09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a1b expref: 7 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.515221:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4bc00, rc 0) 00000100:00100000:3.0:1746155638.515357:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125846400:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 198us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.515363:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16644 00000100:00100000:3.0:1746155638.515376:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125846528 00000100:00100000:3.0:1746155638.515378:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125846528 00000100:00100000:3.0:1746155638.515392:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16645 00000100:00100000:3.0:1746155638.515397:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125846656:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:1.0:1746155638.515402:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16646 00010000:00010000:3.0:1746155638.515403:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155638.515408:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125846272:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.515411:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f6f10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a29 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.515415:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746155638.515423:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e2:0x0] initial LVB size: 4194304, mtime: 0x68143876, atime: 0x68143875, ctime: 0x68143876, blocks: 0x1029 00010000:00010000:1.0:1746155638.515423:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6f17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a14 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.515431:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.515432:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746155638.515435:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x68143876, atime: 0x68143875, ctime: 0x68143876, blocks: 0x81d 00010000:00010000:3.0:1746155638.515436:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f6f10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a29 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155638.515443:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.515444:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.515445:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f6f10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a29 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155638.515448:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6f17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a14 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.515451:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4ac00, rc 0) 00010000:00010000:1.0:1746155638.515458:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6f17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a14 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155638.515464:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0fe00, rc 0) 00000100:00100000:3.0:1746155638.515471:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125846656:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 73us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.515476:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16645 00000100:00100000:1.0:1746155638.515480:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125846272:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 72us (1341us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.515485:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16646 00000100:00100000:3.0:1746155638.515488:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16647 00000100:00100000:3.0:1746155638.515493:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976125846528:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.515498:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.515519:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe4a000/0x844e5faceb5f6f1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a22 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155638.515530:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e4:0x0] initial LVB size: 5079552, mtime: 0x68143876, atime: 0x68143876, ctime: 0x68143876, blocks: 0x1711 00010000:00010000:3.0:1746155638.515537:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.515539:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.515542:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4a000/0x844e5faceb5f6f1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a22 expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.515550:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4a000/0x844e5faceb5f6f1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a22 expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.515556:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4a000, rc 0) 00000100:00100000:3.0:1746155638.515571:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125846528:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 78us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.515575:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16647 00000100:00100000:0.0:1746155638.522229:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.522277:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.522994:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.523131:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.523146:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125846912 00000100:00100000:3.0:1746155638.523153:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125846912 00000100:00100000:3.0:1746155638.523194:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125847168 00000100:00100000:3.0:1746155638.523196:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125847168 00000100:00100000:3.0:1746155638.523209:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125847424 00000100:00100000:3.0:1746155638.523211:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125847424 00000100:00100000:3.0:1746155638.523752:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125847680 00000100:00100000:3.0:1746155638.523755:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125847680 00000100:00100000:2.0:1746155638.523760:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7881 00000100:00100000:2.0:1746155638.523770:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125846912:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:3.0:1746155638.523776:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7882 00000100:00100000:3.0:1746155638.523782:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125847168:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155638.523802:0:31250:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a231400/0x844e5faceb5f6f25 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.523802:0:25391:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013142b400/0x844e5faceb5f6f2c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.523813:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.523813:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.523815:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.523815:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.523819:0:31250:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a231400/0x844e5faceb5f6f25 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.523819:0:25391:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013142b400/0x844e5faceb5f6f2c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.523830:0:25391:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013142b400/0x844e5faceb5f6f2c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.523832:0:31250:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a231400/0x844e5faceb5f6f25 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155638.523854:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7883 00000100:00100000:1.0:1746155638.523861:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125847424:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155638.523876:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6f33 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.523882:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.523883:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.523886:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6f33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.523893:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6f33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.524919:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7884 00000100:00100000:3.0:1746155638.524926:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125847680:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155638.524942:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a231c00/0x844e5faceb5f6f3a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.524963:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.524965:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.524967:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a231c00/0x844e5faceb5f6f3a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.524975:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a231c00/0x844e5faceb5f6f3a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.527430:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.527457:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.527468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.528139:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125848192 00000100:00100000:1.0:1746155638.528139:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125848064 00000100:00100000:2.0:1746155638.528147:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125848192 00000100:00100000:1.0:1746155638.528147:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125848064 00000100:00100000:3.0:1746155638.528160:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.528176:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125848448 00000100:00100000:3.0:1746155638.528178:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125848448 00000100:00100000:1.0:1746155638.528182:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125848576 00000100:00100000:1.0:1746155638.528184:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125848576 00000100:00100000:2.0:1746155638.528190:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7885 00000100:00100000:2.0:1746155638.528198:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125848064:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:1.0:1746155638.528201:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7886 00000100:00100000:3.0:1746155638.528205:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7887 00000100:00100000:1.0:1746155638.528206:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125848192:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:3.0:1746155638.528209:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976125848576:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155638.528222:0:31252:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29200/0x844e5faceb5f6f4f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.528222:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013142ae00/0x844e5faceb5f6f48 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.528222:0:31253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f6f41 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.528233:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.528233:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.528235:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.528235:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.528238:0:31252:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29200/0x844e5faceb5f6f4f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.528238:0:31253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f6f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.528248:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.528249:0:31252:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd29200/0x844e5faceb5f6f4f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.528249:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.528249:0:31253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f6f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.528252:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013142ae00/0x844e5faceb5f6f48 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.528260:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013142ae00/0x844e5faceb5f6f48 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.528286:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7888 00000100:00100000:2.0:1746155638.528290:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976125848448:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155638.528303:0:31251:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013142be00/0x844e5faceb5f6f56 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.528308:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.528310:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.528312:0:31251:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013142be00/0x844e5faceb5f6f56 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.528318:0:31251:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013142be00/0x844e5faceb5f6f56 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.533624:0:31250:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a231400/0x844e5faceb5f6f25 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.533641:0:31250:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a231400/0x844e5faceb5f6f25 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.533649:0:31250:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a231400/0x844e5faceb5f6f25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.533655:0:31250:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a231400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155638.533658:0:31250:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a231400/0x844e5faceb5f6f25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.533665:0:31250:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a231400/0x844e5faceb5f6f25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.533682:0:31250:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a231400/0x844e5faceb5f6f25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.533687:0:31250:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a231400/0x844e5faceb5f6f25 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.533760:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125847168:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 9973us (11478us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.533768:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7882 00010000:00010000:1.0:1746155638.537816:0:25394:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6f33 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.537830:0:25394:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6f33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.537837:0:25394:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6f33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.537843:0:25394:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cf0f800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155638.537847:0:25394:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6f33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.537853:0:25394:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6f33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.537869:0:25394:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6f33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.537874:0:25394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0f800/0x844e5faceb5f6f33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155638.538604:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125847424:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 14738us (15604us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155638.538613:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7883 00010000:00010000:3.0:1746155638.541773:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a231c00/0x844e5faceb5f6f3a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.541788:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a231c00/0x844e5faceb5f6f3a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.541795:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a231c00/0x844e5faceb5f6f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.541801:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a231c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155638.541804:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a231c00/0x844e5faceb5f6f3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.541811:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a231c00/0x844e5faceb5f6f3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.541827:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a231c00/0x844e5faceb5f6f3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.541837:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a231c00/0x844e5faceb5f6f3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.543210:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125847680:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 18278us (20072us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.543218:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7884 00010000:00010000:3.0:1746155638.548807:0:25391:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013142b400/0x844e5faceb5f6f2c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.548823:0:25391:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013142b400/0x844e5faceb5f6f2c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.548830:0:25391:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013142b400/0x844e5faceb5f6f2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.548836:0:25391:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013142b400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155638.548839:0:25391:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013142b400/0x844e5faceb5f6f2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.548845:0:25391:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013142b400/0x844e5faceb5f6f2c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.548861:0:25391:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013142b400/0x844e5faceb5f6f2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.548866:0:25391:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013142b400/0x844e5faceb5f6f2c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.548971:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125846912:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 25175us (26721us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.548981:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7881 00010000:00010000:2.0:1746155638.550188:0:31251:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88013142be00/0x844e5faceb5f6f56 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.550198:0:31251:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013142be00/0x844e5faceb5f6f56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.550205:0:31251:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013142be00/0x844e5faceb5f6f56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.550210:0:31251:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013142be00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155638.550213:0:31251:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013142be00/0x844e5faceb5f6f56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.550218:0:31251:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013142be00/0x844e5faceb5f6f56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.550229:0:31251:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013142be00/0x844e5faceb5f6f56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.550238:0:31251:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013142be00/0x844e5faceb5f6f56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.550298:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125848448:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 22006us (22827us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155638.550306:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7888 00010000:00010000:2.0:1746155638.552716:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013142ae00/0x844e5faceb5f6f48 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.552728:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013142ae00/0x844e5faceb5f6f48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.552734:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013142ae00/0x844e5faceb5f6f48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.552739:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013142ae00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155638.552741:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013142ae00/0x844e5faceb5f6f48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.552747:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013142ae00/0x844e5faceb5f6f48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.552759:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013142ae00/0x844e5faceb5f6f48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.552764:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013142ae00/0x844e5faceb5f6f48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.552864:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125848064:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 24663us (25401us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155638.552872:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7885 00010000:00010000:3.0:1746155638.555990:0:31253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f6f41 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.556005:0:31253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f6f41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.556011:0:31253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f6f41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.556017:0:31253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f77a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155638.556020:0:31253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f6f41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.556027:0:31253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f6f41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.556042:0:31253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f6f41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.556046:0:31253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f6f41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.556116:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125848192:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 27905us (28689us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.556129:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7886 00010000:00010000:3.0:1746155638.557396:0:31252:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29200/0x844e5faceb5f6f4f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.557406:0:31252:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29200/0x844e5faceb5f6f4f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.557413:0:31252:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fd29200/0x844e5faceb5f6f4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.557418:0:31252:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd29200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155638.557420:0:31252:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd29200/0x844e5faceb5f6f4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.557425:0:31252:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd29200/0x844e5faceb5f6f4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.557436:0:31252:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fd29200/0x844e5faceb5f6f4f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.557440:0:31252:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29200/0x844e5faceb5f6f4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.557489:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125848576:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 29278us (29327us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.557495:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7887 00000100:00100000:0.0:1746155638.563253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.563931:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125848960 00000100:00100000:1.0:1746155638.563940:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125848960 00000100:00100000:1.0:1746155638.563992:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11048 00000100:00100000:1.0:1746155638.563999:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32179:x1830976125848960:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:1.0:1746155638.564038:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.564058:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f6ef4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179ff expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.564086:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155638.564090:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155638.564185:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77600/0x844e5faceb5f6f5d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.564196:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77600/0x844e5faceb5f6f5d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.564204:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77600/0x844e5faceb5f6f5d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00010000:1.0:1746155638.564327:0:15474:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a01d1880 reply state ffff88012e272000 transno 8589945192 ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77600/0x844e5faceb5f6f5d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155638.564333:0:15474:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746155638.564395:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32179:x1830976125848960:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 395us (1148us total) trans 8589945192 rc 0/0 00000100:00100000:1.0:1746155638.564400:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11048 00000100:00100000:0.0:1746155638.568335:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155638.568395:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77600/0x844e5faceb5f6f5d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.568404:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77600/0x844e5faceb5f6f5d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.568410:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77600/0x844e5faceb5f6f5d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.568415:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135f77600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155638.568419:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77600/0x844e5faceb5f6f5d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.568424:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77600/0x844e5faceb5f6f5d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.568436:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155638.568438:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155638.568441:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77600/0x844e5faceb5f6f5d lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.568445:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77600/0x844e5faceb5f6f5d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155638.568942:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125849088 00000100:00100000:3.0:1746155638.568958:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125849088 00000100:00100000:3.0:1746155638.569001:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16648 00000100:00100000:3.0:1746155638.569009:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32179:x1830976125849088:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.569023:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.569037:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f6f64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a30 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.569058:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b000/0x844e5faceb5f6f02 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a06 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.569065:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.569066:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.569069:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f6f64 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a30 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.569093:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b000/0x844e5faceb5f6f02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a06 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.569102:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b000/0x844e5faceb5f6f02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a06 expref: 9 pid: 1625 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746155638.569112:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125313152:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.569281:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0053c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155638.573292:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125313152:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.573317:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f6f64 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a30 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.573337:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29000, rc 0) 00000100:00100000:0.0:1746155638.573368:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.573386:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32179:x1830976125849088:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4377us (5057us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.573393:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16648 00000100:00100000:2.0:1746155638.574456:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125849216 00000100:00100000:2.0:1746155638.574462:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125849216 00010000:00010000:2.0:1746155638.574484:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b000/0x844e5faceb5f6f02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a06 expref: 9 pid: 1625 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746155638.574533:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8540 00000100:00100000:2.0:1746155638.574539:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125849216:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.574549:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.574564:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b000/0x844e5faceb5f6f02 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a06 expref: 9 pid: 1625 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.574574:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b000/0x844e5faceb5f6f02 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a06 expref: 9 pid: 1625 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.574592:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b000/0x844e5faceb5f6f02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a06 expref: 9 pid: 1625 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.574607:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.574609:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.574614:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f6f64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a30 expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.574622:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f6f64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a30 expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.574650:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f6f64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a30 expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.574660:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125313280:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155638.574711:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155638.576713:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125313280:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155638.576713:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155638.576726:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155638.576755:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125849344 00000100:00100000:3.0:1746155638.576759:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125849344 00000100:00100000:2.0:1746155638.576763:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125849216:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2223us (3396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.576770:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8540 00000100:00100000:3.0:1746155638.576786:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16649 00000100:00100000:3.0:1746155638.576791:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32179:x1830976125849344:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.576803:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.576815:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f6f6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a37 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.576834:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6efb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a0d expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.576840:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.576842:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.576845:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f6f6b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a37 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.576864:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6efb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a0d expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.576874:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6efb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a0d expref: 10 pid: 20200 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746155638.576890:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125313408:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.576952:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0053c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155638.578964:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125313408:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.578984:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f6f6b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a37 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.578997:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29400, rc 0) 00000100:00100000:3.0:1746155638.579033:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32179:x1830976125849344:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2240us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.579039:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16649 00000100:00100000:1.0:1746155638.579247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.579350:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125849472 00000100:00100000:2.0:1746155638.579356:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125849472 00010000:00010000:2.0:1746155638.579375:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6efb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a0d expref: 10 pid: 20200 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746155638.579394:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8541 00000100:00100000:2.0:1746155638.579399:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125849472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.579409:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.579425:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6efb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a0d expref: 10 pid: 20200 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.579434:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6efb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a0d expref: 10 pid: 20200 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.579455:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801303bb200/0x844e5faceb5f6efb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a0d expref: 10 pid: 20200 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.579465:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.579466:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.579471:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f6f6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a37 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.579478:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f6f6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a37 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.579500:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f6f6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a37 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.579535:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125313536:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155638.579583:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155638.582587:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125313536:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155638.582604:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.582724:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125849472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3323us (3476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.582733:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8541 00000100:00100000:0.0:1746155638.583046:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.583185:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125849600 00000100:00100000:3.0:1746155638.583191:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125849600 00000100:00100000:3.0:1746155638.583223:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16650 00000100:00100000:3.0:1746155638.583229:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32179:x1830976125849600:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.583244:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.583257:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5f6f72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a3e expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.583276:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6f17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a14 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.583282:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.583284:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.583287:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5f6f72 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a3e expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.583310:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6f17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a14 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.583320:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6f17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a14 expref: 10 pid: 8437 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746155638.583329:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125313664:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.583372:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155638.584685:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125313664:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.584701:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5f6f72 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a3e expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.584712:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28c00, rc 0) 00000100:00100000:3.0:1746155638.584916:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32179:x1830976125849600:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1685us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.584922:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16650 00000100:00100000:0.0:1746155638.585419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.585565:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125849728 00000100:00100000:2.0:1746155638.585569:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125849728 00010000:00010000:2.0:1746155638.585587:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6f17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a14 expref: 10 pid: 8437 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746155638.585607:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8542 00000100:00100000:2.0:1746155638.585612:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125849728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.585620:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.585635:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6f17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a14 expref: 10 pid: 8437 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.585644:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6f17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a14 expref: 10 pid: 8437 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.585660:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f6f17 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a14 expref: 10 pid: 8437 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.585672:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.585674:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.585678:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5f6f72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a3e expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.585684:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5f6f72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a3e expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.585701:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5f6f72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a3e expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.585709:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125313792:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155638.585747:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155638.586891:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125313792:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155638.586903:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.586926:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976125849728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1313us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.586933:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8542 00000100:00100000:0.0:1746155638.587235:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.587317:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125849856 00000100:00100000:3.0:1746155638.587322:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125849856 00000100:00100000:3.0:1746155638.587530:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16651 00000100:00100000:3.0:1746155638.587537:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32179:x1830976125849856:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.587549:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.587560:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f6f79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a45 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.587582:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5f6f09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a1b expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.587588:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.587589:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.587592:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f6f79 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a45 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.587610:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5f6f09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a1b expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.587618:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5f6f09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a1b expref: 9 pid: 1625 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746155638.587626:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125313920:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.588088:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.593263:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.593355:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125313920:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.593379:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f6f79 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a45 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.593379:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125849984 00000100:00100000:2.0:1746155638.593385:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125849984 00010000:00010000:3.0:1746155638.593393:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28400, rc 0) 00010000:00010000:2.0:1746155638.593410:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5f6f09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a1b expref: 10 pid: 1625 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746155638.593444:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32179:x1830976125849856:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5907us (6208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.593444:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8543 00000100:00100000:3.0:1746155638.593451:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16651 00000100:00100000:2.0:1746155638.593452:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125849984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.593461:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.593479:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5f6f09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a1b expref: 9 pid: 1625 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.593490:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5f6f09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a1b expref: 9 pid: 1625 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.593527:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4bc00/0x844e5faceb5f6f09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a1b expref: 9 pid: 1625 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.593545:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.593548:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.593552:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f6f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a45 expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.593563:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f6f79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a45 expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.593586:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f6f79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a45 expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.593594:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125314048:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155638.593646:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155638.596414:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125314048:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155638.596431:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.596484:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125849984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3032us (3231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.596494:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8543 00000100:00100000:0.0:1746155638.598308:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.598729:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125850112 00000100:00100000:3.0:1746155638.598737:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125850112 00000100:00100000:3.0:1746155638.598785:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16652 00000100:00100000:3.0:1746155638.598796:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32179:x1830976125850112:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.598812:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.598827:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a4c expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.598855:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4a000/0x844e5faceb5f6f1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a22 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.598866:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.598867:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.598871:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a4c expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.598899:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe4a000/0x844e5faceb5f6f1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a22 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.598913:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4a000/0x844e5faceb5f6f1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a22 expref: 9 pid: 1625 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746155638.598923:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125314176:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.598995:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.602810:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.602887:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125850240 00000100:00100000:2.0:1746155638.602894:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125850240 00010000:00010000:2.0:1746155638.602924:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4a000/0x844e5faceb5f6f1e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a22 expref: 10 pid: 1625 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746155638.602965:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8544 00000100:00100000:2.0:1746155638.602972:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125850240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.602982:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.603000:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe4a000/0x844e5faceb5f6f1e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a22 expref: 10 pid: 1625 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.603017:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe4a000/0x844e5faceb5f6f1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a22 expref: 10 pid: 1625 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.603035:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.603037:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.603042:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a4c expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.603049:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a4c expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.603074:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a4c expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.603084:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125314304:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155638.603159:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4a000/0x844e5faceb5f6f1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a22 expref: 10 pid: 1625 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746155638.603184:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125314176:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.603209:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a4c expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.603217:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29600, rc 0) 00000100:00100000:3.0:1746155638.603424:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32179:x1830976125850112:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4628us (5120us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.603429:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16652 00000100:00100000:2.0:1746155638.603858:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.607200:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.607269:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125850368 00000100:00100000:3.0:1746155638.607276:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125850368 00000100:00100000:2.0:1746155638.607291:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125314304:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155638.607305:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155638.607308:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16653 00000100:00100000:3.0:1746155638.607314:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32179:x1830976125850368:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155638.607327:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.607340:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a53 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.607350:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125850240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4379us (4547us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.607356:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8544 00010000:00010000:3.0:1746155638.607363:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f6f10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a29 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.607370:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.607371:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.607374:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a53 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.607398:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f6f10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a29 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.607407:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f6f10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a29 expref: 10 pid: 1625 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746155638.607417:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125314432:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.607451:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.610621:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.610674:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125850496 00000100:00100000:2.0:1746155638.610681:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125850496 00010000:00010000:2.0:1746155638.610708:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f6f10 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a29 expref: 11 pid: 1625 timeout: 867 lvb_type: 1 00000100:00100000:2.0:1746155638.610748:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8545 00000100:00100000:2.0:1746155638.610755:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125850496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.610766:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.610784:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f6f10 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a29 expref: 11 pid: 1625 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.610794:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f6f10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a29 expref: 11 pid: 1625 timeout: 867 lvb_type: 1 00010000:00010000:2.0:1746155638.610812:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.610814:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.610820:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a53 expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.610827:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a53 expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.610851:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a53 expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.610920:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125314560:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155638.611343:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7000 going to sleep for 11 seconds 00010000:00010000:3.0:1746155638.611543:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f6f10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a29 expref: 11 pid: 1625 timeout: 867 lvb_type: 1 00000100:00100000:3.0:1746155638.611567:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125314432:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.611584:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a53 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.611592:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28600, rc 0) 00000100:00100000:3.0:1746155638.611618:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32179:x1830976125850368:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4303us (4424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.611624:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16653 00000100:00100000:2.0:1746155638.613251:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125314560:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155638.613266:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.613292:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125850496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2537us (2678us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.613300:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8545 00000100:00100000:0.0:1746155638.613910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.613940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.613980:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.614043:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125850624 00000100:00100000:1.0:1746155638.614048:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125850624 00000100:00100000:1.0:1746155638.614074:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125850752 00000100:00100000:1.0:1746155638.614076:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125850752 00000100:00100000:1.0:1746155638.614086:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125851008 00000100:00100000:1.0:1746155638.614088:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125851008 00000100:00100000:1.0:1746155638.614099:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16654 00000100:00100000:1.0:1746155638.614104:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125850624:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155638.614254:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155638.614257:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:1.0:1746155638.614259:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155637 -> 1746155638 00002000:00010000:1.0:1746155638.614261:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155638 -> 1746155639 00002000:00010000:1.0:1746155638.614263:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:2.0:1746155638.614277:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16655 00000100:00100000:2.0:1746155638.614285:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125850752:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:1.0:1746155638.614288:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125850624:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 183us (378us total) trans 17179874179 rc 0/0 00000100:00100000:1.0:1746155638.614294:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16654 00000100:00100000:1.0:1746155638.614304:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16656 00000100:00100000:1.0:1746155638.614308:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125851008:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155638.614372:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155638.614374:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155637 -> 1746155638 00002000:00010000:1.0:1746155638.614376:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155637 -> 1746155638 00002000:00010000:1.0:1746155638.614378:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155637 -> 1746155639 00002000:00010000:1.0:1746155638.614379:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746155638.614385:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155638.614388:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:2.0:1746155638.614390:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:2.0:1746155638.614392:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155638 -> 1746155639 00002000:00010000:2.0:1746155638.614393:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155638.614394:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125851008:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 85us (414us total) trans 17179874180 rc 0/0 00000100:00100000:1.0:1746155638.614400:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16656 00000100:00100000:2.0:1746155638.614411:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125850752:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 127us (470us total) trans 21474841506 rc 0/0 00000100:00100000:2.0:1746155638.614416:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16655 00000100:00100000:1.0:1746155638.614813:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.614833:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.614850:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.614923:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125851264 00000100:00100000:2.0:1746155638.614926:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125851264 00000100:00100000:0.0:1746155638.614934:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125850880 00000100:00100000:0.0:1746155638.614938:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125850880 00000100:00100000:2.0:1746155638.614941:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125851136 00000100:00100000:2.0:1746155638.614943:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125851136 00000100:00100000:0.0:1746155638.614966:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16657 00000100:00100000:0.0:1746155638.614971:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125851264:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:2.0:1746155638.614974:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16658 00000100:00100000:2.0:1746155638.614979:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125850880:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:2.0:1746155638.615063:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155638.615065:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:2.0:1746155638.615067:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155637 -> 1746155638 00002000:00010000:2.0:1746155638.615068:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155638 -> 1746155639 00002000:00010000:2.0:1746155638.615070:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746155638.615095:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16659 00000100:00100000:3.0:1746155638.615104:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125851136:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155638.615248:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:3.0:1746155638.615251:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:3.0:1746155638.615253:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:3.0:1746155638.615255:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155638 -> 1746155639 00002000:00010000:3.0:1746155638.615257:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00002000:00010000:0.0:1746155638.615290:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155638.615292:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:0.0:1746155638.615294:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155637 -> 1746155638 00002000:00010000:0.0:1746155638.615295:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155638 -> 1746155639 00002000:00010000:0.0:1746155638.615297:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746155638.615331:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125850880:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 349us (496us total) trans 21474841507 rc 0/0 00000100:00100000:2.0:1746155638.615340:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16658 00000100:00100000:0.0:1746155638.615373:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125851264:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 401us (560us total) trans 21474841508 rc 0/0 00000100:00100000:3.0:1746155638.615374:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125851136:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 270us (521us total) trans 17179874181 rc 0/0 00000100:00100000:0.0:1746155638.615378:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16657 00000100:00100000:3.0:1746155638.615382:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16659 00000100:00100000:0.0:1746155638.616972:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.617054:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125851520 00000100:00100000:2.0:1746155638.617061:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125851520 00000100:00100000:2.0:1746155638.617105:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4675 00000100:00100000:2.0:1746155638.617111:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b0d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32179:x1830976125851520:12345-192.168.202.51@tcp:35:lfs.0 00000004:00010000:2.0:1746155638.617153:0:16336:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x35e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbc00/0x844e5faceb5f6ea7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179f1 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.617186:0:16336:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155638.617195:0:16336:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f6ee6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179f8 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.617201:0:16336:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155638.617224:0:16336:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f6ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179f8 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.617234:0:16336:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f6ee6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179f8 expref: 9 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.617245:0:16336:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16336:1830976125314688:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.617438:0:16336:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1dc7000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155638.618779:0:16336:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16336:1830976125314688:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155638.618785:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155638.618795:0:16336:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:3.0:1746155638.618874:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125851648 00000100:00100000:3.0:1746155638.618878:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125851648 00010000:00010000:3.0:1746155638.618902:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f6ee6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179f8 expref: 10 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.618921:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8546 00000100:00100000:3.0:1746155638.618926:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125851648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155638.618936:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155638.618941:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f6ee6 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179f8 expref: 10 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.618958:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f6ee6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179f8 expref: 10 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.618975:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f6ee6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179f8 expref: 10 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.618999:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.619002:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155638.619009:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155638.619014:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155638.619053:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155638.619099:0:16336:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155638.619105:0:16336:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:3.0:1746155638.619326:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125851648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 398us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.619335:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8546 00000040:00080000:2.0:1746155638.619889:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3526, 88 off297200 00000004:00080000:2.0:1746155638.619895:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767769391345ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155638.620136:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3537, 88 off298432 00000004:00080000:2.0:1746155638.620139:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767769636372ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155638.620158:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3538, 88 off298520 00000004:00080000:2.0:1746155638.620162:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767769658965ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155638.620169:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3527, 88 off297288 00000004:00080000:2.0:1746155638.620171:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767769668210ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155638.620185:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3528, 88 off297376 00000004:00080000:2.0:1746155638.620187:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767769684336ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155638.620203:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3539, 88 off298608 00000004:00080000:2.0:1746155638.620206:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767769702896ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155638.620218:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3540, 88 off298696 00000004:00080000:2.0:1746155638.620221:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767769718002ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155638.620229:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3541, 88 off298784 00000004:00080000:2.0:1746155638.620232:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767769729061ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155638.620240:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3529, 88 off297464 00000004:00080000:2.0:1746155638.620242:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767769739525ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155638.620249:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3542, 88 off298872 00000004:00080000:2.0:1746155638.620251:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767769748075ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155638.620259:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3530, 88 off297552 00000004:00080000:2.0:1746155638.620262:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767769759320ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155638.620268:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3543, 88 off298960 00000004:00080000:2.0:1746155638.620270:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767769767269ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155638.620282:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3531, 88 off297640 00000004:00080000:2.0:1746155638.620284:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767769781334ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155638.620290:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3532, 88 off297728 00000004:00080000:2.0:1746155638.620292:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767769789660ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155638.620298:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3533, 88 off297816 00000004:00080000:2.0:1746155638.620301:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767769797815ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155638.620306:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3534, 88 off297904 00000004:00080000:2.0:1746155638.620309:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767769805742ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155638.620315:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3544, 88 off299048 00000004:00080000:2.0:1746155638.620318:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767769814892ns, next at 716011101328ns, rc = 0 00000001:00080000:2.0:1746155638.636444:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945192 is committed 00000001:00080000:2.0:1746155638.636526:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945193 is committed 00000004:00080000:2.0:1746155638.636530:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2729 committed 00000004:00080000:2.0:1746155638.636536:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2713 committed 00000004:00080000:2.0:1746155638.636540:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2712 committed 00000004:00080000:2.0:1746155638.636542:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2711 committed 00000004:00080000:2.0:1746155638.636544:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2710 committed 00000004:00080000:2.0:1746155638.636545:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2728 committed 00000004:00080000:2.0:1746155638.636547:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2709 committed 00000004:00080000:2.0:1746155638.636548:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2727 committed 00000004:00080000:2.0:1746155638.636549:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2708 committed 00000004:00080000:2.0:1746155638.636551:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2726 committed 00000004:00080000:2.0:1746155638.636552:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2725 committed 00000004:00080000:2.0:1746155638.636553:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2724 committed 00000004:00080000:2.0:1746155638.636554:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2707 committed 00000004:00080000:2.0:1746155638.636555:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2706 committed 00000004:00080000:2.0:1746155638.636557:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2723 committed 00000004:00080000:2.0:1746155638.636559:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2722 committed 00000004:00080000:2.0:1746155638.636560:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2705 committed 00000100:00100000:2.0:1746155638.636670:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125314816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.636690:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125314944:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746155638.636693:0:16336:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012b0d5c50 reply state ffff88008e3b7800 transno 8589945193 ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:3.0:1746155638.636702:0:16336:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746155638.636709:0:16336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.636712:0:16336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155638.636718:0:16336:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801303bbc00/0x844e5faceb5f6ea7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f179f1 expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155638.636738:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.636757:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125315456:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746155638.636797:0:16336:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746155638.636807:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b0d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32179:x1830976125851520:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 19695us (19838us total) trans 8589945193 rc 0/0 00000100:00100000:3.0:1746155638.636815:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4675 00000100:00100000:3.0:1746155638.636878:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125314944 00000100:00100000:3.0:1746155638.636884:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125314944 00000100:00100000:3.0:1746155638.636910:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16660 00000100:00100000:3.0:1746155638.636915:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976125314944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.636996:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.637020:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125315200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.637034:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.637044:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125315840:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.637054:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.637062:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125316352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.637072:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155638.637154:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125314816 00000100:00100000:1.0:1746155638.637158:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125314816 00000100:00100000:1.0:1746155638.637175:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125315200 00000100:00100000:1.0:1746155638.637177:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125315200 00000100:00100000:1.0:1746155638.637187:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125315840 00000100:00100000:1.0:1746155638.637188:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125315840 00000100:00100000:1.0:1746155638.637196:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125316352 00000100:00100000:1.0:1746155638.637198:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125316352 00000100:00100000:1.0:1746155638.637207:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16661 00000100:00100000:1.0:1746155638.637212:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3296:x1830976125314816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155638.637323:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155638.637325:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:1.0:1746155638.637327:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:1.0:1746155638.637329:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155639 -> 1746155639 00002000:00010000:1.0:1746155638.637331:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:1.0:1746155638.637351:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3296:x1830976125314816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 139us (354us total) trans 17179874182 rc 0/0 00000100:00100000:1.0:1746155638.637356:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16661 00000100:00100000:1.0:1746155638.637365:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16662 00000100:00100000:1.0:1746155638.637369:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3296:x1830976125315200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155638.637431:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155638.637433:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:1.0:1746155638.637435:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:1.0:1746155638.637437:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155639 -> 1746155639 00002000:00010000:1.0:1746155638.637438:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155638.637454:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3296:x1830976125315200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (419us total) trans 17179874183 rc 0/0 00000100:00100000:1.0:1746155638.637458:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16662 00000100:00100000:1.0:1746155638.637466:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16663 00000100:00100000:1.0:1746155638.637470:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3296:x1830976125315840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155638.637563:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:1.0:1746155638.637565:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155638.637567:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746155638.637569:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155638.637570:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746155638.637587:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3296:x1830976125315840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (532us total) trans 21474841509 rc 0/0 00000100:00100000:1.0:1746155638.637592:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16663 00000100:00100000:1.0:1746155638.637601:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16664 00000100:00100000:1.0:1746155638.637605:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3296:x1830976125316352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155638.637670:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3296:x1830976125316352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (596us total) trans 21474841510 rc 0/0 00000100:00100000:1.0:1746155638.637674:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16664 00000100:00100000:0.0:1746155638.638051:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.638066:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125315968:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.638080:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.638089:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125316480:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155638.638095:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f7100/2, rc 0, transno 17179874182 00000100:00100000:2.0:1746155638.638102:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125314816:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.638102:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746155638.638108:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f4000/2, rc 0, transno 17179874183 00000100:00100000:2.0:1746155638.638111:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125315200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.638113:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746155638.638116:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125315072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155638.638117:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a1180/2, rc 0, transno 21474841509 00000100:00100000:2.0:1746155638.638120:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125315840:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155638.638125:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fc700/2, rc 0, transno 21474841510 00000100:00100000:0.0:1746155638.638127:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.638128:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125316352:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.638132:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1746155638.638134:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125315584:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.638136:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125315328:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.638144:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.638155:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125316096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.638157:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125315456 00000100:00100000:2.0:1746155638.638159:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125315456 00000100:00100000:0.0:1746155638.638166:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.638172:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125315968 00000100:00100000:2.0:1746155638.638174:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125315968 00000100:00100000:0.0:1746155638.638174:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125316608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.638180:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125316480 00000100:00100000:2.0:1746155638.638182:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125316480 00000100:00100000:0.0:1746155638.638185:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.638187:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125315072 00000100:00100000:2.0:1746155638.638189:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125315072 00000100:00100000:2.0:1746155638.638195:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125315584 00000100:00100000:2.0:1746155638.638196:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125315584 00000100:00100000:0.0:1746155638.638198:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125316096 00000100:00100000:0.0:1746155638.638200:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125316096 00000100:00100000:2.0:1746155638.638201:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125316608 00000100:00100000:2.0:1746155638.638202:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125316608 00000100:00100000:2.0:1746155638.638209:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16665 00000100:00100000:0.0:1746155638.638211:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16666 00000100:00100000:2.0:1746155638.638213:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3297:x1830976125315456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.638215:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3297:x1830976125315968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.638237:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16667 00000100:00100000:0.0:1746155638.638241:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3297:x1830976125316480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155638.638289:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:2.0:1746155638.638292:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:2.0:1746155638.638294:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:2.0:1746155638.638295:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155639 -> 1746155639 00002000:00010000:2.0:1746155638.638297:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:0.0:1746155638.638314:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3297:x1830976125316480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (210us total) trans 17179874185 rc 0/0 00000100:00100000:0.0:1746155638.638319:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16667 00000100:00100000:0.0:1746155638.638328:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16668 00000100:00100000:0.0:1746155638.638332:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3297:x1830976125315072:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746155638.638357:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155638.638365:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155638.638370:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155638.638375:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135012600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155638.638379:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155638.638384:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155638.638395:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.638397:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155638.638400:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16336 initiator: MDT0 00002000:00010000:0.0:1746155638.638402:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00010000:00010000:3.0:1746155638.638404:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135012600/0x844e5faceb5f6f8e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16336 initiator: MDT0 00002000:00010000:0.0:1746155638.638404:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:0.0:1746155638.638406:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:0.0:1746155638.638408:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155639 -> 1746155639 00002000:00010000:0.0:1746155638.638409:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746155638.638423:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16669 00000100:00100000:3.0:1746155638.638427:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3297:x1830976125315584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155638.638681:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16670 00000100:00100000:1.0:1746155638.638687:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3297:x1830976125316608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.639049:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3297:x1830976125315456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 834us (996us total) trans 17179874184 rc 0/0 00000100:00100000:2.0:1746155638.639055:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16665 00000100:00100000:2.0:1746155638.639065:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16671 00000100:00100000:2.0:1746155638.639070:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976125316096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.639096:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976125315072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 764us (967us total) trans 21474841511 rc 0/0 00000100:00100000:0.0:1746155638.639101:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16668 00000100:00100000:2.0:1746155638.639142:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976125316096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (974us total) trans 21474841514 rc 0/0 00000100:00100000:2.0:1746155638.639147:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16671 00000100:00100000:0.0:1746155638.639163:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3297:x1830976125315968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 947us (1081us total) trans 17179874186 rc 0/0 00000100:00100000:0.0:1746155638.639167:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16666 00000004:00080000:0.0:1746155638.639184:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a1500/2, rc 0, transno 21474841511 00000100:00100000:0.0:1746155638.639187:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125315072:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155638.639189:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1746155638.639194:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125316864:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155638.639325:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976125315584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 896us (1178us total) trans 21474841512 rc 0/0 00000100:00100000:1.0:1746155638.639325:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976125316608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 637us (1137us total) trans 21474841513 rc 0/0 00000100:00100000:1.0:1746155638.639329:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16670 00000004:00080000:0.0:1746155638.639562:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a0380/2, rc 0, transno 21474841512 00000100:00100000:0.0:1746155638.639565:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125315584:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155638.639571:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fd180/2, rc 0, transno 21474841514 00000100:00100000:0.0:1746155638.639574:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125316096:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155638.639579:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fce00/2, rc 0, transno 21474841513 00000100:00100000:0.0:1746155638.639581:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125316608:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155638.639587:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f4700/2, rc 0, transno 17179874184 00000100:00100000:0.0:1746155638.639589:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125315456:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155638.639594:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f5f80/2, rc 0, transno 17179874186 00000100:00100000:0.0:1746155638.639596:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125315968:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155638.639601:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f7480/2, rc 0, transno 17179874185 00000100:00100000:0.0:1746155638.639604:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125316480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155638.639694:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.639709:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125851776 00000100:00100000:1.0:1746155638.639712:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125851776 00000100:00100000:1.0:1746155638.639732:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11049 00000100:00100000:1.0:1746155638.639736:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32179:x1830976125851776:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155638.639748:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155638.639756:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746155638.639757:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6f95 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a5a expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.639777:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.639790:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125315712:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746155638.639793:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6f95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a5a expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.639802:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6f95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a5a expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.639806:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.639814:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125316224:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746155638.639814:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155638.639816:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155638.639818:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092872400, rc 0) 00000100:00100000:2.0:1746155638.639825:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.639833:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125316736:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155638.639839:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32179:x1830976125851776:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 103us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.639844:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155638.639844:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11049 00000100:00100000:2.0:1746155638.639857:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125315328 00000100:00100000:1.0:1746155638.639857:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125316864 00000100:00100000:2.0:1746155638.639859:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125315328 00000100:00100000:1.0:1746155638.639859:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125316864 00000100:00100000:3.0:1746155638.639893:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16669 00000100:00100000:3.0:1746155638.639901:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125315712 00000100:00100000:3.0:1746155638.639904:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125315712 00000100:00100000:3.0:1746155638.639915:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125316224 00000100:00100000:3.0:1746155638.639916:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125316224 00000100:00100000:3.0:1746155638.639923:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125316736 00000100:00100000:3.0:1746155638.639924:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125316736 00000100:00100000:0.0:1746155638.639926:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16672 00000100:00100000:0.0:1746155638.639931:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3296:x1830976125315712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155638.639932:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16673 00000100:00100000:3.0:1746155638.639936:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3296:x1830976125316224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155638.639969:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16674 00000100:00100000:3.0:1746155638.639973:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3296:x1830976125316736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.640026:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3296:x1830976125315712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 95us (218us total) trans 17179874187 rc 0/0 00000100:00100000:0.0:1746155638.640031:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16672 00000100:00100000:3.0:1746155638.640036:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3296:x1830976125316736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (190us total) trans 17179874188 rc 0/0 00000100:00100000:3.0:1746155638.640043:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16674 00000004:00080000:0.0:1746155638.640050:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f6a00/2, rc 0, transno 17179874187 00000100:00100000:0.0:1746155638.640053:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125315712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155638.640058:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f4e00/2, rc 0, transno 17179874188 00000100:00100000:0.0:1746155638.640060:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125316736:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155638.640148:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155638.640150:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:3.0:1746155638.640152:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:3.0:1746155638.640154:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155639 -> 1746155639 00002000:00010000:3.0:1746155638.640155:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155638.640174:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976125314944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3259us (3436us total) trans 21474841515 rc 0/0 00000100:00100000:3.0:1746155638.640179:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16660 00000004:00080000:0.0:1746155638.640185:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a1880/2, rc 0, transno 21474841515 00000100:00100000:0.0:1746155638.640188:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125314944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155638.640245:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3296:x1830976125316224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 307us (418us total) trans 17179874189 rc 0/0 00000100:00100000:3.0:1746155638.640250:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16673 00000100:00100000:2.0:1746155638.640391:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16675 00000100:00100000:2.0:1746155638.640397:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976125316864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155638.640401:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16676 00000100:00100000:1.0:1746155638.640405:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976125315328:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155638.640459:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155638.640462:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:1.0:1746155638.640463:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:1.0:1746155638.640466:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155639 -> 1746155639 00002000:00010000:1.0:1746155638.640467:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746155638.640473:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976125316864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (1262us total) trans 17179874190 rc 0/0 00000100:00100000:2.0:1746155638.640478:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16675 00000100:00100000:1.0:1746155638.640482:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976125315328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (705us total) trans 21474841516 rc 0/0 00000100:00100000:1.0:1746155638.640487:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16676 00000004:00080000:2.0:1746155638.640500:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff69500/2, rc 0, transno 17179874190 00000004:00080000:0.0:1746155638.640538:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a62a3100/2, rc 0, transno 21474841516 00000100:00100000:0.0:1746155638.640541:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125315328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155638.640547:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f5880/2, rc 0, transno 17179874189 00000100:00100000:0.0:1746155638.640549:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125316224:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.640688:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125316864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.643811:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.644104:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125852032 00000100:00100000:3.0:1746155638.644111:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125852032 00000100:00100000:3.0:1746155638.644151:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4676 00000100:00100000:3.0:1746155638.644158:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32179:x1830976125852032:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155638.644358:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32179:x1830976125852032:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 198us (550us total) trans 8589945194 rc 0/0 00000100:00100000:3.0:1746155638.644364:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4676 00000100:00100000:0.0:1746155638.660493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.660558:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125852288 00000100:00100000:2.0:1746155638.660566:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125852288 00000100:00100000:2.0:1746155638.660616:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11050 00000100:00100000:2.0:1746155638.660624:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32185:x1830976125852288:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155638.660642:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.660658:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67200/0x844e5faceb5f6f9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a61 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.660746:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fa3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.660758:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.660771:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.660784:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f6faa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.660789:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f6faa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.660794:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f6faa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.660879:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450de00/0x844e5faceb5f6fb1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.660886:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450de00/0x844e5faceb5f6fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.660892:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450de00/0x844e5faceb5f6fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155638.660898:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155638.660976:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fa3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.660982:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fa3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.660988:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fa3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.660991:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc67e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155638.660995:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fa3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.661001:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fa3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.661010:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155638.661012:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155638.661015:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fa3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.661019:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fa3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.661042:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f6faa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.661046:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f6faa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.661050:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f6faa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.661054:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc66400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155638.661056:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f6faa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.661061:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f6faa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.661067:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcfa200) 00010000:00010000:2.0:1746155638.661068:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155638.661070:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f6faa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.661074:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f6faa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.661108:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67200/0x844e5faceb5f6f9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a61 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.661118:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450de00/0x844e5faceb5f6fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a61 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.661123:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155638.661124:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155638.661126:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450de00, rc 0) 00000100:00100000:2.0:1746155638.661177:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32185:x1830976125852288:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 553us (691us total) trans 8589945195 rc 0/0 00000100:00100000:2.0:1746155638.661183:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11050 00000100:00100000:1.0:1746155638.664956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.665001:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125852544 00000100:00100000:2.0:1746155638.665008:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125852544 00000100:00100000:2.0:1746155638.665052:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11051 00000100:00100000:2.0:1746155638.665060:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32189:x1830976125852544:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.665079:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.665095:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f6fbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a68 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.665177:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665187:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665196:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665210:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f6fcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665214:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f6fcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665219:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f6fcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665298:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f62b400/0x844e5faceb5f6fd4 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665304:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f62b400/0x844e5faceb5f6fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665309:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f62b400/0x844e5faceb5f6fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155638.665315:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155638.665383:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665389:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fc6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665393:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665398:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc67e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155638.665401:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665407:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665416:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155638.665418:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155638.665421:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665426:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f6fc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665451:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f6fcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665456:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f6fcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665465:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f6fcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665468:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc67400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155638.665470:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f6fcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665474:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f6fcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665479:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcfa200) 00010000:00010000:2.0:1746155638.665481:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155638.665483:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f6fcd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665487:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f6fcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.665532:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f6fbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a68 expref: 289 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.665542:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f62b400/0x844e5faceb5f6fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a68 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.665548:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155638.665549:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155638.665552:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f62b400, rc 0) 00000100:00100000:2.0:1746155638.665589:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32189:x1830976125852544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 530us (649us total) trans 8589945196 rc 0/0 00000100:00100000:2.0:1746155638.665594:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11051 00000100:00100000:0.0:1746155638.670127:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.670175:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125852800 00000100:00100000:2.0:1746155638.670183:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125852800 00000100:00100000:2.0:1746155638.670238:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4677 00000100:00100000:2.0:1746155638.670249:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32189:x1830976125852800:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155638.670706:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32189:x1830976125852800:12345-192.168.202.51@tcp:35:cat.0 Request processed in 460us (585us total) trans 8589945197 rc 0/0 00000100:00100000:2.0:1746155638.670713:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4677 00000100:00100000:0.0:1746155638.672408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.672473:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125853056 00000100:00100000:1.0:1746155638.672478:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125853056 00000100:00100000:1.0:1746155638.672531:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11052 00000100:00100000:1.0:1746155638.672537:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32184:x1830976125853056:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155638.672552:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155638.672566:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092872800/0x844e5faceb5f6fe2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a6f expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.672640:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.672652:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450de00/0x844e5faceb5f6fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a61 expref: 7 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.672658:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f62b400/0x844e5faceb5f6fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a68 expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.672663:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.672685:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f62b400/0x844e5faceb5f6fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a68 expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.672693:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f62b400/0x844e5faceb5f6fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a68 expref: 290 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.672703:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125316992:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.672774:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009450de00/0x844e5faceb5f6fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a61 expref: 7 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.672781:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450de00/0x844e5faceb5f6fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a61 expref: 7 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.672787:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125317120:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155638.672804:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.675199:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.675257:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125853184 00000100:00100000:2.0:1746155638.675264:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125853184 00000100:00100000:2.0:1746155638.676859:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16677 00000100:00100000:2.0:1746155638.676871:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32189:x1830976125853184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.676888:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.676902:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc67400/0x844e5faceb5f6ff0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a76 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.676927:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f6f64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a30 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.676935:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155638.676936:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155638.676940:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc67400/0x844e5faceb5f6ff0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a76 expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.676982:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f6f64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a30 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.676991:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f6f64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a30 expref: 10 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.677001:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff68e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125317248:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155638.677713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.677768:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155638.677918:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125316992:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.677953:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125853696 00000100:00100000:3.0:1746155638.677958:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125853696 00000100:00100000:1.0:1746155638.677965:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.678000:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.678005:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125853312 00000100:00100000:2.0:1746155638.678007:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125853312 00010000:00010000:2.0:1746155638.678024:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f62b400/0x844e5faceb5f6fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a68 expref: 291 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.678055:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125853440 00000100:00100000:0.0:1746155638.678057:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125853440 00010000:00010000:0.0:1746155638.678068:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009450de00/0x844e5faceb5f6fb1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a61 expref: 9 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.678097:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8547 00000100:00100000:0.0:1746155638.678103:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125853440:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155638.678110:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155638.678115:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009450de00/0x844e5faceb5f6fb1 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a61 expref: 9 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.678145:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8548 00000100:00100000:2.0:1746155638.678150:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1960:x1830976125853312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.678157:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.678160:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f62b400/0x844e5faceb5f6fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a68 expref: 291 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.678183:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11053 00000100:00100000:3.0:1746155638.678187:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32190:x1830976125853696:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155638.678198:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.678210:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5f6ff7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a7d expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.678288:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6200/0x844e5faceb5f6ffe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.678298:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6200/0x844e5faceb5f6ffe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.678307:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6200/0x844e5faceb5f6ffe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.678317:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6600/0x844e5faceb5f7005 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.678322:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6600/0x844e5faceb5f7005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.678327:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6600/0x844e5faceb5f7005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.678414:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7400/0x844e5faceb5f700c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155638.678682:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125317120:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155638.678875:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009450de00/0x844e5faceb5f6fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a61 expref: 10 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.678885:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f62b400/0x844e5faceb5f6fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a68 expref: 291 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.678903:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f62b400/0x844e5faceb5f6fd4 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a68 expref: 291 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.678918:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155638.678922:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155638.678927:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155638.678932:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155638.678938:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450de00/0x844e5faceb5f6fb1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a61 expref: 10 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746155638.678961:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155638.678964:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155638.678969:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1960:x1830976125853312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 819us (1003us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155638.678969:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155638.678973:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155638.678975:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8548 00010000:00010000:0.0:1746155638.678983:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155638.678995:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125853440:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 893us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155638.678999:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8547 00010000:00010000:3.0:1746155638.679465:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7400/0x844e5faceb5f700c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155638.679491:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.679498:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155638.679516:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155638.679529:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155638.679622:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872800/0x844e5faceb5f6fe2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a6f expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.679638:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a6f expref: 290 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.679644:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155638.679646:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155638.679648:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092872e00, rc 0) 00000100:00100000:1.0:1746155638.679671:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32184:x1830976125853056:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7134us (7269us total) trans 8589945198 rc 0/0 00000100:00100000:1.0:1746155638.679676:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11052 00010000:00010000:3.0:1746155638.679976:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7400/0x844e5faceb5f700c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:3.0:1746155638.679985:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155638.680034:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6200/0x844e5faceb5f6ffe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680040:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6200/0x844e5faceb5f6ffe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680050:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6200/0x844e5faceb5f6ffe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680054:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01d6200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155638.680057:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6200/0x844e5faceb5f6ffe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680063:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6200/0x844e5faceb5f6ffe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680075:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155638.680077:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155638.680079:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6200/0x844e5faceb5f6ffe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680083:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6200/0x844e5faceb5f6ffe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680106:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6600/0x844e5faceb5f7005 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680110:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6600/0x844e5faceb5f7005 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680114:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6600/0x844e5faceb5f7005 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680118:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a01d6600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155638.680120:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6600/0x844e5faceb5f7005 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680125:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6600/0x844e5faceb5f7005 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680134:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c823a00) 00010000:00010000:3.0:1746155638.680136:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155638.680138:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6600/0x844e5faceb5f7005 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680142:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6600/0x844e5faceb5f7005 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.680167:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5f6ff7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a7d expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.680177:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7400/0x844e5faceb5f700c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a7d expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.680182:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.680183:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155638.680185:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01d7400, rc 0) 00000100:00100000:3.0:1746155638.680204:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32190:x1830976125853696:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2016us (2492us total) trans 8589945199 rc 0/0 00000100:00100000:3.0:1746155638.680209:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11053 00000100:00100000:2.0:1746155638.680337:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff68e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125317248:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.680355:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc67400/0x844e5faceb5f6ff0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a76 expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.680366:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc67400, rc 0) 00000100:00100000:2.0:1746155638.680387:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32189:x1830976125853184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3520us (5193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.680393:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16677 00000100:00100000:1.0:1746155638.680663:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.680759:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125853824 00000100:00100000:0.0:1746155638.680764:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125853824 00010000:00010000:0.0:1746155638.680780:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f6f64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a30 expref: 11 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.680922:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8549 00000100:00100000:0.0:1746155638.680929:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125853824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155638.680939:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155638.680963:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f6f64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a30 expref: 11 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746155638.680971:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f6f64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a30 expref: 11 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746155638.680984:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f6f64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a30 expref: 11 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:0.0:1746155638.680993:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155638.680994:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155638.680999:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc67400/0x844e5faceb5f6ff0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a76 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.681006:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc67400/0x844e5faceb5f6ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a76 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.681026:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc67400/0x844e5faceb5f6ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a76 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155638.681036:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e37480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125317376:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155638.681767:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.683005:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.683049:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125853952 00000100:00100000:2.0:1746155638.683055:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125853952 00000100:00100000:2.0:1746155638.683120:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16678 00000100:00100000:2.0:1746155638.683127:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+5:32190:x1830976125853952:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.683143:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.683156:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f7021 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a84 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.683174:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.683175:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.683179:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f7021 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a84 expref: 6 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.683190:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f7021 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a84 expref: 6 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.683198:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc66400, rc 0) 00000100:00100000:2.0:1746155638.683239:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32190:x1830976125853952:12345-192.168.202.51@tcp:101:cat.0 Request processed in 112us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.683244:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16678 00000100:00100000:2.0:1746155638.684138:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e37480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125317376:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155638.684153:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.684187:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125853824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3257us (3686us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.684194:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8549 00000100:00100000:0.0:1746155638.687686:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.688914:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.688964:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125854208 00000100:00100000:3.0:1746155638.688972:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125854208 00002000:00100000:3.0:1746155638.689008:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880094e36680 x1830976125854208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.689017:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36680 with x1830976125854208 ext(0->1048575) 00002000:00010000:3.0:1746155638.689022:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36680 00000100:00100000:3.0:1746155638.689049:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7889 00000100:00100000:3.0:1746155638.689055:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1961:x1830976125854208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155638.690275:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125854336 00000100:00100000:2.0:1746155638.690280:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125854336 00000100:00100000:2.0:1746155638.690306:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11054 00000100:00100000:2.0:1746155638.690312:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32184:x1830976125854336:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155638.690325:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.690341:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67200/0x844e5faceb5f7028 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a8b expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.690384:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67200/0x844e5faceb5f7028 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a8b expref: 291 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.690395:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67200/0x844e5faceb5f7028 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a8b expref: 291 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.690410:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155638.690413:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155638.690416:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc67200, rc 0) 00000100:00100000:2.0:1746155638.690438:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32184:x1830976125854336:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 126us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.690443:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11054 00000100:00100000:3.0:1746155638.695762:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1961:x1830976125854208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6698us (8074us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.697187:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7889 00002000:00100000:3.0:1746155638.697203:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880094e36680 x1830976125854208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.697212:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36680 with x1830976125854208 ext(0->1048575) 00002000:00010000:3.0:1746155638.697217:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36680 00000100:00100000:0.0:1746155638.698137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.698176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.698407:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125854464 00000100:00100000:1.0:1746155638.698414:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125854464 00000100:00100000:1.0:1746155638.698633:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125854720 00000100:00100000:1.0:1746155638.698636:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125854720 00000100:00100000:2.0:1746155638.698718:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11055 00000100:00100000:2.0:1746155638.698727:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32189:x1830976125854464:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.698744:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.698761:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f702f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a92 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.698815:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f702f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a92 expref: 293 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.698827:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f702f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a92 expref: 293 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.698840:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155638.698843:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155638.698846:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc67e00, rc 0) 00000100:00100000:2.0:1746155638.698890:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32189:x1830976125854464:12345-192.168.202.51@tcp:101:cat.0 Request processed in 165us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.698895:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11055 00000100:00100000:2.0:1746155638.698908:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11056 00000100:00100000:2.0:1746155638.698912:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdd0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32184:x1830976125854720:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155638.698918:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.698920:0:14234:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746155638.698932:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67200/0x844e5faceb5f7028 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a8b expref: 292 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.698955:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155638.698958:0:14234:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155638.698964:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5f7036 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17a99 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.698988:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.698996:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6f95 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a5a expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.699001:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f702f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a92 expref: 292 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.699007:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7400/0x844e5faceb5f700c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a7d expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.699015:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 6/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.699039:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7400/0x844e5faceb5f700c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a7d expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.699048:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7400/0x844e5faceb5f700c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a7d expref: 8 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.699058:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125317504:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.699110:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f702f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a92 expref: 292 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.699116:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f702f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a92 expref: 292 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.699123:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff68000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125317632:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.699145:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6f95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a5a expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.699152:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6f95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a5a expref: 7 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.699158:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff68380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125317760:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.699172:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1103c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.704297:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.704762:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff68e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125317504:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.704775:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff68000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125317632:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.704783:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff68380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125317760:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.704809:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155638.704929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.704955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.704984:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.705397:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125854848 00000100:00100000:0.0:1746155638.705402:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125854848 00010000:00010000:0.0:1746155638.705428:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6f95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a5a expref: 8 pid: 15474 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.706454:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125855104 00000100:00100000:0.0:1746155638.706458:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125855104 00010000:00010000:0.0:1746155638.706475:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f702f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a92 expref: 293 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.706500:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125854976 00000100:00100000:3.0:1746155638.706522:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125854976 00010000:00010000:3.0:1746155638.706536:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7400/0x844e5faceb5f700c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a7d expref: 9 pid: 14234 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.706557:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8550 00000100:00100000:3.0:1746155638.706564:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976125854848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155638.706576:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155638.706581:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6f95 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a5a expref: 8 pid: 15474 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.706590:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6f95 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a5a expref: 8 pid: 15474 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.706609:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f6f95 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a5a expref: 8 pid: 15474 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.706627:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.706632:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.706639:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.706644:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155638.706686:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976125854848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 122us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.706692:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8550 00000100:00100000:3.0:1746155638.706708:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8551 00000100:00100000:3.0:1746155638.706713:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1963:x1830976125855104:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155638.706719:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155638.706722:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f702f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a92 expref: 293 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.706728:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f702f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a92 expref: 293 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.706739:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67e00/0x844e5faceb5f702f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a92 expref: 293 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.706747:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.706750:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.706754:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.706758:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155638.706773:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:1963:x1830976125855104:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 60us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.706778:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8551 00000100:00100000:3.0:1746155638.706788:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8552 00000100:00100000:3.0:1746155638.706793:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125854976:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155638.706799:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155638.706802:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7400/0x844e5faceb5f700c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a7d expref: 9 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.706810:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7400/0x844e5faceb5f700c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a7d expref: 9 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.706819:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7400/0x844e5faceb5f700c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a7d expref: 9 pid: 14234 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.706826:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.706828:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.706834:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.706839:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.706856:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155638.706872:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976125854976:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 78us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.706877:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8552 00000100:00100000:3.0:1746155638.706897:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125855232 00000100:00100000:3.0:1746155638.706901:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125855232 00000100:00100000:3.0:1746155638.706920:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11057 00000100:00100000:3.0:1746155638.706926:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32189:x1830976125855232:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155638.706940:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.706961:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17aa0 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.706999:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.707006:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.707017:0:27374:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.707025:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.707034:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.707036:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155638.707039:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.707044:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01d6800, rc 0) 00000100:00100000:3.0:1746155638.707059:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32189:x1830976125855232:12345-192.168.202.51@tcp:101:cat.0 Request processed in 134us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.707064:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11057 00010000:00010000:3.0:1746155638.707080:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155638.707086:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00000040:00080000:3.0:1746155638.707616:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3535, 88 off297992 00000004:00080000:3.0:1746155638.707622:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767857118401ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155638.707690:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3545, 88 off299136 00000004:00080000:3.0:1746155638.707694:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767857190953ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155638.707706:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3546, 88 off299224 00000004:00080000:3.0:1746155638.707708:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767857205513ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155638.707715:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3536, 88 off298080 00000004:00080000:3.0:1746155638.707718:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767857214951ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155638.707728:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3537, 88 off298168 00000004:00080000:3.0:1746155638.707731:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767857227656ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155638.707739:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3547, 88 off299312 00000004:00080000:3.0:1746155638.707741:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767857238261ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155638.707747:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3548, 88 off299400 00000004:00080000:3.0:1746155638.707749:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767857246241ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155638.707755:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3549, 88 off299488 00000004:00080000:3.0:1746155638.707757:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767857254110ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155638.707763:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3538, 88 off298256 00000004:00080000:3.0:1746155638.707765:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767857261871ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155638.707775:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3550, 88 off299576 00000004:00080000:3.0:1746155638.707778:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767857274815ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155638.707784:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3539, 88 off298344 00000004:00080000:3.0:1746155638.707787:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767857283893ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155638.707797:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3551, 88 off299664 00000004:00080000:3.0:1746155638.707800:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767857296863ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155638.707806:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3540, 88 off298432 00000004:00080000:3.0:1746155638.707808:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767857305263ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155638.707817:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3541, 88 off298520 00000004:00080000:3.0:1746155638.707819:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767857316526ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155638.707827:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3542, 88 off298608 00000004:00080000:3.0:1746155638.707830:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767857326789ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155638.707839:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3543, 88 off298696 00000004:00080000:3.0:1746155638.707841:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 767857337930ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155638.707849:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3552, 88 off299752 00000004:00080000:3.0:1746155638.707853:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 767857349963ns, next at 716011101328ns, rc = 0 00000100:00100000:1.0:1746155638.710126:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.710280:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125855360 00000100:00100000:0.0:1746155638.710309:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125855360 00000100:00100000:0.0:1746155638.710431:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16679 00000100:00100000:0.0:1746155638.710437:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32190:x1830976125855360:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155638.710450:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155638.710463:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131447200/0x844e5faceb5f704b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17aa7 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.710489:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f6f6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a37 expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.710496:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155638.710498:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155638.710501:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131447200/0x844e5faceb5f704b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa7 expref: 12 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.710540:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f6f6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a37 expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.710550:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f6f6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a37 expref: 11 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.710560:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125317888:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155638.712677:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.716224:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.716917:0:14232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125855488 00000100:00100000:1.0:1746155638.716925:0:14232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125855488 00000100:00100000:0.0:1746155638.717340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.717388:0:14232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11058 00000100:00100000:1.0:1746155638.717397:0:14232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32185:x1830976125855488:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155638.717417:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155638.717433:0:14232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17aae expref: -99 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.717484:0:14232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aae expref: 9 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.717498:0:14232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aae expref: 9 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.717523:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155638.717525:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155638.717529:0:14232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.717535:0:14232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd0e600, rc 0) 00000100:00100000:1.0:1746155638.717571:0:14232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32185:x1830976125855488:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 177us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.717577:0:14232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11058 00000100:00100000:1.0:1746155638.717660:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125317888:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.717680:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131447200/0x844e5faceb5f704b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa7 expref: 12 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.717692:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131447200, rc 0) 00000100:00100000:1.0:1746155638.717711:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32190:x1830976125855360:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7274us (7593us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.717716:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16679 00000100:00100000:2.0:1746155638.717757:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125855616 00000100:00100000:2.0:1746155638.717761:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125855616 00010000:00010000:2.0:1746155638.718451:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f6f6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a37 expref: 12 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.718479:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8553 00000100:00100000:2.0:1746155638.718485:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125855616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.718492:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.718521:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f6f6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a37 expref: 12 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.718530:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f6f6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a37 expref: 12 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.718545:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f6f6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a37 expref: 12 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.719135:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.719137:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.719144:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131447200/0x844e5faceb5f704b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa7 expref: 11 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.719156:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131447200/0x844e5faceb5f704b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa7 expref: 11 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.719185:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131447200/0x844e5faceb5f704b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa7 expref: 11 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.719197:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125318016:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155638.719240:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43cef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.723690:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff68380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125318016:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155638.723750:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155638.723797:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125855616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5310us (6456us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155638.723806:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8553 00000001:00080000:0.0:1746155638.729260:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945198 is committed 00000001:00080000:0.0:1746155638.729276:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945195 is committed 00000001:00080000:0.0:1746155638.729280:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945200 is committed 00000004:00080000:0.0:1746155638.729283:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2737 committed 00000004:00080000:0.0:1746155638.729289:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2722 committed 00000004:00080000:0.0:1746155638.729293:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2721 committed 00000004:00080000:0.0:1746155638.729294:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2720 committed 00000004:00080000:0.0:1746155638.729296:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2719 committed 00000004:00080000:0.0:1746155638.729297:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2736 committed 00000004:00080000:0.0:1746155638.729298:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2718 committed 00000004:00080000:0.0:1746155638.729300:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2735 committed 00000004:00080000:0.0:1746155638.729302:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2717 committed 00000004:00080000:0.0:1746155638.729303:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2734 committed 00000004:00080000:0.0:1746155638.729305:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2733 committed 00000004:00080000:0.0:1746155638.729306:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2732 committed 00000004:00080000:0.0:1746155638.729308:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2716 committed 00000004:00080000:0.0:1746155638.729309:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2715 committed 00000004:00080000:0.0:1746155638.729310:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2731 committed 00000004:00080000:0.0:1746155638.729311:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2730 committed 00000004:00080000:0.0:1746155638.729313:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2714 committed 00000001:00080000:0.0:1746155638.729316:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945199 is committed 00000001:00080000:0.0:1746155638.729320:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945194 is committed 00010000:00010000:3.0:1746155638.729372:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a99 expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.729384:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155638.729386:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746155638.729390:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.729398:0:14234:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.729404:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.729410:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aae expref: 6 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.729416:0:14234:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aae expref: 6 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.729422:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aae expref: 6 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.729447:0:14234:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aae expref: 6 pid: 14232 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.729458:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125318144:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155638.729542:0:14234:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.729549:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125318272:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155638.729566:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.729667:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125318400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.729699:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.729717:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125318912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.729729:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.729742:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746155638.729746:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125318528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.729757:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.729765:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125319040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.729775:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.729792:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125318784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.729804:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.729813:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125319296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.729823:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.729832:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746155638.729836:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125318656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.729847:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.729855:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125319168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.729869:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.729886:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125318400 00000100:00100000:0.0:1746155638.729891:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125318400 00000100:00100000:0.0:1746155638.729914:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125318912 00000100:00100000:0.0:1746155638.729916:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125318912 00000100:00100000:0.0:1746155638.729925:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125318528 00000100:00100000:0.0:1746155638.729926:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125318528 00000100:00100000:0.0:1746155638.729934:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125319040 00000100:00100000:0.0:1746155638.729936:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125319040 00000100:00100000:0.0:1746155638.729957:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125318784 00000100:00100000:0.0:1746155638.729959:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125318784 00000100:00100000:0.0:1746155638.729966:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125319296 00000100:00100000:0.0:1746155638.729968:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125319296 00000100:00100000:0.0:1746155638.729974:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125318656 00000100:00100000:0.0:1746155638.729975:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125318656 00000100:00100000:0.0:1746155638.729981:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125319168 00000100:00100000:0.0:1746155638.729982:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125319168 00000100:00100000:0.0:1746155638.729991:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16680 00000100:00100000:0.0:1746155638.729997:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976125318400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155638.730134:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155638.730137:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:0.0:1746155638.730139:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:0.0:1746155638.730140:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155639 -> 1746155639 00002000:00010000:0.0:1746155638.730142:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155638.730166:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976125318400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 169us (467us total) trans 21474841517 rc 0/0 00000100:00100000:0.0:1746155638.730171:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16680 00000100:00100000:0.0:1746155638.730185:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16681 00000100:00100000:0.0:1746155638.730189:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976125318912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155638.730257:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:0.0:1746155638.730260:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155638.730261:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155638.730263:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155638.730264:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155638.730281:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976125318912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (551us total) trans 21474841518 rc 0/0 00000100:00100000:0.0:1746155638.730287:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16681 00000100:00100000:0.0:1746155638.730295:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16682 00000100:00100000:0.0:1746155638.730299:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976125318528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155638.730358:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155638.730360:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:0.0:1746155638.730362:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:0.0:1746155638.730363:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155639 -> 1746155639 00002000:00010000:0.0:1746155638.730365:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:0.0:1746155638.730380:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976125318528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (622us total) trans 21474841519 rc 0/0 00000100:00100000:0.0:1746155638.730384:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16682 00000100:00100000:0.0:1746155638.730393:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16683 00000100:00100000:0.0:1746155638.730398:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976125319040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.730464:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976125319040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (686us total) trans 21474841520 rc 0/0 00000100:00100000:0.0:1746155638.730468:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16683 00000100:00100000:0.0:1746155638.730477:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16684 00000100:00100000:0.0:1746155638.730481:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3296:x1830976125318784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.730578:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976125318784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (772us total) trans 21474841521 rc 0/0 00000100:00100000:0.0:1746155638.730583:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16684 00000100:00100000:0.0:1746155638.730591:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16685 00000100:00100000:0.0:1746155638.730595:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3296:x1830976125319296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.730658:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976125319296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (833us total) trans 21474841522 rc 0/0 00000100:00100000:0.0:1746155638.730663:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16685 00000100:00100000:0.0:1746155638.730675:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16686 00000100:00100000:0.0:1746155638.730679:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3296:x1830976125318656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155638.730735:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155638.730737:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:0.0:1746155638.730739:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:0.0:1746155638.730741:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155639 -> 1746155639 00002000:00010000:0.0:1746155638.730743:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155638.730758:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976125318656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (910us total) trans 21474841523 rc 0/0 00000100:00100000:0.0:1746155638.730762:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16686 00000100:00100000:0.0:1746155638.730771:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16687 00000100:00100000:0.0:1746155638.730775:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+28:3296:x1830976125319168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.730836:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976125319168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (965us total) trans 21474841524 rc 0/0 00000100:00100000:0.0:1746155638.730840:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16687 00000004:00080000:0.0:1746155638.730961:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e37100/2, rc 0, transno 21474841523 00000100:00100000:0.0:1746155638.730967:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125318656:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155638.730979:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009045e300/2, rc 0, transno 21474841524 00000100:00100000:0.0:1746155638.730981:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125319168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155638.730987:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e37480/2, rc 0, transno 21474841521 00000100:00100000:0.0:1746155638.730989:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125318784:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155638.730993:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009045c000/2, rc 0, transno 21474841522 00000100:00100000:0.0:1746155638.730995:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125319296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155638.731009:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e34000/2, rc 0, transno 21474841519 00000100:00100000:0.0:1746155638.731012:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125318528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155638.731017:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009045c700/2, rc 0, transno 21474841520 00000100:00100000:0.0:1746155638.731019:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125319040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155638.731024:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e36300/2, rc 0, transno 21474841517 00000100:00100000:0.0:1746155638.731026:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125318400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155638.731031:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009045fb80/2, rc 0, transno 21474841518 00000100:00100000:0.0:1746155638.731033:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125318912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155638.731038:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125319424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.731055:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.731067:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746155638.731071:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125319552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.731082:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.731090:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125319424 00000100:00100000:0.0:1746155638.731091:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125319936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.731094:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125319424 00000100:00100000:0.0:1746155638.731101:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.731109:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125319552 00000100:00100000:0.0:1746155638.731109:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746155638.731111:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125319552 00000100:00100000:0.0:1746155638.731112:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125320064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.731117:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125319936 00000100:00100000:2.0:1746155638.731119:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125319936 00000100:00100000:0.0:1746155638.731122:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155638.731124:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125320064 00000100:00100000:2.0:1746155638.731126:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125320064 00000100:00100000:2.0:1746155638.731132:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16688 00000100:00100000:0.0:1746155638.731135:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16689 00000100:00100000:2.0:1746155638.731136:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3297:x1830976125319424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.731139:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3297:x1830976125319552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.731174:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16690 00000100:00100000:0.0:1746155638.731178:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3297:x1830976125319936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155638.731226:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155638.731229:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:2.0:1746155638.731231:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:2.0:1746155638.731232:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155639 -> 1746155639 00002000:00010000:2.0:1746155638.731234:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:0.0:1746155638.731243:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976125319936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (140us total) trans 17179874192 rc 0/0 00000100:00100000:0.0:1746155638.731248:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16690 00000100:00100000:2.0:1746155638.731249:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976125319424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (194us total) trans 17179874191 rc 0/0 00000100:00100000:2.0:1746155638.731253:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16688 00000100:00100000:0.0:1746155638.731257:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16691 00000100:00100000:0.0:1746155638.731261:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3297:x1830976125320064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.731320:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3297:x1830976125320064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (196us total) trans 17179874193 rc 0/0 00000100:00100000:0.0:1746155638.731324:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16691 00002000:00010000:0.0:1746155638.731376:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155638.731378:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:0.0:1746155638.731379:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:0.0:1746155638.731381:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155639 -> 1746155639 00002000:00010000:0.0:1746155638.731382:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155638.731398:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3297:x1830976125319552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 259us (315us total) trans 17179874194 rc 0/0 00000100:00100000:0.0:1746155638.731402:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16689 00000100:00100000:0.0:1746155638.731414:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125319808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.731426:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.731436:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125320320:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.731448:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155638.731456:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125319808 00000100:00100000:0.0:1746155638.731456:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746155638.731459:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125319808 00000100:00100000:0.0:1746155638.731460:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125319680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.731470:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155638.731472:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16692 00000100:00100000:1.0:1746155638.731477:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3296:x1830976125319808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.731492:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125320192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.731520:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.731534:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125320320 00000100:00100000:0.0:1746155638.731537:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125320320 00000100:00100000:0.0:1746155638.731547:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125319680 00000100:00100000:0.0:1746155638.731549:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125319680 00000100:00100000:0.0:1746155638.731555:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125320192 00000100:00100000:0.0:1746155638.731557:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125320192 00000100:00100000:0.0:1746155638.731562:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16693 00000100:00100000:0.0:1746155638.731566:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976125320320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155638.731574:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976125319808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (146us total) trans 17179874195 rc 0/0 00000100:00100000:1.0:1746155638.731580:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16692 00000100:00100000:1.0:1746155638.731589:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16694 00000100:00100000:1.0:1746155638.731593:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3296:x1830976125319680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155638.731632:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976125320320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (183us total) trans 17179874196 rc 0/0 00000100:00100000:0.0:1746155638.731637:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16693 00000100:00100000:0.0:1746155638.731645:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16695 00000100:00100000:0.0:1746155638.731648:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976125320192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155638.731650:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:1.0:1746155638.731652:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155638 -> 1746155638 00002000:00010000:1.0:1746155638.731654:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155638 -> 1746155638 00002000:00010000:1.0:1746155638.731656:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155639 -> 1746155639 00002000:00010000:1.0:1746155638.731657:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:1.0:1746155638.731673:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976125319680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (202us total) trans 17179874197 rc 0/0 00000100:00100000:1.0:1746155638.731678:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16694 00000100:00100000:0.0:1746155638.731714:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976125320192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (193us total) trans 17179874198 rc 0/0 00000100:00100000:0.0:1746155638.731719:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16695 00000004:00080000:0.0:1746155638.731738:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff69880/2, rc 0, transno 17179874193 00000100:00100000:0.0:1746155638.731743:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125320064:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155638.731749:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6b100/2, rc 0, transno 17179874192 00000100:00100000:0.0:1746155638.731752:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125319936:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155638.731757:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff68e00/2, rc 0, transno 17179874194 00000100:00100000:0.0:1746155638.731759:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125319552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.731763:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:0.0:1746155638.731764:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff68000/2, rc 0, transno 17179874191 00000100:00100000:0.0:1746155638.731766:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125319424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.731768:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125320448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155638.731776:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff69f80/2, rc 0, transno 17179874197 00000100:00100000:0.0:1746155638.731778:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125319680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155638.731783:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff69c00/2, rc 0, transno 17179874198 00000100:00100000:2.0:1746155638.731785:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155638.731785:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125320192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155638.731790:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6ad80/2, rc 0, transno 17179874195 00000100:00100000:0.0:1746155638.731792:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125319808:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155638.731797:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff68a80/2, rc 0, transno 17179874196 00000100:00100000:2.0:1746155638.731798:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125320448 00000100:00100000:0.0:1746155638.731799:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125320320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.731800:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125320448 00000100:00100000:2.0:1746155638.731811:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16696 00000100:00100000:2.0:1746155638.731816:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3298:x1830976125320448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155638.731891:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3298:x1830976125320448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (105us total) trans 17179874199 rc 0/0 00000100:00100000:2.0:1746155638.731895:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16696 00000004:00080000:0.0:1746155638.733321:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ff6a300/2, rc 0, transno 17179874199 00000100:00100000:0.0:1746155638.733326:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125320448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155638.735211:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125318144:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155638.735220:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.735221:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125318272:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155638.735254:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094d7e400/0x844e5faceb5f7036 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a99 expref: 290 pid: 14234 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746155638.735269:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a99 expref: 289 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.735294:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095182000, rc 0) 00000100:00100000:3.0:1746155638.736414:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdd0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32184:x1830976125854720:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 37498us (38234us total) trans 8589945200 rc 0/0 00000100:00100000:3.0:1746155638.736422:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11056 00000100:00100000:0.0:1746155638.736521:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.736597:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125855872 00000100:00100000:2.0:1746155638.736603:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125855872 00000100:00100000:2.0:1746155638.736631:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4678 00000100:00100000:2.0:1746155638.736637:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32189:x1830976125855872:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:2.0:1746155638.736938:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32189:x1830976125855872:12345-192.168.202.51@tcp:49:cat.0 Request processed in 299us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.736952:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4678 00000100:00100000:1.0:1746155638.737019:0:14232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125855744 00000100:00100000:1.0:1746155638.737023:0:14232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125855744 00000100:00100000:1.0:1746155638.737044:0:14232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11059 00000100:00100000:1.0:1746155638.737049:0:14232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32190:x1830976125855744:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155638.737057:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155638.737069:0:14232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e200/0x844e5faceb5f7059 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ab5 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.737101:0:14232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e200/0x844e5faceb5f7059 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ab5 expref: 8 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.737110:0:14232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e200/0x844e5faceb5f7059 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ab5 expref: 8 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.737121:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155638.737124:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155638.737127:0:14232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd0e200, rc 0) 00000100:00100000:1.0:1746155638.737142:0:14232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32190:x1830976125855744:12345-192.168.202.51@tcp:101:cat.0 Request processed in 93us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.737147:0:14232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11059 00000100:00100000:0.0:1746155638.737679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.737692:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125856000 00000100:00100000:3.0:1746155638.737696:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125856000 00000100:00100000:3.0:1746155638.737712:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4679 00000100:00100000:3.0:1746155638.737717:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32185:x1830976125856000:12345-192.168.202.51@tcp:49:multiop.0 00000100:00100000:3.0:1746155638.737797:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32185:x1830976125856000:12345-192.168.202.51@tcp:49:multiop.0 Request processed in 79us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.737802:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4679 00000100:00100000:1.0:1746155638.740254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.740307:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125856128 00000100:00100000:0.0:1746155638.740313:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125856128 00000100:00100000:0.0:1746155638.740350:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 742 00000100:00100000:0.0:1746155638.740355:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976125856128:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155638.740363:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155638.740382:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e200/0x844e5faceb5f7059 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ab5 expref: 8 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.740394:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155638.740397:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155638.740432:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976125856128:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 77us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155638.740437:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 742 00000100:00100000:0.0:1746155638.742106:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.742202:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125856384 00000100:00100000:3.0:1746155638.742208:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125856384 00002000:00100000:3.0:1746155638.742236:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009045ce00 x1830976125856384/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.742246:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045ce00 with x1830976125856384 ext(0->1048575) 00002000:00010000:3.0:1746155638.742250:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045ce00 00000100:00100000:3.0:1746155638.742265:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7890 00000100:00100000:3.0:1746155638.742270:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976125856384:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155638.744545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.744595:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.744660:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125856768 00000100:00100000:2.0:1746155638.744660:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125856640 00000100:00100000:3.0:1746155638.744666:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125856768 00000100:00100000:2.0:1746155638.744666:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125856640 00002000:00100000:2.0:1746155638.744691:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009045ea00 x1830976125856640/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155638.744693:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16697 00000100:00100000:3.0:1746155638.744698:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32185:x1830976125856768:12345-192.168.202.51@tcp:101:multiop.0 00002000:00100000:2.0:1746155638.744699:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045ea00 with x1830976125856640 ext(1048576->2097151) 00002000:00010000:2.0:1746155638.744703:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009045ea00 00010000:00010000:3.0:1746155638.744707:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155638.744712:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7891 00000100:00100000:2.0:1746155638.744716:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125856640:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:3.0:1746155638.744720:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17abc expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.744737:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f6f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a45 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.744742:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155638.744745:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155638.744747:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1515520->1990655] (req 1515520->1990655) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.744768:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f6f79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a45 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.744778:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f6f79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a45 expref: 9 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.744786:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125320576:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.744825:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155638.752333:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976125856384:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10053us (10220us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.752342:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7890 00002000:00100000:3.0:1746155638.752352:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009045ce00 x1830976125856384/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.752360:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045ce00 with x1830976125856384 ext(0->1048575) 00002000:00010000:3.0:1746155638.752364:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045ce00 00000100:00100000:0.0:1746155638.753664:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.754588:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125320576:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.754612:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1515520->1990655] (req 1515520->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 7 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.754625:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19800, rc 0) 00000100:00100000:2.0:1746155638.754653:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32185:x1830976125856768:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 9955us (10058us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.754659:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16697 00000100:00100000:1.0:1746155638.757289:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125856896 00000100:00100000:1.0:1746155638.757300:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125856896 00010000:00010000:1.0:1746155638.757332:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f6f79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a45 expref: 10 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.757358:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8554 00000100:00100000:1.0:1746155638.757364:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125856896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.757374:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.757392:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f6f79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a45 expref: 10 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.757402:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f6f79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a45 expref: 10 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.757423:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f6f79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a45 expref: 10 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.757454:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.757455:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.757461:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 6 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.757473:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 6 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.757500:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 6 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155638.757536:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125320704:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155638.757593:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155638.758130:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125856640:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13412us (13589us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155638.758138:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7891 00002000:00100000:2.0:1746155638.758146:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009045ea00 x1830976125856640/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.758154:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045ea00 with x1830976125856640 ext(1048576->2097151) 00002000:00010000:2.0:1746155638.758157:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009045ea00 00000100:00100000:0.0:1746155638.761748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.761917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.762345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.762551:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125857024 00000100:00100000:2.0:1746155638.762559:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125857024 00000100:00100000:2.0:1746155638.762592:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125857152 00000100:00100000:2.0:1746155638.762594:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125857152 00000100:00100000:2.0:1746155638.762615:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16698 00000100:00100000:2.0:1746155638.762622:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:32189:x1830976125857024:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.762637:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.762652:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a230c00/0x844e5faceb5f7067 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ac3 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.762673:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.762675:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.762683:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a230c00/0x844e5faceb5f7067 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ac3 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.762695:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a230c00/0x844e5faceb5f7067 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ac3 expref: 13 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.762703:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a230c00, rc 0) 00000100:00100000:2.0:1746155638.762740:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:32189:x1830976125857024:12345-192.168.202.51@tcp:101:cat.0 Request processed in 119us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.762746:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16698 00000100:00100000:2.0:1746155638.762758:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16699 00000100:00100000:2.0:1746155638.762763:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32184:x1830976125857152:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155638.762768:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.762775:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17aca expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.762789:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc67400/0x844e5faceb5f6ff0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a76 expref: 25 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.762797:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f7021 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a84 expref: 6 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.762803:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.762804:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.762807:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [593920->753663] (req 593920->753663) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.762829:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f7021 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a84 expref: 6 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.762840:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f7021 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a84 expref: 6 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.762851:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125320832:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.762906:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc67400/0x844e5faceb5f6ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a76 expref: 25 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.762914:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc67400/0x844e5faceb5f6ff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a76 expref: 25 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.762922:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125320960:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155638.762937:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155638.762969:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125857408 00000100:00100000:2.0:1746155638.762972:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125857408 00002000:00100000:2.0:1746155638.762991:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1515520->1519615) req@ffff880094e36a00 x1830976125857408/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.763000:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36a00 with x1830976125857408 ext(1515520->1519615) 00002000:00010000:2.0:1746155638.763004:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36a00 00000100:00100000:1.0:1746155638.764044:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125320704:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155638.764056:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.764146:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7892 00000100:00100000:2.0:1746155638.764152:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976125857408:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155638.764294:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125856896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6929us (10633us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.764302:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8554 00000100:00100000:2.0:1746155638.764481:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976125857408:12345-192.168.202.51@tcp:3:cat.0 Request processed in 328us (2136us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155638.764488:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7892 00002000:00100000:2.0:1746155638.764495:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1515520->1519615) req@ffff880094e36a00 x1830976125857408/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/4536 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.764515:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36a00 with x1830976125857408 ext(1515520->1519615) 00002000:00010000:2.0:1746155638.764519:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36a00 00000100:00100000:2.0:1746155638.767021:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.767110:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125857536 00000100:00100000:3.0:1746155638.767117:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125857536 00000100:00100000:3.0:1746155638.767156:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16700 00000100:00100000:3.0:1746155638.767163:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32190:x1830976125857536:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155638.767175:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.767190:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f7075 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ad1 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.767217:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5f6f72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a3e expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.767224:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155638.767225:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155638.767228:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f7075 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad1 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.767251:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5f6f72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a3e expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.767260:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5f6f72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a3e expref: 10 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.767270:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125321088:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.767330:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.767419:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125320832:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155638.767427:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125320960:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155638.767450:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [593920->753663] (req 593920->753663) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.767460:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a231800, rc 0) 00000100:00100000:0.0:1746155638.767478:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32184:x1830976125857152:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4715us (5562us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155638.767484:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16699 00000100:00100000:0.0:1746155638.769639:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.769763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.769962:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125857792 00000100:00100000:2.0:1746155638.769968:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125857792 00010000:00010000:2.0:1746155638.769992:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc67400/0x844e5faceb5f6ff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a76 expref: 25 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.770012:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125857664 00000100:00100000:2.0:1746155638.770014:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125857664 00010000:00010000:2.0:1746155638.770023:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f7021 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a84 expref: 7 pid: 20796 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.770456:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8555 00000100:00100000:2.0:1746155638.770465:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125857792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.770475:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.770493:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc67400/0x844e5faceb5f6ff0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a76 expref: 25 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.770523:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc67400/0x844e5faceb5f6ff0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a76 expref: 25 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.770542:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc67400/0x844e5faceb5f6ff0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a76 expref: 25 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.770562:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155638.770592:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976125857792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 129us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.770598:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8555 00000100:00100000:2.0:1746155638.770610:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8556 00000100:00100000:2.0:1746155638.770615:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976125857664:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155638.770621:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155638.770627:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f7021 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a84 expref: 7 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.770635:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f7021 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a84 expref: 7 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.770644:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f7021 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a84 expref: 7 pid: 20796 timeout: 867 lvb_type: 0 00010000:00010000:2.0:1746155638.770651:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.770653:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.770658:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.770665:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.770689:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 23 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.770699:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125321216:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155638.770738:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155638.771279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.771460:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125858048 00000100:00100000:0.0:1746155638.771531:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125858048 00010000:00010000:0.0:1746155638.771590:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5f6f72 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a3e expref: 11 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.771671:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.771742:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff6bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125321216:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155638.771757:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.771775:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1961:x1830976125857664:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1159us (2012us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.771781:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8556 00000100:00100000:1.0:1746155638.771793:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8557 00000100:00100000:1.0:1746155638.771798:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125858048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.771807:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.771820:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5f6f72 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a3e expref: 11 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.771909:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5f6f72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a3e expref: 11 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.771923:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.771925:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.771928:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f7075 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad1 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.771934:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f7075 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad1 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.771962:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f7075 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad1 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155638.771970:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125321344:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155638.772000:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effa80 going to sleep for 11 seconds 00010000:00010000:2.0:1746155638.772255:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28c00/0x844e5faceb5f6f72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a3e expref: 11 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:2.0:1746155638.772265:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125321088:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155638.772281:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f7075 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad1 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.772289:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca18000, rc 0) 00000100:00100000:2.0:1746155638.772308:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32190:x1830976125857536:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5147us (5293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.772314:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16700 00000100:00100000:2.0:1746155638.772334:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125858176 00000100:00100000:2.0:1746155638.772337:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125858176 00002000:00100000:2.0:1746155638.772356:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f4fea00 x1830976125858176/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.772365:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fea00 with x1830976125858176 ext(1048576->2097151) 00002000:00010000:2.0:1746155638.772368:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fea00 00000100:00100000:2.0:1746155638.773042:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7893 00000100:00100000:2.0:1746155638.773050:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976125858176:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155638.777179:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.777338:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125858432 00000100:00100000:3.0:1746155638.777345:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125858432 00002000:00100000:3.0:1746155638.777377:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e1:0x0] (593920->598015) req@ffff880094e36d80 x1830976125858432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.777386:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36d80 with x1830976125858432 ext(593920->598015) 00002000:00010000:3.0:1746155638.777391:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36d80 00000100:00100000:3.0:1746155638.777418:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7894 00000100:00100000:3.0:1746155638.777425:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125858432:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155638.777587:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125858432:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 163us (415us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155638.777593:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7894 00002000:00100000:3.0:1746155638.777598:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e1:0x0] (593920->598015) req@ffff880094e36d80 x1830976125858432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/4536 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.777604:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36d80 with x1830976125858432 ext(593920->598015) 00002000:00010000:3.0:1746155638.777607:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36d80 00000100:00100000:1.0:1746155638.777717:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125321344:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155638.777732:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.777793:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125858048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5994us (6514us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.777804:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8557 00000100:00100000:0.0:1746155638.781094:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.781239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.782313:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.782581:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125858816 00000100:00100000:2.0:1746155638.782581:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125859072 00000100:00100000:3.0:1746155638.782588:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125858816 00000100:00100000:2.0:1746155638.782588:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125859072 00002000:00100000:3.0:1746155638.782617:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880094e35c00 x1830976125858816/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.782617:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1515519) req@ffff880094e35f80 x1830976125859072/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.782626:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35c00 with x1830976125858816 ext(1048576->2097151) 00002000:00100000:2.0:1746155638.782626:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35f80 with x1830976125859072 ext(1048576->1515519) 00002000:00010000:3.0:1746155638.782631:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e35c00 00002000:00010000:2.0:1746155638.782631:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35f80 00000100:00100000:3.0:1746155638.782642:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125859200 00000100:00100000:3.0:1746155638.782644:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125859200 00000100:00100000:2.0:1746155638.782645:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7895 00000100:00100000:2.0:1746155638.782651:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976125858816:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:3.0:1746155638.782653:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (749568->753663) req@ffff880094e35500 x1830976125859200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.782658:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35500 with x1830976125859200 ext(749568->753663) 00002000:00010000:3.0:1746155638.782660:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35500 00000100:00100000:3.0:1746155638.782674:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7896 00000100:00100000:3.0:1746155638.782678:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1962:x1830976125859072:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155638.782924:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7897 00000100:00100000:3.0:1746155638.782930:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125859200:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155638.783038:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125859200:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 108us (726us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155638.783047:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7897 00002000:00100000:3.0:1746155638.783051:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (749568->753663) req@ffff880094e35500 x1830976125859200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/4536 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.783057:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35500 with x1830976125859200 ext(749568->753663) 00002000:00010000:3.0:1746155638.783060:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35500 00000100:00100000:2.0:1746155638.784768:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976125858176:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 11715us (13093us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155638.784776:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7893 00002000:00100000:2.0:1746155638.784782:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f4fea00 x1830976125858176/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.784790:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fea00 with x1830976125858176 ext(1048576->2097151) 00002000:00010000:2.0:1746155638.784794:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fea00 00000100:00100000:0.0:1746155638.786131:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.786727:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125859456 00000100:00100000:2.0:1746155638.786734:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125859456 00002000:00100000:2.0:1746155638.786766:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1986560->1990655) req@ffff880094e34a80 x1830976125859456/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.786774:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e34a80 with x1830976125859456 ext(1986560->1990655) 00002000:00010000:2.0:1746155638.786778:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e34a80 00000100:00100000:2.0:1746155638.788638:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7898 00000100:00100000:2.0:1746155638.788650:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976125859456:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155638.788813:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976125859456:12345-192.168.202.51@tcp:3:cat.0 Request processed in 165us (2683us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155638.788819:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7898 00002000:00100000:2.0:1746155638.788826:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1986560->1990655) req@ffff880094e34a80 x1830976125859456/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/4536 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.788833:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e34a80 with x1830976125859456 ext(1986560->1990655) 00002000:00010000:2.0:1746155638.788839:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e34a80 00000100:00100000:3.0:1746155638.791629:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1962:x1830976125859072:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8941us (10381us total) trans 0 rc 466944/466944 00000100:00100000:3.0:1746155638.791640:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7896 00002000:00100000:3.0:1746155638.791648:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1515519) req@ffff880094e35f80 x1830976125859072/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 466944/466944 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.791656:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35f80 with x1830976125859072 ext(1048576->1515519) 00002000:00010000:3.0:1746155638.791661:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35f80 00000100:00100000:2.0:1746155638.794588:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976125858816:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11928us (13491us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155638.794598:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7895 00002000:00100000:2.0:1746155638.794608:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880094e35c00 x1830976125858816/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.794615:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35c00 with x1830976125858816 ext(1048576->2097151) 00002000:00010000:2.0:1746155638.794620:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e35c00 00000100:00100000:0.0:1746155638.794904:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.795064:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125859584 00000100:00100000:3.0:1746155638.795070:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125859584 00000100:00100000:0.0:1746155638.795076:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.795107:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16701 00000100:00100000:3.0:1746155638.795113:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:32189:x1830976125859584:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155638.795128:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.795144:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca18800/0x844e5faceb5f707c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ad8 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.795162:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.795163:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.795169:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca18800/0x844e5faceb5f707c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad8 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.795187:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca18800/0x844e5faceb5f707c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad8 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.795195:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca18800, rc 0) 00000100:00100000:3.0:1746155638.795210:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:32189:x1830976125859584:12345-192.168.202.51@tcp:101:cat.0 Request processed in 98us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.795214:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16701 00000100:00100000:1.0:1746155638.795384:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125859840 00000100:00100000:1.0:1746155638.795388:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125859840 00000100:00100000:1.0:1746155638.795418:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4680 00000100:00100000:1.0:1746155638.795422:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef10c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32185:x1830976125859840:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155638.795623:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef10c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32185:x1830976125859840:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 200us (546us total) trans 8589945201 rc 0/0 00000100:00100000:1.0:1746155638.795628:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4680 00000100:00100000:0.0:1746155638.798599:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.798644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.798700:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125860224 00000100:00100000:3.0:1746155638.798706:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125860224 00000100:00100000:2.0:1746155638.798730:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125860352 00000100:00100000:2.0:1746155638.798733:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125860352 00002000:00100000:3.0:1746155638.798739:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880094e34e00 x1830976125860224/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.798748:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e34e00 with x1830976125860224 ext(1048576->2097151) 00002000:00100000:2.0:1746155638.798748:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1990656->2097151) req@ffff880094e35880 x1830976125860352/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:3.0:1746155638.798752:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e34e00 00002000:00100000:2.0:1746155638.798753:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35880 with x1830976125860352 ext(1990656->2097151) 00002000:00010000:2.0:1746155638.798756:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35880 00000100:00100000:3.0:1746155638.798767:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7899 00000100:00100000:2.0:1746155638.798772:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7900 00000100:00100000:3.0:1746155638.798773:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976125860224:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155638.798776:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1962:x1830976125860352:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155638.803428:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1962:x1830976125860352:12345-192.168.202.51@tcp:3:cat.0 Request processed in 4642us (4775us total) trans 0 rc 106496/106496 00000100:00100000:3.0:1746155638.803438:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7900 00002000:00100000:3.0:1746155638.803447:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1990656->2097151) req@ffff880094e35880 x1830976125860352/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 106496/106496 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.803456:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35880 with x1830976125860352 ext(1990656->2097151) 00002000:00010000:3.0:1746155638.803461:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35880 00000100:00100000:2.0:1746155638.811552:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.811568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.811588:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.811745:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125860480 00000100:00100000:0.0:1746155638.811753:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125860480 00000100:00100000:0.0:1746155638.811781:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125860736 00000100:00100000:0.0:1746155638.811784:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125860736 00000100:00100000:0.0:1746155638.811793:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125860608 00000100:00100000:0.0:1746155638.811795:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125860608 00000100:00100000:0.0:1746155638.811807:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16702 00000100:00100000:3.0:1746155638.811812:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16703 00000100:00100000:0.0:1746155638.811813:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1962:x1830976125860480:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155638.811817:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976125860736:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155638.811825:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155638.811826:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.811838:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5f708a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17aed expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155638.811838:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fccd800/0x844e5faceb5f7083 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17adf expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.811873:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125321600:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155638.811873:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125321472:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155638.812053:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16704 00000100:00100000:2.0:1746155638.812060:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976125860608:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.812069:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.812075:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc68400/0x844e5faceb5f7091 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ae6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.812096:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125321728:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155638.812240:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.812246:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155638.812278:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29af00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155638.812585:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976125860224:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13811us (13992us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.812592:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7899 00002000:00100000:3.0:1746155638.812599:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880094e34e00 x1830976125860224/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.812607:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e34e00 with x1830976125860224 ext(1048576->2097151) 00002000:00010000:3.0:1746155638.812610:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e34e00 00010000:00010000:2.0:1746155638.815306:0:8437:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a4c expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.815322:0:10591:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a53 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.815332:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125321728:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155638.815335:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125321600:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155638.815354:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5f708a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aed expref: 14 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.815354:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc68400/0x844e5faceb5f7091 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ae6 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.815364:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19a00/0x844e5faceb5f708a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aed expref: 14 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.815364:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc68400/0x844e5faceb5f7091 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ae6 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.815374:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19a00, rc 0) 00010000:00010000:2.0:1746155638.815375:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc68400, rc 0) 00000100:00100000:3.0:1746155638.815402:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976125860736:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3583us (3832us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155638.815408:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16703 00002000:00010000:1.0:1746155638.815414:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime: 1746155638 -> 1746155639 00002000:00010000:1.0:1746155638.815417:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime: 1746155638 -> 1746155639 00000100:00100000:1.0:1746155638.815425:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125321472:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155638.815439:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fccd800/0x844e5faceb5f7083 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17adf expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155638.815447:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fccd800/0x844e5faceb5f7083 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17adf expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155638.815457:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fccd800, rc 0) 00000100:00100000:2.0:1746155638.815688:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1962:x1830976125860608:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3627us (4097us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155638.815693:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16704 00000100:00100000:1.0:1746155638.816222:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1962:x1830976125860480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4408us (4675us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155638.816227:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16702 00000100:00100000:0.0:1746155638.820971:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.821881:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125860864 00000100:00100000:1.0:1746155638.821888:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125860864 00000100:00100000:1.0:1746155638.821925:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16705 00000100:00100000:1.0:1746155638.821931:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32189:x1830976125860864:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155638.821954:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155638.821973:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c51aa00/0x844e5faceb5f7098 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17af4 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.821997:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 5 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.822009:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155638.822010:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155638.822013:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c51aa00/0x844e5faceb5f7098 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17af4 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.822037:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 5 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.822047:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 5 pid: 8436 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.822057:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125321856:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155638.822132:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.822290:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.822360:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125860992 00000100:00100000:3.0:1746155638.822364:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125860992 00000100:00100000:3.0:1746155638.822382:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16706 00000100:00100000:3.0:1746155638.822387:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32190:x1830976125860992:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155638.822393:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.822400:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0de000/0x844e5faceb5f709f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17afb expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.822412:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a4c expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.822418:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155638.822419:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155638.822421:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0de000/0x844e5faceb5f709f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17afb expref: 7 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.822436:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a4c expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.822443:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a4c expref: 8 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:3.0:1746155638.822450:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125321984:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.822485:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155638.825337:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125321856:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155638.825360:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c51aa00/0x844e5faceb5f7098 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17af4 expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.825374:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c51aa00, rc 0) 00000100:00100000:1.0:1746155638.825409:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32189:x1830976125860864:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3477us (4443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.825416:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16705 00000100:00100000:3.0:1746155638.825483:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125321984:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.825497:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f0de000/0x844e5faceb5f709f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17afb expref: 7 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.825523:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0de000, rc 0) 00000100:00100000:3.0:1746155638.825538:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32190:x1830976125860992:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3151us (3249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.825543:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16706 00000100:00100000:0.0:1746155638.825647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.825691:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.825790:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125861120 00000100:00100000:3.0:1746155638.825795:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125861120 00002000:00100000:3.0:1746155638.825820:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1515520->1990655) req@ffff880131494e00 x1830976125861120/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.825829:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494e00 with x1830976125861120 ext(1515520->1990655) 00010000:00010000:3.0:1746155638.825834:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 7 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.825843:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 7 pid: 8436 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746155638.825850:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131494e00 00000100:00100000:3.0:1746155638.825874:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1361 00000100:00100000:3.0:1746155638.825879:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976125861120:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155638.825937:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125861248 00000100:00100000:1.0:1746155638.825940:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125861248 00010000:00010000:1.0:1746155638.825961:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a4c expref: 9 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.825990:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8558 00000100:00100000:1.0:1746155638.825995:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125861248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.826002:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.826014:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a4c expref: 9 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.826022:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a4c expref: 9 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.826038:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29600/0x844e5faceb5f6f80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a4c expref: 9 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.826049:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.826051:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.826055:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0de000/0x844e5faceb5f709f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17afb expref: 7 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.826062:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0de000/0x844e5faceb5f709f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17afb expref: 7 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.826082:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0de000/0x844e5faceb5f709f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17afb expref: 7 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155638.826090:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125322112:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155638.826130:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155638.829984:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125322112:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155638.830001:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.830047:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125861248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4050us (4399us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.830056:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8558 00000100:00100000:0.0:1746155638.830628:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.831297:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125861504 00000100:00100000:2.0:1746155638.831304:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125861504 00002000:00100000:2.0:1746155638.831463:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880131497800 x1830976125861504/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.831471:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497800 with x1830976125861504 ext(2097152->3145727) 00002000:00010000:2.0:1746155638.831474:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131497800 00000100:00100000:2.0:1746155638.831522:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7901 00000100:00100000:2.0:1746155638.831529:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125861504:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155638.835904:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125861120:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10015us (10203us total) trans 17179874200 rc 0/0 00000100:00100000:3.0:1746155638.835916:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1361 00002000:00100000:3.0:1746155638.835927:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1515520->1990655) req@ffff880131494e00 x1830976125861120/t17179874200(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/448 e 0 to 0 dl 1746155649 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.835936:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494e00 with x1830976125861120 ext(1515520->1990655) 00010000:00010000:3.0:1746155638.835955:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 11 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:3.0:1746155638.835970:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 11 pid: 8436 timeout: 867 lvb_type: 0 00002000:00010000:3.0:1746155638.835977:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131494e00 00000100:00100000:2.0:1746155638.837832:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125861504:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6299us (7200us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155638.837839:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7901 00002000:00100000:2.0:1746155638.837846:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880131497800 x1830976125861504/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.837852:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497800 with x1830976125861504 ext(2097152->3145727) 00002000:00010000:2.0:1746155638.837856:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131497800 00000100:00100000:0.0:1746155638.839168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.840185:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125861632 00000100:00100000:1.0:1746155638.840193:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125861632 00010000:00010000:1.0:1746155638.840223:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 9 pid: 8436 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.840398:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8559 00000100:00100000:1.0:1746155638.840404:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125861632:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.840415:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746155638.840430:0:22680:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155638 -> 1746155639 00002000:00010000:1.0:1746155638.840433:0:22680:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155638 -> 1746155639 00010000:00010000:1.0:1746155638.840437:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 9 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.840447:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 9 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.840465:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca19800/0x844e5faceb5f7060 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1515520->1990655) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17abc expref: 9 pid: 8436 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.840887:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.840890:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.840896:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c51aa00/0x844e5faceb5f7098 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17af4 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.840903:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c51aa00/0x844e5faceb5f7098 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17af4 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.841108:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.841177:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125861760 00000100:00100000:3.0:1746155638.841181:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125861760 00000100:00100000:3.0:1746155638.841206:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16707 00000100:00100000:3.0:1746155638.841212:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32190:x1830976125861760:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155638.841219:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c51aa00/0x844e5faceb5f7098 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17af4 expref: 24 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.841222:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155638.841229:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125322240:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155638.841232:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ff00c00/0x844e5faceb5f70a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b02 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.841247:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a53 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.841252:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155638.841253:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155638.841255:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff00c00/0x844e5faceb5f70a6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b02 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.841269:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a53 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.841278:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a53 expref: 9 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.841280:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155638.841285:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125322368:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155638.841304:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155638.842446:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125322368:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155638.842464:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ff00c00/0x844e5faceb5f70a6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b02 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.842474:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff00c00, rc 0) 00000100:00100000:1.0:1746155638.842561:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125322240:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155638.842569:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155638.842646:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32190:x1830976125861760:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1434us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.842653:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16707 00000100:00100000:1.0:1746155638.842879:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976125861632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2474us (3713us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.842886:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8559 00000100:00100000:0.0:1746155638.844762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.844864:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125861888 00000100:00100000:1.0:1746155638.844870:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125861888 00010000:00010000:1.0:1746155638.844897:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a53 expref: 10 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:1.0:1746155638.844961:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8560 00000100:00100000:1.0:1746155638.844967:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125861888:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155638.844977:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155638.844994:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a53 expref: 10 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.845009:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a53 expref: 10 pid: 10591 timeout: 867 lvb_type: 0 00010000:00010000:1.0:1746155638.845028:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd28600/0x844e5faceb5f6f87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a53 expref: 10 pid: 10591 timeout: 867 lvb_type: 0 00000100:00100000:0.0:1746155638.845206:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155638.845260:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.845262:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155638.845268:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ff00c00/0x844e5faceb5f70a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b02 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.845275:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff00c00/0x844e5faceb5f70a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b02 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155638.845302:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008ff00c00/0x844e5faceb5f70a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b02 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155638.845313:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125322496:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155638.845538:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125862144 00000100:00100000:2.0:1746155638.845545:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125862144 00002000:00100000:2.0:1746155638.845568:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880131494a80 x1830976125862144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.845576:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494a80 with x1830976125862144 ext(1048576->2097151) 00002000:00010000:2.0:1746155638.845580:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494a80 00000100:00100000:2.0:1746155638.845674:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7902 00000100:00100000:2.0:1746155638.845678:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976125862144:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155638.845744:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155638.849597:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125322496:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155638.849614:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155638.849644:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125861888:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4676us (4885us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155638.849652:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8560 00000100:00100000:0.0:1746155638.853109:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.853167:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125862400 00000100:00100000:3.0:1746155638.853173:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125862400 00002000:00100000:3.0:1746155638.853205:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880131496d80 x1830976125862400/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.853213:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496d80 with x1830976125862400 ext(2097152->3145727) 00002000:00010000:3.0:1746155638.853217:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131496d80 00000100:00100000:1.0:1746155638.853633:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7903 00000100:00100000:1.0:1746155638.853641:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976125862400:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155638.856674:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.857272:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.857341:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125862656 00000100:00100000:3.0:1746155638.857348:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125862656 00002000:00100000:3.0:1746155638.857379:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff880131495180 x1830976125862656/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.857387:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495180 with x1830976125862656 ext(3145728->4194303) 00002000:00010000:3.0:1746155638.857392:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131495180 00000100:00100000:3.0:1746155638.857403:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125862912 00000100:00100000:3.0:1746155638.857405:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125862912 00002000:00100000:3.0:1746155638.857414:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880131497b80 x1830976125862912/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.857421:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497b80 with x1830976125862912 ext(3145728->4194303) 00002000:00010000:3.0:1746155638.857423:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131497b80 00000100:00100000:3.0:1746155638.857439:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7904 00000100:00100000:3.0:1746155638.857445:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125862656:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155638.858585:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7905 00000100:00100000:3.0:1746155638.858592:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976125862912:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155638.863632:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976125862144:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 17945us (18418us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.863643:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7902 00002000:00100000:3.0:1746155638.863651:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880131494a80 x1830976125862144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.863660:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494a80 with x1830976125862144 ext(1048576->2097151) 00002000:00010000:3.0:1746155638.863665:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494a80 00000100:00100000:1.0:1746155638.867434:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125862400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13786us (14322us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155638.867445:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7903 00002000:00100000:1.0:1746155638.867454:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880131496d80 x1830976125862400/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155638.867462:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496d80 with x1830976125862400 ext(2097152->3145727) 00002000:00010000:1.0:1746155638.867467:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131496d80 00000100:00100000:3.0:1746155638.874290:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976125862656:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16836us (17611us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.874301:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7904 00002000:00100000:3.0:1746155638.874310:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff880131495180 x1830976125862656/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155638.874312:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976125862912:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15720us (17040us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155638.874318:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7905 00002000:00100000:0.0:1746155638.874323:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880131497b80 x1830976125862912/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.874324:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495180 with x1830976125862656 ext(3145728->4194303) 00002000:00100000:0.0:1746155638.874328:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497b80 with x1830976125862912 ext(3145728->4194303) 00002000:00010000:3.0:1746155638.874329:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131495180 00002000:00010000:0.0:1746155638.874331:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131497b80 00000100:00100000:2.0:1746155638.874441:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.874520:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125863168 00000100:00100000:3.0:1746155638.874526:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125863168 00000100:00100000:2.0:1746155638.874545:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.874562:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125863040 00000100:00100000:3.0:1746155638.874564:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125863040 00000100:00100000:2.0:1746155638.874571:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16708 00000100:00100000:2.0:1746155638.874578:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976125863168:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.874590:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.874604:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc68e00/0x844e5faceb5f70ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b10 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155638.874621:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16709 00000100:00100000:3.0:1746155638.874626:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125863040:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155638.874632:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155638.874639:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ff00000/0x844e5faceb5f70b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b09 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155638.874656:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.874658:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155638.874665:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff00000/0x844e5faceb5f70b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b09 expref: 26 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.874680:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ff00000/0x844e5faceb5f70b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b09 expref: 26 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155638.874690:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ff00000, rc 0) 00000100:00100000:3.0:1746155638.874710:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125863040:12345-192.168.202.51@tcp:101:cat.0 Request processed in 85us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155638.874715:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16709 00010000:00010000:2.0:1746155638.874796:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.874798:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.874802:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc68e00/0x844e5faceb5f70ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b10 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.874813:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc68e00/0x844e5faceb5f70ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b10 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.874820:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc68e00, rc 0) 00000100:00100000:2.0:1746155638.875039:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976125863168:12345-192.168.202.51@tcp:101:cat.0 Request processed in 460us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.875044:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16708 00000100:00100000:0.0:1746155638.878237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.878280:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.878466:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125863424 00000100:00100000:2.0:1746155638.878473:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125863424 00000100:00100000:2.0:1746155638.878537:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125863296 00000100:00100000:2.0:1746155638.878539:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125863296 00000100:00100000:2.0:1746155638.878558:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16710 00000100:00100000:2.0:1746155638.878564:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976125863424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.878579:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.878592:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc69c00/0x844e5faceb5f70bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b1e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.878610:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.878612:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155638.878618:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc69c00/0x844e5faceb5f70bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b1e expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.878633:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc69c00/0x844e5faceb5f70bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b1e expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.878641:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc69c00, rc 0) 00000100:00100000:2.0:1746155638.878674:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976125863424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 110us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155638.878679:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16710 00000100:00100000:2.0:1746155638.878691:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16711 00000100:00100000:2.0:1746155638.878695:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976125863296:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.878700:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.878705:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b17 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.878732:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125322624:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155638.878776:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29af00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155638.880119:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125322624:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155638.880143:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70c2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b17 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.880152:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b17 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.880172:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc69600, rc 0) 00000100:00100000:2.0:1746155638.880202:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976125863296:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1506us (1921us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155638.880209:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16711 00000100:00100000:0.0:1746155638.885705:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.885733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.885956:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125864320 00000100:00100000:2.0:1746155638.885964:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125864320 00000100:00100000:0.0:1746155638.885966:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155638.885993:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.886291:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125863680 00000100:00100000:0.0:1746155638.886291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155638.886295:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125863680 00000100:00100000:0.0:1746155638.886305:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125863936 00000100:00100000:0.0:1746155638.886307:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125863936 00002000:00100000:0.0:1746155638.886321:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880131495c00 x1830976125863936/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155638.886322:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880131496300 x1830976125863680/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155638.886330:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496300 with x1830976125863680 ext(2097152->3145727) 00002000:00010000:1.0:1746155638.886335:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131496300 00002000:00100000:0.0:1746155638.886335:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495c00 with x1830976125863936 ext(3145728->4194303) 00002000:00010000:0.0:1746155638.886337:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495c00 00002000:00100000:2.0:1746155638.886367:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff880131497480 x1830976125864320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.886374:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497480 with x1830976125864320 ext(3145728->4194303) 00002000:00010000:2.0:1746155638.886376:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131497480 00000100:00100000:3.0:1746155638.886620:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125864192 00000100:00100000:1.0:1746155638.886621:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125864704 00000100:00100000:3.0:1746155638.886624:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125864192 00000100:00100000:1.0:1746155638.886624:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125864704 00002000:00100000:3.0:1746155638.886636:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880131495500 x1830976125864192/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155638.886636:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880131494700 x1830976125864704/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.886642:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495500 with x1830976125864192 ext(2097152->3145727) 00002000:00100000:1.0:1746155638.886642:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494700 with x1830976125864704 ext(4194304->5083135) 00002000:00010000:3.0:1746155638.886645:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131495500 00002000:00010000:1.0:1746155638.886645:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494700 00000100:00100000:3.0:1746155638.886656:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7906 00000100:00100000:3.0:1746155638.886662:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976125863680:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155638.886664:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7907 00000100:00100000:1.0:1746155638.886668:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976125863936:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155638.886706:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7908 00000100:00100000:3.0:1746155638.886850:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7909 00000100:00100000:3.0:1746155638.886855:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976125864192:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155638.886956:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976125864320:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155638.887074:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7910 00000100:00100000:3.0:1746155638.887080:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1963:x1830976125864704:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155638.904193:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976125863680:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17523us (18451us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.904203:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7906 00002000:00100000:3.0:1746155638.904211:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880131496300 x1830976125863680/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.904221:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496300 with x1830976125863680 ext(2097152->3145727) 00002000:00010000:3.0:1746155638.904226:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131496300 00000100:00100000:1.0:1746155638.912595:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125863936:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25916us (26618us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155638.912607:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7907 00002000:00100000:1.0:1746155638.912617:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880131495c00 x1830976125863936/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155638.912625:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495c00 with x1830976125863936 ext(3145728->4194303) 00002000:00010000:1.0:1746155638.912631:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495c00 00000100:00100000:2.0:1746155638.923157:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976125864320:12345-192.168.202.51@tcp:3:cat.0 Request processed in 36437us (37451us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155638.923169:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7908 00002000:00100000:2.0:1746155638.923178:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff880131497480 x1830976125864320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.923186:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497480 with x1830976125864320 ext(3145728->4194303) 00002000:00010000:2.0:1746155638.923191:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131497480 00000100:00100000:0.0:1746155638.923387:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.923631:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976125864192:12345-192.168.202.51@tcp:3:cat.0 Request processed in 36775us (37637us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155638.923637:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7909 00002000:00100000:3.0:1746155638.923642:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880131495500 x1830976125864192/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.923648:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495500 with x1830976125864192 ext(2097152->3145727) 00002000:00010000:3.0:1746155638.923651:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131495500 00000100:00100000:2.0:1746155638.923751:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125864960 00000100:00100000:2.0:1746155638.923757:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125864960 00000100:00100000:2.0:1746155638.923796:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11060 00000100:00100000:2.0:1746155638.923802:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32194:x1830976125864960:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155638.923817:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.923831:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f70c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b25 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.923908:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f70d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.923918:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f70d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.923928:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f70d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.923937:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f70d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.923954:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f70d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.923958:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f70d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924188:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f70de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924278:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f70de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924285:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f70de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155638.924293:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155638.924363:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f70d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924369:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f70d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924374:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f70d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924378:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc68200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155638.924382:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f70d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924387:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f70d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924397:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155638.924399:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155638.924402:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f70d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924407:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f70d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924738:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f70d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924743:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f70d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924748:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f70d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924752:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc69000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155638.924754:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f70d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924758:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f70d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924765:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801366f8500) 00010000:00010000:2.0:1746155638.924767:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155638.924769:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f70d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924774:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f70d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155638.924805:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f70c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b25 expref: 292 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.924814:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f70de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b25 expref: 291 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155638.924820:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155638.924822:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155638.924823:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc69a00, rc 0) 00000100:00100000:2.0:1746155638.924857:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32194:x1830976125864960:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1055us (1471us total) trans 8589945202 rc 0/0 00000100:00100000:2.0:1746155638.924862:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11060 00000100:00100000:3.0:1746155638.925438:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1963:x1830976125864704:12345-192.168.202.51@tcp:3:cat.0 Request processed in 38356us (39145us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155638.925444:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7910 00002000:00100000:3.0:1746155638.925450:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880131494700 x1830976125864704/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155638.925456:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494700 with x1830976125864704 ext(4194304->5083135) 00002000:00010000:3.0:1746155638.925460:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494700 00000100:00100000:2.0:1746155638.930309:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.930399:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125865216 00000100:00100000:3.0:1746155638.930408:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125865216 00000100:00100000:3.0:1746155638.930456:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4681 00000100:00100000:3.0:1746155638.930463:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32194:x1830976125865216:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155638.930800:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32194:x1830976125865216:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 337us (497us total) trans 8589945203 rc 0/0 00000100:00100000:3.0:1746155638.930807:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4681 00000100:00100000:1.0:1746155638.930953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.931411:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125865344 00000100:00100000:2.0:1746155638.931415:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125865344 00000100:00100000:2.0:1746155638.931449:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16712 00000100:00100000:2.0:1746155638.931459:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976125865344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.931468:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.931481:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc69400/0x844e5faceb5f70ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b2c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.931582:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125322752:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155638.931648:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155638.931761:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.931886:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125865600 00000100:00100000:2.0:1746155638.931890:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125865600 00002000:00100000:2.0:1746155638.931911:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880131495f80 x1830976125865600/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/0 e 0 to 0 dl 1746155649 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.931919:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495f80 with x1830976125865600 ext(4194304->5083135) 00002000:00010000:2.0:1746155638.931923:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495f80 00000100:00100000:2.0:1746155638.932090:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7911 00000100:00100000:2.0:1746155638.932096:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976125865600:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155638.938589:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125322752:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155638.938624:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc69400/0x844e5faceb5f70ec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b2c expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.938636:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc69400/0x844e5faceb5f70ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b2c expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.938656:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc69400, rc 0) 00000100:00100000:2.0:1746155638.938702:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976125865344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7243us (7748us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155638.938709:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16712 00000100:00100000:2.0:1746155638.940650:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976125865600:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8547us (8882us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155638.940661:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7911 00002000:00100000:2.0:1746155638.940670:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880131495f80 x1830976125865600/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:709/0 lens 488/440 e 0 to 0 dl 1746155649 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155638.940679:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495f80 with x1830976125865600 ext(4194304->5083135) 00002000:00010000:2.0:1746155638.940684:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495f80 00000100:00100000:0.0:1746155638.941562:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155638.941706:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125865728 00000100:00100000:2.0:1746155638.941712:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125865728 00000100:00100000:2.0:1746155638.941749:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16713 00000100:00100000:2.0:1746155638.941754:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1963:x1830976125865728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155638.941766:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155638.941780:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc68c00/0x844e5faceb5f70f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b33 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155638.941827:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125322880:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155638.941895:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29af00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155638.943559:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125322880:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155638.943586:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc68c00/0x844e5faceb5f70f3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b33 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.943883:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc68c00/0x844e5faceb5f70f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b33 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155638.943893:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc68c00, rc 0) 00000100:00100000:2.0:1746155638.944053:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1963:x1830976125865728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2296us (2492us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155638.944060:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16713 00000100:00100000:0.0:1746155638.964646:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155638.965012:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125865984 00000100:00100000:3.0:1746155638.965020:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125865984 00000100:00100000:3.0:1746155638.965139:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4682 00000100:00100000:3.0:1746155638.965147:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32190:x1830976125865984:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155638.966094:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32190:x1830976125865984:12345-192.168.202.51@tcp:35:cat.0 Request processed in 945us (1452us total) trans 8589945204 rc 0/0 00000100:00100000:3.0:1746155638.966102:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4682 00000100:00100000:0.0:1746155639.020017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.021432:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125866112 00000100:00100000:2.0:1746155639.021440:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125866112 00000100:00100000:2.0:1746155639.022063:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16714 00000100:00100000:2.0:1746155639.022071:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:32194:x1830976125866112:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155639.022087:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.022102:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b3a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.022127:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f0de000/0x844e5faceb5f709f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17afb expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.022134:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ff00000/0x844e5faceb5f70b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b09 expref: 27 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.022139:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.022140:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.022143:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3153920->3952639] (req 3153920->3952639) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.022167:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ff00000/0x844e5faceb5f70b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b09 expref: 27 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.022178:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ff00000/0x844e5faceb5f70b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b09 expref: 27 pid: 10591 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746155639.022188:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125323008:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.022273:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f0de000/0x844e5faceb5f709f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17afb expref: 8 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.022282:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f0de000/0x844e5faceb5f709f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17afb expref: 8 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.022290:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125323136:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.022308:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29af00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.024295:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.024427:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125866368 00000100:00100000:2.0:1746155639.024433:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125866368 00000100:00100000:2.0:1746155639.024460:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11061 00000100:00100000:2.0:1746155639.024466:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32198:x1830976125866368:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155639.024480:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.024492:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69400/0x844e5faceb5f7101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b41 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.024592:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7108 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024602:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024610:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024621:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f710f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024625:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f710f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024629:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f710f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024712:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f7116 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024719:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f7116 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024727:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f7116 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155639.024734:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155639.024801:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024806:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7108 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024811:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7108 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024815:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc69e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155639.024818:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7108 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024823:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7108 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024832:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155639.024834:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155639.024837:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7108 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024842:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7108 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024870:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f710f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024875:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f710f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024882:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f710f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024885:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc69000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155639.024887:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f710f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024891:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f710f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024897:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801366f8500) 00010000:00010000:2.0:1746155639.024899:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155639.024901:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f710f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024904:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f710f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.024933:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69400/0x844e5faceb5f7101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b41 expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.024955:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f7116 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b41 expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.024960:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.024962:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155639.024963:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc68200, rc 0) 00000100:00100000:2.0:1746155639.024993:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32198:x1830976125866368:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 527us (703us total) trans 8589945205 rc 0/0 00000100:00100000:2.0:1746155639.024999:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11061 00000100:00100000:3.0:1746155639.025542:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125323008:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.025549:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125323136:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.025572:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3153920->3952639] (req 3153920->3952639) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.025581:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc69600, rc 0) 00000100:00100000:3.0:1746155639.025599:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:32194:x1830976125866112:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3530us (5590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.025604:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16714 00000100:00100000:0.0:1746155639.027990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.028336:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125866496 00000100:00100000:1.0:1746155639.028344:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125866496 00010000:00010000:1.0:1746155639.028370:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0de000/0x844e5faceb5f709f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17afb expref: 9 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.028409:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8561 00000100:00100000:1.0:1746155639.028416:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125866496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.028427:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.028446:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f0de000/0x844e5faceb5f709f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17afb expref: 9 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.028456:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f0de000/0x844e5faceb5f709f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17afb expref: 9 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.028474:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0de000/0x844e5faceb5f709f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17afb expref: 9 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.029164:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.029206:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976125866496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 789us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.029212:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8561 00000100:00100000:0.0:1746155639.030711:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.031029:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125866624 00000100:00100000:1.0:1746155639.031036:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125866624 00010000:00010000:1.0:1746155639.031056:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ff00000/0x844e5faceb5f70b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b09 expref: 27 pid: 10591 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746155639.031088:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8562 00000100:00100000:1.0:1746155639.031094:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976125866624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.031104:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.031120:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ff00000/0x844e5faceb5f70b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b09 expref: 27 pid: 10591 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746155639.031131:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ff00000/0x844e5faceb5f70b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b09 expref: 27 pid: 10591 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746155639.031147:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ff00000/0x844e5faceb5f70b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b09 expref: 27 pid: 10591 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746155639.031157:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.031159:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.031164:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.031176:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.031201:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 26 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.031211:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125323264:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155639.032307:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155639.033360:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125323264:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155639.033373:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.033554:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976125866624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2458us (2844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.033563:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8562 00000100:00100000:0.0:1746155639.033762:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.034244:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125866880 00000100:00100000:3.0:1746155639.034249:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125866880 00002000:00100000:3.0:1746155639.034278:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3153920->3158015) req@ffff88012cdec000 x1830976125866880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.034286:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec000 with x1830976125866880 ext(3153920->3158015) 00002000:00010000:3.0:1746155639.034290:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdec000 00000100:00100000:3.0:1746155639.034314:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7912 00000100:00100000:3.0:1746155639.034320:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976125866880:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155639.034439:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976125866880:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 119us (677us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155639.034445:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7912 00002000:00100000:3.0:1746155639.034449:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3153920->3158015) req@ffff88012cdec000 x1830976125866880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.034456:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec000 with x1830976125866880 ext(3153920->3158015) 00002000:00010000:3.0:1746155639.034459:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdec000 00000100:00100000:0.0:1746155639.041249:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.041358:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125867136 00000100:00100000:2.0:1746155639.041365:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125867136 00002000:00100000:2.0:1746155639.041400:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3948544->3952639) req@ffff88012cdece00 x1830976125867136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.041409:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdece00 with x1830976125867136 ext(3948544->3952639) 00002000:00010000:2.0:1746155639.041415:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdece00 00000100:00100000:2.0:1746155639.041705:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7913 00000100:00100000:2.0:1746155639.041712:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125867136:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155639.041859:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125867136:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 147us (617us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155639.041864:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7913 00002000:00100000:2.0:1746155639.041869:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3948544->3952639) req@ffff88012cdece00 x1830976125867136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.041876:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdece00 with x1830976125867136 ext(3948544->3952639) 00002000:00010000:2.0:1746155639.041879:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdece00 00000100:00100000:0.0:1746155639.068751:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.068848:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125867392 00000100:00100000:2.0:1746155639.068859:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125867392 00000100:00100000:2.0:1746155639.068904:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11062 00000100:00100000:2.0:1746155639.068911:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32202:x1830976125867392:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.068934:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.068959:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68400/0x844e5faceb5f7124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b48 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.069042:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68000/0x844e5faceb5f712b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069056:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68000/0x844e5faceb5f712b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069065:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68000/0x844e5faceb5f712b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069074:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f7132 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069078:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f7132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069083:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f7132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069253:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69200/0x844e5faceb5f7139 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069260:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69200/0x844e5faceb5f7139 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069265:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69200/0x844e5faceb5f7139 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155639.069271:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155639.069338:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68000/0x844e5faceb5f712b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069344:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68000/0x844e5faceb5f712b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069349:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68000/0x844e5faceb5f712b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069356:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc68000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155639.069359:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68000/0x844e5faceb5f712b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069364:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68000/0x844e5faceb5f712b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069373:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155639.069375:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155639.069378:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68000/0x844e5faceb5f712b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069382:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68000/0x844e5faceb5f712b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069405:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f7132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069410:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f7132 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069413:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f7132 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069418:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc68600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155639.069419:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f7132 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069425:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f7132 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069431:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801366f8c00) 00010000:00010000:2.0:1746155639.069432:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155639.069435:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f7132 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069439:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f7132 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.069467:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68400/0x844e5faceb5f7124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b48 expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.069476:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69200/0x844e5faceb5f7139 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b48 expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.069481:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.069483:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155639.069485:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc69200, rc 0) 00000100:00100000:2.0:1746155639.069924:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32202:x1830976125867392:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1011us (1178us total) trans 8589945206 rc 0/0 00000100:00100000:2.0:1746155639.069931:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11062 00000100:00100000:0.0:1746155639.073096:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.073142:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.073175:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125867776 00000100:00100000:0.0:1746155639.073180:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125867776 00000100:00100000:0.0:1746155639.073218:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 743 00000100:00100000:0.0:1746155639.073225:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1960:x1830976125867776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155639.073237:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155639.073256:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69200/0x844e5faceb5f7139 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b48 expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.073272:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155639.073276:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155639.073305:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1960:x1830976125867776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155639.073311:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 743 00000100:00100000:3.0:1746155639.073850:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125867648 00000100:00100000:3.0:1746155639.073855:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125867648 00000100:00100000:3.0:1746155639.073876:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4683 00000100:00100000:3.0:1746155639.073881:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32202:x1830976125867648:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155639.074024:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32202:x1830976125867648:12345-192.168.202.51@tcp:35:cat.0 Request processed in 142us (933us total) trans 8589945207 rc 0/0 00000100:00100000:3.0:1746155639.074029:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4683 00000100:00100000:0.0:1746155639.088086:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.088213:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125868032 00000100:00100000:3.0:1746155639.088221:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125868032 00002000:00100000:3.0:1746155639.088263:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88012cdec700 x1830976125868032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 504/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.088271:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec700 with x1830976125868032 ext(0->1048575) 00002000:00010000:3.0:1746155639.088275:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdec700 00000100:00100000:3.0:1746155639.088306:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7914 00000100:00100000:3.0:1746155639.088312:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976125868032:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155639.099457:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976125868032:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11137us (11369us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155639.099467:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7914 00002000:00100000:3.0:1746155639.099476:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88012cdec700 x1830976125868032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 504/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.099485:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec700 with x1830976125868032 ext(0->1048575) 00002000:00010000:3.0:1746155639.099490:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdec700 00000100:00100000:0.0:1746155639.108012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.108107:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125868288 00000100:00100000:2.0:1746155639.108114:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125868288 00000100:00100000:2.0:1746155639.108157:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11063 00000100:00100000:2.0:1746155639.108168:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32205:x1830976125868288:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.108188:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.108202:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69400/0x844e5faceb5f7147 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b4f expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.108285:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f714e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108296:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f714e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108305:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f714e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108316:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7155 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108320:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108325:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108404:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68c00/0x844e5faceb5f715c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108411:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68c00/0x844e5faceb5f715c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108416:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68c00/0x844e5faceb5f715c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155639.108422:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155639.108489:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f714e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108495:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f714e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108529:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f714e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108534:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc69000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155639.108538:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f714e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108543:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f714e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108552:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155639.108556:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155639.108558:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f714e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108562:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69000/0x844e5faceb5f714e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108589:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108593:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7155 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108597:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7155 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108600:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc69e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155639.108602:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7155 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108606:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7155 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108611:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801366f8f00) 00010000:00010000:2.0:1746155639.108613:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155639.108614:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7155 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108618:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69e00/0x844e5faceb5f7155 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.108647:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69400/0x844e5faceb5f7147 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b4f expref: 14 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.108656:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68c00/0x844e5faceb5f715c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b4f expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.108662:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.108664:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155639.108666:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc68c00, rc 0) 00000100:00100000:2.0:1746155639.108704:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32205:x1830976125868288:12345-192.168.202.51@tcp:101:cat.0 Request processed in 539us (699us total) trans 8589945208 rc 0/0 00000100:00100000:2.0:1746155639.108710:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11063 00000100:00100000:0.0:1746155639.110770:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.110805:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.110842:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.110911:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125868928 00000100:00100000:1.0:1746155639.110917:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125868928 00000100:00100000:1.0:1746155639.110963:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 744 00000100:00100000:1.0:1746155639.110970:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1961:x1830976125868928:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.110981:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.110998:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68c00/0x844e5faceb5f715c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b4f expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.111015:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155639.111019:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.111047:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125868928:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.111054:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 744 00000100:00100000:2.0:1746155639.111351:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125868672 00000100:00100000:2.0:1746155639.111355:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125868672 00002000:00100000:2.0:1746155639.111439:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012cded880 x1830976125868672/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 504/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.111447:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded880 with x1830976125868672 ext(3145728->4194303) 00002000:00010000:2.0:1746155639.111451:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cded880 00000100:00100000:2.0:1746155639.111471:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125868544 00000100:00100000:2.0:1746155639.111473:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125868544 00002000:00100000:2.0:1746155639.111484:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012cdee300 x1830976125868544/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.111490:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdee300 with x1830976125868544 ext(2097152->3145727) 00002000:00010000:2.0:1746155639.111492:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdee300 00000100:00100000:2.0:1746155639.111536:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7915 00000100:00100000:2.0:1746155639.111542:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976125868672:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155639.111766:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7916 00000100:00100000:3.0:1746155639.111772:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125868544:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155639.112490:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.112538:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.112564:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125869056 00000100:00100000:0.0:1746155639.112567:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125869056 00000100:00100000:0.0:1746155639.112584:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125869184 00000100:00100000:0.0:1746155639.112586:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125869184 00000100:00100000:0.0:1746155639.112602:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16715 00000100:00100000:0.0:1746155639.112606:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976125869056:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155639.112614:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155639.112625:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1dc00/0x844e5faceb5f716a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b56 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.112659:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125323392:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155639.112710:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.112757:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16716 00000100:00100000:0.0:1746155639.112762:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125869184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155639.112768:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155639.112774:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x844e5faceb5f7171 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b5d expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.112796:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125323520:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155639.112816:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b780 going to sleep for 11 seconds 00002000:00010000:0.0:1746155639.119523:0:10591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155638 -> 1746155639 00002000:00010000:0.0:1746155639.119530:0:10591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155638 -> 1746155639 00000100:00100000:0.0:1746155639.119548:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125323520:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155639.119574:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x844e5faceb5f7171 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b5d expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.119587:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x844e5faceb5f7171 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b5d expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.119600:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1ca00, rc 0) 00000100:00100000:0.0:1746155639.119649:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125869184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6885us (7109us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155639.119656:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16716 00000100:00100000:2.0:1746155639.120335:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125868672:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8792us (9569us total) trans 0 rc 249856/249856 00000100:00100000:2.0:1746155639.120343:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7915 00002000:00100000:2.0:1746155639.120351:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012cded880 x1830976125868672/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 504/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 249856/249856 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.120359:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded880 with x1830976125868672 ext(3145728->4194303) 00002000:00010000:2.0:1746155639.120363:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cded880 00000100:00100000:1.0:1746155639.120489:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125323392:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155639.120530:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1dc00/0x844e5faceb5f716a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b56 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.120539:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1dc00/0x844e5faceb5f716a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b56 expref: 9 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.120549:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1dc00, rc 0) 00000100:00100000:1.0:1746155639.120569:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976125869056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7963us (8080us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155639.120575:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16715 00000100:00100000:1.0:1746155639.121102:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976125868544:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9328us (10295us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155639.121108:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7916 00002000:00100000:1.0:1746155639.121114:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012cdee300 x1830976125868544/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.121120:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdee300 with x1830976125868544 ext(2097152->3145727) 00002000:00010000:1.0:1746155639.121123:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdee300 00000100:00100000:0.0:1746155639.123151:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.123381:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125869312 00000100:00100000:1.0:1746155639.123387:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125869312 00000100:00100000:1.0:1746155639.123432:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16717 00000100:00100000:1.0:1746155639.123439:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32205:x1830976125869312:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155639.123451:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155639.123465:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f846800/0x844e5faceb5f7178 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b64 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.123487:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.123493:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155639.123495:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155639.123498:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f846800/0x844e5faceb5f7178 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b64 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.123542:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 25 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.123552:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 25 pid: 8436 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.123563:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125323648:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155639.124019:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.130458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.130535:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125869568 00000100:00100000:1.0:1746155639.130542:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125869568 00002000:00100000:1.0:1746155639.130577:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009366df80 x1830976125869568/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.130586:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366df80 with x1830976125869568 ext(4194304->5083135) 00002000:00010000:1.0:1746155639.130590:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366df80 00000100:00100000:1.0:1746155639.130638:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7917 00000100:00100000:1.0:1746155639.130645:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125869568:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155639.134860:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125323648:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155639.134885:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f846800/0x844e5faceb5f7178 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b64 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.134900:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f846800, rc 0) 00000100:00100000:0.0:1746155639.135244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.135362:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125869696 00000100:00100000:3.0:1746155639.135368:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125869696 00002000:00100000:3.0:1746155639.135399:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (593920->753663) req@ffff88009366c700 x1830976125869696/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.135406:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366c700 with x1830976125869696 ext(593920->753663) 00010000:00010000:3.0:1746155639.135411:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 28 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.135421:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 28 pid: 8436 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746155639.135427:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009366c700 00000100:00100000:3.0:1746155639.135449:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1362 00000100:00100000:3.0:1746155639.135456:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976125869696:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155639.135663:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32205:x1830976125869312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 12224us (12515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.135670:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16717 00000100:00100000:2.0:1746155639.140520:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976125869568:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9854us (10048us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155639.140530:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7917 00002000:00100000:2.0:1746155639.140540:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009366df80 x1830976125869568/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.140548:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366df80 with x1830976125869568 ext(4194304->5083135) 00002000:00010000:2.0:1746155639.140553:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366df80 00000100:00100000:3.0:1746155639.141282:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976125869696:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5825us (6038us total) trans 17179874201 rc 0/0 00000100:00100000:3.0:1746155639.141289:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1362 00002000:00100000:3.0:1746155639.141295:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (593920->753663) req@ffff88009366c700 x1830976125869696/t17179874201(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/448 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.141302:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366c700 with x1830976125869696 ext(593920->753663) 00010000:00010000:3.0:1746155639.141310:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 28 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.141322:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 28 pid: 8436 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746155639.141328:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009366c700 00000100:00100000:0.0:1746155639.146491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.146602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.146802:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125869824 00000100:00100000:2.0:1746155639.146810:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125869824 00010000:00010000:2.0:1746155639.146839:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 28 pid: 8436 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.146863:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8563 00000100:00100000:2.0:1746155639.146869:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125869824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.146879:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.146896:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 28 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.146913:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 28 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.146931:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a231800/0x844e5faceb5f706e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 593920->753663) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aca expref: 28 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.146957:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.146958:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.146965:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f846800/0x844e5faceb5f7178 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b64 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.146972:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f846800/0x844e5faceb5f7178 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b64 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.146999:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f846800/0x844e5faceb5f7178 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b64 expref: 8 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.147009:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125323776:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155639.147081:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155639.147378:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125869952 00000100:00100000:1.0:1746155639.147382:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125869952 00000100:00100000:1.0:1746155639.147412:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16718 00000100:00100000:1.0:1746155639.147417:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125869952:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155639.147428:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155639.147436:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f847800/0x844e5faceb5f717f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b6b expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.147447:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.147449:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.147453:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f847800/0x844e5faceb5f717f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b6b expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.147463:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f847800/0x844e5faceb5f717f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b6b expref: 29 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.147470:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f847800, rc 0) 00000100:00100000:1.0:1746155639.147492:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976125869952:12345-192.168.202.51@tcp:101:cat.0 Request processed in 75us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.147498:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16718 00000100:00100000:2.0:1746155639.149188:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125323776:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155639.149220:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.149245:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125869824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2376us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.149253:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8563 00000100:00100000:0.0:1746155639.153375:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.153419:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.154778:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125870208 00000100:00100000:2.0:1746155639.154787:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125870208 00002000:00100000:2.0:1746155639.154826:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009366d500 x1830976125870208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.154834:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d500 with x1830976125870208 ext(0->1048575) 00002000:00010000:2.0:1746155639.154838:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366d500 00000100:00100000:2.0:1746155639.154853:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125870464 00000100:00100000:2.0:1746155639.154855:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125870464 00002000:00100000:2.0:1746155639.154865:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009366fb80 x1830976125870464/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.154871:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366fb80 with x1830976125870464 ext(1048576->2097151) 00002000:00010000:2.0:1746155639.154874:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366fb80 00000100:00100000:2.0:1746155639.154883:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7918 00000100:00100000:2.0:1746155639.154889:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125870208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155639.155980:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7919 00000100:00100000:2.0:1746155639.155986:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125870464:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155639.163670:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.163766:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125870592 00000100:00100000:2.0:1746155639.163774:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125870592 00000100:00100000:2.0:1746155639.163824:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16719 00000100:00100000:2.0:1746155639.163831:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32198:x1830976125870592:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155639.163846:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.163859:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b72 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.163882:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131447200/0x844e5faceb5f704b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa7 expref: 15 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.163894:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a230c00/0x844e5faceb5f7067 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ac3 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.163899:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.163901:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.163903:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1900544->2097151] (req 1900544->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.163930:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a230c00/0x844e5faceb5f7067 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ac3 expref: 14 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.163949:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a230c00/0x844e5faceb5f7067 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ac3 expref: 14 pid: 8436 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.163960:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125323904:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.164044:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131447200/0x844e5faceb5f704b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa7 expref: 15 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.164051:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131447200/0x844e5faceb5f704b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa7 expref: 15 pid: 29728 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.164058:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125324032:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.164074:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.168302:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125870208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13405us (14927us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.168315:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7918 00002000:00100000:2.0:1746155639.168324:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009366d500 x1830976125870208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.168332:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d500 with x1830976125870208 ext(0->1048575) 00002000:00010000:2.0:1746155639.168337:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366d500 00000100:00100000:1.0:1746155639.171746:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.171987:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125323904:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.171995:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125324032:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.172020:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1900544->2097151] (req 1900544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.172034:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1c67200, rc 0) 00000100:00100000:3.0:1746155639.172539:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125870720 00000100:00100000:3.0:1746155639.172545:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125870720 00010000:00010000:3.0:1746155639.172571:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a230c00/0x844e5faceb5f7067 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ac3 expref: 15 pid: 8436 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.173370:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8564 00000100:00100000:2.0:1746155639.173376:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32198:x1830976125870592:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 9545us (9712us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.173377:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976125870720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155639.173383:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16719 00010000:00010000:3.0:1746155639.173386:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155639.173404:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a230c00/0x844e5faceb5f7067 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ac3 expref: 15 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.173414:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a230c00/0x844e5faceb5f7067 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ac3 expref: 15 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.173432:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a230c00/0x844e5faceb5f7067 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ac3 expref: 15 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.173447:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155639.173597:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976125870720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 220us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.173603:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8564 00000100:00100000:1.0:1746155639.174126:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.174209:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125870848 00000100:00100000:3.0:1746155639.174213:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125870848 00010000:00010000:3.0:1746155639.174231:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131447200/0x844e5faceb5f704b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa7 expref: 15 pid: 29728 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.174258:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8565 00000100:00100000:3.0:1746155639.174263:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976125870848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155639.174270:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155639.174278:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131447200/0x844e5faceb5f704b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa7 expref: 15 pid: 29728 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.174285:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131447200/0x844e5faceb5f704b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa7 expref: 15 pid: 29728 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.174295:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131447200/0x844e5faceb5f704b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa7 expref: 15 pid: 29728 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.174303:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.174305:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.174311:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.174317:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.174341:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155639.174351:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125324160:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155639.174397:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034300 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.174832:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976125870464:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18844us (21411us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.174839:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7919 00002000:00100000:2.0:1746155639.174846:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009366fb80 x1830976125870464/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.174854:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366fb80 with x1830976125870464 ext(1048576->2097151) 00002000:00010000:2.0:1746155639.174857:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366fb80 00000100:00100000:3.0:1746155639.176547:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125324160:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155639.176568:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155639.176596:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125870848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2332us (2470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.176603:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8565 00000100:00100000:0.0:1746155639.177055:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.177129:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125871104 00000100:00100000:2.0:1746155639.177133:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125871104 00002000:00100000:2.0:1746155639.177162:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1900544->1904639) req@ffff88009366d180 x1830976125871104/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.177169:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d180 with x1830976125871104 ext(1900544->1904639) 00002000:00010000:2.0:1746155639.177173:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366d180 00000100:00100000:2.0:1746155639.177739:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7920 00000100:00100000:2.0:1746155639.177746:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1962:x1830976125871104:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155639.177877:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1962:x1830976125871104:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 132us (822us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155639.177883:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7920 00002000:00100000:2.0:1746155639.177887:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1900544->1904639) req@ffff88009366d180 x1830976125871104/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.177893:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d180 with x1830976125871104 ext(1900544->1904639) 00002000:00010000:2.0:1746155639.177897:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366d180 00000100:00100000:0.0:1746155639.181438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.182637:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125871232 00000100:00100000:2.0:1746155639.182646:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125871232 00000100:00100000:2.0:1746155639.182702:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16720 00000100:00100000:2.0:1746155639.182710:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32198:x1830976125871232:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155639.182724:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.182739:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b79 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.182760:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f7075 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad1 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.182768:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca18800/0x844e5faceb5f707c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad8 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.182774:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.182775:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.182778:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->1806335] (req 1048576->1806335) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.182801:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca18800/0x844e5faceb5f707c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad8 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.182812:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca18800/0x844e5faceb5f707c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad8 expref: 13 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.182823:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125324288:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.182903:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f7075 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad1 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.182910:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f7075 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad1 expref: 15 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.182921:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125324416:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.182946:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.185040:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.185101:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125871488 00000100:00100000:3.0:1746155639.185110:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125871488 00002000:00100000:3.0:1746155639.185142:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1900543) req@ffff88009366e300 x1830976125871488/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.185150:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366e300 with x1830976125871488 ext(1048576->1900543) 00002000:00010000:3.0:1746155639.185155:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366e300 00000100:00100000:3.0:1746155639.185186:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7921 00000100:00100000:3.0:1746155639.185193:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125871488:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155639.185546:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125324288:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.185553:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125324416:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.185587:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->1806335] (req 1048576->1806335) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.185604:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a36c00, rc 0) 00000100:00100000:2.0:1746155639.185651:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32198:x1830976125871232:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2941us (4218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.185657:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16720 00000100:00100000:0.0:1746155639.188933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.188977:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.189222:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125871616 00000100:00100000:3.0:1746155639.189230:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125871616 00010000:00010000:3.0:1746155639.189265:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f7075 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad1 expref: 17 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.189299:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8566 00000100:00100000:3.0:1746155639.189305:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976125871616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155639.189316:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155639.189332:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f7075 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad1 expref: 17 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.189341:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f7075 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad1 expref: 17 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.189359:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f7075 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad1 expref: 17 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.189381:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.189442:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125871744 00000100:00100000:1.0:1746155639.189446:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125871744 00010000:00010000:1.0:1746155639.189461:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca18800/0x844e5faceb5f707c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad8 expref: 14 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.189476:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8567 00000100:00100000:1.0:1746155639.189481:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1963:x1830976125871744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.189487:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.189495:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca18800/0x844e5faceb5f707c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad8 expref: 14 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.189531:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca18800/0x844e5faceb5f707c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad8 expref: 14 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.189543:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca18800/0x844e5faceb5f707c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ad8 expref: 14 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.189554:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.189556:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.189564:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.189571:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.189597:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.189607:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125324544:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155639.189919:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125871616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 613us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.189926:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8566 00000100:00100000:1.0:1746155639.189927:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155639.190597:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125871488:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 5403us (5562us total) trans 0 rc 851968/851968 00000100:00100000:3.0:1746155639.190605:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7921 00002000:00100000:3.0:1746155639.190613:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1900543) req@ffff88009366e300 x1830976125871488/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 851968/851968 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.190620:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366e300 with x1830976125871488 ext(1048576->1900543) 00002000:00010000:3.0:1746155639.190625:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366e300 00000100:00100000:1.0:1746155639.192811:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125324544:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155639.192829:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.192861:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1963:x1830976125871744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3379us (3882us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.192869:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8567 00000100:00100000:0.0:1746155639.196841:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.196976:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125872000 00000100:00100000:3.0:1746155639.196984:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125872000 00002000:00100000:3.0:1746155639.197017:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1802240->1806335) req@ffff88009366d880 x1830976125872000/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.197023:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d880 with x1830976125872000 ext(1802240->1806335) 00002000:00010000:3.0:1746155639.197027:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366d880 00000100:00100000:3.0:1746155639.197049:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7922 00000100:00100000:3.0:1746155639.197055:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1963:x1830976125872000:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155639.197208:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1963:x1830976125872000:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 152us (373us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155639.197214:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7922 00002000:00100000:3.0:1746155639.197219:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1802240->1806335) req@ffff88009366d880 x1830976125872000/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.197226:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d880 with x1830976125872000 ext(1802240->1806335) 00002000:00010000:3.0:1746155639.197229:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366d880 00000100:00100000:2.0:1746155639.203028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.203093:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.203305:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125872256 00000100:00100000:0.0:1746155639.203312:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125872256 00000100:00100000:0.0:1746155639.203357:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4684 00000100:00100000:0.0:1746155639.203364:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32198:x1830976125872256:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155639.203562:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32198:x1830976125872256:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 197us (540us total) trans 8589945209 rc 0/0 00000100:00100000:0.0:1746155639.203568:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4684 00000100:00100000:3.0:1746155639.203933:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125872512 00000100:00100000:3.0:1746155639.203946:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125872512 00002000:00100000:3.0:1746155639.203968:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1806336->2097151) req@ffff8800a01d1880 x1830976125872512/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.203977:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d1880 with x1830976125872512 ext(1806336->2097151) 00002000:00010000:3.0:1746155639.203981:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01d1880 00000100:00100000:3.0:1746155639.204006:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7923 00000100:00100000:3.0:1746155639.204012:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125872512:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155639.209892:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125872512:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 5870us (6788us total) trans 0 rc 290816/290816 00000100:00100000:3.0:1746155639.209903:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7923 00002000:00100000:3.0:1746155639.209913:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1806336->2097151) req@ffff8800a01d1880 x1830976125872512/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 290816/290816 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.209921:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d1880 with x1830976125872512 ext(1806336->2097151) 00002000:00010000:3.0:1746155639.209926:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01d1880 00000100:00100000:0.0:1746155639.215637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.216529:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125872640 00000100:00100000:2.0:1746155639.216538:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125872640 00000100:00100000:2.0:1746155639.216587:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16721 00000100:00100000:2.0:1746155639.216595:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32205:x1830976125872640:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.216610:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.216625:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5a37200/0x844e5faceb5f7194 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b80 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.216657:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.216663:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155639.216665:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155639.216668:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a37200/0x844e5faceb5f7194 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b80 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.216693:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 27 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.216704:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 27 pid: 8437 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.216716:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125324672:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.216796:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a780 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.219073:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125324672:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.219099:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a37200/0x844e5faceb5f7194 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b80 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.219113:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a37200, rc 0) 00000100:00100000:2.0:1746155639.219196:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32205:x1830976125872640:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2601us (3564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.219204:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16721 00000100:00100000:0.0:1746155639.220906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.221110:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125872768 00000100:00100000:3.0:1746155639.221117:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125872768 00002000:00100000:3.0:1746155639.221152:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3153920->3952639) req@ffff88009366f800 x1830976125872768/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.221161:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366f800 with x1830976125872768 ext(3153920->3952639) 00010000:00010000:3.0:1746155639.221167:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 28 pid: 8437 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.221180:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 28 pid: 8437 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746155639.221186:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009366f800 00000100:00100000:3.0:1746155639.221215:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1363 00000100:00100000:3.0:1746155639.221221:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976125872768:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155639.236698:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125872768:12345-192.168.202.51@tcp:4:cat.0 Request processed in 15467us (15784us total) trans 17179874202 rc 0/0 00000100:00100000:3.0:1746155639.236707:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1363 00002000:00100000:3.0:1746155639.236715:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3153920->3952639) req@ffff88009366f800 x1830976125872768/t17179874202(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/448 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.236723:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366f800 with x1830976125872768 ext(3153920->3952639) 00010000:00010000:3.0:1746155639.236732:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 30 pid: 8437 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.236744:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 30 pid: 8437 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746155639.236750:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009366f800 00000100:00100000:0.0:1746155639.244590:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.244638:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125872896 00000100:00100000:1.0:1746155639.244646:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125872896 00010000:00010000:1.0:1746155639.244678:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 30 pid: 8437 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.244718:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8568 00000100:00100000:1.0:1746155639.244725:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976125872896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.244736:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.244755:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 30 pid: 8437 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.244765:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 30 pid: 8437 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.244787:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc69600/0x844e5faceb5f70fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3153920->3952639) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b3a expref: 30 pid: 8437 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.244814:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.244816:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.244821:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a37200/0x844e5faceb5f7194 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b80 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.244828:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a37200/0x844e5faceb5f7194 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b80 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.244855:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5a37200/0x844e5faceb5f7194 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b80 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.244865:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125324800:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155639.244936:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155639.247006:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125324800:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155639.247025:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.247057:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976125872896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2332us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.247066:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8568 00000100:00100000:0.0:1746155639.250798:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.250839:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.252165:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125873280 00000100:00100000:3.0:1746155639.252174:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125873280 00000100:00100000:2.0:1746155639.252192:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125873152 00000100:00100000:2.0:1746155639.252197:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125873152 00002000:00100000:3.0:1746155639.252217:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009b881c00 x1830976125873280/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.252220:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009b880380 x1830976125873152/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.252226:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881c00 with x1830976125873280 ext(3145728->4194303) 00002000:00100000:2.0:1746155639.252228:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880380 with x1830976125873152 ext(2097152->3145727) 00002000:00010000:3.0:1746155639.252231:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881c00 00002000:00010000:2.0:1746155639.252231:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b880380 00000100:00100000:3.0:1746155639.252249:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7924 00000100:00100000:3.0:1746155639.252257:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125873280:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155639.252264:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7925 00000100:00100000:2.0:1746155639.252269:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125873152:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155639.268455:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.270486:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125873664 00000100:00100000:1.0:1746155639.270494:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125873664 00000100:00100000:3.0:1746155639.270593:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125873280:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18332us (19797us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155639.270603:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7924 00002000:00100000:3.0:1746155639.270613:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009b881c00 x1830976125873280/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.270620:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881c00 with x1830976125873280 ext(3145728->4194303) 00002000:00010000:3.0:1746155639.270701:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881c00 00000100:00100000:1.0:1746155639.270797:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11064 00000100:00100000:1.0:1746155639.270804:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32209:x1830976125873664:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155639.270828:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155639.270843:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68000/0x844e5faceb5f719b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b87 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.270928:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f71a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.270947:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f71a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271614:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f71a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271628:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68400/0x844e5faceb5f71a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271634:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68400/0x844e5faceb5f71a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271638:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68400/0x844e5faceb5f71a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271720:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68c00/0x844e5faceb5f71b0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271726:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68c00/0x844e5faceb5f71b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271730:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68c00/0x844e5faceb5f71b0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155639.271736:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155639.271795:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f71a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271804:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f71a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271809:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f71a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271813:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc68600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155639.271816:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f71a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271821:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f71a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271828:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155639.271830:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155639.271833:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f71a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271837:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68600/0x844e5faceb5f71a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271854:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68400/0x844e5faceb5f71a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271857:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68400/0x844e5faceb5f71a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271861:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68400/0x844e5faceb5f71a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271865:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc68400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155639.271867:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68400/0x844e5faceb5f71a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271873:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68400/0x844e5faceb5f71a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271878:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c700) 00010000:00010000:1.0:1746155639.271879:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155639.271881:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68400/0x844e5faceb5f71a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271884:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68400/0x844e5faceb5f71a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.271913:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68000/0x844e5faceb5f719b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b87 expref: 297 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.271920:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68c00/0x844e5faceb5f71b0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b87 expref: 296 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.271925:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155639.271926:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155639.271928:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc68c00, rc 0) 00000100:00100000:1.0:1746155639.271985:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32209:x1830976125873664:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1182us (3537us total) trans 8589945210 rc 0/0 00000100:00100000:1.0:1746155639.271991:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11064 00000100:00100000:2.0:1746155639.274126:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125873152:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21851us (23280us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.274135:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7925 00002000:00100000:2.0:1746155639.274144:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009b880380 x1830976125873152/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.274157:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880380 with x1830976125873152 ext(2097152->3145727) 00002000:00010000:2.0:1746155639.274162:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b880380 00010000:00010000:3.0:1746155639.276669:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155639.279407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.279484:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.280748:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125873792 00000100:00100000:1.0:1746155639.280756:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125873792 00000100:00100000:1.0:1746155639.280807:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 745 00000100:00100000:1.0:1746155639.280815:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:1960:x1830976125873792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.280827:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.280849:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68c00/0x844e5faceb5f71b0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b87 expref: 296 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.280866:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155639.280870:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.280908:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1960:x1830976125873792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 94us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.280914:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 745 00000100:00100000:0.0:1746155639.282331:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125874048 00000100:00100000:0.0:1746155639.282338:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125874048 00000100:00100000:1.0:1746155639.283524:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4685 00000100:00100000:1.0:1746155639.283534:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:32209:x1830976125874048:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155639.283708:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32209:x1830976125874048:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 176us (4306us total) trans 8589945211 rc 0/0 00000100:00100000:1.0:1746155639.283714:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4685 00000100:00100000:0.0:1746155639.286687:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.286802:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125874304 00000100:00100000:2.0:1746155639.286809:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125874304 00002000:00100000:2.0:1746155639.286844:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009b881500 x1830976125874304/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.286853:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881500 with x1830976125874304 ext(4194304->5083135) 00002000:00010000:2.0:1746155639.286858:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881500 00000100:00100000:2.0:1746155639.286984:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7926 00000100:00100000:2.0:1746155639.286992:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125874304:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155639.291497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.291714:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125874560 00000100:00100000:1.0:1746155639.291723:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125874560 00000100:00100000:1.0:1746155639.291775:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11065 00000100:00100000:1.0:1746155639.291783:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32212:x1830976125874560:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155639.291802:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155639.291818:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f71be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b8e expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.291903:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f200/0x844e5faceb5f71c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.291915:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f200/0x844e5faceb5f71c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.291924:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f200/0x844e5faceb5f71c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.291934:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f71cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.291951:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f71cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.291955:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f71cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.292041:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ea00/0x844e5faceb5f71d3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.292048:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ea00/0x844e5faceb5f71d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.292053:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ea00/0x844e5faceb5f71d3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155639.292061:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155639.293402:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f200/0x844e5faceb5f71c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293410:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f200/0x844e5faceb5f71c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293415:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f200/0x844e5faceb5f71c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293420:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012df5f200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155639.293423:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f200/0x844e5faceb5f71c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293429:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f200/0x844e5faceb5f71c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293441:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155639.293443:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155639.293447:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f200/0x844e5faceb5f71c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293451:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f200/0x844e5faceb5f71c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293469:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f71cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293473:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f71cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293477:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f71cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293480:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012df5fa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155639.293482:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f71cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293486:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f71cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293491:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58cd00) 00010000:00010000:1.0:1746155639.293492:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155639.293494:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f71cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293498:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f71cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.293550:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f71be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b8e expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.293561:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ea00/0x844e5faceb5f71d3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b8e expref: 298 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.293567:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155639.293569:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155639.293571:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df5ea00, rc 0) 00000100:00100000:1.0:1746155639.294530:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:32212:x1830976125874560:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2719us (3012us total) trans 8589945212 rc 0/0 00000100:00100000:1.0:1746155639.294538:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11065 00000100:00100000:2.0:1746155639.296995:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125874304:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9997us (10307us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155639.297004:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7926 00002000:00100000:2.0:1746155639.297014:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009b881500 x1830976125874304/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.297022:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881500 with x1830976125874304 ext(4194304->5083135) 00002000:00010000:2.0:1746155639.297026:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881500 00000100:00100000:0.0:1746155639.297286:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.297373:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125874816 00000100:00100000:3.0:1746155639.297380:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125874816 00000100:00100000:3.0:1746155639.297444:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4686 00000100:00100000:3.0:1746155639.297450:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ef13c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:32212:x1830976125874816:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:0.0:1746155639.297498:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.297575:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125874944 00000100:00100000:1.0:1746155639.297578:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125874944 00000100:00100000:3.0:1746155639.297690:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ef13c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:32212:x1830976125874816:12345-192.168.202.51@tcp:35:cat.0 Request processed in 239us (404us total) trans 8589945213 rc 0/0 00000100:00100000:3.0:1746155639.297696:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4686 00000100:00100000:1.0:1746155639.297795:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 746 00000100:00100000:1.0:1746155639.297801:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1961:x1830976125874944:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.297809:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.297881:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ea00/0x844e5faceb5f71d3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b8e expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.297896:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155639.297900:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.297969:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1961:x1830976125874944:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 166us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.297975:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 746 00000100:00100000:0.0:1746155639.299791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.299821:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.299851:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.299923:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125875072 00000100:00100000:2.0:1746155639.299928:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125875072 00000100:00100000:2.0:1746155639.299963:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125875200 00000100:00100000:2.0:1746155639.299965:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125875200 00000100:00100000:2.0:1746155639.299975:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125875328 00000100:00100000:2.0:1746155639.299977:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125875328 00000100:00100000:2.0:1746155639.299991:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16722 00000100:00100000:2.0:1746155639.299997:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1962:x1830976125875072:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.300009:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.300023:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f021e00/0x844e5faceb5f71e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b95 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.300059:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125324928:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155639.300117:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a780 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.300132:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16723 00000100:00100000:2.0:1746155639.300137:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976125875200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.300143:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.300149:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ed1800/0x844e5faceb5f71e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17b9c expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.300168:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125325056:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155639.300184:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.300196:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16724 00000100:00100000:2.0:1746155639.300200:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976125875328:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.300206:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.300214:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f71ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ba3 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.300223:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.300224:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.300231:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f71ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ba3 expref: 30 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.300244:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f71ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ba3 expref: 30 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.300253:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed1200, rc 0) 00000100:00100000:2.0:1746155639.300269:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976125875328:12345-192.168.202.51@tcp:101:cat.0 Request processed in 68us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.300274:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16724 00002000:00010000:2.0:1746155639.303404:0:10591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime: 1746155638 -> 1746155639 00002000:00010000:2.0:1746155639.303409:0:10591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime: 1746155638 -> 1746155639 00000100:00100000:2.0:1746155639.303428:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125324928:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155639.303454:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f021e00/0x844e5faceb5f71e1 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b95 expref: 16 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.303466:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f021e00/0x844e5faceb5f71e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b95 expref: 16 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.303488:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f021e00, rc 0) 00000100:00100000:2.0:1746155639.303540:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976125875072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3542us (3752us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155639.303546:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16722 00002000:00010000:3.0:1746155639.303907:0:1625:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime: 1746155638 -> 1746155639 00002000:00010000:3.0:1746155639.303911:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime: 1746155638 -> 1746155639 00000100:00100000:3.0:1746155639.303919:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125325056:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155639.303934:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ed1800/0x844e5faceb5f71e8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b9c expref: 14 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155639.303959:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ed1800/0x844e5faceb5f71e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b9c expref: 14 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155639.303977:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed1800, rc 0) 00000100:00100000:3.0:1746155639.303997:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1962:x1830976125875200:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3860us (4175us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155639.304002:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16723 00000100:00100000:0.0:1746155639.309408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.309456:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.309463:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125875584 00000100:00100000:2.0:1746155639.309491:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125875840 00000100:00100000:2.0:1746155639.309499:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125875840 00002000:00100000:2.0:1746155639.309555:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009b881f80 x1830976125875840/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.309562:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881f80 with x1830976125875840 ext(0->1048575) 00002000:00010000:2.0:1746155639.309565:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881f80 00000100:00100000:2.0:1746155639.309583:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7927 00000100:00100000:2.0:1746155639.309588:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976125875840:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155639.310288:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125875584 00000100:00100000:3.0:1746155639.310325:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4687 00000100:00100000:3.0:1746155639.310331:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32205:x1830976125875584:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155639.310529:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32205:x1830976125875584:12345-192.168.202.51@tcp:35:cat.0 Request processed in 197us (1129us total) trans 8589945214 rc 0/0 00000100:00100000:3.0:1746155639.310536:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4687 00000100:00100000:2.0:1746155639.323638:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1963:x1830976125875840:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14039us (14172us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.323649:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7927 00002000:00100000:2.0:1746155639.323659:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009b881f80 x1830976125875840/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.323668:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881f80 with x1830976125875840 ext(0->1048575) 00002000:00010000:2.0:1746155639.323673:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881f80 00000100:00100000:0.0:1746155639.331040:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.331094:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125875968 00000100:00100000:3.0:1746155639.331101:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125875968 00000100:00100000:3.0:1746155639.331149:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16725 00000100:00100000:3.0:1746155639.331157:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:32212:x1830976125875968:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155639.331172:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.331184:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f471400/0x844e5faceb5f71f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17baa expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.331207:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.331219:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155639.331220:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155639.331223:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f471400/0x844e5faceb5f71f6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17baa expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.331246:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.332911:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 13 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.332926:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125325184:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.333025:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155639.335688:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125325184:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.335714:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f471400/0x844e5faceb5f71f6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17baa expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.335730:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f471400, rc 0) 00000100:00100000:3.0:1746155639.335801:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:32212:x1830976125875968:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4644us (4766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.335808:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16725 00000100:00100000:0.0:1746155639.336733:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.337137:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125876096 00000100:00100000:2.0:1746155639.337143:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125876096 00002000:00100000:2.0:1746155639.337173:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1900544->2097151) req@ffff88009b880700 x1830976125876096/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.337181:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880700 with x1830976125876096 ext(1900544->2097151) 00010000:00010000:2.0:1746155639.337188:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 14 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.337200:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 14 pid: 10591 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746155639.337206:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b880700 00000100:00100000:2.0:1746155639.337221:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1364 00000100:00100000:2.0:1746155639.337227:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125876096:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155639.341990:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125876096:12345-192.168.202.51@tcp:4:cat.0 Request processed in 4756us (5251us total) trans 21474841525 rc 0/0 00000100:00100000:2.0:1746155639.342002:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1364 00002000:00100000:2.0:1746155639.342011:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1900544->2097151) req@ffff88009b880700 x1830976125876096/t21474841525(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/448 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.342018:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880700 with x1830976125876096 ext(1900544->2097151) 00010000:00010000:2.0:1746155639.342026:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 16 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.342037:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 16 pid: 10591 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746155639.342043:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b880700 00000100:00100000:0.0:1746155639.345170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.345384:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125876224 00000100:00100000:1.0:1746155639.345392:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125876224 00010000:00010000:1.0:1746155639.345421:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 16 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.345463:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8569 00000100:00100000:1.0:1746155639.345470:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1962:x1830976125876224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.345483:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.345621:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 16 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.345635:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 16 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.345655:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1c67200/0x844e5faceb5f7186 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b72 expref: 16 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.345670:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.345672:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.345678:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f471400/0x844e5faceb5f71f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17baa expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.345684:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f471400/0x844e5faceb5f71f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17baa expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.345719:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f471400/0x844e5faceb5f71f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17baa expref: 13 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.345730:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125325312:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155639.345798:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155639.348900:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125325312:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155639.348918:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.348964:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1962:x1830976125876224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3493us (3797us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.348973:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8569 00000100:00100000:0.0:1746155639.349471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.349622:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125876480 00000100:00100000:3.0:1746155639.349628:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125876480 00002000:00100000:3.0:1746155639.349665:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f701880 x1830976125876480/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.349679:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f701880 with x1830976125876480 ext(1048576->2097151) 00002000:00010000:3.0:1746155639.349683:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f701880 00000100:00100000:3.0:1746155639.349697:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7928 00000100:00100000:3.0:1746155639.349703:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1963:x1830976125876480:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155639.357661:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1963:x1830976125876480:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7947us (8180us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155639.357672:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7928 00002000:00100000:3.0:1746155639.357682:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f701880 x1830976125876480/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.357691:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f701880 with x1830976125876480 ext(1048576->2097151) 00002000:00010000:3.0:1746155639.357695:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f701880 00000100:00100000:0.0:1746155639.366291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.366379:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125876608 00000100:00100000:3.0:1746155639.366387:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125876608 00000100:00100000:3.0:1746155639.366430:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16726 00000100:00100000:3.0:1746155639.366437:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:32212:x1830976125876608:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155639.366452:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.366465:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f471600/0x844e5faceb5f71fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17bb1 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.366488:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.366495:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155639.366497:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155639.366649:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f471600/0x844e5faceb5f71fd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb1 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.366675:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.366686:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 14 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.366696:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125325440:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.367374:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.369476:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.369587:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125876736 00000100:00100000:2.0:1746155639.369594:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125876736 00000100:00100000:2.0:1746155639.369624:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16727 00000100:00100000:2.0:1746155639.369630:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:32209:x1830976125876736:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155639.369992:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.370008:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17bb8 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.370035:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f846800/0x844e5faceb5f7178 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b64 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.370042:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f847800/0x844e5faceb5f717f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b6b expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.370048:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.370050:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.370053:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [802816->1048575] (req 802816->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 31 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.370084:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f847800/0x844e5faceb5f717f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b6b expref: 31 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.370092:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f847800/0x844e5faceb5f717f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b6b expref: 31 pid: 8436 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746155639.370103:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125325568:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.370180:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f846800/0x844e5faceb5f7178 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b64 expref: 9 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.370188:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f846800/0x844e5faceb5f7178 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b64 expref: 9 pid: 8436 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.370196:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125325696:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.370215:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155639.370399:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125325440:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.370419:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f471600/0x844e5faceb5f71fd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb1 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.370430:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f471600, rc 0) 00000100:00100000:3.0:1746155639.370453:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:32212:x1830976125876608:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4016us (4169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.370459:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16726 00000100:00100000:0.0:1746155639.371586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.371711:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125876864 00000100:00100000:3.0:1746155639.371716:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125876864 00002000:00100000:3.0:1746155639.371743:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1806335) req@ffff88009f700a80 x1830976125876864/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.371750:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700a80 with x1830976125876864 ext(1048576->1806335) 00010000:00010000:3.0:1746155639.371756:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 15 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.371774:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 15 pid: 10591 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746155639.371780:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f700a80 00000100:00100000:3.0:1746155639.371793:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1365 00000100:00100000:3.0:1746155639.371798:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976125876864:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155639.372448:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125325568:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.372456:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125325696:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.372478:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [802816->1048575] (req 802816->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 31 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.372489:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed0400, rc 0) 00000100:00100000:2.0:1746155639.372532:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:32209:x1830976125876736:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2902us (3063us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.372649:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16727 00000100:00100000:0.0:1746155639.373197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.373235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.373299:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125876992 00000100:00100000:1.0:1746155639.373304:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125876992 00010000:00010000:1.0:1746155639.373323:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f846800/0x844e5faceb5f7178 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b64 expref: 10 pid: 8436 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.373340:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125877120 00000100:00100000:1.0:1746155639.373342:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125877120 00010000:00010000:1.0:1746155639.373350:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f847800/0x844e5faceb5f717f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b6b expref: 31 pid: 8436 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746155639.373364:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8570 00000100:00100000:1.0:1746155639.373370:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125876992:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.373378:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.373393:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f846800/0x844e5faceb5f7178 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b64 expref: 10 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.373402:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f846800/0x844e5faceb5f7178 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b64 expref: 10 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.373419:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f846800/0x844e5faceb5f7178 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b64 expref: 10 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.373435:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.373456:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125876992:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.373462:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8570 00000100:00100000:1.0:1746155639.373494:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8571 00000100:00100000:1.0:1746155639.373499:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976125877120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.373524:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.373533:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f847800/0x844e5faceb5f717f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b6b expref: 31 pid: 8436 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746155639.373541:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f847800/0x844e5faceb5f717f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b6b expref: 31 pid: 8436 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746155639.373552:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f847800/0x844e5faceb5f717f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b6b expref: 31 pid: 8436 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746155639.373560:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.373562:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.373567:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 30 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.373574:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 30 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.373596:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 30 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.373607:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125325824:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155639.373655:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.377193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.377213:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125325824:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155639.377230:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.377267:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125877120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3766us (4030us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.377278:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8571 00000100:00100000:3.0:1746155639.377427:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125877376 00000100:00100000:3.0:1746155639.377433:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125877376 00002000:00100000:3.0:1746155639.377459:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (802816->806911) req@ffff8800a01d2d80 x1830976125877376/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.377467:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d2d80 with x1830976125877376 ext(802816->806911) 00002000:00010000:3.0:1746155639.377472:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d2d80 00000100:00100000:3.0:1746155639.377484:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7929 00000100:00100000:3.0:1746155639.377489:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976125877376:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155639.380002:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976125877376:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 2505us (2810us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155639.380013:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7929 00002000:00100000:3.0:1746155639.380020:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (802816->806911) req@ffff8800a01d2d80 x1830976125877376/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.380027:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d2d80 with x1830976125877376 ext(802816->806911) 00002000:00010000:3.0:1746155639.380032:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d2d80 00000100:00100000:2.0:1746155639.380765:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976125876864:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8965us (9179us total) trans 21474841526 rc 0/0 00000100:00100000:2.0:1746155639.380772:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1365 00002000:00100000:2.0:1746155639.380777:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1806335) req@ffff88009f700a80 x1830976125876864/t21474841526(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/448 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.380785:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700a80 with x1830976125876864 ext(1048576->1806335) 00010000:00010000:2.0:1746155639.380792:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 17 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.380804:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 17 pid: 10591 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746155639.380809:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f700a80 00000100:00100000:0.0:1746155639.383442:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.383493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.383586:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125877632 00000100:00100000:2.0:1746155639.383593:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125877632 00000100:00100000:2.0:1746155639.383645:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16728 00000100:00100000:2.0:1746155639.383653:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:32209:x1830976125877632:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155639.383668:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.383681:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17bbf expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.383702:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f471400/0x844e5faceb5f71f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17baa expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.383713:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.383715:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.383718:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->1486847] (req 1048576->1486847) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.383740:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f471400/0x844e5faceb5f71f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17baa expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.383749:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f471400/0x844e5faceb5f71f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17baa expref: 16 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.383759:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125325952:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.383819:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155639.384082:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125877504 00000100:00100000:1.0:1746155639.384086:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125877504 00010000:00010000:1.0:1746155639.384105:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 17 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.384132:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8572 00000100:00100000:1.0:1746155639.384138:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976125877504:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.384145:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.384161:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 17 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.384171:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 17 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.384184:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f718d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1806335) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b79 expref: 17 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.384411:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.384413:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.384419:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f471600/0x844e5faceb5f71fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb1 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.384431:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f471600/0x844e5faceb5f71fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb1 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.384450:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f471600/0x844e5faceb5f71fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb1 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.384458:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125326080:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155639.384872:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155639.387054:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125326080:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155639.387071:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.387101:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125325952:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155639.387115:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1962:x1830976125877504:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2977us (3621us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155639.387122:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->1486847] (req 1048576->1486847) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.387123:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8572 00010000:00010000:2.0:1746155639.387133:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090415e00, rc 0) 00000100:00100000:2.0:1746155639.387151:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32209:x1830976125877632:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3500us (3716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.387156:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16728 00000100:00100000:0.0:1746155639.387322:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.387446:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125877760 00000100:00100000:1.0:1746155639.387451:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125877760 00010000:00010000:1.0:1746155639.387469:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f471400/0x844e5faceb5f71f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17baa expref: 16 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.387489:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8573 00000100:00100000:1.0:1746155639.387495:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976125877760:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.387526:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.387544:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f471400/0x844e5faceb5f71f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17baa expref: 16 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.387558:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f471400/0x844e5faceb5f71f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17baa expref: 16 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.387576:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f471400/0x844e5faceb5f71f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17baa expref: 16 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.387585:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.387586:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.387591:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.387598:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.387619:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.387628:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125326208:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155639.387687:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.388461:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.388523:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125878016 00000100:00100000:2.0:1746155639.388527:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125878016 00002000:00100000:2.0:1746155639.388550:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009f703b80 x1830976125878016/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.388564:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f703b80 with x1830976125878016 ext(1048576->2097151) 00002000:00010000:2.0:1746155639.388568:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f703b80 00000100:00100000:2.0:1746155639.388592:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7930 00000100:00100000:2.0:1746155639.388598:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976125878016:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155639.389587:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125326208:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155639.389599:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.389619:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976125877760:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2124us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.389629:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8573 00000100:00100000:0.0:1746155639.393268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.393356:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125878272 00000100:00100000:3.0:1746155639.393364:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125878272 00002000:00100000:3.0:1746155639.393399:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1482752->1486847) req@ffff88009f703800 x1830976125878272/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.393408:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f703800 with x1830976125878272 ext(1482752->1486847) 00002000:00010000:3.0:1746155639.393412:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f703800 00000100:00100000:3.0:1746155639.393447:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7931 00000100:00100000:3.0:1746155639.393454:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976125878272:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155639.394612:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976125878272:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 1154us (1373us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155639.394619:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7931 00002000:00100000:3.0:1746155639.394626:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1482752->1486847) req@ffff88009f703800 x1830976125878272/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.394633:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f703800 with x1830976125878272 ext(1482752->1486847) 00002000:00010000:3.0:1746155639.394638:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f703800 00000100:00100000:2.0:1746155639.395626:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976125878016:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7025us (7162us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.395634:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7930 00002000:00100000:2.0:1746155639.395640:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009f703b80 x1830976125878016/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.395647:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f703b80 with x1830976125878016 ext(1048576->2097151) 00002000:00010000:2.0:1746155639.395650:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f703b80 00000100:00100000:0.0:1746155639.406047:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.406130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.406202:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125878528 00000100:00100000:2.0:1746155639.406210:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125878528 00002000:00100000:2.0:1746155639.406245:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f702a00 x1830976125878528/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.406254:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f702a00 with x1830976125878528 ext(2097152->3145727) 00002000:00010000:2.0:1746155639.406258:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f702a00 00000100:00100000:2.0:1746155639.406285:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125878656 00000100:00100000:2.0:1746155639.406287:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125878656 00002000:00100000:2.0:1746155639.406298:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f702300 x1830976125878656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.406304:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f702300 with x1830976125878656 ext(3145728->4194303) 00002000:00010000:2.0:1746155639.406306:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f702300 00000100:00100000:2.0:1746155639.406318:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7932 00000100:00100000:2.0:1746155639.406324:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976125878528:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155639.406392:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7933 00000100:00100000:1.0:1746155639.406400:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976125878656:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155639.414546:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976125878656:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8137us (8406us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155639.414557:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7933 00002000:00100000:1.0:1746155639.414566:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f702300 x1830976125878656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.414575:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f702300 with x1830976125878656 ext(3145728->4194303) 00002000:00010000:1.0:1746155639.414580:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f702300 00000100:00100000:2.0:1746155639.422186:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125878528:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15853us (16137us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.422198:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7932 00002000:00100000:2.0:1746155639.422213:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f702a00 x1830976125878528/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.422221:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f702a00 with x1830976125878528 ext(2097152->3145727) 00002000:00010000:2.0:1746155639.422226:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f702a00 00000100:00100000:0.0:1746155639.432979:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.433113:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125879040 00000100:00100000:2.0:1746155639.433785:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125879040 00002000:00100000:2.0:1746155639.433823:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f700380 x1830976125879040/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.433832:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700380 with x1830976125879040 ext(4194304->5083135) 00002000:00010000:2.0:1746155639.433837:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f700380 00000100:00100000:2.0:1746155639.435144:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7934 00000100:00100000:2.0:1746155639.435154:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125879040:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155639.435584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.436054:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125879296 00000100:00100000:1.0:1746155639.436063:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125879296 00000100:00100000:1.0:1746155639.436106:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11066 00000100:00100000:1.0:1746155639.436112:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32220:x1830976125879296:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155639.436126:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155639.436141:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f7212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17bc6 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.436222:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f7219 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436234:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f7219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436244:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f7219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436256:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7220 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436261:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436266:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436360:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7227 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436369:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7227 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436375:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7227 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155639.436381:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155639.436448:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f7219 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436454:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f7219 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436459:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f7219 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436463:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb0800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155639.436466:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f7219 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436472:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f7219 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436480:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155639.436483:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155639.436486:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f7219 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436493:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f7219 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436534:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7220 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436539:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7220 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436543:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7220 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436546:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb1800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155639.436549:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7220 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436568:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7220 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436574:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58ca00) 00010000:00010000:1.0:1746155639.436576:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155639.436578:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7220 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436582:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7220 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155639.436855:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f7212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bc6 expref: 17 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.436867:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7227 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bc6 expref: 16 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.436877:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155639.436878:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155639.436880:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0e00, rc 0) 00000100:00100000:1.0:1746155639.436915:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32220:x1830976125879296:12345-192.168.202.51@tcp:101:cat.0 Request processed in 803us (1332us total) trans 8589945215 rc 0/0 00000100:00100000:1.0:1746155639.436920:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11066 00000100:00100000:0.0:1746155639.438998:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.439021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.439208:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125879680 00000100:00100000:0.0:1746155639.439214:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125879680 00000100:00100000:0.0:1746155639.439256:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11067 00000100:00100000:0.0:1746155639.439263:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32217:x1830976125879680:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155639.439280:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155639.439292:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093480400/0x844e5faceb5f7235 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17bcd expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.439354:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125879424 00000100:00100000:2.0:1746155639.439358:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125879424 00010000:00010000:0.0:1746155639.439368:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093481400/0x844e5faceb5f723c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439377:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093481400/0x844e5faceb5f723c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155639.439382:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 747 00010000:00010000:0.0:1746155639.439385:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093481400/0x844e5faceb5f723c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155639.439386:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976125879424:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.439393:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155639.439395:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5f7243 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439399:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5f7243 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.439404:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7227 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bc6 expref: 18 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.439404:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5f7243 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.439419:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.439422:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.439448:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125879424:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 61us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.439453:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 747 00010000:00010000:0.0:1746155639.439561:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5f724a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439569:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5f724a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439575:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5f724a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155639.439582:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155639.439642:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093481400/0x844e5faceb5f723c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439647:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093481400/0x844e5faceb5f723c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439655:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093481400/0x844e5faceb5f723c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439660:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093481400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155639.439662:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093481400/0x844e5faceb5f723c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439667:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093481400/0x844e5faceb5f723c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439672:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155639.439674:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155639.439676:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093481400/0x844e5faceb5f723c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439680:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093481400/0x844e5faceb5f723c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439689:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5f7243 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439693:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5f7243 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439697:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5f7243 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439701:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093481000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155639.439703:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5f7243 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439707:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5f7243 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439715:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51f00) 00010000:00010000:0.0:1746155639.439717:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155639.439719:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5f7243 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439722:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093481000/0x844e5faceb5f7243 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155639.439748:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093480400/0x844e5faceb5f7235 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bcd expref: 18 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.439757:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5f724a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bcd expref: 17 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.439763:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155639.439764:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155639.439766:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093480000, rc 0) 00000100:00100000:0.0:1746155639.439784:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32217:x1830976125879680:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 521us (790us total) trans 8589945216 rc 0/0 00000100:00100000:0.0:1746155639.439788:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11067 00000100:00100000:0.0:1746155639.439835:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.439901:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125879808 00000100:00100000:0.0:1746155639.439904:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125879808 00000100:00100000:0.0:1746155639.439924:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16729 00000100:00100000:0.0:1746155639.439929:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976125879808:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155639.439936:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155639.441348:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093480800/0x844e5faceb5f7258 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17bd4 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.441401:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125326336:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155639.441469:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155639.441545:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.441623:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.441754:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125879936 00000100:00100000:2.0:1746155639.441758:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125879936 00000100:00100000:2.0:1746155639.441793:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125880064 00000100:00100000:2.0:1746155639.441795:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125880064 00000100:00100000:2.0:1746155639.441817:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16730 00000100:00100000:2.0:1746155639.441823:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976125879936:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.441831:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.441841:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f725f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17bdb expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.441865:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125326464:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155639.441904:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.441931:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16731 00000100:00100000:0.0:1746155639.441948:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1963:x1830976125880064:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155639.441955:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155639.441961:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f7266 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17be2 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.441971:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.441972:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.441979:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f7266 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be2 expref: 19 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.441990:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f7266 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be2 expref: 19 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.441999:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0a00, rc 0) 00000100:00100000:0.0:1746155639.442029:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1963:x1830976125880064:12345-192.168.202.51@tcp:101:cat.0 Request processed in 92us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155639.442034:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16731 00000100:00100000:2.0:1746155639.443385:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125326336:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155639.443412:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093480800/0x844e5faceb5f7258 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bd4 expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.443423:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093480800/0x844e5faceb5f7258 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bd4 expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.443433:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093480800, rc 0) 00000100:00100000:2.0:1746155639.443465:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976125879808:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3535us (3629us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155639.443471:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16729 00000100:00100000:3.0:1746155639.445626:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125879040:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10468us (12648us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155639.445636:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7934 00002000:00100000:3.0:1746155639.445645:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f700380 x1830976125879040/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.445654:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700380 with x1830976125879040 ext(4194304->5083135) 00002000:00010000:3.0:1746155639.445659:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f700380 00000100:00100000:0.0:1746155639.445884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.445950:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125880192 00000100:00100000:2.0:1746155639.445957:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125880192 00000100:00100000:2.0:1746155639.446001:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 748 00000100:00100000:2.0:1746155639.446007:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976125880192:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.446017:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.446036:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093480000/0x844e5faceb5f724a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bcd expref: 17 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.446048:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.446052:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155639.446193:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125326464:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155639.446220:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f725f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bdb expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155639.446235:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f725f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bdb expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155639.446252:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090414c00, rc 0) 00000100:00100000:3.0:1746155639.446344:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976125879936:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4521us (4799us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155639.446344:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125880192:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 336us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.446349:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16730 00000100:00100000:2.0:1746155639.446350:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 748 00000100:00100000:0.0:1746155639.449316:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.449390:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125880320 00000100:00100000:3.0:1746155639.449398:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125880320 00000100:00100000:3.0:1746155639.449446:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16732 00000100:00100000:3.0:1746155639.449452:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32220:x1830976125880320:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155639.449466:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.449480:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f471000/0x844e5faceb5f726d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17be9 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.449617:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 29 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.449624:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155639.449626:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155639.449629:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f471000/0x844e5faceb5f726d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be9 expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.449653:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 29 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.449669:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 29 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.449680:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125326592:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.450139:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155639.452960:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125326592:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.452986:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f471000/0x844e5faceb5f726d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be9 expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.453001:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f471000, rc 0) 00000100:00100000:3.0:1746155639.453048:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32220:x1830976125880320:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3595us (3737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.453055:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16732 00000100:00100000:0.0:1746155639.453378:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.453493:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125880448 00000100:00100000:3.0:1746155639.453499:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125880448 00002000:00100000:3.0:1746155639.453692:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (802816->1048575) req@ffff88009ca97b80 x1830976125880448/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.453700:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97b80 with x1830976125880448 ext(802816->1048575) 00010000:00010000:3.0:1746155639.453705:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 30 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.453717:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 30 pid: 10591 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746155639.453727:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca97b80 00000100:00100000:3.0:1746155639.453752:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1366 00000100:00100000:3.0:1746155639.453759:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125880448:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155639.457873:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976125880448:12345-192.168.202.51@tcp:4:cat.0 Request processed in 4106us (4488us total) trans 17179874203 rc 0/0 00000100:00100000:3.0:1746155639.457883:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1366 00002000:00100000:3.0:1746155639.457892:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (802816->1048575) req@ffff88009ca97b80 x1830976125880448/t17179874203(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/448 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.457900:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97b80 with x1830976125880448 ext(802816->1048575) 00010000:00010000:3.0:1746155639.457909:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 32 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.457921:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 32 pid: 10591 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746155639.457927:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca97b80 00000100:00100000:0.0:1746155639.459915:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.460645:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125880576 00000100:00100000:2.0:1746155639.460653:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125880576 00010000:00010000:2.0:1746155639.460681:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 32 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.461000:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.461046:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8574 00000100:00100000:3.0:1746155639.461049:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125880704 00000100:00100000:3.0:1746155639.461052:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125880704 00000100:00100000:2.0:1746155639.461053:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976125880576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.461065:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155639.461081:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16733 00000100:00100000:3.0:1746155639.461086:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32217:x1830976125880704:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155639.461093:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 32 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.461098:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.461107:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 32 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.461108:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17bf0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.461123:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ed0400/0x844e5faceb5f7204 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 802816->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb8 expref: 32 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.461127:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ff00c00/0x844e5faceb5f70a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b02 expref: 18 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.461133:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc68e00/0x844e5faceb5f70ad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b10 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.461137:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.461138:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.461138:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.461139:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.461142:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3227648->3543039] (req 3227648->3543039) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.461143:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f471000/0x844e5faceb5f726d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be9 expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.461149:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f471000/0x844e5faceb5f726d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be9 expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.461163:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc68e00/0x844e5faceb5f70ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b10 expref: 14 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.461164:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f471000/0x844e5faceb5f726d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be9 expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.461172:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc68e00/0x844e5faceb5f70ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b10 expref: 14 pid: 8437 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746155639.461173:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125326848:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155639.461178:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125326720:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.461912:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a780 going to sleep for 11 seconds 00010000:00010000:3.0:1746155639.461935:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ff00c00/0x844e5faceb5f70a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b02 expref: 18 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.461958:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ff00c00/0x844e5faceb5f70a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b02 expref: 18 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.461966:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125326976:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.461984:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155639.465084:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125326720:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.465094:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125326976:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.465117:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3227648->3543039] (req 3227648->3543039) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.465132:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c286600, rc 0) 00000100:00100000:3.0:1746155639.465178:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32217:x1830976125880704:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4091us (4177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.465185:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16733 00000100:00100000:2.0:1746155639.465358:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125326848:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155639.465376:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.465394:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976125880576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4341us (5484us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.465700:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8574 00000100:00100000:1.0:1746155639.466185:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.466222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.466286:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125880832 00000100:00100000:2.0:1746155639.466469:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125880960 00000100:00100000:2.0:1746155639.466472:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125880960 00010000:00010000:2.0:1746155639.466490:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ff00c00/0x844e5faceb5f70a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b02 expref: 18 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.466535:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8575 00000100:00100000:2.0:1746155639.466541:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976125880960:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.466550:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.466567:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ff00c00/0x844e5faceb5f70a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b02 expref: 18 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.466577:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ff00c00/0x844e5faceb5f70a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b02 expref: 18 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.466594:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ff00c00/0x844e5faceb5f70a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b02 expref: 18 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.466616:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.466643:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125880960:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 102us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.466648:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8575 00000100:00100000:0.0:1746155639.466798:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125880832 00010000:00010000:0.0:1746155639.466812:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc68e00/0x844e5faceb5f70ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b10 expref: 15 pid: 8437 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746155639.466825:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8576 00000100:00100000:1.0:1746155639.466826:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.466829:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1963:x1830976125880832:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155639.466834:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155639.466841:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc68e00/0x844e5faceb5f70ad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b10 expref: 15 pid: 8437 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746155639.466849:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc68e00/0x844e5faceb5f70ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b10 expref: 15 pid: 8437 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746155639.466858:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc68e00/0x844e5faceb5f70ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b10 expref: 15 pid: 8437 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746155639.466868:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.466869:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.466874:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.466880:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.466900:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.466908:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125327104:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155639.466954:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155639.467003:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125881216 00000100:00100000:3.0:1746155639.467007:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125881216 00002000:00100000:3.0:1746155639.467028:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f4ffb80 x1830976125881216/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.467036:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ffb80 with x1830976125881216 ext(0->1048575) 00002000:00010000:3.0:1746155639.467039:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4ffb80 00000100:00100000:3.0:1746155639.467051:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7935 00000100:00100000:3.0:1746155639.467056:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1963:x1830976125881216:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155639.469096:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125327104:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155639.469113:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155639.469347:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.469387:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125881472 00000100:00100000:1.0:1746155639.469392:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125881472 00002000:00100000:1.0:1746155639.469417:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3227648->3231743) req@ffff88009ca94000 x1830976125881472/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.469425:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94000 with x1830976125881472 ext(3227648->3231743) 00002000:00010000:1.0:1746155639.469429:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca94000 00000100:00100000:2.0:1746155639.469585:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1963:x1830976125880832:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2753us (3398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.469594:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8576 00000100:00100000:1.0:1746155639.469710:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7936 00000100:00100000:1.0:1746155639.469719:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976125881472:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155639.469822:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976125881472:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 104us (476us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155639.469827:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7936 00002000:00100000:1.0:1746155639.469832:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3227648->3231743) req@ffff88009ca94000 x1830976125881472/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.469839:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94000 with x1830976125881472 ext(3227648->3231743) 00002000:00010000:1.0:1746155639.469842:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca94000 00000100:00100000:2.0:1746155639.474266:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1963:x1830976125881216:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7201us (7431us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.474277:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7935 00002000:00100000:2.0:1746155639.474286:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f4ffb80 x1830976125881216/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.474294:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ffb80 with x1830976125881216 ext(0->1048575) 00002000:00010000:2.0:1746155639.474298:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4ffb80 00000100:00100000:0.0:1746155639.476339:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.476450:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125881728 00000100:00100000:2.0:1746155639.476458:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125881728 00002000:00100000:2.0:1746155639.476491:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3538944->3543039) req@ffff88009ca94380 x1830976125881728/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.476500:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94380 with x1830976125881728 ext(3538944->3543039) 00002000:00010000:2.0:1746155639.476527:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca94380 00000100:00100000:2.0:1746155639.476561:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7937 00000100:00100000:2.0:1746155639.476569:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976125881728:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155639.476721:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976125881728:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 152us (386us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155639.476727:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7937 00002000:00100000:2.0:1746155639.476732:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3538944->3543039) req@ffff88009ca94380 x1830976125881728/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.476738:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94380 with x1830976125881728 ext(3538944->3543039) 00002000:00010000:2.0:1746155639.476741:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca94380 00000100:00100000:0.0:1746155639.480450:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.480533:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125881984 00000100:00100000:0.0:1746155639.480539:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.480541:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125881984 00000100:00100000:3.0:1746155639.480584:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4688 00000100:00100000:3.0:1746155639.480592:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32217:x1830976125881984:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155639.480681:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125882112 00000100:00100000:2.0:1746155639.480686:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125882112 00000100:00100000:2.0:1746155639.480709:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16734 00000100:00100000:2.0:1746155639.480714:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32220:x1830976125882112:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.480723:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.480736:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f727b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17bf7 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155639.480781:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32217:x1830976125881984:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 189us (337us total) trans 8589945217 rc 0/0 00000100:00100000:3.0:1746155639.480790:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4688 00010000:00010000:2.0:1746155639.481253:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.481260:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155639.481262:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155639.481265:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f727b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf7 expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.481287:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.481296:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 13 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.481306:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125327232:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.481372:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.486551:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125327232:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.486581:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f727b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf7 expref: 18 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.486596:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090414c00, rc 0) 00000100:00100000:2.0:1746155639.486646:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32220:x1830976125882112:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5931us (6142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.486655:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16734 00000100:00100000:0.0:1746155639.486730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.486927:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125882240 00000100:00100000:2.0:1746155639.486933:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125882240 00002000:00100000:2.0:1746155639.486969:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1486847) req@ffff88009ca97480 x1830976125882240/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.486978:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97480 with x1830976125882240 ext(1048576->1486847) 00010000:00010000:2.0:1746155639.486984:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 14 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.486994:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 14 pid: 10591 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746155639.487000:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca97480 00000100:00100000:2.0:1746155639.487024:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1367 00000100:00100000:2.0:1746155639.487030:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976125882240:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155639.493256:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976125882240:12345-192.168.202.51@tcp:4:cat.0 Request processed in 6219us (6519us total) trans 21474841527 rc 0/0 00000100:00100000:2.0:1746155639.493266:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1367 00002000:00100000:2.0:1746155639.493275:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1486847) req@ffff88009ca97480 x1830976125882240/t21474841527(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/448 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.493283:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97480 with x1830976125882240 ext(1048576->1486847) 00010000:00010000:2.0:1746155639.493290:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 16 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.493308:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 16 pid: 10591 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746155639.493314:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca97480 00000100:00100000:0.0:1746155639.495054:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.495128:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125882368 00000100:00100000:2.0:1746155639.495135:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125882368 00010000:00010000:2.0:1746155639.495159:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 16 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.495179:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8577 00000100:00100000:2.0:1746155639.495185:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976125882368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.495195:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.495209:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 16 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.495219:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 16 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.495236:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090415e00/0x844e5faceb5f720b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1486847) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bbf expref: 16 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.495262:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.495264:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.495270:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f727b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf7 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.495282:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f727b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf7 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.495308:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f727b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf7 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.495318:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125327360:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155639.495380:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.497072:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125327360:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155639.497086:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.497121:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976125882368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1935us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.497129:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8577 00000100:00100000:0.0:1746155639.501979:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.502093:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125882624 00000100:00100000:2.0:1746155639.502100:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125882624 00002000:00100000:2.0:1746155639.502136:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009ca97100 x1830976125882624/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.502144:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97100 with x1830976125882624 ext(1048576->2097151) 00002000:00010000:2.0:1746155639.502149:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca97100 00000100:00100000:2.0:1746155639.502174:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7938 00000100:00100000:2.0:1746155639.502181:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976125882624:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155639.504290:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.505219:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125882880 00000100:00100000:1.0:1746155639.505228:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125882880 00002000:00100000:1.0:1746155639.505263:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009ca97800 x1830976125882880/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.505272:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97800 with x1830976125882880 ext(1048576->2097151) 00002000:00010000:1.0:1746155639.505276:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca97800 00000100:00100000:1.0:1746155639.505299:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7939 00000100:00100000:1.0:1746155639.505305:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976125882880:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155639.508363:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976125882624:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 6174us (6383us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155639.508372:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7938 00002000:00100000:3.0:1746155639.508380:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009ca97100 x1830976125882624/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.508388:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97100 with x1830976125882624 ext(1048576->2097151) 00002000:00010000:3.0:1746155639.508392:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca97100 00000100:00100000:1.0:1746155639.513113:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976125882880:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7799us (8820us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155639.513123:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7939 00002000:00100000:1.0:1746155639.513133:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009ca97800 x1830976125882880/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.513142:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97800 with x1830976125882880 ext(1048576->2097151) 00002000:00010000:1.0:1746155639.513146:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca97800 00000100:00100000:0.0:1746155639.518572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.518635:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125883136 00000100:00100000:3.0:1746155639.518642:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125883136 00000100:00100000:3.0:1746155639.518691:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11068 00000100:00100000:3.0:1746155639.518698:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:32225:x1830976125883136:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155639.518716:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.518730:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40400/0x844e5faceb5f7282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17bfe expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.518820:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f7289 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.518830:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f7289 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.518840:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f7289 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.518851:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5f7290 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.518919:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5f7290 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.518925:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5f7290 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519016:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f471e00/0x844e5faceb5f7297 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519024:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f471e00/0x844e5faceb5f7297 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519029:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f471e00/0x844e5faceb5f7297 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155639.519037:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155639.519101:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f7289 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519107:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f7289 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519111:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f7289 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519116:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a40600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155639.519119:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f7289 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519124:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f7289 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519132:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155639.519135:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155639.519138:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f7289 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519142:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f7289 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519726:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5f7290 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519733:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5f7290 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519737:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5f7290 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519741:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c287000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155639.519743:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5f7290 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519748:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5f7290 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519754:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fab9700) 00010000:00010000:3.0:1746155639.519756:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155639.519758:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5f7290 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519763:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c287000/0x844e5faceb5f7290 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.519796:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40400/0x844e5faceb5f7282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bfe expref: 301 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.519809:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f471e00/0x844e5faceb5f7297 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bfe expref: 300 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.519815:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.519816:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155639.519818:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f471e00, rc 0) 00000100:00100000:3.0:1746155639.519871:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:32225:x1830976125883136:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1173us (1304us total) trans 8589945218 rc 0/0 00000100:00100000:3.0:1746155639.519877:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11068 00000100:00100000:0.0:1746155639.522691:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.522740:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.522790:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125883520 00000100:00100000:3.0:1746155639.522797:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125883520 00000100:00100000:2.0:1746155639.522812:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125883392 00000100:00100000:2.0:1746155639.522816:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125883392 00000100:00100000:3.0:1746155639.522839:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4689 00000100:00100000:2.0:1746155639.522843:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 749 00000100:00100000:3.0:1746155639.522846:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:32225:x1830976125883520:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155639.522848:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1962:x1830976125883392:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.522859:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.522878:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f471e00/0x844e5faceb5f7297 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bfe expref: 301 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.522893:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.522896:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.522929:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1962:x1830976125883392:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 80us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.522935:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 749 00000100:00100000:3.0:1746155639.522993:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:32225:x1830976125883520:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 147us (252us total) trans 8589945219 rc 0/0 00000100:00100000:3.0:1746155639.522998:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4689 00000100:00100000:1.0:1746155639.527074:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.527106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.527156:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125883776 00000100:00100000:3.0:1746155639.527163:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125883776 00002000:00100000:3.0:1746155639.527192:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f4fc380 x1830976125883776/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.527198:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fc380 with x1830976125883776 ext(2097152->3145727) 00002000:00010000:3.0:1746155639.527201:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fc380 00000100:00100000:3.0:1746155639.527218:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125883904 00000100:00100000:3.0:1746155639.527219:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125883904 00002000:00100000:3.0:1746155639.527226:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f4fca80 x1830976125883904/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 504/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.527230:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fca80 with x1830976125883904 ext(3145728->4194303) 00002000:00010000:3.0:1746155639.527232:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fca80 00000100:00100000:3.0:1746155639.527244:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7940 00000100:00100000:3.0:1746155639.527248:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976125883776:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155639.527462:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7941 00000100:00100000:0.0:1746155639.527471:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976125883904:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155639.532885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.533578:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125884160 00000100:00100000:0.0:1746155639.533585:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125884160 00000100:00100000:0.0:1746155639.533667:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16735 00000100:00100000:0.0:1746155639.533679:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:32225:x1830976125884160:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155639.533693:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155639.533708:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c05 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.533731:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a37200/0x844e5faceb5f7194 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b80 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.533739:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f71ef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ba3 expref: 32 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.533745:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.533746:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.533749:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3710976->3903487] (req 3710976->3903487) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 32 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.533772:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f71ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ba3 expref: 32 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.533782:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f71ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ba3 expref: 32 pid: 19959 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746155639.533792:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125327488:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155639.534343:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5a37200/0x844e5faceb5f7194 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b80 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.534352:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a37200/0x844e5faceb5f7194 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b80 expref: 9 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746155639.534359:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125327616:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155639.534382:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.536482:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976125883904:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9006us (9367us total) trans 0 rc 733184/733184 00000100:00100000:2.0:1746155639.536492:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7941 00002000:00100000:2.0:1746155639.536532:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f4fca80 x1830976125883904/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 504/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 733184/733184 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.536541:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fca80 with x1830976125883904 ext(3145728->4194303) 00002000:00010000:2.0:1746155639.536545:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fca80 00000100:00100000:3.0:1746155639.537288:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976125883776:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10036us (10216us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155639.537295:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7940 00002000:00100000:3.0:1746155639.537300:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f4fc380 x1830976125883776/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.537307:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fc380 with x1830976125883776 ext(2097152->3145727) 00002000:00010000:3.0:1746155639.537310:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fc380 00000100:00100000:1.0:1746155639.537379:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125327488:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155639.537387:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca95500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125327616:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155639.537410:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3710976->3903487] (req 3710976->3903487) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 32 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.537424:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0e00, rc 0) 00000100:00100000:1.0:1746155639.537439:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:32225:x1830976125884160:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3766us (4561us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.537444:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16735 00000100:00100000:1.0:1746155639.543596:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.543693:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.543774:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125884288 00000100:00100000:2.0:1746155639.543781:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125884288 00010000:00010000:2.0:1746155639.543811:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f71ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ba3 expref: 32 pid: 19959 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746155639.543847:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125884416 00000100:00100000:2.0:1746155639.543850:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125884416 00010000:00010000:2.0:1746155639.543861:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a37200/0x844e5faceb5f7194 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b80 expref: 10 pid: 10591 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.543878:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8578 00000100:00100000:2.0:1746155639.543884:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976125884288:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.543895:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.543915:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f71ef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ba3 expref: 32 pid: 19959 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746155639.543925:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f71ef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ba3 expref: 32 pid: 19959 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746155639.543953:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f71ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ba3 expref: 32 pid: 19959 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746155639.543970:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.544015:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976125884288:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 130us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.544021:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8578 00000100:00100000:2.0:1746155639.544035:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8579 00000100:00100000:2.0:1746155639.544040:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125884416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.544046:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.544053:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a37200/0x844e5faceb5f7194 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b80 expref: 10 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.544061:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5a37200/0x844e5faceb5f7194 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b80 expref: 10 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.544071:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a37200/0x844e5faceb5f7194 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b80 expref: 10 pid: 10591 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.544078:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.544080:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.544085:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 30 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.544092:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 30 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.544117:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 30 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.544127:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125327744:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155639.544175:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155639.544478:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.544524:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125884544 00000100:00100000:0.0:1746155639.544528:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125884544 00000100:00100000:0.0:1746155639.544547:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16736 00000100:00100000:0.0:1746155639.544552:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32220:x1830976125884544:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155639.544563:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155639.544572:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5f72ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c0c expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.544587:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 30 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.544596:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155639.544598:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155639.544601:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5f72ac lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c0c expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.544616:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 30 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.544629:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 30 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746155639.544637:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125327872:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155639.544679:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.546814:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.546975:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca96d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125327872:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.546994:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125884800 00010000:00010000:1.0:1746155639.546997:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5f72ac lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c0c expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155639.547000:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125884800 00010000:00010000:1.0:1746155639.547009:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1000, rc 0) 00002000:00100000:3.0:1746155639.547029:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3710976->3715071) req@ffff88009ca95500 x1830976125884800/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.547038:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95500 with x1830976125884800 ext(3710976->3715071) 00000100:00100000:1.0:1746155639.547039:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32220:x1830976125884544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2486us (2560us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155639.547045:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 31 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.547046:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16736 00010000:00010000:3.0:1746155639.547056:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 31 pid: 1625 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746155639.547063:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca95500 00000100:00100000:3.0:1746155639.547077:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1368 00000100:00100000:2.0:1746155639.547137:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125327744:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155639.547151:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.547167:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125884416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3128us (3476us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.547174:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8579 00000100:00100000:3.0:1746155639.547219:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976125884800:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155639.547331:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976125884800:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 248us (522us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155639.547336:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1368 00002000:00100000:3.0:1746155639.547341:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3710976->3715071) req@ffff88009ca95500 x1830976125884800/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.547347:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95500 with x1830976125884800 ext(3710976->3715071) 00010000:00010000:3.0:1746155639.547351:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 31 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.547358:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 31 pid: 1625 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746155639.547363:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca95500 00000100:00100000:0.0:1746155639.550321:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.550390:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125885056 00000100:00100000:3.0:1746155639.550396:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125885056 00002000:00100000:3.0:1746155639.550428:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3899392->3903487) req@ffff88009ca94a80 x1830976125885056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.550436:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94a80 with x1830976125885056 ext(3899392->3903487) 00010000:00010000:3.0:1746155639.550443:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 31 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.550455:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 31 pid: 1625 timeout: 868 lvb_type: 0 00002000:00010000:3.0:1746155639.550461:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca94a80 00000100:00100000:2.0:1746155639.550598:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1369 00000100:00100000:2.0:1746155639.550605:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976125885056:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155639.550739:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1963:x1830976125885056:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 133us (421us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155639.550745:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1369 00002000:00100000:2.0:1746155639.550750:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3899392->3903487) req@ffff88009ca94a80 x1830976125885056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.550756:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94a80 with x1830976125885056 ext(3899392->3903487) 00010000:00010000:2.0:1746155639.550760:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 31 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.550768:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 31 pid: 1625 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746155639.550773:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca94a80 00000100:00100000:0.0:1746155639.552208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.552364:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125885312 00000100:00100000:2.0:1746155639.552369:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125885312 00002000:00100000:2.0:1746155639.552391:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3710976->3903487) req@ffff88009ca96d80 x1830976125885312/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.552397:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96d80 with x1830976125885312 ext(3710976->3903487) 00010000:00010000:2.0:1746155639.552402:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 31 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.552412:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 31 pid: 1625 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746155639.552418:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca96d80 00000100:00100000:2.0:1746155639.552442:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1370 00000100:00100000:2.0:1746155639.552448:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976125885312:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155639.557014:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976125885312:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 4559us (4802us total) trans 17179874204 rc 0/0 00000100:00100000:2.0:1746155639.557023:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1370 00002000:00100000:2.0:1746155639.557032:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3710976->3903487) req@ffff88009ca96d80 x1830976125885312/t17179874204(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/448 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.557040:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96d80 with x1830976125885312 ext(3710976->3903487) 00010000:00010000:2.0:1746155639.557048:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 33 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.557060:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 33 pid: 1625 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746155639.557067:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca96d80 00000100:00100000:0.0:1746155639.559975:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.560247:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125885440 00000100:00100000:2.0:1746155639.560254:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125885440 00010000:00010000:2.0:1746155639.560283:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 33 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.560314:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8580 00000100:00100000:2.0:1746155639.560320:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1963:x1830976125885440:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.560332:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746155639.560347:0:7064:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155639 -> 1746155640 00002000:00010000:2.0:1746155639.560350:0:7064:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155639 -> 1746155640 00010000:00010000:2.0:1746155639.560354:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 33 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.560370:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 33 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.560387:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0e00/0x844e5faceb5f72a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3710976->3903487) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c05 expref: 33 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.560408:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.560410:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.560415:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5f72ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c0c expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.560422:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5f72ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c0c expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.560446:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5f72ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c0c expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.560456:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125328000:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155639.560640:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.563632:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125328000:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155639.563653:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.563701:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976125885440:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3379us (3731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.563710:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8580 00000100:00100000:0.0:1746155639.565702:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.565759:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125885696 00000100:00100000:2.0:1746155639.565766:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125885696 00002000:00100000:2.0:1746155639.565797:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f0db800 x1830976125885696/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.565806:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0db800 with x1830976125885696 ext(3145728->4194303) 00002000:00010000:2.0:1746155639.565810:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0db800 00000100:00100000:2.0:1746155639.565839:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7942 00000100:00100000:2.0:1746155639.565845:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125885696:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155639.572182:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125885696:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6328us (6476us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155639.572193:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7942 00002000:00100000:3.0:1746155639.572202:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f0db800 x1830976125885696/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.572211:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0db800 with x1830976125885696 ext(3145728->4194303) 00002000:00010000:3.0:1746155639.572216:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0db800 00000100:00100000:0.0:1746155639.580430:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.581127:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125885952 00000100:00100000:3.0:1746155639.581135:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125885952 00002000:00100000:3.0:1746155639.581169:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f0d9f80 x1830976125885952/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.581178:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d9f80 with x1830976125885952 ext(4194304->5083135) 00002000:00010000:3.0:1746155639.581183:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d9f80 00000100:00100000:3.0:1746155639.581288:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7943 00000100:00100000:3.0:1746155639.581295:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125885952:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155639.592070:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125885952:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10767us (12027us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155639.592080:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7943 00002000:00100000:3.0:1746155639.592090:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f0d9f80 x1830976125885952/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.592098:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d9f80 with x1830976125885952 ext(4194304->5083135) 00002000:00010000:3.0:1746155639.592103:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d9f80 00000100:00100000:0.0:1746155639.603094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.603185:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125886208 00000100:00100000:1.0:1746155639.603192:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125886208 00000100:00100000:1.0:1746155639.603234:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4690 00000100:00100000:1.0:1746155639.603240:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32220:x1830976125886208:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155639.603458:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32220:x1830976125886208:12345-192.168.202.51@tcp:35:cat.0 Request processed in 217us (371us total) trans 8589945220 rc 0/0 00000100:00100000:1.0:1746155639.603463:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4690 00000100:00100000:0.0:1746155639.619831:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.619915:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125886336 00000100:00100000:3.0:1746155639.619924:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125886336 00000100:00100000:3.0:1746155639.619969:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11069 00000100:00100000:3.0:1746155639.619975:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32228:x1830976125886336:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155639.619994:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.620007:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f72b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c13 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.620052:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40400/0x844e5faceb5f72ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.620062:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40400/0x844e5faceb5f72ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.620070:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40400/0x844e5faceb5f72ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.620079:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1c61200/0x844e5faceb5f72c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.620083:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1c61200/0x844e5faceb5f72c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.620088:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1c61200/0x844e5faceb5f72c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.620184:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.620193:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a6f expref: 299 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.620199:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.620222:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a6f expref: 299 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.620233:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a6f expref: 299 pid: 15474 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.620244:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125328128:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.620321:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155639.622989:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125328128:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.623009:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155639.624776:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.624868:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125886592 00000100:00100000:3.0:1746155639.624874:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125886592 00000100:00100000:3.0:1746155639.624922:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4691 00000100:00100000:3.0:1746155639.624929:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:23568:x1830976125886592:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746155639.625120:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:23568:x1830976125886592:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 190us (347us total) trans 8589945221 rc 0/0 00000100:00100000:3.0:1746155639.625127:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4691 00000100:00100000:0.0:1746155639.627014:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.627331:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125886720 00000100:00100000:2.0:1746155639.627337:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125886720 00010000:00010000:2.0:1746155639.627361:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a6f expref: 301 pid: 15474 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.627392:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8581 00000100:00100000:2.0:1746155639.627398:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1961:x1830976125886720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.627407:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.627412:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a6f expref: 301 pid: 15474 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.627421:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a6f expref: 301 pid: 15474 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.627437:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f6fe9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a6f expref: 301 pid: 15474 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.627458:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.627462:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627472:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627477:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627495:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.627551:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1961:x1830976125886720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 153us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.627556:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8581 00010000:00010000:2.0:1746155639.627604:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627609:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155639.627637:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155639.627640:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155639.627650:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627657:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627664:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40400/0x844e5faceb5f72ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627668:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40400/0x844e5faceb5f72ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627673:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40400/0x844e5faceb5f72ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627680:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a40400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155639.627683:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40400/0x844e5faceb5f72ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627688:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40400/0x844e5faceb5f72ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627694:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155639.627696:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155639.627698:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40400/0x844e5faceb5f72ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627702:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40400/0x844e5faceb5f72ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627709:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1c61200/0x844e5faceb5f72c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627713:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1c61200/0x844e5faceb5f72c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627717:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1c61200/0x844e5faceb5f72c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627720:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b1c61200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155639.627722:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1c61200/0x844e5faceb5f72c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627725:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1c61200/0x844e5faceb5f72c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627730:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fab9700) 00010000:00010000:2.0:1746155639.627731:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155639.627733:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1c61200/0x844e5faceb5f72c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627737:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1c61200/0x844e5faceb5f72c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.627761:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f72b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c13 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.627768:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c13 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.627773:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.627775:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155639.627777:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17a200, rc 0) 00000100:00100000:2.0:1746155639.627794:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32228:x1830976125886336:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 7820us (7972us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.627799:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11069 00000100:00100000:0.0:1746155639.629997:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.630026:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.630049:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.630172:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125886848 00000100:00100000:1.0:1746155639.630177:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125886848 00000100:00100000:2.0:1746155639.630188:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125887104 00000100:00100000:2.0:1746155639.630192:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125887104 00000100:00100000:2.0:1746155639.630221:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125887360 00000100:00100000:2.0:1746155639.630223:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125887360 00000100:00100000:2.0:1746155639.630552:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16737 00000100:00100000:2.0:1746155639.630560:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125887104:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155639.630573:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.630584:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a45200/0x844e5faceb5f72cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c28 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.630600:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.630601:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.630609:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a45200/0x844e5faceb5f72cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c28 expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.630621:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a45200/0x844e5faceb5f72cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c28 expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.630630:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a45200, rc 0) 00000100:00100000:1.0:1746155639.630645:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16738 00000100:00100000:0.0:1746155639.630651:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16739 00000100:00100000:1.0:1746155639.630652:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125887360:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:0.0:1746155639.630657:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125886848:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155639.630659:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155639.630662:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125887104:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 104us (635us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155639.630662:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155639.630667:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16737 00010000:00010000:1.0:1746155639.630668:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013142b200/0x844e5faceb5f72d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c36 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.630668:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe06200/0x844e5faceb5f72dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c1a expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.630679:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.630679:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.630681:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.630681:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.630685:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013142b200/0x844e5faceb5f72d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c36 expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.630685:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe06200/0x844e5faceb5f72dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c1a expref: 11 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.630694:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013142b200/0x844e5faceb5f72d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c36 expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.630694:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fe06200/0x844e5faceb5f72dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c1a expref: 11 pid: 4461 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155639.630698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155639.630701:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013142b200, rc 0) 00010000:00010000:0.0:1746155639.630701:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe06200, rc 0) 00000100:00100000:2.0:1746155639.630714:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125886976 00000100:00100000:2.0:1746155639.630716:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125886976 00000100:00100000:1.0:1746155639.630716:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125887360:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 65us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155639.630716:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125886848:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 60us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.630721:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16738 00000100:00100000:0.0:1746155639.630723:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16739 00000100:00100000:1.0:1746155639.630768:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:3.0:1746155639.630781:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746155639.630791:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125887232 00000100:00100000:3.0:1746155639.630794:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125887232 00000100:00100000:1.0:1746155639.630800:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.630814:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125887488 00000100:00100000:3.0:1746155639.630816:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125887488 00000100:00100000:1.0:1746155639.630816:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16740 00000100:00100000:1.0:1746155639.630820:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125887232:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:3.0:1746155639.630826:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16741 00010000:00010000:1.0:1746155639.630826:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155639.630830:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125887488:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155639.630832:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013142a000/0x844e5faceb5f72e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c2f expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.630835:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.630840:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f72eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c3d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.630840:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.630842:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.630846:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013142a000/0x844e5faceb5f72e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c2f expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.630853:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013142a000/0x844e5faceb5f72e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c2f expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.630859:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013142a000, rc 0) 00000100:00100000:3.0:1746155639.630869:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125328256:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155639.630870:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125887232:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 50us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.630874:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16740 00000100:00100000:3.0:1746155639.630910:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.631090:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16742 00000100:00100000:2.0:1746155639.631095:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125886976:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155639.631101:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.631107:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a44400/0x844e5faceb5f72f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c21 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.631117:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.631118:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.631122:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a44400/0x844e5faceb5f72f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c21 expref: 13 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.631135:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093a44400/0x844e5faceb5f72f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c21 expref: 13 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.631142:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a44400, rc 0) 00000100:00100000:2.0:1746155639.631158:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125886976:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 63us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.631162:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16742 00002000:00010000:3.0:1746155639.633462:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime: 1746155638 -> 1746155640 00002000:00010000:3.0:1746155639.633470:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime: 1746155638 -> 1746155640 00002000:00010000:3.0:1746155639.633472:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime: 1746155639 -> 1746155640 00000100:00100000:3.0:1746155639.633491:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125328256:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155639.633538:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f72eb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c3d expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155639.633550:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f72eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c3d expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155639.633572:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17ae00, rc 0) 00000100:00100000:3.0:1746155639.633610:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125887488:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2778us (2808us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155639.633617:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16741 00000100:00100000:2.0:1746155639.637336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.637393:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125887744 00000100:00100000:0.0:1746155639.637400:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125887744 00000100:00100000:0.0:1746155639.637444:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11070 00000100:00100000:0.0:1746155639.637451:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32228:x1830976125887744:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155639.637465:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155639.637482:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06800/0x844e5faceb5f72f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c44 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.637562:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155639.637573:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c13 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.637579:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155639.637601:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c13 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.637609:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c13 expref: 8 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746155639.637618:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125328384:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155639.637682:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.638981:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.639032:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125887872 00000100:00100000:3.0:1746155639.639037:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125887872 00010000:00010000:3.0:1746155639.639058:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c13 expref: 9 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.639058:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125328384:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.639075:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155639.639077:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8582 00000100:00100000:3.0:1746155639.639083:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125887872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155639.639090:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155639.639094:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c13 expref: 9 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.639102:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c13 expref: 9 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.639116:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17a200/0x844e5faceb5f72c8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c13 expref: 9 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.639129:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.639132:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.639138:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.639143:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.641426:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155639.641471:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125887872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2384us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.641479:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8582 00010000:00010000:2.0:1746155639.641722:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.641729:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155639.641744:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155639.641862:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe06800/0x844e5faceb5f72f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c44 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.641893:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c44 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.641901:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.641903:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155639.641905:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe07c00, rc 0) 00000100:00100000:2.0:1746155639.641947:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32228:x1830976125887744:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4483us (4604us total) trans 8589945222 rc 0/0 00000100:00100000:2.0:1746155639.641954:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11070 00000100:00100000:0.0:1746155639.644337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.644443:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125888000 00000100:00100000:2.0:1746155639.644450:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125888000 00000100:00100000:2.0:1746155639.644492:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11071 00000100:00100000:2.0:1746155639.644500:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32228:x1830976125888000:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155639.644552:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.644565:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44c00/0x844e5faceb5f730e lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c4b expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.644628:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f7315 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.644639:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c44 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.644645:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f7315 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.644667:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c44 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.644677:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c44 expref: 9 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.644687:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125328512:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.644754:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.646265:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d3480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125328512:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.646285:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f7315 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155639.646841:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.646906:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125888128 00000100:00100000:3.0:1746155639.646910:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125888128 00010000:00010000:3.0:1746155639.646931:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c44 expref: 10 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.646962:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8583 00000100:00100000:3.0:1746155639.646968:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125888128:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155639.646979:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155639.646984:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c44 expref: 10 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.646993:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c44 expref: 10 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.647463:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe07c00/0x844e5faceb5f7300 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c44 expref: 10 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.647479:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.647482:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f7315 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.647489:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f7315 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.647494:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f7315 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.647543:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155639.647588:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125888128:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 616us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.647595:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8583 00010000:00010000:1.0:1746155639.647884:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f7315 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155639.647892:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f7315 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155639.647922:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155639.647926:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155639.647954:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f7315 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155639.647977:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44c00/0x844e5faceb5f730e lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c4b expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.647997:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f7315 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c4b expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.648003:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155639.648006:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155639.648008:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a44000, rc 0) 00000100:00100000:1.0:1746155639.648846:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32228:x1830976125888000:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4346us (4511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.648853:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11071 00000100:00100000:0.0:1746155639.651065:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.651158:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125888256 00000100:00100000:3.0:1746155639.651165:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125888256 00000100:00100000:3.0:1746155639.651632:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16743 00000100:00100000:3.0:1746155639.651640:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125888256:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155639.651652:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.651666:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f17ba00/0x844e5faceb5f731c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c52 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155639.651705:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125328640:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155639.652375:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155639.654593:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125328640:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155639.654620:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f17ba00/0x844e5faceb5f731c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c52 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155639.654631:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f17ba00/0x844e5faceb5f731c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c52 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155639.654642:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17ba00, rc 0) 00000100:00100000:3.0:1746155639.654806:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125888256:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3164us (3746us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155639.654813:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16743 00000100:00100000:1.0:1746155639.657086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.657129:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125888512 00000100:00100000:2.0:1746155639.657136:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125888512 00000100:00100000:2.0:1746155639.657174:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11072 00000100:00100000:2.0:1746155639.657179:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32228:x1830976125888512:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155639.657193:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.657205:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45a00/0x844e5faceb5f7323 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c59 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.657271:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44c00/0x844e5faceb5f732a lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.657282:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44c00/0x844e5faceb5f732a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.657290:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44c00/0x844e5faceb5f732a lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155639.657299:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155639.657380:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a45a00/0x844e5faceb5f7323 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c59 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.657465:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44c00/0x844e5faceb5f732a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c59 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.657471:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.657473:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155639.657476:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093a44c00, rc 0) 00000100:00100000:2.0:1746155639.657616:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32228:x1830976125888512:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 435us (534us total) trans 8589945223 rc 0/0 00000100:00100000:2.0:1746155639.657622:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11072 00000100:00100000:0.0:1746155639.663806:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.663844:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.663876:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.663902:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125888640 00000100:00100000:1.0:1746155639.663910:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125888640 00000100:00100000:1.0:1746155639.663956:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125888896 00000100:00100000:1.0:1746155639.663959:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125888896 00000100:00100000:1.0:1746155639.663972:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125889152 00000100:00100000:1.0:1746155639.663974:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125889152 00000100:00100000:1.0:1746155639.663985:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16744 00000100:00100000:1.0:1746155639.663991:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125888640:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:0.0:1746155639.664000:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.664016:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125888768 00000100:00100000:0.0:1746155639.664019:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125888768 00010000:00010000:1.0:1746155639.664023:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.664035:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16745 00010000:00010000:1.0:1746155639.664037:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f471000/0x844e5faceb5f726d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be9 expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.664040:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125888896:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155639.664044:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fe06200/0x844e5faceb5f72dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c1a expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.664049:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.664051:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.664053:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.664056:0:9235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.664067:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f471600/0x844e5faceb5f71fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb1 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.664074:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a45200/0x844e5faceb5f72cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c28 expref: 12 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.664076:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fe06200/0x844e5faceb5f72dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c1a expref: 12 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.664081:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f7266 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be2 expref: 17 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.664086:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.664087:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.664089:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.664092:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fe06200/0x844e5faceb5f72dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c1a expref: 12 pid: 4461 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746155639.664103:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125328768:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155639.664104:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f7266 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be2 expref: 17 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.664112:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f7266 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be2 expref: 17 pid: 4461 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746155639.664120:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125328896:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155639.664168:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f471000/0x844e5faceb5f726d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be9 expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.664176:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f471000/0x844e5faceb5f726d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be9 expref: 9 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.664184:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125329024:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.664218:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16746 00000100:00100000:2.0:1746155639.664226:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125889152:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155639.664242:0:19959:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.664251:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5f72ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c0c expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.664257:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013142b200/0x844e5faceb5f72d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c36 expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.664262:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.664263:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.664265:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.664277:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013142b200/0x844e5faceb5f72d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c36 expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.664284:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013142b200/0x844e5faceb5f72d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c36 expref: 12 pid: 1625 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746155639.664292:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125329152:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.664355:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16747 00000100:00100000:3.0:1746155639.664361:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125888768:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155639.664376:0:10591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.664384:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f727b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf7 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.664389:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093a44400/0x844e5faceb5f72f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c21 expref: 12 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155639.664398:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.664399:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.664400:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.664414:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a44400/0x844e5faceb5f72f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c21 expref: 12 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155639.664421:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a44400/0x844e5faceb5f72f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c21 expref: 12 pid: 19959 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746155639.664428:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125329280:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155639.665094:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093a45200/0x844e5faceb5f72cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c28 expref: 12 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.665102:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093a45200/0x844e5faceb5f72cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c28 expref: 12 pid: 10591 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746155639.665109:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.665110:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125329408:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155639.665131:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f471600/0x844e5faceb5f71fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb1 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.665137:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f471600/0x844e5faceb5f71fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb1 expref: 14 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746155639.665143:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125329536:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155639.665144:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.665153:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155639.665160:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125889024 00000100:00100000:1.0:1746155639.665163:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125889024 00000100:00100000:1.0:1746155639.665187:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16748 00000100:00100000:1.0:1746155639.665192:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976125889024:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155639.665208:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.665218:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c51aa00/0x844e5faceb5f7098 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17af4 expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.665224:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013142a000/0x844e5faceb5f72e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c2f expref: 13 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.665231:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc69c00/0x844e5faceb5f70bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b1e expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.665236:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.665238:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.665240:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.665253:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc69c00/0x844e5faceb5f70bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b1e expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.665261:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc69c00/0x844e5faceb5f70bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b1e expref: 9 pid: 8437 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746155639.665268:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125329664:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155639.665296:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013142a000/0x844e5faceb5f72e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c2f expref: 13 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.665303:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013142a000/0x844e5faceb5f72e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c2f expref: 13 pid: 1625 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746155639.665310:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125329792:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155639.665328:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c51aa00/0x844e5faceb5f7098 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17af4 expref: 31 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.665339:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c51aa00/0x844e5faceb5f7098 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17af4 expref: 31 pid: 8436 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.665346:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125329920:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155639.665357:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effd80 going to sleep for 11 seconds 00010000:00010000:2.0:1746155639.665387:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5f72ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c0c expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.665399:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5f72ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c0c expref: 9 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.665411:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125330048:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.665427:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a180 going to sleep for 11 seconds 00010000:00010000:3.0:1746155639.665470:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f727b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf7 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.665478:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f727b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf7 expref: 17 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.665485:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125330176:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.665498:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.665588:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.665611:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125889280 00000100:00100000:0.0:1746155639.665614:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125889280 00000100:00100000:0.0:1746155639.665632:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16749 00000100:00100000:0.0:1746155639.665637:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976125889280:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155639.665652:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.665661:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.665665:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155639.665667:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155639.665669:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.665682:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.665689:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 17 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746155639.666318:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125330304:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155639.666355:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155639.671756:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125329152:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155639.671821:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125330304:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155639.671840:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.671867:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.671881:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.671895:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125889408 00000100:00100000:0.0:1746155639.671900:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125889408 00000100:00100000:2.0:1746155639.671904:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125328896:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.671914:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125329408:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.671921:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125329536:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155639.671923:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe06200/0x844e5faceb5f72dd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c1a expref: 14 pid: 4461 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746155639.671954:0:9235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.671955:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125889792 00000100:00100000:0.0:1746155639.671957:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125889792 00010000:00010000:0.0:1746155639.671966:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f471000/0x844e5faceb5f726d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be9 expref: 10 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746155639.671985:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8584 00000100:00100000:0.0:1746155639.671991:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1962:x1830976125889408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155639.672001:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155639.672017:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fe06200/0x844e5faceb5f72dd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c1a expref: 14 pid: 4461 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746155639.672025:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fe06200/0x844e5faceb5f72dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c1a expref: 14 pid: 4461 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746155639.672045:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155639.672075:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1962:x1830976125889408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 84us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155639.672081:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8584 00000100:00100000:0.0:1746155639.672094:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8585 00000100:00100000:0.0:1746155639.672099:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976125889792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155639.672105:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155639.672112:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f471000/0x844e5faceb5f726d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be9 expref: 10 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746155639.672119:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f471000/0x844e5faceb5f726d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be9 expref: 10 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746155639.672129:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.672131:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.672135:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.672142:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.672151:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125329664:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155639.672154:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.672158:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125329792:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155639.672165:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125329920:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155639.672168:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976125889792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 69us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155639.672173:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8585 00010000:00010000:1.0:1746155639.672180:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.672198:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe06200/0x844e5faceb5f72dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c1a expref: 13 pid: 4461 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746155639.672201:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.672213:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125328768:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155639.672214:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125890048 00000100:00100000:0.0:1746155639.672217:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125890048 00010000:00010000:1.0:1746155639.672220:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f471000/0x844e5faceb5f726d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be9 expref: 9 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746155639.672226:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a44400/0x844e5faceb5f72f2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c21 expref: 14 pid: 19959 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746155639.672227:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125329024:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155639.672235:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.672238:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8586 00000100:00100000:0.0:1746155639.672242:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1962:x1830976125890048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.672246:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.672247:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.672252:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.672257:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a44400/0x844e5faceb5f72f2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c21 expref: 14 pid: 19959 timeout: 868 lvb_type: 1 00010000:00010000:0.0:1746155639.672264:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a44400/0x844e5faceb5f72f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c21 expref: 14 pid: 19959 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746155639.672270:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.672273:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155639.672276:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.672282:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.672284:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1962:x1830976125890048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 42us (83us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155639.672287:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013142ba00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155639.672290:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.672291:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8586 00010000:00010000:1.0:1746155639.672297:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.672305:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.672310:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013142ba00/0x844e5faceb5f7338 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.672326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.672333:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125890432 00000100:00100000:0.0:1746155639.672335:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125890432 00010000:00010000:0.0:1746155639.672342:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c51aa00/0x844e5faceb5f7098 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17af4 expref: 32 pid: 8436 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.672346:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125888640:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 8354us (8547us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.672352:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16744 00000100:00100000:0.0:1746155639.672352:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8587 00000100:00100000:0.0:1746155639.672356:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1962:x1830976125890432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155639.672360:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155639.672367:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c51aa00/0x844e5faceb5f7098 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17af4 expref: 32 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746155639.672374:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c51aa00/0x844e5faceb5f7098 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17af4 expref: 32 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746155639.672382:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c51aa00/0x844e5faceb5f7098 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17af4 expref: 32 pid: 8436 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746155639.672391:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155639.672401:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1962:x1830976125890432:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 44us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155639.672405:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8587 00000100:00100000:3.0:1746155639.672440:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125330048:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.672460:0:19959:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.672485:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a44400/0x844e5faceb5f72f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c21 expref: 13 pid: 19959 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746155639.672496:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125329280:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.672523:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125330176:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.672535:0:10591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.672630:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.672645:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.672651:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125889664 00000100:00100000:0.0:1746155639.672654:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125889664 00010000:00010000:0.0:1746155639.672662:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f7266 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be2 expref: 18 pid: 4461 timeout: 868 lvb_type: 1 00000100:00100000:0.0:1746155639.673472:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125889920 00000100:00100000:0.0:1746155639.673477:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125889920 00010000:00010000:0.0:1746155639.673488:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013142b200/0x844e5faceb5f72d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c36 expref: 12 pid: 1625 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746155639.673533:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8588 00000100:00100000:2.0:1746155639.673539:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d759850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976125889664:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.673546:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.673557:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f7266 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be2 expref: 18 pid: 4461 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746155639.673565:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f7266 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be2 expref: 18 pid: 4461 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746155639.673576:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f7266 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17be2 expref: 18 pid: 4461 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746155639.673587:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.673604:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d759850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976125889664:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 65us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.673612:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8588 00000100:00100000:2.0:1746155639.673636:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8589 00000100:00100000:2.0:1746155639.673640:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976125889920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.673645:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.673653:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013142b200/0x844e5faceb5f72d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c36 expref: 12 pid: 1625 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746155639.673659:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013142b200/0x844e5faceb5f72d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c36 expref: 12 pid: 1625 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746155639.673674:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013142b200/0x844e5faceb5f72d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c36 expref: 12 pid: 1625 timeout: 868 lvb_type: 1 00010000:00010000:2.0:1746155639.673680:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.673690:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976125889920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 50us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.673694:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8589 00000100:00100000:0.0:1746155639.674119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.674149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.674174:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.674207:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.674217:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.674369:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.674370:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125890176 00000100:00100000:1.0:1746155639.674374:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125890176 00010000:00010000:1.0:1746155639.674387:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013142a000/0x844e5faceb5f72e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c2f expref: 11 pid: 1625 timeout: 868 lvb_type: 1 00000100:00100000:1.0:1746155639.674397:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125890304 00000100:00100000:0.0:1746155639.674397:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.674398:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125890304 00010000:00010000:1.0:1746155639.674405:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f471600/0x844e5faceb5f71fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb1 expref: 15 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.674412:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125890816 00000100:00100000:1.0:1746155639.674414:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125890816 00010000:00010000:1.0:1746155639.674420:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5f72ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c0c expref: 9 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.674427:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125890944 00000100:00100000:1.0:1746155639.674428:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125890944 00010000:00010000:1.0:1746155639.674434:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc69c00/0x844e5faceb5f70bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b1e expref: 10 pid: 8437 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746155639.674437:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125889536 00000100:00100000:3.0:1746155639.674440:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125889536 00000100:00100000:1.0:1746155639.674441:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125890688 00000100:00100000:1.0:1746155639.674442:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125890688 00010000:00010000:1.0:1746155639.674448:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f727b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf7 expref: 17 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.674454:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8590 00000100:00100000:3.0:1746155639.674459:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976125890176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155639.674462:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8591 00000100:00100000:1.0:1746155639.674466:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976125890304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155639.674467:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.674471:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155639.674476:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013142a000/0x844e5faceb5f72e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c2f expref: 11 pid: 1625 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746155639.674478:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f471600/0x844e5faceb5f71fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb1 expref: 15 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.674483:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013142a000/0x844e5faceb5f72e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c2f expref: 11 pid: 1625 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746155639.674485:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f471600/0x844e5faceb5f71fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb1 expref: 15 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.674494:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013142a000/0x844e5faceb5f72e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c2f expref: 11 pid: 1625 timeout: 868 lvb_type: 1 00010000:00010000:1.0:1746155639.674496:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f471600/0x844e5faceb5f71fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bb1 expref: 15 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.674519:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155639.674520:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155639.674538:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976125890176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 79us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.674544:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8590 00000100:00100000:3.0:1746155639.674555:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8592 00000100:00100000:3.0:1746155639.674558:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125890816:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155639.674561:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8593 00010000:00010000:3.0:1746155639.674563:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155639.674567:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1963:x1830976125890944:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155639.674570:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5f72ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c0c expref: 10 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.674573:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155639.674576:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5f72ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c0c expref: 10 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.674581:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc69c00/0x844e5faceb5f70bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b1e expref: 10 pid: 8437 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746155639.674586:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1000/0x844e5faceb5f72ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c0c expref: 10 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.674588:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc69c00/0x844e5faceb5f70bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b1e expref: 10 pid: 8437 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746155639.674592:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.674594:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.674596:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.674601:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc69c00/0x844e5faceb5f70bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b1e expref: 9 pid: 8437 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746155639.674602:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.674608:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.674609:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.674611:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.674617:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155639.674617:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.674632:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.674965:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976125890304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 497us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.674970:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976125890816:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 409us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.674972:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8591 00000100:00100000:3.0:1746155639.674975:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8592 00000100:00100000:1.0:1746155639.674983:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8594 00000100:00100000:1.0:1746155639.674987:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d75a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976125890688:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155639.674993:0:19959:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.674993:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155639.675000:0:19959:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675001:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f727b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf7 expref: 17 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.675008:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f727b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf7 expref: 17 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.675014:0:19959:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.675020:0:19959:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675022:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090414c00/0x844e5faceb5f727b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf7 expref: 17 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.675026:0:19959:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675029:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.675030:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.675031:0:19959:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a45c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155639.675033:0:19959:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675033:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.675038:0:19959:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675038:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.675046:0:19959:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.675050:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093a45c00/0x844e5faceb5f7346 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675051:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.675065:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d75a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125890688:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 77us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.675070:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8594 00000100:00100000:3.0:1746155639.675079:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125889152:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 10855us (11203us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155639.675084:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155639.675085:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16746 00010000:00010000:1.0:1746155639.675090:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.675101:0:10591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675102:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.675107:0:10591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675107:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675117:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.675118:0:10591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675121:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f061a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155639.675123:0:10591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675124:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.675129:0:10591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675130:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.675133:0:10591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f17ae00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155639.675135:0:10591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675138:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.675140:0:10591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.675143:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f061a00/0x844e5faceb5f7354 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.675148:0:10591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.675153:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f17ae00/0x844e5faceb5f734d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.675167:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125889024:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 9975us (10024us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.675172:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16748 00000100:00100000:3.0:1746155639.675184:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976125888768:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 10824us (11184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.675190:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16747 00010000:00010000:3.0:1746155639.675210:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093a45200/0x844e5faceb5f72cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c28 expref: 12 pid: 10591 timeout: 868 lvb_type: 1 00000100:00100000:3.0:1746155639.675224:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8595 00000100:00100000:3.0:1746155639.675228:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125889536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155639.675233:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155639.675237:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1963:x1830976125890944:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 669us (1018us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155639.675241:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093a45200/0x844e5faceb5f72cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c28 expref: 12 pid: 10591 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746155639.675242:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8593 00010000:00010000:3.0:1746155639.675248:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093a45200/0x844e5faceb5f72cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c28 expref: 12 pid: 10591 timeout: 868 lvb_type: 1 00010000:00010000:3.0:1746155639.675257:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a45200/0x844e5faceb5f72cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c28 expref: 12 pid: 10591 timeout: 868 lvb_type: 1 00000100:00100000:2.0:1746155639.675257:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125890560 00000100:00100000:2.0:1746155639.675260:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125890560 00010000:00010000:3.0:1746155639.675264:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.675265:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.675267:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.675272:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746155639.675278:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3227648->3543039) req@ffff8800a06a4e00 x1830976125890560/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.675285:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a4e00 with x1830976125890560 ext(3227648->3543039) 00010000:00010000:2.0:1746155639.675289:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 16 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.675295:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155639.675299:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 16 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.675306:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125889536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 78us (938us total) trans 0 rc 0/0 00002000:00010000:2.0:1746155639.675308:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a06a4e00 00000100:00100000:3.0:1746155639.675311:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8595 00010000:00010000:2.0:1746155639.675325:0:9235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.675331:0:9235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.675342:0:9235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.675346:0:9235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.675351:0:9235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.675355:0:9235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe06400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155639.675357:0:9235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.675362:0:9235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.675369:0:9235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.675377:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe06400/0x844e5faceb5f733f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.675400:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125888896:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 11360us (11556us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.675404:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16745 00000100:00100000:2.0:1746155639.675415:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1371 00000100:00100000:2.0:1746155639.675419:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1962:x1830976125890560:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155639.681424:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976125890560:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5994us (7264us total) trans 21474841528 rc 0/0 00000100:00100000:2.0:1746155639.681434:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1371 00002000:00100000:2.0:1746155639.681443:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3227648->3543039) req@ffff8800a06a4e00 x1830976125890560/t21474841528(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/448 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.681451:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a4e00 with x1830976125890560 ext(3227648->3543039) 00010000:00010000:2.0:1746155639.681458:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 18 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.681471:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 18 pid: 1625 timeout: 868 lvb_type: 0 00002000:00010000:2.0:1746155639.681477:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a06a4e00 00000100:00100000:0.0:1746155639.687725:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.687826:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125891072 00000100:00100000:1.0:1746155639.687834:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125891072 00010000:00010000:1.0:1746155639.687868:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 18 pid: 1625 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.688448:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8596 00000100:00100000:1.0:1746155639.688456:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976125891072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.688471:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.688491:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 18 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.688582:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 18 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.688603:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c286600/0x844e5faceb5f7274 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3227648->3543039) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17bf0 expref: 18 pid: 1625 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.688620:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.688622:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.688625:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.688632:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.688650:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155639.688684:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125891072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 229us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.688690:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8596 00010000:00010000:1.0:1746155639.688798:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.688806:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.688827:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.688833:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.688839:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.688844:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094ee0000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155639.688848:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.688854:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.688863:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.688867:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f735b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.688906:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125889280:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 23269us (23317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.688913:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16749 00000100:00100000:0.0:1746155639.693083:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.694378:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125891328 00000100:00100000:2.0:1746155639.694386:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125891328 00000100:00100000:2.0:1746155639.694432:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11073 00000100:00100000:2.0:1746155639.694439:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32228:x1830976125891328:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155639.694482:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.694514:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44000/0x844e5faceb5f7315 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c4b expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.694537:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.694541:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155639.694566:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.694575:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a99 expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.694581:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 299 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.694587:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aae expref: 17 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.694592:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f70de lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b25 expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.694602:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f7116 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b41 expref: 17 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.694607:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.694630:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f7116 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b41 expref: 17 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.694639:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f7116 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b41 expref: 17 pid: 14234 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.694648:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125330432:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.694723:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f70de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b25 expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.694730:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f70de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b25 expref: 299 pid: 14234 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.694736:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125330560:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.694759:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aae expref: 17 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.694765:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aae expref: 17 pid: 14232 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.694770:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125330688:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.694854:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 299 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.694861:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 299 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.694868:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125330816:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.694889:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a99 expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.694895:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a99 expref: 299 pid: 14234 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.694900:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125330944:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.694911:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.697746:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d2680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125330432:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.697756:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125330560:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.698960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.698988:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.699017:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125891584 00000100:00100000:3.0:1746155639.699023:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125891584 00000100:00100000:2.0:1746155639.699024:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125330688:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155639.699048:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125891456 00010000:00010000:3.0:1746155639.699050:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f70de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b25 expref: 300 pid: 14234 timeout: 868 lvb_type: 0 00000100:00100000:1.0:1746155639.699052:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125891456 00010000:00010000:1.0:1746155639.699064:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f7116 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b41 expref: 18 pid: 14234 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.699079:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8597 00000100:00100000:3.0:1746155639.699086:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1961:x1830976125891584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155639.699087:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8598 00000100:00100000:1.0:1746155639.699091:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976125891456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155639.699096:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.699096:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155639.699100:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125330816:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155639.699100:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f7116 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b41 expref: 18 pid: 14234 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.699101:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f70de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b25 expref: 300 pid: 14234 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.699109:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f70de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b25 expref: 300 pid: 14234 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.699116:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f7116 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b41 expref: 18 pid: 14234 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746155639.699327:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.699338:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125891840 00000100:00100000:0.0:1746155639.699341:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125891840 00010000:00010000:0.0:1746155639.699354:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 301 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746155639.699382:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8599 00000100:00100000:0.0:1746155639.699387:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1961:x1830976125891840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155639.699393:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155639.699396:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 301 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.699530:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc69a00/0x844e5faceb5f70de lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b25 expref: 301 pid: 14234 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.699535:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc68200/0x844e5faceb5f7116 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17b41 expref: 18 pid: 14234 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.699548:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155639.699552:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.699559:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155639.699559:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155639.699562:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.699565:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155639.699598:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1961:x1830976125891584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 513us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.699598:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125891456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 505us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.699604:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8597 00000100:00100000:1.0:1746155639.699606:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8598 00000100:00100000:2.0:1746155639.699613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.699620:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125891712 00000100:00100000:3.0:1746155639.699623:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125891712 00010000:00010000:3.0:1746155639.699631:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aae expref: 17 pid: 14232 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.699649:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8600 00000100:00100000:3.0:1746155639.699654:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125891712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155639.699660:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155639.699663:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aae expref: 17 pid: 14232 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746155639.699669:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 299 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.699676:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aae expref: 17 pid: 14232 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746155639.699686:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6800/0x844e5faceb5f7044 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aa0 expref: 299 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.699688:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125330944:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.699689:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd0e600/0x844e5faceb5f7052 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17aae expref: 17 pid: 14232 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.699695:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.699698:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.699702:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155639.699712:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155639.699717:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125891712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 63us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.699722:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8600 00010000:00010000:0.0:1746155639.699797:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155639.699800:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155639.699806:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155639.699830:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1961:x1830976125891840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 442us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155639.699835:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8599 00000100:00100000:0.0:1746155639.700197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.700239:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125891968 00000100:00100000:2.0:1746155639.700242:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125891968 00010000:00010000:2.0:1746155639.700254:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a99 expref: 298 pid: 14234 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.700280:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8601 00000100:00100000:2.0:1746155639.700285:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1960:x1830976125891968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.700292:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.700295:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a99 expref: 298 pid: 14234 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.700303:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a99 expref: 298 pid: 14234 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.700313:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095182000/0x844e5faceb5f703d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17a99 expref: 298 pid: 14234 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.700335:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.700338:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.700344:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.701031:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.701055:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.701086:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1960:x1830976125891968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 800us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.701095:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8601 00010000:00010000:0.0:1746155639.701131:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155639.701137:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000040:00080000:1.0:1746155639.701729:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3544, 88 off298784 00000004:00080000:1.0:1746155639.701736:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768851232782ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155639.702332:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3553, 88 off299840 00000004:00080000:1.0:1746155639.702338:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768851834777ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155639.702395:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3554, 88 off299928 00000004:00080000:1.0:1746155639.702399:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768851895565ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155639.702406:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3545, 88 off298872 00000004:00080000:1.0:1746155639.702409:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768851905656ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155639.702414:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3546, 88 off298960 00000004:00080000:1.0:1746155639.702416:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768851913483ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155639.702422:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3555, 88 off300016 00000004:00080000:1.0:1746155639.702426:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768851922705ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155639.702432:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3556, 88 off300104 00000004:00080000:1.0:1746155639.702434:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768851931352ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155639.702440:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3557, 88 off300192 00000004:00080000:1.0:1746155639.702442:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768851938996ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155639.702447:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3547, 88 off299048 00000004:00080000:1.0:1746155639.702459:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768851956561ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155639.702466:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3558, 88 off300280 00000004:00080000:1.0:1746155639.702468:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768851965335ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155639.702474:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3548, 88 off299136 00000004:00080000:1.0:1746155639.702476:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768851973256ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155639.702485:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3559, 88 off300368 00000004:00080000:1.0:1746155639.702487:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768851984477ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155639.702493:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3549, 88 off299224 00000004:00080000:1.0:1746155639.702495:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768851992462ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155639.702520:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3550, 88 off299312 00000004:00080000:1.0:1746155639.702523:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768852019833ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155639.702530:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3551, 88 off299400 00000004:00080000:1.0:1746155639.702532:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768852029117ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155639.702538:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3552, 88 off299488 00000004:00080000:1.0:1746155639.702540:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768852036831ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155639.702546:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3560, 88 off300456 00000004:00080000:1.0:1746155639.702549:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768852045735ns, next at 716011101328ns, rc = 0 00000001:00080000:0.0:1746155639.723437:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945224 is committed 00000004:00080000:0.0:1746155639.723445:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2745 committed 00000004:00080000:0.0:1746155639.723450:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2731 committed 00000004:00010000:2.0:1746155639.723481:0:27374:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a06a6680 reply state ffff88009f5d3400 transno 8589945224 ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155639.723490:0:27374:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1746155639.723589:0:27374:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746155639.723602:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32228:x1830976125891328:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 29160us (30522us total) trans 8589945224 rc 0/0 00000100:00100000:2.0:1746155639.723612:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11073 00000100:00100000:3.0:1746155639.723634:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125331200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155639.723671:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155639.723678:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2730 committed 00000004:00080000:0.0:1746155639.723680:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2729 committed 00000004:00080000:0.0:1746155639.723681:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2728 committed 00000004:00080000:0.0:1746155639.723683:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2744 committed 00000004:00080000:0.0:1746155639.723684:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2727 committed 00000004:00080000:0.0:1746155639.723686:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2743 committed 00000004:00080000:0.0:1746155639.723687:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2726 committed 00000004:00080000:0.0:1746155639.723688:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2742 committed 00000004:00080000:0.0:1746155639.723690:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2741 committed 00000004:00080000:0.0:1746155639.723691:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2740 committed 00000100:00100000:3.0:1746155639.723692:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:0.0:1746155639.723693:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2725 committed 00000004:00080000:0.0:1746155639.723694:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2724 committed 00000004:00080000:0.0:1746155639.723695:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2739 committed 00000100:00100000:3.0:1746155639.723696:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125331328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155639.723697:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2738 committed 00000004:00080000:0.0:1746155639.723698:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2723 committed 00000001:00080000:0.0:1746155639.723703:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945216 is committed 00000100:00100000:3.0:1746155639.723706:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1746155639.723716:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945220 is committed 00000001:00080000:0.0:1746155639.723721:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945212 is committed 00000100:00100000:3.0:1746155639.723723:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125331200 00000100:00100000:3.0:1746155639.723728:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125331200 00000001:00080000:0.0:1746155639.723739:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945221 is committed 00000100:00100000:3.0:1746155639.723752:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125331328 00000100:00100000:3.0:1746155639.723754:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125331328 00000100:00100000:3.0:1746155639.723763:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16750 00000100:00100000:3.0:1746155639.723768:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3295:x1830976125331200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155639.723839:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125331072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155639.723861:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746155639.723889:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155639.723895:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155639.723901:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155639.723903:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3295:x1830976125331200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (230us total) trans 21474841529 rc 0/0 00010000:00010000:1.0:1746155639.723906:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801369b9800 already unused, calling callback (ffffffffa135a690) 00000100:00100000:3.0:1746155639.723908:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16750 00010000:00010000:1.0:1746155639.723909:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155639.723915:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155639.723917:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125331072 00000100:00100000:3.0:1746155639.723918:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125331072 00010000:00010000:1.0:1746155639.723927:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00000100:00100000:3.0:1746155639.723928:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16751 00010000:00010000:1.0:1746155639.723929:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746155639.723931:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3295:x1830976125331328:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1746155639.723932:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155639.723948:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801369b9800/0x844e5faceb5f7362 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155639.723967:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16752 00000100:00100000:1.0:1746155639.723973:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+31:3298:x1830976125331072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155639.724012:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3295:x1830976125331328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (304us total) trans 21474841530 rc 0/0 00000100:00100000:3.0:1746155639.724016:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16751 00000100:00080000:3.0:1746155639.724031:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746155639.724042:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125331712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.724056:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155639.724064:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+32:3298:x1830976125331072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (202us total) trans 21474841531 rc 0/0 00000100:00100000:3.0:1746155639.724067:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125332224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155639.724071:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16752 00000100:00100000:2.0:1746155639.724074:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125331712 00000100:00100000:2.0:1746155639.724077:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125331712 00000100:00100000:3.0:1746155639.724079:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155639.724096:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125332224 00000100:00100000:2.0:1746155639.724098:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125332224 00000004:00080000:3.0:1746155639.724101:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366f480/2, rc 0, transno 21474841530 00000100:00100000:3.0:1746155639.724106:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125331328:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155639.724108:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16753 00000100:00100000:1.0:1746155639.724111:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125331584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155639.724112:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3295:x1830976125331712:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155639.724114:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366c380/2, rc 0, transno 21474841529 00000100:00100000:3.0:1746155639.724116:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125331200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155639.724122:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125332736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155639.724128:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155639.724136:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155639.724140:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125332096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.724146:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1746155639.724151:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125331840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155639.724152:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155639.724161:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155639.724162:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125332608:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155639.724170:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125332352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155639.724175:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155639.724183:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125331584 00000100:00100000:3.0:1746155639.724186:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125331584 00000004:00080000:1.0:1746155639.724193:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366ca80/2, rc 0, transno 21474841531 00000100:00100000:3.0:1746155639.724196:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125332736 00000100:00100000:3.0:1746155639.724197:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125332736 00000100:00100000:1.0:1746155639.724197:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125331072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155639.724202:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1746155639.724204:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125332096 00000100:00100000:3.0:1746155639.724206:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125332096 00000100:00100000:1.0:1746155639.724206:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125331456:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.724210:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125331840 00000100:00100000:3.0:1746155639.724212:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125331840 00000100:00100000:3.0:1746155639.724216:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125332608 00000100:00100000:1.0:1746155639.724216:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155639.724217:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125332608 00000100:00100000:2.0:1746155639.724220:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3295:x1830976125331712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (162us total) trans 17179874205 rc 0/0 00000100:00100000:3.0:1746155639.724222:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125331456 00000100:00100000:3.0:1746155639.724223:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125331456 00000100:00100000:1.0:1746155639.724223:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125331968:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155639.724225:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16753 00000100:00100000:3.0:1746155639.724230:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16754 00000100:00100000:3.0:1746155639.724233:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3295:x1830976125332224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155639.724233:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155639.724235:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16755 00000100:00100000:1.0:1746155639.724238:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125332480:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155639.724239:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3298:x1830976125331584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155639.724248:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155639.724253:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125332992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155639.724263:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155639.724275:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125331968 00000100:00100000:1.0:1746155639.724278:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125331968 00000100:00100000:1.0:1746155639.724288:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125332480 00000100:00100000:1.0:1746155639.724289:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125332480 00000100:00100000:1.0:1746155639.724295:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125332992 00000100:00100000:1.0:1746155639.724297:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125332992 00000100:00100000:1.0:1746155639.724303:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16756 00000100:00100000:1.0:1746155639.724307:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3295:x1830976125332736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155639.724308:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976125332224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (227us total) trans 17179874206 rc 0/0 00000100:00100000:3.0:1746155639.724312:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16754 00000100:00100000:3.0:1746155639.724320:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16757 00000100:00100000:2.0:1746155639.724323:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+39:3298:x1830976125331584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (194us total) trans 17179874207 rc 0/0 00000100:00100000:3.0:1746155639.724324:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3298:x1830976125332096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155639.724328:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16755 00000100:00100000:2.0:1746155639.724337:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16758 00000100:00100000:2.0:1746155639.724341:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+38:3295:x1830976125331840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155639.724372:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16759 00000100:00100000:2.0:1746155639.724376:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3298:x1830976125332608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155639.724376:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3295:x1830976125332736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (238us total) trans 21474841532 rc 0/0 00000100:00100000:1.0:1746155639.724380:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16756 00000100:00100000:1.0:1746155639.724388:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16760 00000100:00100000:3.0:1746155639.724389:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3298:x1830976125332096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (236us total) trans 17179874208 rc 0/0 00000100:00100000:1.0:1746155639.724392:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3298:x1830976125331456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.724394:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16757 00000100:00100000:3.0:1746155639.724401:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16761 00000100:00100000:3.0:1746155639.724405:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+38:3298:x1830976125331968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155639.724443:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:2.0:1746155639.724446:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:2.0:1746155639.724448:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155639.724450:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:2.0:1746155639.724452:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:3.0:1746155639.724462:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+39:3298:x1830976125331968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (228us total) trans 17179874209 rc 0/0 00000100:00100000:3.0:1746155639.724466:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16761 00000100:00100000:2.0:1746155639.724471:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3298:x1830976125332608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (294us total) trans 21474841533 rc 0/0 00000100:00100000:3.0:1746155639.724473:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16762 00000100:00100000:2.0:1746155639.724476:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16759 00000100:00100000:3.0:1746155639.724477:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3298:x1830976125332480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155639.724486:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16763 00000100:00100000:2.0:1746155639.724490:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+35:3298:x1830976125332992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155639.724557:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+37:3298:x1830976125332480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (307us total) trans 21474841534 rc 0/0 00000100:00100000:3.0:1746155639.724561:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16762 00000100:00100000:3.0:1746155639.724576:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155639.724577:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3298:x1830976125332992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (311us total) trans 21474841535 rc 0/0 00000100:00100000:2.0:1746155639.724582:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16763 00000100:00100000:3.0:1746155639.724586:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125332864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155639.724591:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125332352 00000100:00100000:2.0:1746155639.724593:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125332352 00000100:00100000:3.0:1746155639.724598:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746155639.724772:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366f100/2, rc 0, transno 21474841532 00000100:00100000:3.0:1746155639.724776:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125332736:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155639.724783:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01d0a80/2, rc 0, transno 17179874205 00000100:00100000:3.0:1746155639.724788:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125331712:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155639.724792:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0dbb80/2, rc 0, transno 17179874206 00000100:00100000:3.0:1746155639.724795:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125332224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155639.724801:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3298:x1830976125331456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 408us (583us total) trans 17179874210 rc 0/0 00000100:00100000:1.0:1746155639.724806:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16760 00000100:00100000:2.0:1746155639.725599:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125332864 00000100:00100000:2.0:1746155639.725603:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125332864 00000100:00100000:2.0:1746155639.725619:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16764 00000100:00100000:2.0:1746155639.725624:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3295:x1830976125332352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155639.725703:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976125332352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (1125us total) trans 17179874211 rc 0/0 00000100:00100000:2.0:1746155639.725708:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16764 00000100:00100000:2.0:1746155639.725718:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16765 00000100:00100000:2.0:1746155639.725722:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+36:3295:x1830976125332864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155639.725797:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3295:x1830976125332864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (1197us total) trans 21474841536 rc 0/0 00000100:00100000:2.0:1746155639.725802:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16765 00000100:00080000:2.0:1746155639.725815:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155639.725874:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976125331840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1531us (1710us total) trans 17179874212 rc 0/0 00000100:00100000:2.0:1746155639.725879:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16758 00000100:00100000:2.0:1746155639.725913:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125333120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155639.725932:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746155639.725963:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01d1500/2, rc 0, transno 17179874210 00000100:00100000:2.0:1746155639.725967:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125331456:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155639.725973:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01d2680/2, rc 0, transno 17179874209 00000100:00100000:2.0:1746155639.725976:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125331968:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155639.725982:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366ed80/2, rc 0, transno 21474841534 00000100:00100000:2.0:1746155639.725984:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125332480:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155639.725989:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366e680/2, rc 0, transno 21474841535 00000100:00100000:2.0:1746155639.725991:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125332992:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155639.725996:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01d3b80/2, rc 0, transno 17179874207 00000100:00100000:2.0:1746155639.725998:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125331584:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155639.726004:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0d9c00/2, rc 0, transno 17179874208 00000100:00100000:2.0:1746155639.726006:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125332096:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155639.726011:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366c000/2, rc 0, transno 21474841533 00000100:00100000:2.0:1746155639.726013:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125332608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155639.726025:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125333120 00000100:00100000:2.0:1746155639.726027:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125333120 00000100:00100000:2.0:1746155639.726039:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16766 00000100:00100000:2.0:1746155639.726043:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+40:3298:x1830976125333120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155639.726115:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+41:3298:x1830976125333120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (181us total) trans 17179874213 rc 0/0 00000100:00100000:2.0:1746155639.726119:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16766 00000004:00080000:2.0:1746155639.726136:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca94700/2, rc 0, transno 17179874213 00000100:00100000:2.0:1746155639.726138:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125333120:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155639.726909:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01d0700/2, rc 0, transno 17179874212 00000100:00100000:2.0:1746155639.726913:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125331840:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155639.726919:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0d9500/2, rc 0, transno 17179874211 00000100:00100000:2.0:1746155639.726921:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125332352:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155639.726926:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366ea00/2, rc 0, transno 21474841536 00000100:00100000:2.0:1746155639.726928:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125332864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155639.728565:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.728696:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125892096 00000100:00100000:3.0:1746155639.728702:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125892096 00000100:00100000:3.0:1746155639.728730:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11074 00000100:00100000:3.0:1746155639.728736:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32228:x1830976125892096:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155639.728754:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.728769:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fe00/0x844e5faceb5f7369 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c60 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.728949:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fe00/0x844e5faceb5f7369 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c60 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.728960:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fe00/0x844e5faceb5f7369 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c60 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.728975:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.728978:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155639.728981:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132b0fe00, rc 0) 00000100:00100000:3.0:1746155639.729247:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32228:x1830976125892096:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 510us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.729252:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11074 00000100:00100000:0.0:1746155639.732103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.732188:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125892224 00000100:00100000:3.0:1746155639.732196:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125892224 00000100:00100000:3.0:1746155639.732241:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11075 00000100:00100000:3.0:1746155639.732247:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32228:x1830976125892224:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155639.732293:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.732310:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f7370 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c67 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.732369:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f7377 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.732383:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f7377 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.732392:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f7377 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155639.732412:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155639.732416:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155639.732428:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f7377 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.732448:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872e00/0x844e5faceb5f7370 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c67 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.732476:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f7377 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c67 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.732483:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.732485:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155639.732487:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092872400, rc 0) 00000100:00100000:3.0:1746155639.732544:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32228:x1830976125892224:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 296us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.732550:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11075 00000100:00100000:2.0:1746155639.736819:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.736853:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.736865:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.736882:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125892352 00000100:00100000:2.0:1746155639.736885:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.736889:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125892352 00000100:00100000:2.0:1746155639.736900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.736918:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125892608 00000100:00100000:1.0:1746155639.736920:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125892608 00000100:00100000:1.0:1746155639.736947:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125892864 00000100:00100000:1.0:1746155639.736949:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125892864 00000100:00100000:1.0:1746155639.736958:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125892480 00000100:00100000:1.0:1746155639.736960:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125892480 00000100:00100000:1.0:1746155639.736967:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125892736 00000100:00100000:1.0:1746155639.736969:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125892736 00000100:00100000:2.0:1746155639.736970:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.737056:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125892992 00000100:00100000:1.0:1746155639.737059:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125892992 00000100:00100000:1.0:1746155639.737074:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16767 00000100:00100000:1.0:1746155639.737081:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125892352:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155639.737093:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155639.737114:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f737e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c6e expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155639.737133:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e1:0x0] initial LVB size: 1048576, mtime: 0x68143877, atime: 0x68143877, ctime: 0x68143877, blocks: 0x7e9 00010000:00010000:1.0:1746155639.737147:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.737149:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.737156:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f737e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c6e expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.737169:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f737e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c6e expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.737179:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17b600, rc 0) 00000100:00100000:1.0:1746155639.737222:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125892352:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 141us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.737227:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16767 00000100:00100000:1.0:1746155639.737242:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16768 00000100:00100000:1.0:1746155639.737246:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125892608:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155639.737253:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155639.737261:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f17aa00/0x844e5faceb5f7385 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c7c expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155639.737273:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x68143877, atime: 0x68143877, ctime: 0x68143877, blocks: 0x81d 00010000:00010000:1.0:1746155639.737281:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.737282:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.737286:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f17aa00/0x844e5faceb5f7385 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c7c expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.737295:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f17aa00/0x844e5faceb5f7385 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c7c expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.737306:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17aa00, rc 0) 00000100:00100000:1.0:1746155639.737320:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976125892608:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 74us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.737325:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16768 00000100:00100000:1.0:1746155639.737334:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16769 00000100:00100000:1.0:1746155639.737338:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125892864:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155639.737343:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155639.737349:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f738c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c8a expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155639.737359:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e4:0x0] initial LVB size: 5079552, mtime: 0x68143878, atime: 0x68143877, ctime: 0x68143878, blocks: 0x1711 00010000:00010000:1.0:1746155639.737364:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.737365:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.737369:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f738c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c8a expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.737377:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f738c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c8a expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.737383:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17a800, rc 0) 00000100:00100000:1.0:1746155639.737396:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125892864:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 58us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.737401:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16769 00000100:00100000:1.0:1746155639.737409:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16770 00000100:00100000:1.0:1746155639.737414:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125892480:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155639.737418:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155639.737424:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f17b200/0x844e5faceb5f7393 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c75 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155639.737434:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x68143877, atime: 0x68143877, ctime: 0x68143877, blocks: 0x821 00010000:00010000:1.0:1746155639.737441:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.737442:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.737446:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f17b200/0x844e5faceb5f7393 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c75 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.737453:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f17b200/0x844e5faceb5f7393 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c75 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.737460:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17b200, rc 0) 00000100:00100000:1.0:1746155639.737472:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976125892480:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 59us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.737477:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16770 00000100:00100000:2.0:1746155639.737572:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16771 00000100:00100000:2.0:1746155639.737579:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976125892736:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155639.737586:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155639.737590:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16772 00010000:00010000:2.0:1746155639.737595:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e000/0x844e5faceb5f739a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c83 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155639.737607:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e3:0x0] initial LVB size: 2097152, mtime: 0x68143877, atime: 0x68143877, ctime: 0x68143877, blocks: 0x821 00010000:00010000:2.0:1746155639.737615:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.737617:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.737621:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e000/0x844e5faceb5f739a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c83 expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.737631:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e000/0x844e5faceb5f739a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c83 expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.737637:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd0e000, rc 0) 00000100:00100000:2.0:1746155639.737656:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125892736:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 78us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.737661:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16771 00000100:00100000:0.0:1746155639.737681:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125892992:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155639.737688:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155639.737696:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea96800/0x844e5faceb5f73a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c91 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155639.737708:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e2:0x0] initial LVB size: 4194304, mtime: 0x68143878, atime: 0x68143878, ctime: 0x68143877, blocks: 0x1029 00010000:00010000:0.0:1746155639.737715:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.737717:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.737721:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea96800/0x844e5faceb5f73a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c91 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.737730:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea96800/0x844e5faceb5f73a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c91 expref: 12 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.737742:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea96800, rc 0) 00000100:00100000:0.0:1746155639.737761:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976125892992:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 164us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155639.737766:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16772 00000100:00100000:0.0:1746155639.746788:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.746836:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.746895:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125893248 00000100:00100000:1.0:1746155639.746902:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125893248 00000100:00100000:1.0:1746155639.747221:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125893504 00000100:00100000:1.0:1746155639.747223:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125893504 00000100:00100000:2.0:1746155639.747334:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7944 00000100:00100000:2.0:1746155639.747343:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125893248:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155639.747374:0:31252:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd0ea00/0x844e5faceb5f73a8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.747387:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.747388:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.747394:0:31252:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd0ea00/0x844e5faceb5f73a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.747415:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7945 00000100:00100000:1.0:1746155639.747421:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125893504:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155639.747436:0:31251:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f17b400/0x844e5faceb5f73af lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.747443:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.747445:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.747447:0:31251:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f17b400/0x844e5faceb5f73af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.747457:0:31251:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f17b400/0x844e5faceb5f73af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.748012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.748035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.748049:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125893760 00000100:00100000:0.0:1746155639.748052:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125893760 00000100:00100000:0.0:1746155639.748074:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125894016 00000100:00100000:0.0:1746155639.748076:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125894016 00000100:00100000:0.0:1746155639.748090:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7946 00000100:00100000:0.0:1746155639.748096:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125893760:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155639.748108:0:25391:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5f73b6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.748116:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.748117:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.748120:0:25391:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5f73b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.748134:0:25391:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5f73b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.748160:0:31252:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd0ea00/0x844e5faceb5f73a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.749903:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7947 00000100:00100000:2.0:1746155639.749912:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125894016:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155639.749945:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e200/0x844e5faceb5f73bd lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.749955:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.749956:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.749961:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e200/0x844e5faceb5f73bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.749975:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e200/0x844e5faceb5f73bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.751664:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.751711:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125894272 00000100:00100000:3.0:1746155639.751719:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125894272 00000100:00100000:3.0:1746155639.751770:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7948 00000100:00100000:3.0:1746155639.751777:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125894272:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155639.751796:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f73c4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.751809:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.751811:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.751814:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f73c4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.751824:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f73c4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.752950:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.753389:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125894528 00000100:00100000:2.0:1746155639.753395:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125894528 00000100:00100000:2.0:1746155639.753429:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7949 00000100:00100000:2.0:1746155639.753435:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125894528:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155639.753456:0:31250:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093a45c00/0x844e5faceb5f73cb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.753466:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.753468:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.753471:0:31250:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093a45c00/0x844e5faceb5f73cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.753480:0:31250:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093a45c00/0x844e5faceb5f73cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.753492:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.755030:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125894784 00000100:00100000:0.0:1746155639.755036:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125894784 00000100:00100000:0.0:1746155639.755589:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7950 00000100:00100000:0.0:1746155639.755596:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125894784:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155639.755617:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f0dec00/0x844e5faceb5f73d2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.755627:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.755628:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.755632:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0dec00/0x844e5faceb5f73d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.755640:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f0dec00/0x844e5faceb5f73d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.756379:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.756421:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125895040 00000100:00100000:3.0:1746155639.756426:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125895040 00000100:00100000:3.0:1746155639.756454:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7951 00000100:00100000:3.0:1746155639.756459:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1961:x1830976125895040:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155639.756475:0:31253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092872a00/0x844e5faceb5f73d9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.756483:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.756484:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.756487:0:31253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092872a00/0x844e5faceb5f73d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.756495:0:31253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092872a00/0x844e5faceb5f73d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.756648:0:31251:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f17b400/0x844e5faceb5f73af lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.756657:0:31251:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f17b400/0x844e5faceb5f73af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.756664:0:31251:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f17b400/0x844e5faceb5f73af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.756671:0:31251:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f17b400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155639.756674:0:31251:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f17b400/0x844e5faceb5f73af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.756680:0:31251:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f17b400/0x844e5faceb5f73af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.756693:0:31251:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f17b400/0x844e5faceb5f73af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.756703:0:31251:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f17b400/0x844e5faceb5f73af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.756747:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125893504:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 9325us (9909us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155639.756753:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7945 00010000:00010000:2.0:1746155639.762799:0:31252:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd0ea00/0x844e5faceb5f73a8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.762814:0:31252:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd0ea00/0x844e5faceb5f73a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.762822:0:31252:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fd0ea00/0x844e5faceb5f73a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.762828:0:31252:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd0ea00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155639.762833:0:31252:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd0ea00/0x844e5faceb5f73a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.762840:0:31252:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd0ea00/0x844e5faceb5f73a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.762856:0:31252:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fd0ea00/0x844e5faceb5f73a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.762862:0:31252:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd0ea00/0x844e5faceb5f73a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.762953:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125893248:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 15606us (16168us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.762962:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7944 00010000:00010000:3.0:1746155639.771097:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e200/0x844e5faceb5f73bd lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.771113:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e200/0x844e5faceb5f73bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.771125:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e200/0x844e5faceb5f73bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.771131:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd0e200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155639.771135:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e200/0x844e5faceb5f73bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.771142:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e200/0x844e5faceb5f73bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.771158:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e200/0x844e5faceb5f73bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.771163:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e200/0x844e5faceb5f73bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155639.771239:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125894016:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 21325us (23199us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155639.771248:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7947 00010000:00010000:3.0:1746155639.772463:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f73c4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.772472:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f73c4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.772478:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f73c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.772488:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092872200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155639.772491:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f73c4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.772497:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f73c4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.772529:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f73c4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.772535:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f73c4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155639.772726:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125894272:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 20946us (21064us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155639.772735:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7948 00010000:00010000:3.0:1746155639.777993:0:31250:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093a45c00/0x844e5faceb5f73cb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.778008:0:31250:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093a45c00/0x844e5faceb5f73cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.778015:0:31250:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093a45c00/0x844e5faceb5f73cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.778021:0:31250:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093a45c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155639.778025:0:31250:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a45c00/0x844e5faceb5f73cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.778032:0:31250:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093a45c00/0x844e5faceb5f73cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.778047:0:31250:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093a45c00/0x844e5faceb5f73cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.778053:0:31250:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093a45c00/0x844e5faceb5f73cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155639.778129:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125894528:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 24690us (25177us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155639.778138:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7949 00010000:00010000:1.0:1746155639.779954:0:31253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092872a00/0x844e5faceb5f73d9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.779966:0:31253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092872a00/0x844e5faceb5f73d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.779973:0:31253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092872a00/0x844e5faceb5f73d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.779978:0:31253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092872a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155639.779981:0:31253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092872a00/0x844e5faceb5f73d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.779987:0:31253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092872a00/0x844e5faceb5f73d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.780000:0:31253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092872a00/0x844e5faceb5f73d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.780006:0:31253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092872a00/0x844e5faceb5f73d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.781160:0:25394:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f0dec00/0x844e5faceb5f73d2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.781171:0:25394:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f0dec00/0x844e5faceb5f73d2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.781177:0:25394:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f0dec00/0x844e5faceb5f73d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.781182:0:25394:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0dec00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155639.781185:0:25394:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f0dec00/0x844e5faceb5f73d2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.781191:0:25394:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f0dec00/0x844e5faceb5f73d2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.781205:0:25394:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f0dec00/0x844e5faceb5f73d2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.781210:0:25394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f0dec00/0x844e5faceb5f73d2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.781284:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125894784:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 25684us (27787us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155639.781293:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7950 00000100:00100000:1.0:1746155639.781311:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125895040:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 24850us (24934us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155639.781318:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7951 00010000:00010000:2.0:1746155639.784888:0:25391:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5f73b6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.784904:0:25391:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5f73b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.784911:0:25391:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5f73b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.784917:0:25391:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea97e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155639.784920:0:25391:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5f73b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.784927:0:25391:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5f73b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.784953:0:25391:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5f73b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.784959:0:25391:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea97e00/0x844e5faceb5f73b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.785211:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125893760:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 37110us (37195us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.785220:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7946 00000100:00100000:0.0:1746155639.791253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.791308:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125895296 00000100:00100000:3.0:1746155639.791317:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125895296 00000100:00100000:3.0:1746155639.791366:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11076 00000100:00100000:3.0:1746155639.791373:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32228:x1830976125895296:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:3.0:1746155639.791413:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155639.791433:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872400/0x844e5faceb5f7377 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c67 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.791463:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.791467:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155639.791495:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f73e0 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.791541:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f73e0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.791550:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f73e0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00010000:3.0:1746155639.791708:0:27374:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a06a7b80 reply state ffff8800a0609000 transno 8589945225 ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f73e0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155639.791715:0:27374:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746155639.792350:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32228:x1830976125895296:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 976us (1102us total) trans 8589945225 rc 0/0 00000100:00100000:3.0:1746155639.792356:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11076 00010000:00010000:3.0:1746155639.794204:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f73e0 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.794214:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f73e0 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.794220:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f73e0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.794225:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092873600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155639.794228:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f73e0 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.794234:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f73e0 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.794246:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.794248:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155639.794251:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f73e0 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.794255:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f73e0 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155639.794454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.794481:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.794526:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125895424 00000100:00100000:3.0:1746155639.794532:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125895424 00000100:00100000:2.0:1746155639.794550:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125895552 00000100:00100000:2.0:1746155639.794554:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125895552 00000100:00100000:3.0:1746155639.794560:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16773 00000100:00100000:3.0:1746155639.794565:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125895424:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:2.0:1746155639.794578:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16774 00000100:00100000:2.0:1746155639.794584:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125895552:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:0.0:1746155639.794584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.794598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.794609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.794622:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125895680 00000100:00100000:0.0:1746155639.794629:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125895680 00000100:00100000:0.0:1746155639.794643:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125895808 00000100:00100000:0.0:1746155639.794645:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125895808 00000100:00100000:1.0:1746155639.794646:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125895936 00000100:00100000:1.0:1746155639.794649:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125895936 00000100:00100000:0.0:1746155639.794656:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16775 00000100:00100000:0.0:1746155639.794660:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976125895680:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:1.0:1746155639.794664:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16776 00000100:00100000:1.0:1746155639.794668:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125895808:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155639.794690:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746155639.794693:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155639 -> 1746155640 00002000:00010000:3.0:1746155639.794694:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155639 -> 1746155640 00002000:00010000:3.0:1746155639.794696:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155639 -> 1746155640 00002000:00010000:3.0:1746155639.794698:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:3.0:1746155639.794725:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976125895424:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 160us (272us total) trans 17179874214 rc 0/0 00000100:00100000:3.0:1746155639.794731:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16773 00002000:00010000:1.0:1746155639.794737:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155639.794740:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155639 -> 1746155640 00000100:00100000:3.0:1746155639.794742:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16777 00002000:00010000:1.0:1746155639.794742:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155639 -> 1746155640 00002000:00010000:1.0:1746155639.794744:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155639 -> 1746155640 00002000:00010000:1.0:1746155639.794745:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155639.794746:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125895936:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:1.0:1746155639.794763:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125895808:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 93us (164us total) trans 17179874215 rc 0/0 00000100:00100000:1.0:1746155639.794767:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16776 00002000:00010000:3.0:1746155639.794797:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:3.0:1746155639.794799:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.794801:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155639 -> 1746155640 00002000:00010000:3.0:1746155639.794802:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.794804:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:1.0:1746155639.794816:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.794860:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125895936:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 73us (210us total) trans 17179874216 rc 0/0 00000100:00100000:3.0:1746155639.794866:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16777 00000100:00100000:1.0:1746155639.794876:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125896064 00000100:00100000:1.0:1746155639.794879:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125896064 00000100:00100000:1.0:1746155639.794894:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16778 00000100:00100000:1.0:1746155639.794898:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125896064:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155639.794983:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155639.794985:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00002000:00010000:1.0:1746155639.794987:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155640 -> 1746155640 00002000:00010000:1.0:1746155639.794989:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155639 -> 1746155640 00002000:00010000:1.0:1746155639.794991:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00002000:00010000:0.0:1746155639.794996:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155639.794998:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155639 -> 1746155640 00002000:00010000:0.0:1746155639.795000:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155639 -> 1746155640 00002000:00010000:0.0:1746155639.795001:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155639 -> 1746155640 00002000:00010000:0.0:1746155639.795003:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746155639.795009:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125896064:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 110us (193us total) trans 21474841537 rc 0/0 00000100:00100000:1.0:1746155639.795014:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16778 00000100:00100000:0.0:1746155639.795015:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125895680:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 355us (431us total) trans 21474841538 rc 0/0 00000100:00100000:0.0:1746155639.795019:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16775 00002000:00010000:2.0:1746155639.795112:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155639.795114:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155639 -> 1746155640 00002000:00010000:2.0:1746155639.795115:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155639 -> 1746155640 00002000:00010000:2.0:1746155639.795117:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155639 -> 1746155640 00002000:00010000:2.0:1746155639.795118:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155639.795134:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125895552:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 550us (652us total) trans 21474841539 rc 0/0 00000100:00100000:2.0:1746155639.795139:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16774 00000100:00100000:0.0:1746155639.797007:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.797060:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125896320 00000100:00100000:3.0:1746155639.797064:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125896320 00000100:00100000:3.0:1746155639.797218:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4692 00000100:00100000:3.0:1746155639.797225:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009461ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32228:x1830976125896320:12345-192.168.202.51@tcp:35:lfs.0 00000004:00010000:3.0:1746155639.797265:0:14236:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x35e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44c00/0x844e5faceb5f732a lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c59 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.797299:0:14236:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155639.797310:0:14236:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fe00/0x844e5faceb5f7369 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c60 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.797316:0:14236:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155639.797338:0:14236:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fe00/0x844e5faceb5f7369 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c60 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.797348:0:14236:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fe00/0x844e5faceb5f7369 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c60 expref: 9 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.797358:0:14236:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14236:1830976125333248:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.797997:0:14236:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155639.799047:0:14236:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14236:1830976125333248:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.799063:0:14236:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00000100:00100000:0.0:1746155639.799420:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.799479:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125896448 00000100:00100000:2.0:1746155639.799483:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125896448 00010000:00010000:2.0:1746155639.799520:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fe00/0x844e5faceb5f7369 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c60 expref: 10 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.799621:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8602 00000100:00100000:2.0:1746155639.799627:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d759450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125896448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.799636:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.799642:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fe00/0x844e5faceb5f7369 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c60 expref: 10 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.799651:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fe00/0x844e5faceb5f7369 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c60 expref: 10 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.799665:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132b0fe00/0x844e5faceb5f7369 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c60 expref: 10 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.799816:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.799820:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00010000:00010000:2.0:1746155639.799827:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14236 initiator: MDT0 00010000:00010000:2.0:1746155639.799832:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14236 initiator: MDT0 00010000:00010000:2.0:1746155639.799932:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.799970:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d759450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125896448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 343us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.799975:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8602 00010000:00010000:3.0:1746155639.800024:0:14236:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155639.800029:0:14236:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00000040:00080000:3.0:1746155639.800536:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3553, 88 off299576 00000004:00080000:3.0:1746155639.800542:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768950038811ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155639.800579:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3561, 88 off300544 00000004:00080000:3.0:1746155639.800583:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768950079964ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155639.800828:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3562, 88 off300632 00000004:00080000:3.0:1746155639.800832:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768950329366ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155639.800840:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3554, 88 off299664 00000004:00080000:3.0:1746155639.800842:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768950339538ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155639.800862:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3555, 88 off299752 00000004:00080000:3.0:1746155639.800865:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768950362373ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155639.800872:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3563, 88 off300720 00000004:00080000:3.0:1746155639.800874:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768950371356ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155639.800882:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3564, 88 off300808 00000004:00080000:3.0:1746155639.800884:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768950381201ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155639.800889:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3565, 88 off300896 00000004:00080000:3.0:1746155639.800891:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768950388474ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155639.800897:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3556, 88 off299840 00000004:00080000:3.0:1746155639.800899:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768950395831ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155639.800905:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3566, 88 off300984 00000004:00080000:3.0:1746155639.800908:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768950404868ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155639.800914:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3557, 88 off299928 00000004:00080000:3.0:1746155639.800916:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768950413151ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155639.800922:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3567, 88 off301072 00000004:00080000:3.0:1746155639.800924:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768950421531ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155639.800930:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3558, 88 off300016 00000004:00080000:3.0:1746155639.800932:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768950429522ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155639.800951:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3559, 88 off300104 00000004:00080000:3.0:1746155639.800953:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768950450503ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155639.800960:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3560, 88 off300192 00000004:00080000:3.0:1746155639.800963:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768950459954ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155639.800970:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3561, 88 off300280 00000004:00080000:3.0:1746155639.800972:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768950468901ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155639.800979:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3568, 88 off301160 00000004:00080000:3.0:1746155639.800981:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768950478611ns, next at 716011101328ns, rc = 0 00000001:00080000:0.0:1746155639.813965:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945226 is committed 00000004:00080000:0.0:1746155639.813972:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2753 committed 00000004:00080000:0.0:1746155639.813979:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2740 committed 00000004:00080000:0.0:1746155639.813983:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2739 committed 00000004:00080000:0.0:1746155639.813985:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2738 committed 00000004:00080000:0.0:1746155639.813986:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2737 committed 00000004:00080000:0.0:1746155639.813988:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2752 committed 00000004:00080000:0.0:1746155639.813989:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2736 committed 00000004:00080000:0.0:1746155639.813990:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2751 committed 00000004:00080000:0.0:1746155639.813991:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2735 committed 00000004:00080000:0.0:1746155639.813993:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2750 committed 00000004:00010000:3.0:1746155639.813994:0:14236:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009461ac50 reply state ffff8801353ccc00 transno 8589945226 ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00000004:00080000:0.0:1746155639.813995:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2749 committed 00000004:00080000:0.0:1746155639.813996:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2748 committed 00000004:00080000:0.0:1746155639.813998:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2734 committed 00000004:00080000:0.0:1746155639.813999:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2733 committed 00000004:00080000:0.0:1746155639.814001:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2747 committed 00000004:00080000:0.0:1746155639.814002:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2746 committed 00000004:00080000:0.0:1746155639.814003:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2732 committed 00000100:00100000:3.0:1746155639.814004:0:14236:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746155639.814012:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.814014:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155639.814022:0:14236:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093a44c00/0x844e5faceb5f732a lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c59 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746155639.814101:0:14236:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746155639.814104:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125333376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.814110:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009461ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32228:x1830976125896320:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 16885us (17106us total) trans 8589945226 rc 0/0 00000100:00100000:3.0:1746155639.814118:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4692 00000100:00100000:0.0:1746155639.814118:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125333760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.814143:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155639.814144:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125333504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155639.814157:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125333632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155639.814164:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155639.814168:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125334272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155639.814177:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155639.814179:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125334016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155639.814194:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155639.814194:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125334144:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.814199:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125333760 00000100:00100000:2.0:1746155639.814204:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125334528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.814205:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125333760 00000100:00100000:1.0:1746155639.814207:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155639.814217:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155639.814217:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125334656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.814227:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125333504 00000100:00100000:2.0:1746155639.814228:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125335040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.814230:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125333504 00000100:00100000:1.0:1746155639.814231:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155639.814238:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125333632 00000100:00100000:1.0:1746155639.814240:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125335168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.814240:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125334016 00000100:00100000:3.0:1746155639.814241:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125333632 00000100:00100000:2.0:1746155639.814242:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155639.814242:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125334016 00000100:00100000:0.0:1746155639.814251:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125334144 00000100:00100000:0.0:1746155639.814252:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125334144 00000100:00100000:1.0:1746155639.814253:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155639.814256:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125334528 00000100:00100000:2.0:1746155639.814256:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746155639.814258:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125334528 00000100:00100000:0.0:1746155639.814259:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125334656 00000100:00100000:0.0:1746155639.814260:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125334656 00000100:00100000:2.0:1746155639.814261:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125334912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155639.814266:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125335040 00000100:00100000:3.0:1746155639.814267:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125335040 00000100:00100000:0.0:1746155639.814268:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125335168 00000100:00100000:0.0:1746155639.814270:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125335168 00010000:00010000:1.0:1746155639.814272:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 00000100:00100000:2.0:1746155639.814275:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155639.814276:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16779 00010000:00010000:1.0:1746155639.814279:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 00000100:00100000:0.0:1746155639.814280:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125334912 00000100:00100000:3.0:1746155639.814281:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3298:x1830976125333760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.814282:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125334912 00010000:00010000:1.0:1746155639.814286:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 00000100:00100000:0.0:1746155639.814289:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16780 00010000:00010000:1.0:1746155639.814291:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131447a00 already unused, calling callback (ffffffffa135a690) 00000100:00100000:2.0:1746155639.814293:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16781 00010000:00010000:1.0:1746155639.814294:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 00000100:00100000:0.0:1746155639.814294:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+42:3296:x1830976125333504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155639.814297:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3296:x1830976125334016:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746155639.814300:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 00010000:00010000:1.0:1746155639.814310:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155639.814312:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155639.814315:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 00010000:00010000:1.0:1746155639.814318:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131447a00/0x844e5faceb5f73e7 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 00000100:00100000:2.0:1746155639.814323:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16782 00000100:00100000:2.0:1746155639.814327:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3297:x1830976125333632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155639.814336:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16783 00000100:00100000:1.0:1746155639.814341:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+44:3297:x1830976125334144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.814382:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16784 00000100:00100000:0.0:1746155639.814387:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3296:x1830976125334528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155639.814399:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16785 00000100:00100000:1.0:1746155639.814402:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3297:x1830976125334656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155639.814406:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155639.814406:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155639.814409:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00002000:00010000:2.0:1746155639.814409:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.814411:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155640 -> 1746155640 00002000:00010000:2.0:1746155639.814411:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.814413:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155640 -> 1746155640 00002000:00010000:2.0:1746155639.814413:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.814414:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746155639.814415:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:3.0:1746155639.814432:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+46:3298:x1830976125333760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 151us (290us total) trans 17179874217 rc 0/0 00000100:00100000:2.0:1746155639.814432:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3297:x1830976125333632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (255us total) trans 21474841540 rc 0/0 00000100:00100000:3.0:1746155639.814437:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16779 00000100:00100000:2.0:1746155639.814440:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16782 00000100:00100000:2.0:1746155639.814447:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16786 00000100:00100000:3.0:1746155639.814450:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16787 00000100:00100000:2.0:1746155639.814451:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3296:x1830976125335040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155639.814453:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3297:x1830976125335168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155639.814473:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16788 00000100:00100000:1.0:1746155639.814473:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+43:3297:x1830976125334656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (240us total) trans 21474841541 rc 0/0 00000100:00100000:0.0:1746155639.814474:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3296:x1830976125334528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (256us total) trans 17179874219 rc 0/0 00000100:00100000:3.0:1746155639.814477:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3296:x1830976125334912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155639.814478:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16785 00000100:00100000:0.0:1746155639.814480:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16784 00000100:00100000:0.0:1746155639.814492:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155639.814519:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125333888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.814534:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155639.814537:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3297:x1830976125334144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 197us (329us total) trans 17179874218 rc 0/0 00000100:00100000:1.0:1746155639.814542:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16783 00000100:00100000:0.0:1746155639.814543:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125334400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155639.814545:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125333376 00000100:00100000:3.0:1746155639.814548:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125333376 00000100:00100000:1.0:1746155639.814550:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125333888 00000100:00100000:1.0:1746155639.814552:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125333888 00000100:00100000:0.0:1746155639.814554:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155639.814561:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125334400 00000100:00100000:3.0:1746155639.814563:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125334400 00000100:00100000:1.0:1746155639.814564:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16789 00000100:00100000:1.0:1746155639.814568:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3295:x1830976125333376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.814573:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16790 00000100:00100000:0.0:1746155639.814573:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155639.814577:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3295:x1830976125333888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.814595:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125334784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.814609:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155639.814615:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125335296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.814631:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746155639.814636:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155639.814638:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00002000:00010000:1.0:1746155639.814640:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155640 -> 1746155640 00002000:00010000:1.0:1746155639.814641:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155640 -> 1746155640 00002000:00010000:1.0:1746155639.814643:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00002000:00010000:3.0:1746155639.814644:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:3.0:1746155639.814646:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.814648:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.814650:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.814651:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000004:00080000:0.0:1746155639.814651:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc7100/2, rc 0, transno 17179874217 00000100:00100000:0.0:1746155639.814658:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125333760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155639.814666:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3295:x1830976125333376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (173us total) trans 17179874220 rc 0/0 00000100:00100000:3.0:1746155639.814669:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3295:x1830976125333888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (134us total) trans 17179874221 rc 0/0 00000100:00100000:1.0:1746155639.814671:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16789 00000100:00100000:3.0:1746155639.814676:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16790 00000100:00100000:1.0:1746155639.814680:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125334272 00000100:00100000:0.0:1746155639.814681:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125334784 00000100:00100000:1.0:1746155639.814682:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125334272 00000100:00100000:0.0:1746155639.814682:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125334784 00000100:00100000:3.0:1746155639.814686:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125335296 00000100:00100000:3.0:1746155639.814689:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125335296 00000100:00100000:1.0:1746155639.814692:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16791 00000100:00100000:0.0:1746155639.814694:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16792 00000100:00100000:1.0:1746155639.814696:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3295:x1830976125334400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.814698:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3298:x1830976125334272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.814700:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16793 00000100:00100000:3.0:1746155639.814703:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3298:x1830976125334784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155639.814717:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3296:x1830976125335040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 265us (474us total) trans 21474841542 rc 0/0 00000100:00100000:2.0:1746155639.814722:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16786 00000100:00100000:2.0:1746155639.814731:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16794 00000100:00100000:2.0:1746155639.814735:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+45:3298:x1830976125335296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.814772:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+50:3298:x1830976125334272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (197us total) trans 17179874222 rc 0/0 00002000:00010000:1.0:1746155639.814775:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:3.0:1746155639.814776:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+50:3298:x1830976125334784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (166us total) trans 17179874223 rc 0/0 00002000:00010000:1.0:1746155639.814777:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00000100:00100000:0.0:1746155639.814777:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16792 00002000:00010000:1.0:1746155639.814779:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155640 -> 1746155640 00002000:00010000:1.0:1746155639.814780:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155640 -> 1746155640 00002000:00010000:1.0:1746155639.814782:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746155639.814799:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3295:x1830976125334400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (243us total) trans 21474841544 rc 0/0 00000100:00100000:2.0:1746155639.814804:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+47:3298:x1830976125335296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (172us total) trans 21474841545 rc 0/0 00000100:00100000:0.0:1746155639.814830:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125335424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.814844:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155639.814858:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc5180/2, rc 0, transno 17179874220 00000100:00100000:0.0:1746155639.814861:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125333376:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155639.814866:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc7800/2, rc 0, transno 17179874221 00000100:00100000:0.0:1746155639.814869:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125333888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155639.814874:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a5500/2, rc 0, transno 21474841544 00000100:00100000:0.0:1746155639.814877:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125334400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155639.814887:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc5c00/2, rc 0, transno 17179874222 00000100:00100000:0.0:1746155639.814889:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125334272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155639.814894:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc6680/2, rc 0, transno 17179874223 00000100:00100000:0.0:1746155639.814896:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125334784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.814900:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16793 00000004:00080000:0.0:1746155639.814900:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc53800/2, rc 0, transno 21474841545 00000100:00100000:0.0:1746155639.814902:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125335296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155639.814904:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16791 00000100:00100000:2.0:1746155639.814907:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16794 00000100:00100000:3.0:1746155639.814912:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125335424 00000100:00100000:3.0:1746155639.814914:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125335424 00000100:00100000:3.0:1746155639.814926:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16795 00000004:00080000:1.0:1746155639.814927:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a5180/2, rc 0, transno 21474841540 00000100:00100000:3.0:1746155639.814930:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+49:3295:x1830976125335424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155639.814930:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125333632:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155639.814930:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155639.814944:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00002000:00010000:0.0:1746155639.814946:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155640 -> 1746155640 00002000:00010000:0.0:1746155639.814947:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155640 -> 1746155640 00000004:00080000:1.0:1746155639.814948:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc6a00/2, rc 0, transno 17179874218 00002000:00010000:0.0:1746155639.814949:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155639.814951:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125334144:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155639.814956:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a4700/2, rc 0, transno 21474841541 00000100:00100000:1.0:1746155639.814958:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125334656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.814965:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3296:x1830976125333504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 672us (801us total) trans 21474841546 rc 0/0 00000100:00100000:0.0:1746155639.814970:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16780 00000100:00100000:2.0:1746155639.814994:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+51:3296:x1830976125334016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 696us (798us total) trans 17179874224 rc 0/0 00000100:00100000:2.0:1746155639.814999:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16781 00000100:00100000:3.0:1746155639.815001:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+51:3295:x1830976125335424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (156us total) trans 17179874225 rc 0/0 00000100:00100000:3.0:1746155639.815005:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16795 00000004:00080000:0.0:1746155639.815009:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc51c00/2, rc 0, transno 17179874225 00000100:00100000:0.0:1746155639.815012:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125335424:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155639.815019:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a6300/2, rc 0, transno 21474841546 00000100:00100000:2.0:1746155639.815023:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125333504:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155639.815028:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00000004:00080000:2.0:1746155639.815030:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc6d80/2, rc 0, transno 17179874224 00002000:00010000:3.0:1746155639.815031:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00000100:00100000:2.0:1746155639.815032:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125334016:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155639.815033:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746155639.815034:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:3.0:1746155639.815036:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000004:00080000:2.0:1746155639.815038:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc4a80/2, rc 0, transno 17179874219 00000100:00100000:2.0:1746155639.815040:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125334528:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155639.815046:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc52680/2, rc 0, transno 21474841542 00000100:00100000:2.0:1746155639.815048:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125335040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155639.815050:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3296:x1830976125334912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 573us (774us total) trans 21474841543 rc 0/0 00000004:00080000:2.0:1746155639.815054:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc50a80/2, rc 0, transno 21474841543 00000100:00100000:3.0:1746155639.815055:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16788 00000100:00100000:2.0:1746155639.815056:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125334912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155639.815121:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3297:x1830976125335168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 666us (866us total) trans 21474841547 rc 0/0 00000100:00100000:3.0:1746155639.815125:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16787 00000004:00080000:0.0:1746155639.815133:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc53b80/2, rc 0, transno 21474841547 00000100:00100000:0.0:1746155639.815137:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125335168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.816364:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.816434:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125896576 00000100:00100000:3.0:1746155639.816439:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125896576 00000100:00100000:3.0:1746155639.816466:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11077 00000100:00100000:3.0:1746155639.816471:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32228:x1830976125896576:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155639.816484:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.816494:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f73ee lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c98 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.816547:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f73ee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c98 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.816559:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f73ee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c98 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.816573:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.816576:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155639.816578:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013121f400, rc 0) 00000100:00100000:3.0:1746155639.816604:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32228:x1830976125896576:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 133us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.816609:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11077 00000100:00100000:0.0:1746155639.818096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.818827:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125896832 00000100:00100000:3.0:1746155639.818833:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125896832 00000100:00100000:3.0:1746155639.818866:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4693 00000100:00100000:3.0:1746155639.818873:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32228:x1830976125896832:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155639.819070:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32228:x1830976125896832:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 197us (975us total) trans 8589945227 rc 0/0 00000100:00100000:3.0:1746155639.819076:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4693 00000100:00100000:2.0:1746155639.829469:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.829544:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125897088 00000100:00100000:3.0:1746155639.829550:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125897088 00000100:00100000:3.0:1746155639.829586:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11078 00000100:00100000:3.0:1746155639.829594:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32236:x1830976125897088:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155639.829614:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.829652:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e400/0x844e5faceb5f73f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17c9f expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.829739:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f73fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.829750:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f73fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.829759:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f73fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.829770:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7403 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.829775:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.829780:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.829907:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x844e5faceb5f740a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.829914:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x844e5faceb5f740a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.829919:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x844e5faceb5f740a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155639.829928:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155639.830011:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f73fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830016:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f73fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830021:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f73fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830025:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b1c600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155639.830028:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f73fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830034:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f73fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830042:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155639.830044:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155639.830047:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f73fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830051:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f73fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830074:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7403 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830079:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7403 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830084:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7403 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830091:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b1d000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155639.830093:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7403 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830097:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7403 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830102:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fab9a00) 00010000:00010000:3.0:1746155639.830103:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155639.830105:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7403 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830108:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7403 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.830141:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e400/0x844e5faceb5f73f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c9f expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.830150:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x844e5faceb5f740a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c9f expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.830155:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.830157:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155639.830158:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c400, rc 0) 00000100:00100000:3.0:1746155639.830206:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32236:x1830976125897088:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 613us (745us total) trans 8589945228 rc 0/0 00000100:00100000:3.0:1746155639.830211:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11078 00000100:00100000:0.0:1746155639.830883:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.830927:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125897344 00000100:00100000:3.0:1746155639.830930:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125897344 00000100:00100000:3.0:1746155639.830959:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11079 00000100:00100000:3.0:1746155639.830963:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32239:x1830976125897344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155639.830973:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.830979:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1dc00/0x844e5faceb5f7418 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ca6 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.831018:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f741f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831025:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f741f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831031:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f741f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831039:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x844e5faceb5f7426 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831043:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x844e5faceb5f7426 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831048:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x844e5faceb5f7426 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831094:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c800/0x844e5faceb5f742d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831100:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c800/0x844e5faceb5f742d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831105:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c800/0x844e5faceb5f742d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155639.831110:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155639.831147:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f741f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831153:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f741f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831157:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f741f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831161:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b1d800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155639.831163:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f741f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831168:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f741f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831175:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155639.831177:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155639.831179:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f741f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831183:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f741f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831190:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x844e5faceb5f7426 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831194:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x844e5faceb5f7426 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831198:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x844e5faceb5f7426 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831202:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b1d600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155639.831204:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x844e5faceb5f7426 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831208:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x844e5faceb5f7426 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831213:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fab9000) 00010000:00010000:3.0:1746155639.831215:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155639.831217:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x844e5faceb5f7426 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831220:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d600/0x844e5faceb5f7426 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.831240:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1dc00/0x844e5faceb5f7418 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ca6 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.831247:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c800/0x844e5faceb5f742d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ca6 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.831251:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.831253:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155639.831254:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c800, rc 0) 00000100:00100000:3.0:1746155639.831285:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32239:x1830976125897344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 321us (402us total) trans 8589945229 rc 0/0 00000100:00100000:3.0:1746155639.831290:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11079 00000100:00100000:0.0:1746155639.832896:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.832959:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125897600 00000100:00100000:2.0:1746155639.832964:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125897600 00000100:00100000:2.0:1746155639.832995:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4694 00000100:00100000:2.0:1746155639.833000:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32239:x1830976125897600:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155639.833121:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32239:x1830976125897600:12345-192.168.202.51@tcp:35:cat.0 Request processed in 121us (227us total) trans 8589945230 rc 0/0 00000100:00100000:2.0:1746155639.833127:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4694 00000100:00100000:0.0:1746155639.834141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.834198:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125897856 00000100:00100000:2.0:1746155639.834203:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125897856 00000100:00100000:2.0:1746155639.834235:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11080 00000100:00100000:2.0:1746155639.834241:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32236:x1830976125897856:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155639.834252:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.834255:0:14234:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746155639.834275:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c400/0x844e5faceb5f740a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c9f expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.834288:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.834297:0:14234:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155639.834306:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135012400/0x844e5faceb5f743b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17cad expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.834339:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.834349:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f73ee lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c98 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.834355:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c800/0x844e5faceb5f742d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ca6 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.834364:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.834386:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c800/0x844e5faceb5f742d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ca6 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.834396:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c800/0x844e5faceb5f742d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ca6 expref: 288 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.834407:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125335552:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155639.834414:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.834459:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125898112 00000100:00100000:3.0:1746155639.834463:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125898112 00000100:00100000:3.0:1746155639.834582:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11081 00010000:00010000:2.0:1746155639.834582:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f73ee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c98 expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155639.834588:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32240:x1830976125898112:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.834590:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f73ee lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c98 expref: 7 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:3.0:1746155639.834595:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155639.834598:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125335680:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.834603:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f7449 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17cb4 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.834616:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.834871:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.834872:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.834900:0:14232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125898368 00000100:00100000:1.0:1746155639.834903:0:14232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125898368 00000100:00100000:1.0:1746155639.834922:0:14232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11082 00000100:00100000:1.0:1746155639.834928:0:14232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32234:x1830976125898368:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155639.834951:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155639.834958:0:14232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5355600/0x844e5faceb5f7450 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17cbb expref: -99 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.835001:0:14232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 00010000:00010000:1.0:1746155639.835008:0:14232:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 00010000:00010000:1.0:1746155639.835014:0:14232:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:3.0:1746155639.835067:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f745e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835074:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f745e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835081:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f745e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835089:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d400/0x844e5faceb5f7465 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835094:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d400/0x844e5faceb5f7465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835099:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d400/0x844e5faceb5f7465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155639.835134:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125898496 00000100:00100000:2.0:1746155639.835138:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125898496 00000100:00100000:2.0:1746155639.835159:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16796 00010000:00010000:3.0:1746155639.835163:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c000/0x844e5faceb5f746c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155639.835164:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:32239:x1830976125898496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155639.835168:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c000/0x844e5faceb5f746c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x10/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.835171:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.835173:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c000/0x844e5faceb5f746c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x10/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155639.835179:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f7473 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17cc2 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.835193:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.835196:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000004:00200000:3.0:1746155639.835199:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155639.835200:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f7473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc2 expref: 32 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.835209:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f7473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc2 expref: 32 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.835217:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131447e00, rc 0) 00000100:00100000:2.0:1746155639.835235:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:32239:x1830976125898496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 71us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.835240:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16796 00010000:00010000:3.0:1746155639.835247:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c000/0x844e5faceb5f746c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x10/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835253:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c000/0x844e5faceb5f746c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x10/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835279:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c000/0x844e5faceb5f746c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x10/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835283:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b1c000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155639.835286:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c000/0x844e5faceb5f746c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x10/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835291:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c000/0x844e5faceb5f746c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x10/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835298:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.835300:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1746155639.835312:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c000/0x844e5faceb5f746c lrc: 2/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x10/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835317:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c000/0x844e5faceb5f746c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x10/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835327:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f745e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835331:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f745e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835335:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f745e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835339:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b1ce00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155639.835340:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f745e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835345:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f745e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835354:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155639.835356:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155639.835358:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f745e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835362:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f745e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835369:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d400/0x844e5faceb5f7465 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835372:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d400/0x844e5faceb5f7465 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835376:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d400/0x844e5faceb5f7465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835379:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b1d400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155639.835381:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d400/0x844e5faceb5f7465 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835385:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d400/0x844e5faceb5f7465 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835390:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fab9d00) 00010000:00010000:3.0:1746155639.835392:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155639.835394:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d400/0x844e5faceb5f7465 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835397:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d400/0x844e5faceb5f7465 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.835579:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f7449 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cb4 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.835586:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f7449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cb4 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.835593:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d200, rc 0) 00000100:00100000:3.0:1746155639.835623:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32240:x1830976125898112:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1034us (1208us total) trans 8589945231 rc 301/301 00000100:00100000:3.0:1746155639.835628:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11081 00000100:00100000:1.0:1746155639.835814:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.836373:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125335552:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.836381:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125335680:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.836398:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155639.836480:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.836526:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125898752 00000100:00100000:2.0:1746155639.836530:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125898752 00010000:00010000:2.0:1746155639.836544:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f73ee lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c98 expref: 8 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.836560:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125898624 00000100:00100000:2.0:1746155639.836562:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125898624 00000100:00100000:0.0:1746155639.836562:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155639.836570:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c800/0x844e5faceb5f742d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ca6 expref: 291 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:2.0:1746155639.836582:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8603 00000100:00100000:2.0:1746155639.836591:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976125898752:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.836602:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.836607:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f73ee lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c98 expref: 8 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.836615:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f73ee lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c98 expref: 8 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.836626:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f73ee lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c98 expref: 8 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.836635:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.836638:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:2.0:1746155639.836644:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.836649:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:2.0:1746155639.836653:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.836657:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.836682:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976125898752:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 95us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.836690:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8603 00000100:00100000:2.0:1746155639.836700:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8604 00000100:00100000:2.0:1746155639.836705:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1962:x1830976125898624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.836713:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155639.836717:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125898880 00010000:00010000:2.0:1746155639.836717:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c800/0x844e5faceb5f742d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ca6 expref: 291 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.836720:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125898880 00010000:00010000:2.0:1746155639.836724:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c800/0x844e5faceb5f742d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ca6 expref: 292 pid: 27374 timeout: 868 lvb_type: 0 00010000:00010000:2.0:1746155639.836733:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c800/0x844e5faceb5f742d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ca6 expref: 292 pid: 27374 timeout: 868 lvb_type: 0 00000100:00100000:3.0:1746155639.836734:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11083 00000100:00100000:3.0:1746155639.836739:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32239:x1830976125898880:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.836741:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.836743:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:3.0:1746155639.836746:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.836748:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 14232 initiator: MDT0 00010000:00010000:3.0:1746155639.836752:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17cc9 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.836752:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14232 initiator: MDT0 00010000:00010000:2.0:1746155639.836757:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.836761:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.836765:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155639.836773:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155639.836779:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.836914:0:27374:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155639.836923:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.836949:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.836951:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155639.836954:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.836959:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d000, rc 0) 00000100:00100000:3.0:1746155639.836985:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32239:x1830976125898880:12345-192.168.202.51@tcp:101:cat.0 Request processed in 246us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.836990:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11083 00000100:00100000:0.0:1746155639.837180:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155639.837239:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.837258:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1962:x1830976125898624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 552us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.837266:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8604 00010000:00010000:2.0:1746155639.837284:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155639.837289:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00000100:00100000:3.0:1746155639.837324:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125899008 00000100:00100000:3.0:1746155639.837326:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125899008 00000100:00100000:3.0:1746155639.837341:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11084 00000100:00100000:3.0:1746155639.837346:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32240:x1830976125899008:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155639.837353:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.837359:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f7488 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17cd0 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.837394:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.837400:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:3.0:1746155639.837404:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.837411:0:27374:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14232 initiator: MDT0 00010000:00010000:3.0:1746155639.837419:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155639.837606:0:14232:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14232 initiator: MDT0 00010000:00010000:1.0:1746155639.837611:0:14232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14232 initiator: MDT0 00000004:00200000:1.0:1746155639.837626:0:14232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155639.837752:0:14232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5355600/0x844e5faceb5f7450 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cbb expref: 292 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.837784:0:14232:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cbb expref: 291 pid: 14232 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.837791:0:14232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cbb expref: 291 pid: 14232 timeout: 868 lvb_type: 0 00010000:00010000:1.0:1746155639.837800:0:14232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0fa00, rc 0) 00000100:00100000:1.0:1746155639.837820:0:14232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32234:x1830976125898368:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2892us (2949us total) trans 8589945232 rc 0/0 00000100:00100000:1.0:1746155639.837825:0:14232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11082 00000040:00080000:2.0:1746155639.838097:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3562, 88 off300368 00000004:00080000:2.0:1746155639.838102:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768987598776ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155639.838148:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3569, 88 off301248 00000004:00080000:2.0:1746155639.838152:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768987649129ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155639.838207:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3570, 88 off301336 00000004:00080000:2.0:1746155639.838211:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768987708150ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155639.838221:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3563, 88 off300456 00000004:00080000:2.0:1746155639.838224:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768987720910ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155639.838253:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3564, 88 off300544 00000004:00080000:2.0:1746155639.838256:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768987752716ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155639.838355:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3571, 88 off301424 00000004:00080000:2.0:1746155639.838359:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768987855937ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155639.838366:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3572, 88 off301512 00000004:00080000:2.0:1746155639.838368:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768987865134ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155639.838373:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3573, 88 off301600 00000004:00080000:2.0:1746155639.838375:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768987872297ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155639.838381:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3565, 88 off300632 00000004:00080000:2.0:1746155639.838383:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768987880186ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155639.838389:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3574, 88 off301688 00000004:00080000:2.0:1746155639.838391:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768987888289ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155639.838397:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3566, 88 off300720 00000004:00080000:2.0:1746155639.838399:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768987896512ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155639.838406:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3575, 88 off301776 00000004:00080000:2.0:1746155639.838408:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768987905442ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155639.838414:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3567, 88 off300808 00000004:00080000:2.0:1746155639.838416:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768987912744ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155639.838422:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3568, 88 off300896 00000004:00080000:2.0:1746155639.838425:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768987921800ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155639.838431:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3569, 88 off300984 00000004:00080000:2.0:1746155639.838434:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768987930724ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155639.838440:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3570, 88 off301072 00000004:00080000:2.0:1746155639.838442:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 768987939557ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155639.838449:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3576, 88 off301864 00000004:00080000:2.0:1746155639.838452:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 768987949019ns, next at 716011101328ns, rc = 0 00000100:00100000:1.0:1746155639.843387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.843562:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125899136 00000100:00100000:0.0:1746155639.843569:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125899136 00010000:00010000:0.0:1746155639.843592:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cbb expref: 291 pid: 14232 timeout: 868 lvb_type: 0 00000100:00100000:0.0:1746155639.843727:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8605 00000100:00100000:0.0:1746155639.843735:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1960:x1830976125899136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155639.843746:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155639.843891:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cbb expref: 291 pid: 14232 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746155639.843904:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cbb expref: 291 pid: 14232 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746155639.843920:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf0fa00/0x844e5faceb5f7457 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cbb expref: 291 pid: 14232 timeout: 868 lvb_type: 0 00010000:00010000:0.0:1746155639.843946:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155639.843950:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155639.843957:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155639.843962:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.843967:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155639.843972:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155639.844004:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1960:x1830976125899136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 271us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155639.844010:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8605 00000001:00080000:0.0:1746155639.852391:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945232 is committed 00000001:00080000:0.0:1746155639.852403:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945233 is committed 00000004:00080000:0.0:1746155639.852408:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2761 committed 00000004:00080000:0.0:1746155639.852418:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2749 committed 00000004:00080000:0.0:1746155639.852423:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2748 committed 00000004:00080000:0.0:1746155639.852424:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2747 committed 00000004:00080000:0.0:1746155639.852425:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2746 committed 00000004:00080000:0.0:1746155639.852426:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2760 committed 00000004:00080000:0.0:1746155639.852428:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2745 committed 00000004:00080000:0.0:1746155639.852429:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2759 committed 00000004:00080000:0.0:1746155639.852430:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2744 committed 00000004:00080000:0.0:1746155639.852432:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2758 committed 00000004:00080000:0.0:1746155639.852433:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2757 committed 00000004:00080000:0.0:1746155639.852434:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2756 committed 00000004:00080000:0.0:1746155639.852435:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2743 committed 00000004:00080000:0.0:1746155639.852437:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2742 committed 00000004:00080000:0.0:1746155639.852438:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2755 committed 00000004:00080000:0.0:1746155639.852439:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2754 committed 00000004:00080000:0.0:1746155639.852441:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2741 committed 00000001:00080000:0.0:1746155639.852455:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945227 is committed 00010000:00010000:3.0:1746155639.852461:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cad expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.852472:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.852474:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746155639.852477:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.852483:0:14234:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.852487:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155639.852493:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 286 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.852500:0:14234:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 286 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.852517:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125335808:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746155639.852518:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 286 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.852537:0:14234:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 286 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155639.852545:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125336064:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155639.852575:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155639.852597:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125335808 00000100:00100000:2.0:1746155639.852602:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125335808 00000100:00100000:3.0:1746155639.852605:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.852632:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16797 00000100:00100000:2.0:1746155639.852637:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3296:x1830976125335808:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.852641:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125336320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.852662:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155639.852677:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125336832:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746155639.852689:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155639.852691:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746155639.852696:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155639.852701:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125337344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.852714:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:3.0:1746155639.852722:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000100:00100000:0.0:1746155639.852724:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125337856:0@lo:2:osp-syn-1-0.0 00000004:00200000:3.0:1746155639.852726:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1746155639.852735:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1746155639.852738:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155639.852748:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1746155639.852752:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125336448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.852765:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746155639.852766:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155639.852769:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00002000:00010000:2.0:1746155639.852770:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155640 -> 1746155640 00002000:00010000:2.0:1746155639.852772:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155640 -> 1746155640 00002000:00010000:2.0:1746155639.852774:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155639.852774:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125336960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155639.852778:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125336320 00000100:00100000:1.0:1746155639.852782:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125336320 00000100:00100000:0.0:1746155639.852784:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746155639.852788:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f7488 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cd0 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.852792:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125337472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155639.852796:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125336832 00000100:00100000:1.0:1746155639.852798:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125336832 00010000:00010000:3.0:1746155639.852799:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cd0 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.852803:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746155639.852804:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.852806:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746155639.852808:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a76f200, rc 0) 00000100:00100000:1.0:1746155639.852808:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125337344 00000100:00100000:1.0:1746155639.852809:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125337344 00000100:00100000:1.0:1746155639.852817:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125337856 00000100:00100000:0.0:1746155639.852818:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125335936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155639.852819:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125337856 00000100:00100000:1.0:1746155639.852825:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125336448 00000100:00100000:1.0:1746155639.852826:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125336448 00000100:00100000:3.0:1746155639.852831:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32240:x1830976125899008:12345-192.168.202.51@tcp:101:cat.0 Request processed in 15484us (15650us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.852832:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125336960 00000100:00100000:0.0:1746155639.852832:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155639.852833:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125336960 00000100:00100000:3.0:1746155639.852837:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11084 00000100:00100000:0.0:1746155639.852838:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125336576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155639.852839:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125337472 00000100:00100000:1.0:1746155639.852840:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125337472 00000100:00100000:1.0:1746155639.852846:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125335936 00000100:00100000:1.0:1746155639.852847:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125335936 00000100:00100000:0.0:1746155639.852850:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155639.852852:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125336576 00000100:00100000:1.0:1746155639.852854:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125336576 00000100:00100000:0.0:1746155639.852856:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125337088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.852860:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16798 00000100:00100000:1.0:1746155639.852863:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16799 00000100:00100000:3.0:1746155639.852865:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+51:3295:x1830976125336320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.852866:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155639.852868:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3295:x1830976125336832:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.852872:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125337600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.852883:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155639.852890:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746155639.852893:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125336192:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.852905:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155639.852910:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125336704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.852920:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155639.852926:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125337216:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.852949:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155639.852958:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125337728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.852970:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155639.852976:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3295:x1830976125336320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 110us (312us total) trans 21474841549 rc 0/0 00000100:00100000:3.0:1746155639.852982:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16798 00000100:00100000:1.0:1746155639.852982:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+53:3295:x1830976125336832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (290us total) trans 21474841550 rc 0/0 00000100:00100000:0.0:1746155639.852986:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125337088 00000100:00100000:1.0:1746155639.852988:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16799 00000100:00100000:0.0:1746155639.852988:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125337088 00000100:00100000:3.0:1746155639.852992:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125337600 00000100:00100000:3.0:1746155639.852994:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125337600 00000100:00100000:1.0:1746155639.852996:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125336192 00000100:00100000:0.0:1746155639.852998:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125336704 00000100:00100000:1.0:1746155639.852999:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125336192 00000100:00100000:0.0:1746155639.853000:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125336704 00000100:00100000:3.0:1746155639.853003:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125337216 00000100:00100000:3.0:1746155639.853005:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125337216 00000100:00100000:0.0:1746155639.853006:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125337728 00000100:00100000:0.0:1746155639.853008:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125337728 00000100:00100000:1.0:1746155639.853009:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16800 00000100:00100000:1.0:1746155639.853012:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3295:x1830976125337344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.853015:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16801 00000100:00100000:0.0:1746155639.853018:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16802 00000100:00100000:3.0:1746155639.853019:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3295:x1830976125337856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.853022:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+53:3295:x1830976125336448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155639.853044:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16803 00000100:00100000:3.0:1746155639.853049:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3295:x1830976125336960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155639.853087:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:0.0:1746155639.853090:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155639.853092:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155639.853093:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155639.853095:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746155639.853101:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976125337344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (386us total) trans 17179874226 rc 0/0 00000100:00100000:1.0:1746155639.853107:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16800 00000100:00100000:0.0:1746155639.853107:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+54:3295:x1830976125336448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (341us total) trans 21474841551 rc 0/0 00000100:00100000:0.0:1746155639.853112:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16802 00000100:00100000:1.0:1746155639.853116:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16804 00000100:00100000:0.0:1746155639.853118:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16805 00002000:00010000:3.0:1746155639.853119:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:1.0:1746155639.853120:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976125337472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155639.853122:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00000100:00100000:0.0:1746155639.853122:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125335936:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155639.853124:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.853125:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.853127:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:3.0:1746155639.853146:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976125336960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (360us total) trans 17179874227 rc 0/0 00000100:00100000:3.0:1746155639.853151:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16803 00000100:00100000:3.0:1746155639.853167:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16806 00000100:00100000:3.0:1746155639.853171:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125336576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155639.853181:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3296:x1830976125335808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 544us (607us total) trans 21474841548 rc 0/0 00000100:00100000:2.0:1746155639.853187:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16797 00000100:00100000:1.0:1746155639.853190:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976125337472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (386us total) trans 17179874228 rc 0/0 00000100:00100000:1.0:1746155639.853195:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16804 00000100:00100000:2.0:1746155639.853198:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16807 00000100:00100000:2.0:1746155639.853202:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3297:x1830976125337088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155639.853204:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16808 00000100:00100000:1.0:1746155639.853208:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3297:x1830976125337600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155639.853268:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155639.853270:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00002000:00010000:2.0:1746155639.853272:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155640 -> 1746155640 00002000:00010000:2.0:1746155639.853273:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155640 -> 1746155640 00002000:00010000:2.0:1746155639.853274:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155639.853295:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3297:x1830976125337088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (427us total) trans 17179874229 rc 0/0 00000100:00100000:2.0:1746155639.853300:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16807 00000100:00100000:1.0:1746155639.853304:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16809 00000100:00100000:1.0:1746155639.853308:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3297:x1830976125336192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155639.853311:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16810 00000004:00080000:0.0:1746155639.853313:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac4e00/2, rc 0, transno 17179874229 00000100:00100000:2.0:1746155639.853315:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125336704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155639.853320:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125337088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.853343:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125336576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (491us total) trans 21474841552 rc 0/0 00000100:00100000:3.0:1746155639.853348:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16806 00000100:00100000:3.0:1746155639.853357:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16811 00000100:00100000:3.0:1746155639.853360:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3297:x1830976125337216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155639.853368:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16812 00000100:00100000:2.0:1746155639.853371:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+57:3297:x1830976125337728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155639.853378:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155639.853380:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00002000:00010000:1.0:1746155639.853382:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155640 -> 1746155640 00002000:00010000:1.0:1746155639.853384:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155640 -> 1746155640 00002000:00010000:1.0:1746155639.853385:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746155639.853401:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3297:x1830976125336192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (496us total) trans 21474841553 rc 0/0 00000100:00100000:1.0:1746155639.853405:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16809 00002000:00010000:3.0:1746155639.853419:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:3.0:1746155639.853422:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.853423:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.853425:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.853427:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:2.0:1746155639.853433:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3297:x1830976125337728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (462us total) trans 17179874231 rc 0/0 00000100:00100000:3.0:1746155639.853439:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3297:x1830976125337216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (490us total) trans 17179874230 rc 0/0 00000100:00100000:2.0:1746155639.853439:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16812 00000100:00100000:3.0:1746155639.853443:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16811 00000100:00100000:1.0:1746155639.853466:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3297:x1830976125337600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 257us (582us total) trans 17179874232 rc 0/0 00000100:00100000:1.0:1746155639.853472:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16808 00000004:00080000:2.0:1746155639.853473:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26c380/2, rc 0, transno 21474841548 00000100:00100000:2.0:1746155639.853477:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125335808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155639.853485:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125337984:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155639.853517:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155639.853518:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125336704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (596us total) trans 21474841554 rc 0/0 00000100:00100000:1.0:1746155639.853523:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16810 00000100:00100000:1.0:1746155639.853540:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125337984 00000100:00100000:1.0:1746155639.853542:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125337984 00000004:00080000:0.0:1746155639.853544:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26d180/2, rc 0, transno 21474841553 00000100:00100000:0.0:1746155639.853548:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125336192:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155639.853549:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155639.853551:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.853553:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155640 -> 1746155640 00000100:00100000:1.0:1746155639.853553:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16813 00000004:00080000:0.0:1746155639.853554:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26d500/2, rc 0, transno 21474841554 00002000:00010000:3.0:1746155639.853555:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155640 -> 1746155640 00002000:00010000:3.0:1746155639.853556:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746155639.853557:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976125337984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155639.853557:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125336704:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155639.853562:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac6d80/2, rc 0, transno 17179874230 00000100:00100000:0.0:1746155639.853565:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125337216:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155639.853571:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac5880/2, rc 0, transno 17179874231 00000100:00100000:3.0:1746155639.853573:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125335936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 451us (741us total) trans 21474841555 rc 0/0 00000100:00100000:0.0:1746155639.853574:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125337728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.853578:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16805 00000004:00080000:0.0:1746155639.853580:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26df80/2, rc 0, transno 21474841555 00000100:00100000:0.0:1746155639.853583:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125335936:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155639.853588:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26ea00/2, rc 0, transno 21474841552 00000100:00100000:0.0:1746155639.853590:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125336576:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155639.853595:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26e680/2, rc 0, transno 21474841551 00000004:00080000:0.0:1746155639.853595:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac4700/2, rc 0, transno 17179874232 00000100:00100000:0.0:1746155639.853597:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125337600:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.853598:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125336448:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155639.853604:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac5f80/2, rc 0, transno 17179874227 00000100:00100000:3.0:1746155639.853606:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125336960:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155639.853612:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac5c00/2, rc 0, transno 17179874228 00000100:00100000:3.0:1746155639.853614:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125337472:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155639.853618:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26f100/2, rc 0, transno 21474841549 00000100:00100000:3.0:1746155639.853620:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125336320:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155639.853624:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26e300/2, rc 0, transno 21474841550 00000100:00100000:3.0:1746155639.853627:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125336832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155639.853627:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3296:x1830976125337984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (125us total) trans 17179874233 rc 0/0 00000004:00080000:3.0:1746155639.853632:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac5180/2, rc 0, transno 17179874226 00000100:00100000:1.0:1746155639.853632:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16813 00000100:00100000:3.0:1746155639.853635:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125337344:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155639.853637:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f883480/2, rc 0, transno 17179874233 00000100:00100000:2.0:1746155639.853640:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125337984:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.853696:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+59:3295:x1830976125337856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 676us (959us total) trans 17179874234 rc 0/0 00000100:00100000:3.0:1746155639.853700:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16801 00000004:00080000:0.0:1746155639.853706:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac4000/2, rc 0, transno 17179874234 00000100:00100000:0.0:1746155639.853710:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125337856:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155639.855928:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125336064:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155639.855975:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135012400/0x844e5faceb5f743b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cad expref: 9 pid: 14234 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746155639.855991:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cad expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.856017:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131443800, rc 0) 00000100:00100000:3.0:1746155639.856060:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32236:x1830976125897856:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 21818us (21919us total) trans 8589945233 rc 0/0 00000100:00100000:3.0:1746155639.856066:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11080 00000100:00100000:0.0:1746155639.858013:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.858087:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125899264 00000100:00100000:2.0:1746155639.858094:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125899264 00000100:00100000:2.0:1746155639.858127:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4695 00000100:00100000:2.0:1746155639.858133:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32239:x1830976125899264:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:2.0:1746155639.858231:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32239:x1830976125899264:12345-192.168.202.51@tcp:49:cat.0 Request processed in 98us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.858236:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4695 00000100:00100000:1.0:1746155639.858268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.858386:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.858427:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125899520 00000100:00100000:2.0:1746155639.858431:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125899520 00000100:00100000:2.0:1746155639.858448:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16814 00000100:00100000:2.0:1746155639.858453:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32236:x1830976125899520:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:3.0:1746155639.858459:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125899392 00010000:00010000:2.0:1746155639.858462:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155639.858463:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125899392 00010000:00010000:2.0:1746155639.858475:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17cde expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155639.858489:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11085 00000100:00100000:3.0:1746155639.858495:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32240:x1830976125899392:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.858495:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea96800/0x844e5faceb5f73a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c91 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.858515:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.858517:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.858520:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3702784->3833855] (req 3702784->3833855) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.858521:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.858532:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb600/0x844e5faceb5f74a4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17cd7 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.858544:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea96800/0x844e5faceb5f73a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c91 expref: 14 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.858558:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ea96800/0x844e5faceb5f73a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c91 expref: 14 pid: 8436 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746155639.858564:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb600/0x844e5faceb5f74a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cd7 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.858568:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125338112:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.858574:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb600/0x844e5faceb5f74a4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cd7 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.858592:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155639.858595:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155639.858597:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbeb600, rc 0) 00000100:00100000:2.0:1746155639.858616:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bde40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155639.858621:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32240:x1830976125899392:12345-192.168.202.51@tcp:101:cat.0 Request processed in 126us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.858625:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11085 00000100:00100000:2.0:1746155639.860245:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125338112:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155639.860251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155639.860288:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3702784->3833855] (req 3702784->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.860300:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f64800, rc 0) 00000100:00100000:2.0:1746155639.860328:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32236:x1830976125899520:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1874us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.860333:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16814 00000100:00100000:1.0:1746155639.860441:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125899648 00000100:00100000:1.0:1746155639.860445:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125899648 00010000:00010000:1.0:1746155639.860464:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea96800/0x844e5faceb5f73a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c91 expref: 15 pid: 8436 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746155639.860493:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8606 00000100:00100000:1.0:1746155639.860498:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125899648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155639.860527:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155639.860542:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ea96800/0x844e5faceb5f73a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c91 expref: 15 pid: 8436 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155639.860551:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ea96800/0x844e5faceb5f73a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c91 expref: 15 pid: 8436 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155639.861075:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea96800/0x844e5faceb5f73a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c91 expref: 15 pid: 8436 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155639.861087:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.861088:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.861093:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.861100:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.861123:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155639.861132:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125338240:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155639.861383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.861408:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.861421:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.861423:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125899776 00000100:00100000:2.0:1746155639.861427:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125899776 00000100:00100000:0.0:1746155639.861431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.861442:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.861451:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 750 00000100:00100000:0.0:1746155639.861452:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.861456:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976125899776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.861464:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155639.861468:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155639.861476:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb600/0x844e5faceb5f74a4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cd7 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.861480:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125899904 00000100:00100000:0.0:1746155639.861482:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125899904 00010000:00010000:2.0:1746155639.861486:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155639.861489:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155639.861498:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125900032 00000100:00100000:0.0:1746155639.861500:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125900032 00000100:00100000:2.0:1746155639.861524:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976125899776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155639.861524:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125900160 00000100:00100000:0.0:1746155639.861525:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125900160 00000100:00100000:2.0:1746155639.861530:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 750 00000100:00100000:0.0:1746155639.861533:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125900288 00000100:00100000:0.0:1746155639.861534:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125900288 00000100:00100000:0.0:1746155639.861542:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125900416 00000100:00100000:0.0:1746155639.861544:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125900416 00000100:00100000:0.0:1746155639.861552:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125900544 00000100:00100000:0.0:1746155639.861553:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125900544 00000100:00100000:2.0:1746155639.861556:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16815 00000100:00100000:2.0:1746155639.861562:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125899904:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155639.861564:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16816 00000100:00100000:0.0:1746155639.861569:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976125900032:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.861571:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155639.861576:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.861581:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880133832800/0x844e5faceb5f74ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ce5 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.861584:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f847800/0x844e5faceb5f74b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17cec expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.861592:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.861594:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.861594:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155639.861595:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.861599:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880133832800/0x844e5faceb5f74ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ce5 expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.861600:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f847800/0x844e5faceb5f74b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cec expref: 21 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.861609:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880133832800/0x844e5faceb5f74ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ce5 expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155639.861609:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f847800/0x844e5faceb5f74b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cec expref: 21 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155639.861615:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133832800, rc 0) 00010000:00010000:0.0:1746155639.861616:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f847800, rc 0) 00000100:00100000:2.0:1746155639.861630:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125899904:12345-192.168.202.51@tcp:101:cat.0 Request processed in 69us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.861635:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16815 00000100:00100000:2.0:1746155639.861647:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16817 00000100:00100000:2.0:1746155639.861651:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976125900160:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.861657:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155639.861657:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3540 going to sleep for 11 seconds 00010000:00010000:2.0:1746155639.861662:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133833800/0x844e5faceb5f74b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17cf3 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.861670:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.861671:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.861675:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133833800/0x844e5faceb5f74b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cf3 expref: 22 pid: 9235 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155639.861675:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16818 00000100:00100000:1.0:1746155639.861681:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125900288:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.861683:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133833800/0x844e5faceb5f74b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cf3 expref: 22 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.861688:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.861689:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133833800, rc 0) 00010000:00010000:1.0:1746155639.861694:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1c000/0x844e5faceb5f74c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17cfa expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.861708:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.861709:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.861714:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c000/0x844e5faceb5f74c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cfa expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.861726:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c000/0x844e5faceb5f74c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cfa expref: 10 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.861733:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c000, rc 0) 00000100:00100000:3.0:1746155639.862033:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16819 00000100:00100000:3.0:1746155639.862041:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125900416:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155639.862047:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.862057:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbebc00/0x844e5faceb5f74c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d01 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.862066:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.862067:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.862071:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbebc00/0x844e5faceb5f74c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d01 expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155639.862082:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbebc00/0x844e5faceb5f74c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d01 expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155639.862089:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbebc00, rc 0) 00000100:00100000:0.0:1746155639.862370:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125900032:12345-192.168.202.51@tcp:101:cat.0 Request processed in 799us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155639.862375:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16816 00000100:00100000:2.0:1746155639.862376:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125900160:12345-192.168.202.51@tcp:101:cat.0 Request processed in 723us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.862382:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16817 00000100:00100000:0.0:1746155639.862387:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16820 00000100:00100000:0.0:1746155639.862391:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976125900544:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155639.862397:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155639.862402:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f846800/0x844e5faceb5f74ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d08 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155639.862421:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f702d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125338368:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155639.862444:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746155639.862461:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125900288:12345-192.168.202.51@tcp:101:cat.0 Request processed in 779us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155639.862466:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16818 00000100:00100000:3.0:1746155639.862544:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125900416:12345-192.168.202.51@tcp:101:cat.0 Request processed in 504us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.862549:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16819 00000100:00100000:1.0:1746155639.862664:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.862783:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125900672 00000100:00100000:3.0:1746155639.862788:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125900672 00000100:00100000:3.0:1746155639.862808:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16821 00000100:00100000:3.0:1746155639.862813:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:32234:x1830976125900672:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155639.862819:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.862825:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d0f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.862838:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.862844:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155639.862845:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155639.862847:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3026944->3145727] (req 3026944->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.862862:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.862871:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 21 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155639.862879:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125338496:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.862904:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.863105:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125338240:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155639.863117:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155639.863134:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125899648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2635us (2884us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155639.863140:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8606 00000100:00100000:1.0:1746155639.863153:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.863191:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125901056 00000100:00100000:3.0:1746155639.863194:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125901056 00002000:00100000:3.0:1746155639.863216:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fb6ad80 x1830976125901056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.863224:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6ad80 with x1830976125901056 ext(0->1048575) 00002000:00010000:3.0:1746155639.863228:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6ad80 00000100:00100000:3.0:1746155639.863250:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7952 00000100:00100000:3.0:1746155639.863255:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976125901056:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155639.863453:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.863599:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125901184 00000100:00100000:0.0:1746155639.863603:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125901184 00002000:00100000:0.0:1746155639.863619:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3702784->3706879) req@ffff88009fb6a300 x1830976125901184/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155639.863626:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6a300 with x1830976125901184 ext(3702784->3706879) 00010000:00010000:0.0:1746155639.863630:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 22 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746155639.863639:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 22 pid: 8437 timeout: 869 lvb_type: 0 00002000:00010000:0.0:1746155639.863645:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb6a300 00000100:00100000:0.0:1746155639.863657:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1372 00000100:00100000:0.0:1746155639.863662:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976125901184:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155639.863946:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976125901184:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 283us (493us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155639.863951:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1372 00002000:00100000:0.0:1746155639.863956:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3702784->3706879) req@ffff88009fb6a300 x1830976125901184/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155639.863968:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6a300 with x1830976125901184 ext(3702784->3706879) 00010000:00010000:0.0:1746155639.863971:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 22 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746155639.863980:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 22 pid: 8437 timeout: 869 lvb_type: 0 00002000:00010000:0.0:1746155639.863985:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb6a300 00000100:00100000:1.0:1746155639.865875:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f702d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125338368:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155639.865902:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f846800/0x844e5faceb5f74ce lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d08 expref: 21 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.865913:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f846800/0x844e5faceb5f74ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d08 expref: 21 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.865923:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f846800, rc 0) 00000100:00100000:1.0:1746155639.865963:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976125900544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3571us (4493us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155639.865970:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16820 00000100:00100000:3.0:1746155639.866168:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125338496:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.866185:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3026944->3145727] (req 3026944->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.866195:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbeb800, rc 0) 00000100:00100000:3.0:1746155639.866429:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:32234:x1830976125900672:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3615us (3765us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.866435:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16821 00000100:00100000:1.0:1746155639.867000:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.867138:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125901440 00000100:00100000:0.0:1746155639.867144:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125901440 00002000:00100000:0.0:1746155639.867167:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3829760->3833855) req@ffff88009fb6a680 x1830976125901440/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155639.867174:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6a680 with x1830976125901440 ext(3829760->3833855) 00010000:00010000:0.0:1746155639.867180:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 20 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746155639.867191:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 20 pid: 8437 timeout: 869 lvb_type: 0 00002000:00010000:0.0:1746155639.867197:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb6a680 00000100:00100000:0.0:1746155639.867225:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1373 00000100:00100000:0.0:1746155639.867232:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976125901440:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155639.867332:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976125901440:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 101us (332us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155639.867341:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1373 00002000:00100000:0.0:1746155639.867346:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3829760->3833855) req@ffff88009fb6a680 x1830976125901440/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155639.867352:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6a680 with x1830976125901440 ext(3829760->3833855) 00010000:00010000:0.0:1746155639.867356:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 20 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746155639.867365:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 20 pid: 8437 timeout: 869 lvb_type: 0 00002000:00010000:0.0:1746155639.867370:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb6a680 00000100:00100000:3.0:1746155639.872367:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976125901056:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9103us (9205us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155639.872377:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7952 00002000:00100000:3.0:1746155639.872387:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fb6ad80 x1830976125901056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.872394:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6ad80 with x1830976125901056 ext(0->1048575) 00002000:00010000:3.0:1746155639.872399:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6ad80 00000100:00100000:0.0:1746155639.872986:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.873311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.873396:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125901952 00000100:00100000:2.0:1746155639.873403:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125901952 00000100:00100000:2.0:1746155639.873433:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4696 00000100:00100000:2.0:1746155639.873440:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32236:x1830976125901952:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155639.873455:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125901824 00000100:00100000:3.0:1746155639.873458:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125901824 00002000:00100000:3.0:1746155639.873475:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3702784->3833855) req@ffff88009f701500 x1830976125901824/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.873482:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f701500 with x1830976125901824 ext(3702784->3833855) 00010000:00010000:3.0:1746155639.873488:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 20 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155639.873519:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 20 pid: 8437 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746155639.873525:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f701500 00000100:00100000:2.0:1746155639.873646:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32236:x1830976125901952:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 206us (660us total) trans 8589945234 rc 0/0 00000100:00100000:2.0:1746155639.873652:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4696 00000100:00100000:3.0:1746155639.873947:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1374 00000100:00100000:3.0:1746155639.873953:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976125901824:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155639.878637:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.878684:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125902208 00000100:00100000:1.0:1746155639.878693:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125902208 00002000:00100000:1.0:1746155639.878727:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f702d80 x1830976125902208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.878737:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f702d80 with x1830976125902208 ext(0->1048575) 00002000:00010000:1.0:1746155639.878742:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f702d80 00000100:00100000:1.0:1746155639.878772:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7953 00000100:00100000:1.0:1746155639.878779:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125902208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155639.882873:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.883407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.883431:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125902464 00000100:00100000:0.0:1746155639.883434:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.883439:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125902464 00002000:00100000:3.0:1746155639.883471:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88012f1f0000 x1830976125902464/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.883480:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0000 with x1830976125902464 ext(1048576->2097151) 00002000:00010000:3.0:1746155639.883484:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f0000 00000100:00100000:3.0:1746155639.883497:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125902720 00000100:00100000:3.0:1746155639.883499:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125902720 00000100:00100000:0.0:1746155639.883517:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125902976 00000100:00100000:0.0:1746155639.883520:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125902976 00002000:00100000:3.0:1746155639.883523:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88012cdef100 x1830976125902720/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.883529:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdef100 with x1830976125902720 ext(1048576->2097151) 00002000:00010000:3.0:1746155639.883532:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdef100 00002000:00100000:0.0:1746155639.883533:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012cded180 x1830976125902976/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155639.883539:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded180 with x1830976125902976 ext(1048576->2097151) 00000100:00100000:3.0:1746155639.883542:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7954 00002000:00010000:0.0:1746155639.883542:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cded180 00000100:00100000:3.0:1746155639.883548:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125902464:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155639.883563:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7955 00000100:00100000:0.0:1746155639.883567:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976125902720:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155639.883589:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7956 00000100:00100000:1.0:1746155639.883598:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125902976:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155639.886749:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.887243:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976125901824:12345-192.168.202.51@tcp:4:cat.0 Request processed in 13287us (13929us total) trans 21474841556 rc 0/0 00000100:00100000:3.0:1746155639.887254:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1374 00002000:00100000:3.0:1746155639.887264:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3702784->3833855) req@ffff88009f701500 x1830976125901824/t21474841556(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/448 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.887273:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f701500 with x1830976125901824 ext(3702784->3833855) 00010000:00010000:3.0:1746155639.887281:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 26 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155639.887295:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 26 pid: 8437 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746155639.887301:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f701500 00000100:00100000:3.0:1746155639.887326:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125903104 00000100:00100000:3.0:1746155639.887333:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125903104 00000100:00100000:3.0:1746155639.887359:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16822 00000100:00100000:3.0:1746155639.887365:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:32239:x1830976125903104:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155639.887376:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.887387:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f74dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d16 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.887403:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.887404:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.887410:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f74dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d16 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.887421:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f74dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d16 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.887429:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df5fa00, rc 0) 00000100:00100000:3.0:1746155639.887671:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32239:x1830976125903104:12345-192.168.202.51@tcp:101:cat.0 Request processed in 305us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.887676:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16822 00000100:00100000:0.0:1746155639.890298:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.890491:0:14230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125903232 00000100:00100000:2.0:1746155639.890498:0:14230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125903232 00000100:00100000:2.0:1746155639.890553:0:14230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 219 00000100:00100000:2.0:1746155639.890559:0:14230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a03bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06793f43-a06c-4add-b66d-476e36bacde6+15:1960:x1830976125903232:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:2.0:1746155639.890598:0:14230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a03bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06793f43-a06c-4add-b66d-476e36bacde6+15:1960:x1830976125903232:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 39us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.890603:0:14230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 219 00000100:00100000:1.0:1746155639.890912:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125902208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12132us (12281us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155639.890920:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7953 00002000:00100000:1.0:1746155639.890930:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f702d80 x1830976125902208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.890953:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f702d80 with x1830976125902208 ext(0->1048575) 00002000:00010000:1.0:1746155639.890958:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f702d80 00000100:00100000:0.0:1746155639.891060:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976125902720:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7490us (7651us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155639.891066:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7955 00002000:00100000:0.0:1746155639.891071:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88012cdef100 x1830976125902720/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155639.891078:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdef100 with x1830976125902720 ext(1048576->2097151) 00002000:00010000:0.0:1746155639.891082:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdef100 00000100:00100000:0.0:1746155639.892048:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.892113:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125903360 00000100:00100000:2.0:1746155639.892117:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125903360 00010000:00010000:2.0:1746155639.892139:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 24 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155639.892157:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8607 00000100:00100000:2.0:1746155639.892162:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976125903360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.892170:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.892185:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 24 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155639.892194:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 24 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155639.892210:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f64800/0x844e5faceb5f749d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3702784->3833855) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cde expref: 24 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155639.892220:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.892222:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.892227:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.892234:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.892258:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.892272:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125338624:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155639.892812:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.894980:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.895105:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125903616 00000100:00100000:2.0:1746155639.895111:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125903616 00002000:00100000:2.0:1746155639.895143:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88012cdefb80 x1830976125903616/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.895153:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdefb80 with x1830976125903616 ext(1048576->2097151) 00002000:00010000:2.0:1746155639.895157:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdefb80 00000100:00100000:2.0:1746155639.895174:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7957 00000100:00100000:2.0:1746155639.895180:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976125903616:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155639.895371:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125902976:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11774us (11934us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155639.895377:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7956 00002000:00100000:1.0:1746155639.895381:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012cded180 x1830976125902976/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.895386:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded180 with x1830976125902976 ext(1048576->2097151) 00002000:00010000:1.0:1746155639.895389:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cded180 00000100:00100000:3.0:1746155639.896856:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125902464:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13305us (13988us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155639.896863:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7954 00002000:00100000:3.0:1746155639.896869:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88012f1f0000 x1830976125902464/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.896876:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0000 with x1830976125902464 ext(1048576->2097151) 00002000:00010000:3.0:1746155639.896879:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f0000 00000100:00100000:2.0:1746155639.898031:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125338624:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155639.898049:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.898072:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976125903360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5909us (6025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.898080:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8607 00000100:00100000:1.0:1746155639.898714:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.898771:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125903872 00000100:00100000:3.0:1746155639.898777:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125903872 00002000:00100000:3.0:1746155639.898805:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3026944->3031039) req@ffff88009fb6b800 x1830976125903872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.898814:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b800 with x1830976125903872 ext(3026944->3031039) 00002000:00010000:3.0:1746155639.898817:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb6b800 00000100:00100000:3.0:1746155639.898833:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7958 00000100:00100000:3.0:1746155639.898840:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976125903872:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155639.898965:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976125903872:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 125us (251us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155639.898971:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7958 00002000:00100000:3.0:1746155639.898976:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3026944->3031039) req@ffff88009fb6b800 x1830976125903872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.898982:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b800 with x1830976125903872 ext(3026944->3031039) 00002000:00010000:3.0:1746155639.898986:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb6b800 00000100:00100000:2.0:1746155639.902946:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976125903616:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7750us (7956us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.902957:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7957 00002000:00100000:2.0:1746155639.902966:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88012cdefb80 x1830976125903616/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.903122:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdefb80 with x1830976125903616 ext(1048576->2097151) 00002000:00010000:2.0:1746155639.903128:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdefb80 00000100:00100000:0.0:1746155639.908539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.908583:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.908870:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125904128 00000100:00100000:2.0:1746155639.908877:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125904128 00002000:00100000:2.0:1746155639.908913:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012cdee680 x1830976125904128/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.908922:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdee680 with x1830976125904128 ext(2097152->3145727) 00002000:00010000:2.0:1746155639.908927:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdee680 00000100:00100000:2.0:1746155639.908998:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7959 00000100:00100000:2.0:1746155639.909004:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125904128:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155639.909024:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.909139:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125904256 00000100:00100000:1.0:1746155639.909143:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125904256 00000100:00100000:3.0:1746155639.909144:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125904384 00000100:00100000:3.0:1746155639.909148:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125904384 00000100:00100000:1.0:1746155639.909174:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16823 00000100:00100000:1.0:1746155639.909180:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:32234:x1830976125904256:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155639.909189:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155639.909204:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d1d expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.909224:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f738c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c8a expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.909239:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbebc00/0x844e5faceb5f74c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d01 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.909244:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.909246:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155639.909248:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->3465215] (req 3145728->3465215) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 33 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.909271:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbebc00/0x844e5faceb5f74c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d01 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155639.909282:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbebc00/0x844e5faceb5f74c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d01 expref: 10 pid: 1625 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746155639.909292:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125338752:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.909316:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16824 00000100:00100000:3.0:1746155639.909323:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32239:x1830976125904384:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155639.909329:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.909338:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f74ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d24 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.909350:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.909351:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.909358:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f74ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d24 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.909360:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f738c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c8a expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155639.909370:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f74ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d24 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155639.909373:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f738c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c8a expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746155639.909378:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df5fc00, rc 0) 00000100:00100000:1.0:1746155639.909381:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125338880:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.909400:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:32239:x1830976125904384:12345-192.168.202.51@tcp:101:cat.0 Request processed in 77us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.909405:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16824 00000100:00100000:1.0:1746155639.909441:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.911425:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.911632:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125904512 00000100:00100000:3.0:1746155639.911638:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125904512 00010000:00010000:3.0:1746155639.911666:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f738c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c8a expref: 14 pid: 18270 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155639.911701:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8608 00000100:00100000:3.0:1746155639.911711:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d75a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1963:x1830976125904512:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155639.911724:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155639.911740:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f738c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c8a expref: 14 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746155639.911750:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f738c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c8a expref: 14 pid: 18270 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746155639.911756:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125338752:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155639.911767:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125338880:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155639.911769:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f17a800/0x844e5faceb5f738c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c8a expref: 14 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746155639.911795:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155639.911795:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->3465215] (req 3145728->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 33 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.911805:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a36000, rc 0) 00000100:00100000:2.0:1746155639.912612:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:32234:x1830976125904256:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3429us (4025us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.912613:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d75a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976125904512:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 901us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.912620:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8608 00000100:00100000:2.0:1746155639.912620:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16823 00000100:00100000:0.0:1746155639.915406:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.915547:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125904768 00000100:00100000:3.0:1746155639.915555:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125904768 00002000:00100000:3.0:1746155639.915590:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88012cdeca80 x1830976125904768/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.915600:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeca80 with x1830976125904768 ext(1048576->2097151) 00002000:00010000:3.0:1746155639.915605:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdeca80 00000100:00100000:3.0:1746155639.915632:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7960 00000100:00100000:3.0:1746155639.915638:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976125904768:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155639.916395:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125904128:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7388us (7891us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.916402:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7959 00002000:00100000:2.0:1746155639.916408:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012cdee680 x1830976125904128/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.916416:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdee680 with x1830976125904128 ext(2097152->3145727) 00010000:00010000:2.0:1746155639.916423:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009fbebc00/0x844e5faceb5f74c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d01 expref: 10 pid: 1625 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746155639.916436:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009fbebc00/0x844e5faceb5f74c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d01 expref: 10 pid: 1625 timeout: 869 lvb_type: 1 00002000:00010000:2.0:1746155639.916442:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdee680 00000100:00100000:3.0:1746155639.922242:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976125904768:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 6595us (6834us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155639.922252:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7960 00002000:00100000:3.0:1746155639.922262:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88012cdeca80 x1830976125904768/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.922271:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeca80 with x1830976125904768 ext(1048576->2097151) 00002000:00010000:3.0:1746155639.922276:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdeca80 00000100:00100000:2.0:1746155639.922637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.922743:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125904896 00000100:00100000:0.0:1746155639.922750:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125904896 00000100:00100000:0.0:1746155639.922785:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16825 00000100:00100000:0.0:1746155639.922792:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:32240:x1830976125904896:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155639.922804:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155639.922822:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5f74f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d2b expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.922844:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.922851:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155639.922853:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155639.922857:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5f74f1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d2b expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.922882:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155639.922891:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 16 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746155639.922901:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a62a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125339008:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155639.922973:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.923836:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.923882:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125905024 00000100:00100000:2.0:1746155639.923886:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125905024 00010000:00010000:2.0:1746155639.923907:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbebc00/0x844e5faceb5f74c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d01 expref: 10 pid: 1625 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746155639.923943:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8609 00000100:00100000:2.0:1746155639.923953:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125905024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.923963:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.923982:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbebc00/0x844e5faceb5f74c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d01 expref: 10 pid: 1625 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746155639.923992:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbebc00/0x844e5faceb5f74c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d01 expref: 10 pid: 1625 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746155639.924016:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbebc00/0x844e5faceb5f74c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d01 expref: 10 pid: 1625 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746155639.924037:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.924039:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.924044:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.924055:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.924078:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.924086:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125339136:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155639.924482:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.926740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.926815:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a62a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125339008:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.926843:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5f74f1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d2b expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.926858:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55f7600, rc 0) 00000100:00100000:2.0:1746155639.926902:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32240:x1830976125904896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4109us (4265us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.926910:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16825 00000100:00100000:3.0:1746155639.927114:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125905152 00000100:00100000:3.0:1746155639.927121:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125905152 00000100:00100000:2.0:1746155639.927127:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125339136:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155639.927138:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746155639.927151:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3026944->3145727) req@ffff8800a62a1f80 x1830976125905152/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.927160:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a1f80 with x1830976125905152 ext(3026944->3145727) 00000100:00100000:2.0:1746155639.927160:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976125905024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3211us (3326us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155639.927166:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 17 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155639.927167:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8609 00010000:00010000:3.0:1746155639.927184:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 17 pid: 8437 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746155639.927190:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a62a1f80 00000100:00100000:3.0:1746155639.927213:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1375 00000100:00100000:3.0:1746155639.927222:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976125905152:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155639.927755:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.927797:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125905280 00000100:00100000:2.0:1746155639.927801:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125905280 00000100:00100000:2.0:1746155639.927819:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16826 00000100:00100000:2.0:1746155639.927825:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:32239:x1830976125905280:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.927832:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.927845:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x844e5faceb5f74f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d32 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.927860:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.927862:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.927868:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x844e5faceb5f74f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d32 expref: 34 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.927879:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x844e5faceb5f74f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d32 expref: 34 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.927885:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1ca00, rc 0) 00000100:00100000:2.0:1746155639.927907:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:32239:x1830976125905280:12345-192.168.202.51@tcp:101:cat.0 Request processed in 82us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.927912:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16826 00000100:00100000:2.0:1746155639.931081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.931128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.931360:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125905536 00000100:00100000:0.0:1746155639.931370:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125905536 00002000:00100000:0.0:1746155639.931399:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3461120->3465215) req@ffff88012f1f1500 x1830976125905536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155639.931408:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1500 with x1830976125905536 ext(3461120->3465215) 00002000:00010000:0.0:1746155639.931412:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f1500 00000100:00100000:0.0:1746155639.931432:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125905792 00000100:00100000:0.0:1746155639.931434:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125905792 00002000:00100000:0.0:1746155639.931443:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012f1f2d80 x1830976125905792/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155639.931450:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2d80 with x1830976125905792 ext(1048576->2097151) 00002000:00010000:0.0:1746155639.931452:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f2d80 00000100:00100000:1.0:1746155639.931457:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7961 00000100:00100000:1.0:1746155639.931467:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1962:x1830976125905536:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155639.931478:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7962 00000100:00100000:0.0:1746155639.931483:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976125905792:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155639.931577:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1962:x1830976125905536:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 112us (502us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155639.931583:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7961 00002000:00100000:1.0:1746155639.931588:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3461120->3465215) req@ffff88012f1f1500 x1830976125905536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/4536 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.931596:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1500 with x1830976125905536 ext(3461120->3465215) 00002000:00010000:1.0:1746155639.931599:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f1500 00000100:00100000:3.0:1746155639.931995:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976125905152:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 4775us (5260us total) trans 21474841557 rc 0/0 00000100:00100000:3.0:1746155639.932001:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1375 00002000:00100000:3.0:1746155639.932006:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3026944->3145727) req@ffff8800a62a1f80 x1830976125905152/t21474841557(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/448 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.932013:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a1f80 with x1830976125905152 ext(3026944->3145727) 00010000:00010000:3.0:1746155639.932019:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 19 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155639.932031:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 19 pid: 8437 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746155639.932036:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a62a1f80 00000100:00100000:0.0:1746155639.936353:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.936385:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.936404:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125906048 00000100:00100000:2.0:1746155639.936410:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125906048 00010000:00010000:2.0:1746155639.936435:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 19 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155639.936463:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8610 00000100:00100000:2.0:1746155639.936469:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976125906048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155639.936480:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155639.936498:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 19 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155639.936533:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 19 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155639.936553:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f74d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3026944->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d0f expref: 19 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155639.936576:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.936578:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.936584:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5f74f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d2b expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.936591:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5f74f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d2b expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.936618:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5f74f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d2b expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155639.936628:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125339264:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155639.936698:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155639.936823:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976125905792:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 5338us (5692us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155639.936830:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7962 00002000:00100000:0.0:1746155639.936838:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012f1f2d80 x1830976125905792/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155639.936845:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2d80 with x1830976125905792 ext(1048576->2097151) 00002000:00010000:0.0:1746155639.936849:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f2d80 00000100:00100000:1.0:1746155639.937623:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125906176 00000100:00100000:1.0:1746155639.937628:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125906176 00000100:00100000:1.0:1746155639.937665:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4697 00000100:00100000:1.0:1746155639.937672:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32234:x1830976125906176:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155639.937845:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32234:x1830976125906176:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 173us (1457us total) trans 8589945235 rc 0/0 00000100:00100000:1.0:1746155639.937850:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4697 00000100:00100000:2.0:1746155639.938373:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125339264:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155639.938387:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155639.938652:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976125906048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2182us (2305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.938658:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8610 00000100:00100000:0.0:1746155639.941157:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.941209:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125906432 00000100:00100000:2.0:1746155639.941220:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125906432 00002000:00100000:2.0:1746155639.941265:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a62a0e00 x1830976125906432/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.941274:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a0e00 with x1830976125906432 ext(2097152->3145727) 00002000:00010000:2.0:1746155639.941278:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a0e00 00000100:00100000:2.0:1746155639.941307:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7963 00000100:00100000:2.0:1746155639.941315:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125906432:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155639.942274:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.942335:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125906688 00000100:00100000:3.0:1746155639.942339:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125906688 00002000:00100000:3.0:1746155639.942358:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a62a2300 x1830976125906688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.942365:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a2300 with x1830976125906688 ext(2097152->3145727) 00002000:00010000:3.0:1746155639.942368:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a2300 00000100:00100000:3.0:1746155639.942381:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7964 00000100:00100000:3.0:1746155639.942386:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976125906688:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155639.949003:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125906432:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7680us (7844us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.949014:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7963 00002000:00100000:2.0:1746155639.949023:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a62a0e00 x1830976125906432/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.949032:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a0e00 with x1830976125906432 ext(2097152->3145727) 00002000:00010000:2.0:1746155639.949036:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a0e00 00000100:00100000:3.0:1746155639.950547:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976125906688:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8154us (8269us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155639.950555:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7964 00002000:00100000:3.0:1746155639.950562:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a62a2300 x1830976125906688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.950570:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a2300 with x1830976125906688 ext(2097152->3145727) 00002000:00010000:3.0:1746155639.950574:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a2300 00000100:00100000:0.0:1746155639.953136:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.953720:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125906816 00000100:00100000:2.0:1746155639.953727:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125906816 00000100:00100000:0.0:1746155639.953748:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.953772:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125906944 00000100:00100000:2.0:1746155639.953774:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125906944 00000100:00100000:2.0:1746155639.953789:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16827 00000100:00100000:2.0:1746155639.953795:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32240:x1830976125906816:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155639.953809:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16828 00010000:00010000:2.0:1746155639.953809:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155639.953818:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:32239:x1830976125906944:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.953823:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x844e5faceb5f74ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d39 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.953826:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155639.953835:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f7506 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d40 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.953842:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 33 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.953848:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.953848:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155639.953849:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155639.953850:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.953851:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x844e5faceb5f74ff lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d39 expref: 10 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.953855:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f7506 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d40 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.953866:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f7506 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d40 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.953869:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 33 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.953874:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df5ee00, rc 0) 00010000:00010000:2.0:1746155639.953876:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 33 pid: 20796 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155639.953883:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125339392:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155639.953916:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32239:x1830976125906944:12345-192.168.202.51@tcp:101:cat.0 Request processed in 99us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.953921:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16828 00000100:00100000:2.0:1746155639.953941:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155639.955464:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125339392:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155639.955483:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x844e5faceb5f74ff lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d39 expref: 10 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.955494:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1c400, rc 0) 00000100:00100000:2.0:1746155639.955553:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32240:x1830976125906816:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1758us (2424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.955559:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16827 00000100:00100000:0.0:1746155639.955981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.956057:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125907072 00000100:00100000:3.0:1746155639.956062:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125907072 00002000:00100000:3.0:1746155639.956091:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3465215) req@ffff88009f582d80 x1830976125907072/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.956100:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f582d80 with x1830976125907072 ext(3145728->3465215) 00010000:00010000:3.0:1746155639.956106:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 34 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155639.956117:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 34 pid: 20796 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746155639.956123:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f582d80 00000100:00100000:3.0:1746155639.956147:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1376 00000100:00100000:3.0:1746155639.956153:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976125907072:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155639.957043:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.957118:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125907328 00000100:00100000:2.0:1746155639.957122:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125907328 00002000:00100000:2.0:1746155639.957139:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f583480 x1830976125907328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.957152:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f583480 with x1830976125907328 ext(2097152->3145727) 00002000:00010000:2.0:1746155639.957156:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f583480 00000100:00100000:2.0:1746155639.957174:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7965 00000100:00100000:2.0:1746155639.957180:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976125907328:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155639.959817:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976125907072:12345-192.168.202.51@tcp:4:cat.0 Request processed in 3656us (3829us total) trans 17179874235 rc 0/0 00000100:00100000:3.0:1746155639.959827:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1376 00002000:00100000:3.0:1746155639.959836:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3465215) req@ffff88009f582d80 x1830976125907072/t17179874235(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/448 e 0 to 0 dl 1746155650 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.959845:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f582d80 with x1830976125907072 ext(3145728->3465215) 00010000:00010000:3.0:1746155639.959853:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 36 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155639.959866:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 36 pid: 20796 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746155639.959873:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f582d80 00000100:00100000:0.0:1746155639.965899:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.966134:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125907456 00000100:00100000:3.0:1746155639.966141:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125907456 00010000:00010000:3.0:1746155639.966170:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 36 pid: 20796 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155639.966196:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8611 00000100:00100000:3.0:1746155639.966202:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976125907456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155639.966213:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155639.966230:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 36 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155639.966240:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 36 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155639.966258:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f74e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3465215) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d1d expref: 36 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155639.966280:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.966282:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155639.966288:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x844e5faceb5f74ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d39 expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.966295:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x844e5faceb5f74ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d39 expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155639.966323:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x844e5faceb5f74ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d39 expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155639.966334:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125339520:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155639.966767:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976125907328:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9584us (9722us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.966774:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7965 00000100:00100000:3.0:1746155639.966781:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00002000:00100000:2.0:1746155639.966782:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f583480 x1830976125907328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.966791:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f583480 with x1830976125907328 ext(2097152->3145727) 00002000:00010000:2.0:1746155639.966917:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f583480 00000100:00100000:3.0:1746155639.968741:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125339520:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155639.968756:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155639.968784:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976125907456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2582us (2945us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155639.968791:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8611 00000100:00100000:0.0:1746155639.972559:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.972604:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125907712 00000100:00100000:2.0:1746155639.972612:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125907712 00000100:00100000:2.0:1746155639.973425:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16829 00000100:00100000:2.0:1746155639.973432:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:32239:x1830976125907712:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155639.973446:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155639.973459:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5f750d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d47 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.973536:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.973538:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155639.973544:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5f750d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d47 expref: 36 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.973556:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5f750d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d47 expref: 36 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155639.973565:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d400, rc 0) 00000100:00100000:2.0:1746155639.974069:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:32239:x1830976125907712:12345-192.168.202.51@tcp:101:cat.0 Request processed in 636us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155639.974075:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16829 00000100:00100000:3.0:1746155639.974398:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155639.974484:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.974596:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125907840 00000100:00100000:2.0:1746155639.974601:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125907840 00002000:00100000:2.0:1746155639.974649:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a6060000 x1830976125907840/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.974657:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060000 with x1830976125907840 ext(3145728->4194303) 00002000:00010000:2.0:1746155639.974661:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6060000 00000100:00100000:2.0:1746155639.974672:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125908096 00000100:00100000:2.0:1746155639.974675:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125908096 00002000:00100000:2.0:1746155639.974686:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a6060380 x1830976125908096/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.974692:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060380 with x1830976125908096 ext(3145728->4194303) 00002000:00010000:2.0:1746155639.974695:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6060380 00000100:00100000:0.0:1746155639.974700:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7966 00000100:00100000:0.0:1746155639.974709:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125907840:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155639.974712:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7967 00000100:00100000:2.0:1746155639.974717:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125908096:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155639.984745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155639.984788:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.984966:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125908352 00000100:00100000:1.0:1746155639.984974:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125908352 00002000:00100000:1.0:1746155639.985008:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012c2bd180 x1830976125908352/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.985018:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bd180 with x1830976125908352 ext(3145728->4194303) 00002000:00010000:1.0:1746155639.985022:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c2bd180 00000100:00100000:1.0:1746155639.985035:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125908608 00000100:00100000:1.0:1746155639.985037:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125908608 00002000:00100000:1.0:1746155639.985046:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88012c2bfb80 x1830976125908608/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.985053:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bfb80 with x1830976125908608 ext(3145728->4194303) 00002000:00010000:1.0:1746155639.985056:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c2bfb80 00000100:00100000:2.0:1746155639.985058:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7968 00000100:00100000:2.0:1746155639.985067:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976125908352:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155639.985159:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125907840:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10450us (10760us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155639.985409:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125908096:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10690us (10924us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155639.985445:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7966 00002000:00100000:0.0:1746155639.985451:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a6060000 x1830976125907840/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155639.985454:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7969 00000100:00100000:1.0:1746155639.985461:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976125908608:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:0.0:1746155639.985461:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060000 with x1830976125907840 ext(3145728->4194303) 00002000:00010000:0.0:1746155639.985468:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6060000 00000100:00100000:3.0:1746155639.986217:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7967 00002000:00100000:3.0:1746155639.986225:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a6060380 x1830976125908096/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155639.986232:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060380 with x1830976125908096 ext(3145728->4194303) 00002000:00010000:3.0:1746155639.986236:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6060380 00000100:00100000:1.0:1746155639.991136:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976125908608:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5665us (6336us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155639.991146:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7969 00002000:00100000:1.0:1746155639.991161:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88012c2bfb80 x1830976125908608/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155639.991169:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bfb80 with x1830976125908608 ext(3145728->4194303) 00002000:00010000:1.0:1746155639.991174:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c2bfb80 00000100:00100000:2.0:1746155639.993133:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976125908352:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8061us (8391us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155639.993143:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7968 00002000:00100000:2.0:1746155639.993152:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012c2bd180 x1830976125908352/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.993160:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bd180 with x1830976125908352 ext(3145728->4194303) 00002000:00010000:2.0:1746155639.993165:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c2bd180 00000100:00100000:0.0:1746155639.994130:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155639.994277:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125908864 00000100:00100000:2.0:1746155639.994284:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125908864 00002000:00100000:2.0:1746155639.994314:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012c2bf100 x1830976125908864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155639.994321:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bf100 with x1830976125908864 ext(4194304->5083135) 00002000:00010000:2.0:1746155639.994325:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c2bf100 00000100:00100000:2.0:1746155639.994353:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7970 00000100:00100000:2.0:1746155639.994360:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125908864:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155639.999421:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155639.999977:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125909120 00000100:00100000:1.0:1746155639.999984:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125909120 00002000:00100000:1.0:1746155640.000019:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012c2bea00 x1830976125909120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/0 e 0 to 0 dl 1746155650 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.000029:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bea00 with x1830976125909120 ext(4194304->5083135) 00002000:00010000:1.0:1746155640.000034:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c2bea00 00000100:00100000:1.0:1746155640.000056:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7971 00000100:00100000:1.0:1746155640.000063:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976125909120:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155640.000631:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976125908864:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6270us (6503us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155640.000638:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7970 00002000:00100000:3.0:1746155640.000644:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012c2bf100 x1830976125908864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.000650:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bf100 with x1830976125908864 ext(4194304->5083135) 00002000:00010000:3.0:1746155640.000654:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c2bf100 00000100:00100000:0.0:1746155640.006150:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.006223:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125909376 00000100:00100000:2.0:1746155640.006237:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125909376 00000100:00080000:0.0:1746155640.006351:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746155640.006412:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4698 00000100:00100000:2.0:1746155640.006421:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094618c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32240:x1830976125909376:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155640.006754:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094618c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32240:x1830976125909376:12345-192.168.202.51@tcp:35:cat.0 Request processed in 333us (611us total) trans 8589945236 rc 0/0 00000100:00100000:2.0:1746155640.006760:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4698 00000100:00100000:1.0:1746155640.007730:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976125909120:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7666us (8316us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155640.007738:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7971 00002000:00100000:1.0:1746155640.007745:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012c2bea00 x1830976125909120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:710/0 lens 488/440 e 0 to 0 dl 1746155650 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.007754:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bea00 with x1830976125909120 ext(4194304->5083135) 00002000:00010000:1.0:1746155640.007759:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c2bea00 00000100:00100000:0.0:1746155640.056625:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.056680:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125909632 00000100:00100000:3.0:1746155640.056688:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125909632 00000100:00100000:3.0:1746155640.056761:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11086 00000100:00100000:3.0:1746155640.056769:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32246:x1830976125909632:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155640.056789:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.056805:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5e000/0x844e5faceb5f7514 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d4e expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.056907:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f751b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.056918:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f751b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.056946:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f751b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.056959:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7522 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.056965:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.056970:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057068:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f7529 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057076:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f7529 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057081:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f7529 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155640.057089:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155640.057167:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f751b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057173:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f751b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057178:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f751b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057183:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012df5fe00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155640.057186:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f751b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057192:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f751b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057201:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155640.057204:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155640.057207:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f751b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057211:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5fe00/0x844e5faceb5f751b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057224:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7522 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057229:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7522 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057233:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7522 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057237:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012df5f000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155640.057239:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7522 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057243:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7522 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057248:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fab9a00) 00010000:00010000:3.0:1746155640.057250:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155640.057252:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7522 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057256:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7522 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.057290:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5e000/0x844e5faceb5f7514 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d4e expref: 291 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.057300:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f7529 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d4e expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.057306:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155640.057307:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155640.057309:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df5ec00, rc 0) 00000100:00100000:3.0:1746155640.057348:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32246:x1830976125909632:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 580us (729us total) trans 8589945237 rc 0/0 00000100:00100000:3.0:1746155640.057354:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11086 00000100:00080000:0.0:1746155640.057522:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155640.097846:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.097954:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125909888 00000100:00100000:2.0:1746155640.097962:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125909888 00000100:00100000:2.0:1746155640.098160:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11087 00000100:00100000:2.0:1746155640.098168:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32248:x1830976125909888:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155640.098188:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155640.098202:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f7537 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d55 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.098280:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f753e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098287:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f753e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098294:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f753e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098302:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f7545 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098305:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f7545 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098308:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f7545 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098372:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f754c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098377:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f754c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098380:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f754c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155640.098386:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155640.098438:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f753e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098442:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f753e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098448:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f753e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098451:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b1d800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155640.098453:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f753e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098457:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f753e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098464:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155640.098465:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155640.098467:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f753e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098470:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d800/0x844e5faceb5f753e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098487:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f7545 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098492:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f7545 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098496:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f7545 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098499:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136b1ce00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155640.098521:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f7545 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098525:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f7545 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098535:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8801366f8f00) 00010000:00010000:2.0:1746155640.098536:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155640.098538:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f7545 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098542:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1ce00/0x844e5faceb5f7545 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.098570:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1c600/0x844e5faceb5f7537 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d55 expref: 13 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.098581:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f754c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d55 expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.098586:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155640.098588:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155640.098590:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d200, rc 0) 00000100:00100000:2.0:1746155640.098639:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32248:x1830976125909888:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 471us (800us total) trans 8589945238 rc 0/0 00000100:00100000:2.0:1746155640.098645:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11087 00000100:00100000:0.0:1746155640.101592:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.101746:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125910016 00000100:00100000:2.0:1746155640.101753:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125910016 00000100:00100000:2.0:1746155640.101795:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16830 00000100:00100000:2.0:1746155640.101803:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32248:x1830976125910016:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155640.101816:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155640.101830:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d5c expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.101858:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f737e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c6e expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.101866:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880133832800/0x844e5faceb5f74ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ce5 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.101872:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f7473 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc2 expref: 35 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.101878:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.101880:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.101883:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [978944->1048575] (req 978944->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 11 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.101907:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f7473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc2 expref: 35 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.101918:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f7473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc2 expref: 35 pid: 10591 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155640.101929:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125339648:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155640.102022:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880133832800/0x844e5faceb5f74ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ce5 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.102031:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880133832800/0x844e5faceb5f74ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ce5 expref: 11 pid: 9235 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746155640.102044:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125339776:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155640.102068:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f737e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c6e expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.102075:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f737e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c6e expref: 12 pid: 18270 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746155640.102082:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125339904:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155640.102097:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd540 going to sleep for 11 seconds 00000100:00080000:1.0:1746155640.102260:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155640.103345:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125339648:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155640.103356:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125339776:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155640.103362:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125339904:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155640.103383:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [978944->1048575] (req 978944->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 11 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.103395:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b1d600, rc 0) 00000100:00100000:2.0:1746155640.103433:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32248:x1830976125910016:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1630us (1847us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.103439:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16830 00000100:00100000:0.0:1746155640.105846:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.105866:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.106837:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125910144 00000100:00100000:3.0:1746155640.106845:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125910144 00000100:00100000:0.0:1746155640.106863:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155640.106871:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880133832800/0x844e5faceb5f74ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ce5 expref: 11 pid: 9235 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746155640.106886:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125910400 00000100:00100000:0.0:1746155640.106889:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125910400 00000100:00100000:3.0:1746155640.106891:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125910272 00000100:00100000:3.0:1746155640.106893:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125910272 00010000:00010000:3.0:1746155640.106902:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f737e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c6e expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746155640.107139:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f7473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc2 expref: 36 pid: 10591 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.107184:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8612 00000100:00100000:3.0:1746155640.107192:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125910144:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155640.107204:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155640.107211:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8613 00000100:00100000:2.0:1746155640.107218:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125910272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155640.107224:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880133832800/0x844e5faceb5f74ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ce5 expref: 11 pid: 9235 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746155640.107230:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155640.107234:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880133832800/0x844e5faceb5f74ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ce5 expref: 11 pid: 9235 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746155640.107256:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f737e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c6e expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746155640.107326:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880133832800/0x844e5faceb5f74ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ce5 expref: 11 pid: 9235 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746155640.107328:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f737e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c6e expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746155640.107341:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f17b600/0x844e5faceb5f737e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c6e expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746155640.107355:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155640.107356:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155640.107396:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8614 00000100:00100000:0.0:1746155640.107402:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976125910400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155640.107409:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155640.107417:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f7473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc2 expref: 36 pid: 10591 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.107429:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125910144:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 238us (1587us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155640.107431:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f7473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc2 expref: 36 pid: 10591 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.107436:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8612 00000100:00080000:1.0:1746155640.107563:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746155640.107891:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131447e00/0x844e5faceb5f7473 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc2 expref: 36 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746155640.107910:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155640.107911:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155640.107917:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155640.107928:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155640.107963:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125910272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 744us (1099us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155640.107965:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155640.107969:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8613 00000100:00100000:0.0:1746155640.107976:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125340032:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155640.108031:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155640.112447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.112547:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125340032:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155640.112565:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155640.113053:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976125910400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5649us (7183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.113061:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8614 00000100:00100000:3.0:1746155640.113144:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125910528 00000100:00100000:3.0:1746155640.113149:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125910528 00000100:00100000:3.0:1746155640.113186:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16831 00000100:00100000:3.0:1746155640.113192:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32248:x1830976125910528:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155640.113205:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.113217:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d63 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.113237:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f17b200/0x844e5faceb5f7393 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c75 expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.113244:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f74dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d16 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.113249:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f847800/0x844e5faceb5f74b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cec expref: 23 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.113255:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.113256:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.113259:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [1048576->1081343] (req 1048576->1081343) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.113278:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f847800/0x844e5faceb5f74b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cec expref: 23 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.113286:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f847800/0x844e5faceb5f74b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cec expref: 23 pid: 20796 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155640.113295:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125340160:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.113339:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f74dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d16 expref: 18 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.113345:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f74dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d16 expref: 18 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.113351:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125340288:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.113368:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f17b200/0x844e5faceb5f7393 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c75 expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.113375:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f17b200/0x844e5faceb5f7393 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c75 expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155640.113386:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125340416:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.113400:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00080000:1.0:1746155640.113400:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746155640.116565:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125340160:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.116576:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125340288:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155640.120585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.120859:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.120911:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.120945:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125910656 00000100:00100000:1.0:1746155640.120951:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125910656 00010000:00010000:1.0:1746155640.120997:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f74dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d16 expref: 19 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.121017:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125910784 00000100:00100000:1.0:1746155640.121019:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125910784 00010000:00010000:1.0:1746155640.121027:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f847800/0x844e5faceb5f74b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cec expref: 24 pid: 20796 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746155640.121037:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125910912 00000100:00100000:1.0:1746155640.121039:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125910912 00010000:00010000:1.0:1746155640.121048:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f17b200/0x844e5faceb5f7393 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c75 expref: 14 pid: 18270 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746155640.121062:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8615 00000100:00100000:1.0:1746155640.121069:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d758450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976125910656:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.121078:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.121097:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f74dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d16 expref: 19 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.121105:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f74dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d16 expref: 19 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.121123:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df5fa00/0x844e5faceb5f74dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d16 expref: 19 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.121138:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.121171:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d758450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976125910656:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 103us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.121176:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8615 00000100:00100000:1.0:1746155640.121214:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8616 00000100:00100000:1.0:1746155640.121218:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1962:x1830976125910784:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.121224:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.121231:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f847800/0x844e5faceb5f74b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cec expref: 24 pid: 20796 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.121242:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f847800/0x844e5faceb5f74b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cec expref: 24 pid: 20796 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.121252:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f847800/0x844e5faceb5f74b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cec expref: 24 pid: 20796 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.121260:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.121273:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1962:x1830976125910784:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.121277:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8616 00000100:00100000:1.0:1746155640.121285:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8617 00000100:00100000:1.0:1746155640.121291:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125910912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.121298:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.121306:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f17b200/0x844e5faceb5f7393 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c75 expref: 14 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.121316:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f17b200/0x844e5faceb5f7393 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c75 expref: 14 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.121328:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.121330:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.121336:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.121344:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.121377:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.121390:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125340544:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155640.121448:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd000 going to sleep for 11 seconds 00010000:00010000:1.0:1746155640.121491:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f17b200/0x844e5faceb5f7393 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c75 expref: 14 pid: 18270 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746155640.121532:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125340416:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155640.121563:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 22 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.121572:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012df5f000, rc 0) 00000100:00100000:1.0:1746155640.121597:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32248:x1830976125910528:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8405us (9158us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.121603:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16831 00000100:00080000:0.0:1746155640.122048:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155640.125187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.125309:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125340544:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155640.125328:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.125371:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125910912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4078us (4457us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.125380:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8617 00000100:00100000:2.0:1746155640.125960:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125911168 00000100:00100000:2.0:1746155640.125969:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125911168 00002000:00100000:2.0:1746155640.126008:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1077248->1081343) req@ffff88009fff7800 x1830976125911168/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.126017:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7800 with x1830976125911168 ext(1077248->1081343) 00002000:00010000:2.0:1746155640.126022:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fff7800 00000100:00100000:2.0:1746155640.126052:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7972 00000100:00100000:2.0:1746155640.126060:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1963:x1830976125911168:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155640.126235:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1963:x1830976125911168:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 174us (1055us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155640.126241:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7972 00002000:00100000:2.0:1746155640.126247:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1077248->1081343) req@ffff88009fff7800 x1830976125911168/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/4536 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.126254:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7800 with x1830976125911168 ext(1077248->1081343) 00002000:00010000:2.0:1746155640.126257:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fff7800 00000100:00100000:0.0:1746155640.129011:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.129232:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125911424 00000100:00100000:2.0:1746155640.129240:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125911424 00000100:00100000:2.0:1746155640.129864:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11088 00000100:00100000:2.0:1746155640.129871:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32252:x1830976125911424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155640.129888:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155640.129900:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7568 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d6a expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.129981:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f756f lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.129993:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f756f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155640.130001:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f756f lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155640.130010:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155640.130095:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7568 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d6a expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.130116:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f756f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d6a expref: 14 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.130122:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155640.130124:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746155640.130126:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a36e00, rc 0) 00000100:00100000:2.0:1746155640.130173:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32252:x1830976125911424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 303us (1169us total) trans 8589945239 rc 0/0 00000100:00100000:2.0:1746155640.130179:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11088 00000100:00100000:0.0:1746155640.130390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.130564:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125911680 00000100:00100000:1.0:1746155640.130568:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125911680 00000100:00100000:1.0:1746155640.130590:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4699 00000100:00100000:1.0:1746155640.130597:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32248:x1830976125911680:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155640.131127:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32248:x1830976125911680:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 530us (737us total) trans 8589945240 rc 0/0 00000100:00100000:1.0:1746155640.131134:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4699 00000100:00100000:0.0:1746155640.133354:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.133392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.133564:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125911808 00000100:00100000:1.0:1746155640.133570:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125911808 00000100:00100000:3.0:1746155640.133606:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125911936 00000100:00100000:3.0:1746155640.133610:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125911936 00000100:00100000:3.0:1746155640.133644:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16832 00000100:00100000:3.0:1746155640.133650:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976125911936:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155640.133884:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.133899:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e28c00/0x844e5faceb5f757d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d78 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.133928:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16833 00000100:00100000:1.0:1746155640.133942:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976125911808:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155640.133948:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155640.133951:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125340672:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155640.133956:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093602800/0x844e5faceb5f7584 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d71 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.133976:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125340800:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155640.134921:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.134972:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155640.136923:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125340800:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155640.136964:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093602800/0x844e5faceb5f7584 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d71 expref: 36 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155640.136975:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093602800/0x844e5faceb5f7584 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d71 expref: 36 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155640.136983:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093602800, rc 0) 00000100:00100000:1.0:1746155640.137027:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976125911808:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3085us (3677us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155640.137034:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16833 00000100:00100000:3.0:1746155640.137082:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125340672:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155640.137099:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e28c00/0x844e5faceb5f757d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d78 expref: 19 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.137107:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e28c00/0x844e5faceb5f757d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d78 expref: 19 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.137117:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e28c00, rc 0) 00000100:00100000:3.0:1746155640.137133:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976125911936:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3483us (3740us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155640.137138:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16832 00000100:00100000:0.0:1746155640.139198:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.139236:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.139278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.139340:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125912064 00000100:00100000:2.0:1746155640.139340:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125912320 00000100:00100000:3.0:1746155640.139346:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125912064 00000100:00100000:2.0:1746155640.139346:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125912320 00002000:00100000:2.0:1746155640.139375:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (0->978943) req@ffff88012bdf5f80 x1830976125912320/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.139388:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5f80 with x1830976125912320 ext(0->978943) 00002000:00010000:2.0:1746155640.139392:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf5f80 00000100:00100000:2.0:1746155640.139403:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125912576 00000100:00100000:2.0:1746155640.139406:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125912576 00000100:00100000:3.0:1746155640.139413:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16834 00002000:00100000:2.0:1746155640.139417:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1081344->2097151) req@ffff88012bdf6300 x1830976125912576/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155640.139420:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:32254:x1830976125912064:12345-192.168.202.51@tcp:101:cat.0 00002000:00100000:2.0:1746155640.139424:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf6300 with x1830976125912576 ext(1081344->2097151) 00002000:00010000:2.0:1746155640.139426:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf6300 00010000:00010000:3.0:1746155640.139430:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155640.139434:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7973 00000100:00100000:2.0:1746155640.139439:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976125912320:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:3.0:1746155640.139443:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c286600/0x844e5faceb5f758b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d7f expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.139460:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 10 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.139466:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155640.139467:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155640.139470:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c286600/0x844e5faceb5f758b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d7f expref: 36 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.139491:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 10 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.139521:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 10 pid: 20796 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.139532:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125340928:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.139578:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.139592:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7974 00000100:00100000:3.0:1746155640.139597:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125912576:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155640.144703:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.144910:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125340928:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.144944:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c286600/0x844e5faceb5f758b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d7f expref: 36 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.144960:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c286600, rc 0) 00000100:00100000:3.0:1746155640.144994:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:32254:x1830976125912064:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5574us (5801us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.145001:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16834 00000100:00100000:2.0:1746155640.145451:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125912704 00000100:00100000:2.0:1746155640.145457:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125912704 00002000:00100000:2.0:1746155640.145483:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (978944->1048575) req@ffff88012bdf5180 x1830976125912704/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.145492:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5180 with x1830976125912704 ext(978944->1048575) 00010000:00010000:2.0:1746155640.145498:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.145612:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.145619:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bdf5180 00000100:00100000:3.0:1746155640.149757:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125912576:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10150us (10469us total) trans 0 rc 1015808/1015808 00000100:00100000:3.0:1746155640.149767:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7974 00002000:00100000:3.0:1746155640.149775:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1081344->2097151) req@ffff88012bdf6300 x1830976125912576/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.149783:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf6300 with x1830976125912576 ext(1081344->2097151) 00002000:00010000:3.0:1746155640.149788:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf6300 00000100:00100000:3.0:1746155640.149807:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1377 00000100:00100000:3.0:1746155640.149816:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125912704:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155640.149921:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125912320:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10480us (10683us total) trans 0 rc 978944/978944 00000100:00100000:2.0:1746155640.149928:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7973 00002000:00100000:2.0:1746155640.149944:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (0->978943) req@ffff88012bdf5f80 x1830976125912320/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 978944/978944 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.149950:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5f80 with x1830976125912320 ext(0->978943) 00010000:00010000:2.0:1746155640.149956:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.149968:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.149974:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bdf5f80 00000100:00100000:3.0:1746155640.153717:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125912704:12345-192.168.202.51@tcp:4:cat.0 Request processed in 3896us (9014us total) trans 17179874236 rc 0/0 00000100:00100000:3.0:1746155640.153727:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1377 00002000:00100000:3.0:1746155640.153736:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (978944->1048575) req@ffff88012bdf5180 x1830976125912704/t17179874236(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/448 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.153751:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5180 with x1830976125912704 ext(978944->1048575) 00010000:00010000:3.0:1746155640.153760:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.153774:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746155640.153781:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bdf5180 00000100:00100000:0.0:1746155640.165056:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.165408:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125912832 00000100:00100000:1.0:1746155640.165415:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125912832 00010000:00010000:1.0:1746155640.165442:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.165477:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8618 00000100:00100000:1.0:1746155640.165484:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1963:x1830976125912832:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.165495:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.165535:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.165546:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.165564:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d600/0x844e5faceb5f755a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d5c expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.165591:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.165593:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.165600:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c286600/0x844e5faceb5f758b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d7f expref: 35 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.165607:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c286600/0x844e5faceb5f758b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d7f expref: 35 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.165632:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c286600/0x844e5faceb5f758b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d7f expref: 35 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.165648:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125341056:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155640.165716:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155640.169068:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.169078:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125341056:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155640.169099:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155640.169128:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125913088 00000100:00100000:3.0:1746155640.169133:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125913088 00000100:00100000:1.0:1746155640.169146:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1963:x1830976125912832:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3662us (4098us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.169154:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8618 00002000:00100000:3.0:1746155640.169170:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012bdf4000 x1830976125913088/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.169179:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4000 with x1830976125913088 ext(2097152->3145727) 00002000:00010000:3.0:1746155640.169183:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf4000 00000100:00100000:3.0:1746155640.169210:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7975 00000100:00100000:3.0:1746155640.169216:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125913088:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155640.176500:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.176651:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125913344 00000100:00100000:2.0:1746155640.176658:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125913344 00002000:00100000:2.0:1746155640.176688:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88012bdf7100 x1830976125913344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.176695:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7100 with x1830976125913344 ext(0->1048575) 00002000:00010000:2.0:1746155640.176699:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf7100 00000100:00100000:2.0:1746155640.176729:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7976 00000100:00100000:2.0:1746155640.176736:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976125913344:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155640.179625:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125913088:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10402us (10556us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155640.179635:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7975 00002000:00100000:3.0:1746155640.179644:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012bdf4000 x1830976125913088/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.179653:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4000 with x1830976125913088 ext(2097152->3145727) 00002000:00010000:3.0:1746155640.179657:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf4000 00000100:00100000:2.0:1746155640.184838:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976125913344:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8095us (8338us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.184848:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7976 00002000:00100000:2.0:1746155640.184858:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88012bdf7100 x1830976125913344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.184868:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7100 with x1830976125913344 ext(0->1048575) 00002000:00010000:2.0:1746155640.184874:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf7100 00000100:00100000:0.0:1746155640.188988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.189050:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125913472 00000100:00100000:3.0:1746155640.189058:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125913472 00000100:00100000:3.0:1746155640.189107:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16835 00000100:00100000:3.0:1746155640.189114:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125913472:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155640.189129:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.189247:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129e28c00/0x844e5faceb5f7592 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d86 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.189268:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.189270:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.189277:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129e28c00/0x844e5faceb5f7592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d86 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.189290:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129e28c00/0x844e5faceb5f7592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d86 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.189299:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e28c00, rc 0) 00000100:00100000:3.0:1746155640.189431:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125913472:12345-192.168.202.51@tcp:101:cat.0 Request processed in 315us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.189437:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16835 00000100:00100000:0.0:1746155640.190997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.191056:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125913600 00000100:00100000:3.0:1746155640.191060:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125913600 00000100:00100000:3.0:1746155640.191305:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16836 00000100:00100000:3.0:1746155640.191313:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:32254:x1830976125913600:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155640.191324:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.191336:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e28400/0x844e5faceb5f7599 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d8d expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.191357:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.191364:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155640.191366:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155640.191369:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e28400/0x844e5faceb5f7599 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d8d expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.191395:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.191406:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 21 pid: 20796 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.191415:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125341184:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.191489:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155640.194108:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.194184:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125913728 00000100:00100000:2.0:1746155640.194190:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125913728 00002000:00100000:2.0:1746155640.194221:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1081343) req@ffff88012bdf7480 x1830976125913728/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.194229:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7480 with x1830976125913728 ext(1048576->1081343) 00010000:00010000:2.0:1746155640.194236:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 22 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.194246:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 22 pid: 20796 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.194263:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bdf7480 00000100:00100000:2.0:1746155640.194279:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1378 00000100:00100000:2.0:1746155640.194286:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976125913728:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155640.194923:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125341184:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.194952:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e28400/0x844e5faceb5f7599 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d8d expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.194965:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e28400, rc 0) 00000100:00100000:3.0:1746155640.195170:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32254:x1830976125913600:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3856us (4173us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.195176:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16836 00000100:00100000:0.0:1746155640.195680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.196231:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976125913728:12345-192.168.202.51@tcp:4:cat.0 Request processed in 1945us (2125us total) trans 21474841558 rc 0/0 00000100:00100000:2.0:1746155640.196239:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1378 00002000:00100000:2.0:1746155640.196245:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1081343) req@ffff88012bdf7480 x1830976125913728/t21474841558(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/448 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.196252:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7480 with x1830976125913728 ext(1048576->1081343) 00010000:00010000:2.0:1746155640.196259:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 24 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.196268:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 24 pid: 20796 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.196274:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012bdf7480 00000100:00100000:3.0:1746155640.196547:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125913856 00000100:00100000:3.0:1746155640.196551:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125913856 00000100:00100000:3.0:1746155640.196572:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16837 00000100:00100000:3.0:1746155640.196577:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32246:x1830976125913856:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155640.196586:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.196596:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d94 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.196611:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f17aa00/0x844e5faceb5f7385 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c7c expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.196618:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f74ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d24 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.196624:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133833800/0x844e5faceb5f74b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cf3 expref: 23 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.196630:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.196631:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.196634:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1986560->2097151] (req 1986560->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.196656:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133833800/0x844e5faceb5f74b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cf3 expref: 23 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.196664:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133833800/0x844e5faceb5f74b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cf3 expref: 23 pid: 9235 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155640.196674:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125341312:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.196723:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f74ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d24 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.196736:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f74ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d24 expref: 20 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.196743:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125341440:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.196765:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f17aa00/0x844e5faceb5f7385 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c7c expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.196772:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f17aa00/0x844e5faceb5f7385 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c7c expref: 12 pid: 18270 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155640.196779:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125341568:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.196794:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.201388:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125341312:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.201398:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125341440:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.201404:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125341568:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.201428:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1986560->2097151] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.201442:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129e28e00, rc 0) 00000100:00100000:3.0:1746155640.202032:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:32246:x1830976125913856:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5452us (6351us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.202040:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16837 00000100:00100000:0.0:1746155640.202176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.202426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.202451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.202465:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125913984 00000100:00100000:0.0:1746155640.202471:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125913984 00010000:00010000:0.0:1746155640.202492:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133833800/0x844e5faceb5f74b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cf3 expref: 24 pid: 9235 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746155640.202526:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125914240 00000100:00100000:0.0:1746155640.202529:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125914240 00010000:00010000:0.0:1746155640.202538:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f17aa00/0x844e5faceb5f7385 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c7c expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746155640.202549:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125914112 00000100:00100000:0.0:1746155640.202551:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125914112 00010000:00010000:0.0:1746155640.202558:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f74ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d24 expref: 20 pid: 8437 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746155640.202576:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8619 00000100:00100000:1.0:1746155640.202578:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.202582:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1963:x1830976125913984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155640.202591:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155640.202592:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125914368 00000100:00100000:1.0:1746155640.202595:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125914368 00010000:00010000:1.0:1746155640.202608:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 25 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746155640.202609:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133833800/0x844e5faceb5f74b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cf3 expref: 25 pid: 9235 timeout: 869 lvb_type: 1 00010000:00010000:0.0:1746155640.202617:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133833800/0x844e5faceb5f74b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cf3 expref: 25 pid: 9235 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746155640.202622:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8620 00000100:00100000:1.0:1746155640.202627:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976125914240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155640.202633:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133833800/0x844e5faceb5f74b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cf3 expref: 25 pid: 9235 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.202634:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.202642:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f17aa00/0x844e5faceb5f7385 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c7c expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.202651:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f17aa00/0x844e5faceb5f7385 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c7c expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.202661:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f17aa00/0x844e5faceb5f7385 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c7c expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155640.202752:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8621 00000100:00100000:3.0:1746155640.202758:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976125914112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155640.202764:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155640.202819:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8622 00000100:00100000:2.0:1746155640.202826:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976125914368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155640.202831:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155640.202840:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 24 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.202848:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 24 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.202857:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df5f000/0x844e5faceb5f7561 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1081343) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d63 expref: 24 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.202871:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.202873:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.202878:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e28400/0x844e5faceb5f7599 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d8d expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.202885:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e28400/0x844e5faceb5f7599 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d8d expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.202916:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e28400/0x844e5faceb5f7599 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d8d expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155640.202918:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155640.202920:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155640.202926:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125341696:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155640.202948:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1963:x1830976125913984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 366us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.202949:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976125914240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 321us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155640.202953:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8619 00000100:00100000:1.0:1746155640.202957:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8620 00000100:00100000:2.0:1746155640.202969:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd840 going to sleep for 11 seconds 00010000:00010000:3.0:1746155640.203102:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f74ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d24 expref: 20 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.203111:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f74ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d24 expref: 20 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.203127:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df5fc00/0x844e5faceb5f74ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d24 expref: 20 pid: 8437 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.203137:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.203138:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.203142:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.203148:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.203163:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155640.203170:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125341824:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155640.203202:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155640.204677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.204678:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125341824:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155640.204693:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155640.204714:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976125914112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1957us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.204721:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8621 00000100:00100000:2.0:1746155640.204744:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125341696:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155640.204754:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155640.204771:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125914368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1945us (2193us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.204777:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8622 00000100:00100000:2.0:1746155640.204807:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125914624 00000100:00100000:2.0:1746155640.204811:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125914624 00002000:00100000:2.0:1746155640.204832:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1986560->1990655) req@ffff88012bdf5c00 x1830976125914624/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.204840:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5c00 with x1830976125914624 ext(1986560->1990655) 00002000:00010000:2.0:1746155640.204844:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf5c00 00000100:00100000:2.0:1746155640.204868:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7977 00000100:00100000:2.0:1746155640.204874:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976125914624:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155640.205225:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976125914624:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 349us (549us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155640.205231:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7977 00002000:00100000:2.0:1746155640.205236:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e1:0x0] (1986560->1990655) req@ffff88012bdf5c00 x1830976125914624/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/4536 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.205242:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5c00 with x1830976125914624 ext(1986560->1990655) 00002000:00010000:2.0:1746155640.205245:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf5c00 00000100:00100000:0.0:1746155640.207542:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.207580:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.207638:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125914880 00000100:00100000:1.0:1746155640.207643:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125914880 00002000:00100000:1.0:1746155640.207661:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88012bdf6680 x1830976125914880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.207668:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf6680 with x1830976125914880 ext(1048576->2097151) 00002000:00010000:1.0:1746155640.207672:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf6680 00000100:00100000:1.0:1746155640.207682:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125915008 00000100:00100000:1.0:1746155640.207684:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125915008 00002000:00100000:1.0:1746155640.207694:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1986559) req@ffff88012bdf4700 x1830976125915008/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.207700:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4700 with x1830976125915008 ext(1048576->1986559) 00002000:00010000:1.0:1746155640.207703:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf4700 00000100:00100000:1.0:1746155640.207717:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7978 00000100:00100000:1.0:1746155640.207722:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976125914880:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155640.207889:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7979 00000100:00100000:0.0:1746155640.207896:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976125915008:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155640.208806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.208884:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125915264 00000100:00100000:3.0:1746155640.208887:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125915264 00000100:00100000:3.0:1746155640.208909:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16838 00000100:00100000:3.0:1746155640.208914:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:32246:x1830976125915264:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155640.208923:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.208945:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17d9b expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.208965:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e000/0x844e5faceb5f739a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c83 expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.208973:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x844e5faceb5f74f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d32 expref: 37 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.208980:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c000/0x844e5faceb5f74c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cfa expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.208985:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.208987:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.208990:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1048576->1880063] (req 1048576->1880063) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 37 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.209012:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1c000/0x844e5faceb5f74c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cfa expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.209023:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c000/0x844e5faceb5f74c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cfa expref: 11 pid: 8436 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155640.209034:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125341952:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.209382:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x844e5faceb5f74f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d32 expref: 37 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.209390:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x844e5faceb5f74f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d32 expref: 37 pid: 20796 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.209398:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125342080:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.209423:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e000/0x844e5faceb5f739a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c83 expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.209429:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e000/0x844e5faceb5f739a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c83 expref: 11 pid: 20796 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155640.209436:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125342208:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.209449:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.214126:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125341952:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.215252:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125342080:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.215260:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125342208:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.215292:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1048576->1880063] (req 1048576->1880063) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 37 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.215306:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f62200, rc 0) 00000100:00100000:3.0:1746155640.215344:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:32246:x1830976125915264:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6429us (6538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.215351:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16838 00000100:00100000:2.0:1746155640.217059:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976125914880:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9332us (9516us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.217072:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7978 00002000:00100000:2.0:1746155640.217081:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88012bdf6680 x1830976125914880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.217089:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf6680 with x1830976125914880 ext(1048576->2097151) 00002000:00010000:2.0:1746155640.217094:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf6680 00000100:00100000:2.0:1746155640.217322:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.217371:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125915520 00000100:00100000:3.0:1746155640.217377:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125915520 00010000:00010000:3.0:1746155640.217400:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c000/0x844e5faceb5f74c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cfa expref: 12 pid: 8436 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155640.217421:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8623 00000100:00100000:3.0:1746155640.217427:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125915520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155640.217438:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155640.217455:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1c000/0x844e5faceb5f74c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cfa expref: 12 pid: 8436 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746155640.217464:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1c000/0x844e5faceb5f74c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cfa expref: 12 pid: 8436 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746155640.217481:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c000/0x844e5faceb5f74c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cfa expref: 12 pid: 8436 timeout: 869 lvb_type: 1 00000100:00100000:0.0:1746155640.218243:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.218261:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155640.218384:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.218387:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125915392 00000100:00100000:1.0:1746155640.218391:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125915392 00010000:00010000:1.0:1746155640.218403:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e000/0x844e5faceb5f739a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c83 expref: 12 pid: 20796 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155640.218406:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125915520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 979us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.218412:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8623 00000100:00100000:1.0:1746155640.218421:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125915648 00000100:00100000:3.0:1746155640.218423:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8624 00000100:00100000:1.0:1746155640.218423:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125915648 00000100:00100000:3.0:1746155640.218427:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976125915392:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.218430:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x844e5faceb5f74f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d32 expref: 37 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.218434:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155640.218441:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e000/0x844e5faceb5f739a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c83 expref: 12 pid: 20796 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746155640.218441:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8625 00000100:00100000:1.0:1746155640.218446:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976125915648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155640.218449:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e000/0x844e5faceb5f739a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c83 expref: 12 pid: 20796 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.218450:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.218455:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x844e5faceb5f74f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d32 expref: 37 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.218460:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd0e000/0x844e5faceb5f739a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17c83 expref: 12 pid: 20796 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.218462:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x844e5faceb5f74f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d32 expref: 37 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.218472:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1ca00/0x844e5faceb5f74f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d32 expref: 37 pid: 20796 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746155640.218488:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976125915008:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10592us (10906us total) trans 0 rc 937984/937984 00000100:00100000:0.0:1746155640.218495:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7979 00002000:00100000:0.0:1746155640.218515:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1986559) req@ffff88012bdf4700 x1830976125915008/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 937984/937984 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155640.218522:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4700 with x1830976125915008 ext(1048576->1986559) 00002000:00010000:0.0:1746155640.218526:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf4700 00010000:00010000:3.0:1746155640.218684:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.218686:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.218692:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 36 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.218699:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 36 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.218706:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.218722:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976125915648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 276us (461us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155640.218723:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 36 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.218728:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8625 00000100:00100000:3.0:1746155640.218732:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125342336:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155640.218777:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.221277:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125342336:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155640.221294:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155640.221323:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976125915392:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2895us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.221331:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8624 00000100:00100000:0.0:1746155640.222699:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.222787:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125915904 00000100:00100000:2.0:1746155640.222793:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125915904 00002000:00100000:2.0:1746155640.222826:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012bdf6d80 x1830976125915904/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.222835:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf6d80 with x1830976125915904 ext(1048576->2097151) 00002000:00010000:2.0:1746155640.222838:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf6d80 00000100:00100000:2.0:1746155640.222889:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7980 00000100:00100000:2.0:1746155640.222896:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976125915904:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155640.230006:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976125915904:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7103us (7303us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.230016:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7980 00002000:00100000:2.0:1746155640.230025:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012bdf6d80 x1830976125915904/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.230034:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf6d80 with x1830976125915904 ext(1048576->2097151) 00002000:00010000:2.0:1746155640.230038:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf6d80 00000100:00100000:1.0:1746155640.238086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.238472:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125916160 00000100:00100000:2.0:1746155640.238483:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125916160 00000100:00100000:2.0:1746155640.238555:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4700 00000100:00100000:2.0:1746155640.238563:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32246:x1830976125916160:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155640.239471:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32246:x1830976125916160:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 907us (1391us total) trans 8589945241 rc 0/0 00000100:00100000:2.0:1746155640.239478:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4700 00000100:00100000:0.0:1746155640.240046:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.240174:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125916416 00000100:00100000:3.0:1746155640.240179:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125916416 00002000:00100000:3.0:1746155640.240203:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a0d4ea00 x1830976125916416/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.240212:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4ea00 with x1830976125916416 ext(2097152->3145727) 00002000:00010000:3.0:1746155640.240217:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d4ea00 00000100:00100000:3.0:1746155640.240242:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7981 00000100:00100000:3.0:1746155640.240248:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976125916416:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155640.248340:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.248431:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125916672 00000100:00100000:2.0:1746155640.248438:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125916672 00000100:00100000:2.0:1746155640.248472:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11089 00000100:00100000:2.0:1746155640.248479:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32258:x1830976125916672:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155640.248499:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155640.248536:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f75ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17da2 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.248609:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.248621:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cd0 expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.248628:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f7529 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d4e expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.248634:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f754c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d55 expref: 16 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.248640:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.248663:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f754c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d55 expref: 16 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.248673:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f754c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d55 expref: 16 pid: 14234 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155640.248682:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125342464:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155640.248759:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f7529 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d4e expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.248766:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f7529 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d4e expref: 290 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155640.248772:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125342592:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155640.248794:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cd0 expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.248801:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cd0 expref: 16 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155640.248808:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125342720:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155640.248826:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.249315:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1962:x1830976125916416:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9066us (9269us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155640.249328:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7981 00002000:00100000:3.0:1746155640.249335:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a0d4ea00 x1830976125916416/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.249345:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4ea00 with x1830976125916416 ext(2097152->3145727) 00002000:00010000:3.0:1746155640.249350:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d4ea00 00000100:00100000:3.0:1746155640.250681:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125342464:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155640.251922:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.252056:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125342592:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155640.252109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.252167:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125916800 00000100:00100000:1.0:1746155640.252172:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125916800 00010000:00010000:1.0:1746155640.252197:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f754c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d55 expref: 17 pid: 14234 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.252215:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125916928 00000100:00100000:1.0:1746155640.252217:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125916928 00010000:00010000:1.0:1746155640.252225:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f7529 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d4e expref: 291 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746155640.252225:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.252236:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125917056 00000100:00100000:1.0:1746155640.252237:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125917056 00000100:00100000:0.0:1746155640.252244:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8626 00010000:00010000:1.0:1746155640.252245:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cd0 expref: 18 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:0.0:1746155640.252252:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976125916800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155640.252258:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8627 00010000:00010000:0.0:1746155640.252262:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155640.252263:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1961:x1830976125916928:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155640.252267:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f754c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d55 expref: 18 pid: 14234 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.252269:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.252273:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f7529 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d4e expref: 291 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:0.0:1746155640.252277:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f754c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d55 expref: 18 pid: 14234 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.252318:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125342720:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155640.252387:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8628 00000100:00100000:2.0:1746155640.252394:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976125917056:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155640.252405:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155640.252410:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cd0 expref: 18 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.252744:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f7529 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d4e expref: 291 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.252762:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012df5ec00/0x844e5faceb5f7529 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d4e expref: 291 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.252776:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155640.252780:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155640.252790:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155640.252794:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.252824:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1961:x1830976125916928:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 561us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.252830:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8627 00010000:00010000:0.0:1746155640.252981:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d200/0x844e5faceb5f754c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d55 expref: 18 pid: 14234 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.252987:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155640.252995:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155640.252999:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155640.253004:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155640.253009:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155640.253036:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cd0 expref: 17 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.253048:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f748f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cd0 expref: 17 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.253068:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155640.253071:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.253077:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.253082:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.253096:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155640.253114:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125917056:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 721us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.253123:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8628 00010000:00010000:3.0:1746155640.253226:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.253232:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155640.253248:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155640.253363:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f75ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da2 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.253377:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da2 expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.253383:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155640.253385:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155640.253388:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a37a00, rc 0) 00000100:00100000:2.0:1746155640.253855:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125916800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1604us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.253861:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8626 00000100:00100000:3.0:1746155640.253911:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32258:x1830976125916672:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5432us (5576us total) trans 8589945242 rc 0/0 00000100:00100000:3.0:1746155640.253916:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11089 00010000:00010000:3.0:1746155640.279229:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155640.290200:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.290406:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125917184 00000100:00100000:3.0:1746155640.290414:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125917184 00000100:00100000:3.0:1746155640.290842:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16839 00000100:00100000:3.0:1746155640.290921:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32258:x1830976125917184:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155640.290944:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.290959:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17da9 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.290983:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 18 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.290989:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155640.290991:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155640.290994:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1126400->1634303] (req 1126400->1634303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 23 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.291018:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 18 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.291028:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 18 pid: 18270 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.291038:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125342848:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.291858:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.298017:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125342848:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.298043:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1126400->1634303] (req 1126400->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 23 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.298055:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155640.298057:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbebc00, rc 0) 00000100:00100000:2.0:1746155640.298114:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125917312 00000100:00100000:2.0:1746155640.298119:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125917312 00002000:00100000:2.0:1746155640.298151:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1986560->2097151) req@ffff88009fb69500 x1830976125917312/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.298159:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69500 with x1830976125917312 ext(1986560->2097151) 00010000:00010000:2.0:1746155640.298166:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 19 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.298176:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 19 pid: 18270 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.298182:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb69500 00000100:00100000:2.0:1746155640.298199:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1379 00000100:00100000:2.0:1746155640.298205:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976125917312:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155640.298428:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:32258:x1830976125917184:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7509us (8235us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.298435:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16839 00000100:00100000:2.0:1746155640.302081:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976125917312:12345-192.168.202.51@tcp:4:cat.0 Request processed in 3868us (4020us total) trans 21474841559 rc 0/0 00000100:00100000:2.0:1746155640.302090:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1379 00002000:00100000:2.0:1746155640.302099:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1986560->2097151) req@ffff88009fb69500 x1830976125917312/t21474841559(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/448 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.302111:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69500 with x1830976125917312 ext(1986560->2097151) 00010000:00010000:2.0:1746155640.302120:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 21 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.302132:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 21 pid: 18270 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.302139:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb69500 00000100:00100000:0.0:1746155640.304561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.304652:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125917440 00000100:00100000:2.0:1746155640.304660:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125917440 00010000:00010000:2.0:1746155640.304693:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 21 pid: 18270 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155640.304719:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8629 00000100:00100000:2.0:1746155640.304726:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d759050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976125917440:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155640.304739:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155640.304757:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 21 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.304767:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 21 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.304793:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1986560->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d94 expref: 21 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.305008:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.305010:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.305016:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 22 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.305028:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 22 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.305054:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 22 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155640.305064:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125342976:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155640.305354:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155640.306659:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125342976:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155640.306673:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155640.306805:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d759050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976125917440:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2078us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.306813:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8629 00000100:00100000:0.0:1746155640.307149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.307403:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125917696 00000100:00100000:2.0:1746155640.307408:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125917696 00002000:00100000:2.0:1746155640.307434:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1126400->1130495) req@ffff8800a0d4ca80 x1830976125917696/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.307441:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4ca80 with x1830976125917696 ext(1126400->1130495) 00002000:00010000:2.0:1746155640.307445:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4ca80 00000100:00100000:2.0:1746155640.307469:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7982 00000100:00100000:2.0:1746155640.307475:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125917696:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155640.307724:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125917696:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 248us (575us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155640.307732:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7982 00002000:00100000:2.0:1746155640.307737:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1126400->1130495) req@ffff8800a0d4ca80 x1830976125917696/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/4536 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.307743:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4ca80 with x1830976125917696 ext(1126400->1130495) 00002000:00010000:2.0:1746155640.307745:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4ca80 00000100:00100000:0.0:1746155640.313035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.313171:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125917952 00000100:00100000:2.0:1746155640.313178:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125917952 00002000:00100000:2.0:1746155640.313208:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1630208->1634303) req@ffff8800a0d4d180 x1830976125917952/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.313217:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4d180 with x1830976125917952 ext(1630208->1634303) 00002000:00010000:2.0:1746155640.313222:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4d180 00000100:00100000:2.0:1746155640.313238:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7983 00000100:00100000:2.0:1746155640.313244:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1963:x1830976125917952:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155640.313381:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1963:x1830976125917952:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 136us (352us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155640.313387:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7983 00002000:00100000:2.0:1746155640.313393:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1630208->1634303) req@ffff8800a0d4d180 x1830976125917952/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/4536 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.313399:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4d180 with x1830976125917952 ext(1630208->1634303) 00002000:00010000:2.0:1746155640.313401:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4d180 00000100:00100000:0.0:1746155640.315736:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.316308:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125918208 00000100:00100000:3.0:1746155640.316315:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125918208 00000100:00100000:3.0:1746155640.316360:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11090 00000100:00100000:3.0:1746155640.316367:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32263:x1830976125918208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155640.316388:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.316404:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f75ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17db0 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.316491:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f75d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316669:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f75d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316680:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f75d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316693:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316698:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316703:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316805:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29a600/0x844e5faceb5f75df lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316813:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29a600/0x844e5faceb5f75df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316819:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29a600/0x844e5faceb5f75df lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155640.316833:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155640.316900:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f75d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316906:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f75d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316911:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f75d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316915:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fbeb800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155640.316918:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f75d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316923:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f75d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316944:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155640.316946:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155640.316949:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f75d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316953:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbeb800/0x844e5faceb5f75d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316977:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316982:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316987:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.316994:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129e28e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155640.316996:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.317000:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.317006:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fab9800) 00010000:00010000:3.0:1746155640.317008:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155640.317010:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.317014:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129e28e00/0x844e5faceb5f75d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.317046:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbebe00/0x844e5faceb5f75ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db0 expref: 18 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.317056:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29a600/0x844e5faceb5f75df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db0 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.317062:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155640.317064:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155640.317066:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c29a600, rc 0) 00000100:00100000:3.0:1746155640.317115:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32263:x1830976125918208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 747us (1382us total) trans 8589945243 rc 0/0 00000100:00100000:3.0:1746155640.317120:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11090 00000100:00100000:0.0:1746155640.318841:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.318918:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125918464 00000100:00100000:2.0:1746155640.318923:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125918464 00000100:00100000:2.0:1746155640.318967:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4701 00000100:00100000:2.0:1746155640.318973:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32263:x1830976125918464:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155640.319099:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32263:x1830976125918464:12345-192.168.202.51@tcp:35:cat.0 Request processed in 126us (262us total) trans 8589945244 rc 0/0 00000100:00100000:2.0:1746155640.319104:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4701 00000100:00100000:0.0:1746155640.321252:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.321468:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.321529:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125918592 00000100:00100000:1.0:1746155640.321535:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125918592 00000100:00100000:3.0:1746155640.321577:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125918720 00000100:00100000:3.0:1746155640.321581:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125918720 00000100:00100000:1.0:1746155640.321582:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16840 00000100:00100000:1.0:1746155640.321588:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976125918592:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155640.321601:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155640.321605:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16841 00000100:00100000:3.0:1746155640.321609:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125918720:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155640.321615:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c51a000/0x844e5faceb5f75ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17db7 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.321617:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.321625:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5f75f4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17dbe expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.321632:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.321633:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.321640:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c51a000/0x844e5faceb5f75ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db7 expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155640.321654:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c51a000/0x844e5faceb5f75ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db7 expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155640.321656:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125343104:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155640.321662:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c51a000, rc 0) 00000100:00100000:1.0:1746155640.321691:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976125918592:12345-192.168.202.51@tcp:101:cat.0 Request processed in 103us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.321700:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16840 00000100:00100000:3.0:1746155640.321705:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.324697:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125343104:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155640.324726:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5f75f4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dbe expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.324737:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c29ac00/0x844e5faceb5f75f4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dbe expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.324983:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c29ac00, rc 0) 00000100:00100000:3.0:1746155640.325078:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125918720:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3465us (3607us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155640.325087:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16841 00000100:00100000:0.0:1746155640.333015:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.333105:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125918976 00000100:00100000:2.0:1746155640.333112:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125918976 00002000:00100000:2.0:1746155640.333148:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff8800a0d4e680 x1830976125918976/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.333156:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4e680 with x1830976125918976 ext(0->1048575) 00002000:00010000:2.0:1746155640.333162:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d4e680 00000100:00100000:2.0:1746155640.333192:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7984 00000100:00100000:2.0:1746155640.333198:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125918976:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155640.336291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.336323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.336411:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125919232 00000100:00100000:2.0:1746155640.336414:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125919360 00000100:00100000:2.0:1746155640.336418:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125919360 00000100:00100000:0.0:1746155640.336418:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125919232 00002000:00100000:2.0:1746155640.336446:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009fb69180 x1830976125919360/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 504/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155640.336446:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009fb6b100 x1830976125919232/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.336455:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69180 with x1830976125919360 ext(1048576->2097151) 00002000:00100000:0.0:1746155640.336458:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b100 with x1830976125919232 ext(1048576->2097151) 00002000:00010000:2.0:1746155640.336459:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb69180 00002000:00010000:0.0:1746155640.336461:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb6b100 00000100:00100000:2.0:1746155640.336522:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7985 00000100:00100000:0.0:1746155640.336528:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7986 00000100:00100000:2.0:1746155640.336530:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976125919360:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155640.336535:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1961:x1830976125919232:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155640.343836:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125918976:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10630us (10821us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.343847:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7984 00002000:00100000:2.0:1746155640.343857:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff8800a0d4e680 x1830976125918976/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.343871:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4e680 with x1830976125918976 ext(0->1048575) 00002000:00010000:2.0:1746155640.343877:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d4e680 00000100:00100000:2.0:1746155640.346229:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1961:x1830976125919232:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9688us (9937us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.346239:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7986 00002000:00100000:2.0:1746155640.346246:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009fb6b100 x1830976125919232/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.346254:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b100 with x1830976125919232 ext(1048576->2097151) 00002000:00010000:2.0:1746155640.346259:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb6b100 00000100:00100000:2.0:1746155640.346649:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976125919360:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10119us (10323us total) trans 0 rc 540672/540672 00000100:00100000:2.0:1746155640.346655:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7985 00002000:00100000:2.0:1746155640.346660:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009fb69180 x1830976125919360/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 504/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 540672/540672 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.346667:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69180 with x1830976125919360 ext(1048576->2097151) 00002000:00010000:2.0:1746155640.346670:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb69180 00000100:00100000:0.0:1746155640.357593:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.357631:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125919616 00000100:00100000:3.0:1746155640.357639:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125919616 00000100:00100000:3.0:1746155640.357677:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16842 00000100:00100000:3.0:1746155640.357683:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32263:x1830976125919616:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155640.357697:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.357711:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c29b000/0x844e5faceb5f75fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17dc5 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.357738:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 35 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.357745:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155640.357746:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155640.357749:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c29b000/0x844e5faceb5f75fb lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dc5 expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.357773:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 35 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.357783:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 35 pid: 18270 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.357793:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125343232:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.358456:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.360367:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125343232:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.360403:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c29b000/0x844e5faceb5f75fb lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dc5 expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.360417:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c29b000, rc 0) 00000100:00100000:3.0:1746155640.360583:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32263:x1830976125919616:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2898us (2995us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.360589:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16842 00000100:00100000:0.0:1746155640.360622:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.360699:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125919744 00000100:00100000:2.0:1746155640.360705:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125919744 00002000:00100000:2.0:1746155640.360733:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1880063) req@ffff8800a0d4ce00 x1830976125919744/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.360740:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4ce00 with x1830976125919744 ext(1048576->1880063) 00010000:00010000:2.0:1746155640.360746:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 36 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.360762:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 36 pid: 18270 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.360767:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0d4ce00 00000100:00100000:2.0:1746155640.360782:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1380 00000100:00100000:2.0:1746155640.360788:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976125919744:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155640.367733:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976125919744:12345-192.168.202.51@tcp:4:cat.0 Request processed in 6936us (7102us total) trans 17179874237 rc 0/0 00000100:00100000:3.0:1746155640.367746:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1380 00002000:00100000:3.0:1746155640.367756:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1880063) req@ffff8800a0d4ce00 x1830976125919744/t17179874237(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/448 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.367764:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4ce00 with x1830976125919744 ext(1048576->1880063) 00010000:00010000:3.0:1746155640.367771:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 38 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.367782:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 38 pid: 18270 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746155640.367788:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0d4ce00 00000100:00100000:0.0:1746155640.370698:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.370791:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125919872 00000100:00100000:2.0:1746155640.370799:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125919872 00010000:00010000:2.0:1746155640.370828:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 38 pid: 18270 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155640.370852:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8630 00000100:00100000:2.0:1746155640.370859:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976125919872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155640.370870:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155640.370888:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 38 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.370898:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 38 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.370917:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f62200/0x844e5faceb5f75a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1880063) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d9b expref: 38 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.371099:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.371101:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.371108:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c29b000/0x844e5faceb5f75fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dc5 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.371114:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c29b000/0x844e5faceb5f75fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dc5 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.371238:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c29b000/0x844e5faceb5f75fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dc5 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155640.371249:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125343360:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155640.372103:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155640.373844:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125343360:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155640.373860:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155640.373901:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1963:x1830976125919872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3041us (3209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.373910:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8630 00000100:00100000:0.0:1746155640.375231:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.375275:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125920128 00000100:00100000:3.0:1746155640.375281:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125920128 00002000:00100000:3.0:1746155640.375316:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800a0d4f480 x1830976125920128/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.375325:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4f480 with x1830976125920128 ext(1048576->2097151) 00002000:00010000:3.0:1746155640.375329:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d4f480 00000100:00100000:3.0:1746155640.375356:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7987 00000100:00100000:3.0:1746155640.375362:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125920128:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155640.383676:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125920128:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8302us (8436us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155640.383687:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7987 00002000:00100000:3.0:1746155640.383697:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800a0d4f480 x1830976125920128/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.383711:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4f480 with x1830976125920128 ext(1048576->2097151) 00002000:00010000:3.0:1746155640.383716:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d4f480 00000100:00100000:0.0:1746155640.432184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.432303:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125920256 00000100:00100000:3.0:1746155640.432310:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125920256 00000100:00080000:0.0:1746155640.432390:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155640.432479:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11091 00000100:00100000:3.0:1746155640.432487:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32266:x1830976125920256:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155640.432534:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.432552:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0ba00/0x844e5faceb5f7602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17dcc expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.432601:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7609 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.432611:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.432619:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.432629:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7610 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.432633:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.432637:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.432719:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.432728:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da2 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.432732:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.432753:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da2 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.432760:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da2 expref: 17 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.432768:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125343488:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.432848:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.434253:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125343488:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.434265:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155640.434815:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.434885:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125920512 00000100:00100000:2.0:1746155640.434891:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125920512 00000100:00100000:2.0:1746155640.434920:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4702 00000100:00100000:2.0:1746155640.434925:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:23568:x1830976125920512:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746155640.435336:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:23568:x1830976125920512:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 409us (522us total) trans 8589945245 rc 0/0 00000100:00100000:2.0:1746155640.435343:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4702 00000100:00100000:0.0:1746155640.436554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.436735:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125920640 00000100:00100000:2.0:1746155640.436739:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125920640 00010000:00010000:2.0:1746155640.436760:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da2 expref: 19 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155640.436781:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8631 00000100:00100000:2.0:1746155640.436786:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976125920640:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155640.436794:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155640.436798:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da2 expref: 19 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.436806:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da2 expref: 19 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.436824:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f75b5 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da2 expref: 19 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.436836:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155640.436840:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.436848:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.436853:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.437019:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155640.437094:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437100:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155640.437129:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155640.437133:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155640.437144:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437151:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437160:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7609 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437165:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7609 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437169:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7609 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437173:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012de0b400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155640.437175:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7609 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437180:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7609 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437186:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155640.437188:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155640.437191:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7609 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437194:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7609 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437207:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7610 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437212:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7610 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437217:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7610 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437221:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012de0bc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155640.437223:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7610 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437227:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7610 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437233:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fab9a00) 00010000:00010000:3.0:1746155640.437235:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155640.437237:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7610 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437241:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7610 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.437264:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0ba00/0x844e5faceb5f7602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dcc expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.437273:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dcc expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.437278:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155640.437280:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155640.437282:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a55f6200, rc 0) 00000100:00100000:2.0:1746155640.437317:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976125920640:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 530us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.437323:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8631 00000100:00100000:3.0:1746155640.437661:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32266:x1830976125920256:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5174us (5483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.437666:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11091 00000100:00100000:0.0:1746155640.439743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.439778:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.439805:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125920768 00000100:00100000:3.0:1746155640.439811:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125920768 00000100:00100000:3.0:1746155640.439939:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125921024 00000100:00100000:3.0:1746155640.439941:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125921024 00000100:00100000:3.0:1746155640.439957:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16843 00000100:00100000:3.0:1746155640.439962:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125920768:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155640.439975:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.439990:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f761e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17dd3 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.440006:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.440007:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.440014:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f761e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dd3 expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.440026:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f761e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dd3 expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.440034:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed1200, rc 0) 00000100:00100000:2.0:1746155640.440076:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16844 00000100:00100000:2.0:1746155640.440082:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125921024:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155640.440089:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155640.440096:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e01400/0x844e5faceb5f7625 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17de1 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155640.440122:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125343616:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155640.440290:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125920768:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 327us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.440295:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16843 00000100:00100000:2.0:1746155640.440339:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155640.440371:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.440400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.440454:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125921280 00000100:00100000:0.0:1746155640.440458:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125921280 00000100:00100000:0.0:1746155640.440482:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125920896 00000100:00100000:0.0:1746155640.440485:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125920896 00000100:00100000:0.0:1746155640.440500:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16845 00000100:00100000:0.0:1746155640.440524:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125921280:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155640.440530:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155640.440539:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f800/0x844e5faceb5f762c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17def expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155640.440550:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155640.440551:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746155640.440555:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16846 00010000:00010000:0.0:1746155640.440556:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f800/0x844e5faceb5f762c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17def expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155640.440561:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125920896:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155640.440565:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f800/0x844e5faceb5f762c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17def expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.440568:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155640.440573:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc7f800, rc 0) 00010000:00010000:2.0:1746155640.440580:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e00600/0x844e5faceb5f7633 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17dda expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.440589:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.440591:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.440595:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e00600/0x844e5faceb5f7633 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dda expref: 15 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.440604:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e00600/0x844e5faceb5f7633 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dda expref: 15 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.440611:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e00600, rc 0) 00000100:00100000:1.0:1746155640.440769:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.440780:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125921152 00000100:00100000:1.0:1746155640.440783:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125921152 00000100:00100000:0.0:1746155640.440899:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125921280:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 374us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155640.440905:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16845 00000100:00100000:0.0:1746155640.440953:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.440997:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125921408 00000100:00100000:0.0:1746155640.441000:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125921408 00000100:00100000:0.0:1746155640.441015:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16847 00000100:00100000:0.0:1746155640.441020:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125921408:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155640.441028:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155640.441034:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f763a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17df6 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155640.441045:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155640.441046:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155640.441050:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f763a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17df6 expref: 17 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155640.441059:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f763a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17df6 expref: 17 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155640.441151:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125920896:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 589us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.441157:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16848 00000100:00100000:1.0:1746155640.441162:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125921152:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155640.441167:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155640.441173:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f7641 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17de8 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.441182:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.441186:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.441190:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f7641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17de8 expref: 14 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155640.441199:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f7641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17de8 expref: 14 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155640.441205:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013121e400, rc 0) 00000100:00100000:1.0:1746155640.441282:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125921152:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 64us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.441306:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16846 00000100:00100000:1.0:1746155640.441383:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16848 00010000:00010000:0.0:1746155640.441529:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc7ec00, rc 0) 00000100:00100000:1.0:1746155640.441680:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125921408:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 658us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.441685:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16847 00000100:00100000:2.0:1746155640.442626:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125343616:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155640.442649:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e01400/0x844e5faceb5f7625 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17de1 expref: 15 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.442659:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e01400/0x844e5faceb5f7625 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17de1 expref: 15 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.442667:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e01400, rc 0) 00000100:00100000:2.0:1746155640.442690:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125921024:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2608us (2912us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155640.442695:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16844 00000100:00100000:0.0:1746155640.445721:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.445779:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125921664 00000100:00100000:3.0:1746155640.445786:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125921664 00000100:00100000:3.0:1746155640.445960:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11092 00000100:00100000:3.0:1746155640.445968:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32266:x1830976125921664:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155640.445983:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.445997:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74a00/0x844e5faceb5f7648 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17dfd expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.446073:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.446088:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dcc expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.446095:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.446121:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dcc expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.446130:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dcc expref: 8 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.446140:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125343744:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.446222:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155640.449629:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.449706:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125343744:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.449724:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155640.449765:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125921792 00000100:00100000:2.0:1746155640.449770:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125921792 00010000:00010000:2.0:1746155640.449792:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dcc expref: 9 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155640.449809:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8632 00000100:00100000:2.0:1746155640.449814:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976125921792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155640.449823:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155640.449828:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dcc expref: 9 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.449836:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dcc expref: 9 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.449853:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a55f6200/0x844e5faceb5f7617 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dcc expref: 9 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.449863:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155640.449867:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.449874:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.449880:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.449891:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155640.449943:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976125921792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 128us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.449949:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8632 00010000:00010000:3.0:1746155640.449986:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.449991:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155640.450004:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155640.450106:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74a00/0x844e5faceb5f7648 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dfd expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.450121:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dfd expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.450127:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155640.450129:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155640.450131:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa74200, rc 0) 00000100:00100000:3.0:1746155640.450151:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32266:x1830976125921664:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4185us (4438us total) trans 8589945246 rc 0/0 00000100:00100000:3.0:1746155640.450157:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11092 00000100:00100000:0.0:1746155640.453197:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.453263:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125921920 00000100:00100000:3.0:1746155640.453270:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125921920 00000100:00100000:3.0:1746155640.453317:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11093 00000100:00100000:3.0:1746155640.453324:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32266:x1830976125921920:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155640.453345:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.453360:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0200/0x844e5faceb5f765d lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e04 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.453426:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.453439:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dfd expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.453445:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.453470:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dfd expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.453477:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dfd expref: 9 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.453489:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125343872:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.453643:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155640.455614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.455739:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125922048 00000100:00100000:1.0:1746155640.455745:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125922048 00000100:00100000:3.0:1746155640.455755:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063800 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125343872:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155640.455766:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dfd expref: 10 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.455771:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155640.455799:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8633 00000100:00100000:1.0:1746155640.455805:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125922048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.455814:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.455819:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dfd expref: 10 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.455828:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dfd expref: 10 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.455846:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa74200/0x844e5faceb5f764f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dfd expref: 10 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.455873:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155640.455877:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155640.455884:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155640.455890:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155640.455905:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.455942:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125922048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 136us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.455948:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8633 00010000:00010000:3.0:1746155640.455953:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.455958:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155640.455988:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155640.455992:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155640.456003:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.456028:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0200/0x844e5faceb5f765d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e04 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.456038:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e04 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.456043:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155640.456046:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155640.456048:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0e00, rc 0) 00000100:00100000:3.0:1746155640.456068:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32266:x1830976125921920:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2745us (2879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.456077:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11093 00000100:00100000:0.0:1746155640.459121:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.459161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.459358:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125922304 00000100:00100000:3.0:1746155640.459366:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125922304 00000100:00100000:3.0:1746155640.459411:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11094 00000100:00100000:3.0:1746155640.459419:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32268:x1830976125922304:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155640.459437:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.459451:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f766b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e0b expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.459560:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5f7672 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459571:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5f7672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459579:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5f7672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459590:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5f7679 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459595:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5f7679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459600:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5f7679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459684:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7680 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459692:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7680 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459698:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7680 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155640.459705:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000100:00100000:2.0:1746155640.459773:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125922432 00010000:00010000:3.0:1746155640.459777:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5f7672 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155640.459777:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125922432 00010000:00010000:3.0:1746155640.459782:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5f7672 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459787:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5f7672 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459792:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb1e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155640.459795:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5f7672 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459799:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5f7672 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459808:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00000100:00100000:2.0:1746155640.459809:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16849 00010000:00010000:3.0:1746155640.459811:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155640.459814:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5f7672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155640.459814:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125922432:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155640.459818:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1e00/0x844e5faceb5f7672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.459821:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.459826:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5f7679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.459829:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e01e00/0x844e5faceb5f768e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e12 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.459830:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5f7679 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459837:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5f7679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459841:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb0c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155640.459843:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5f7679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459847:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5f7679 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459851:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fab9a00) 00010000:00010000:3.0:1746155640.459853:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155640.459855:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5f7679 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.459859:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0c00/0x844e5faceb5f7679 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155640.459862:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125344000:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155640.459887:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f766b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e0b expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.459896:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7680 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e0b expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.459901:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155640.459903:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155640.459905:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1800, rc 0) 00000100:00100000:2.0:1746155640.459919:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.459941:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32268:x1830976125922304:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 511us (815us total) trans 8589945247 rc 0/0 00000100:00100000:3.0:1746155640.459947:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11094 00000100:00100000:2.0:1746155640.461464:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125344000:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155640.461485:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092e01e00/0x844e5faceb5f768e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e12 expref: 15 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.461494:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e01e00/0x844e5faceb5f768e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e12 expref: 15 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.461534:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e01e00, rc 0) 00000100:00100000:2.0:1746155640.461564:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125922432:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1749us (2401us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155640.461569:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16849 00000100:00100000:0.0:1746155640.465914:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.465981:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125922688 00000100:00100000:1.0:1746155640.465989:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125922688 00000100:00100000:1.0:1746155640.466037:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11095 00000100:00100000:1.0:1746155640.466045:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32266:x1830976125922688:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155640.466060:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155640.466075:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f7695 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e19 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.466149:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f769c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.466161:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f769c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.466170:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f769c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.466180:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f769c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.466185:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f769c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.466191:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f769c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.466196:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013121f400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155640.466199:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f769c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.466209:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f769c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.466217:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155640.466220:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155640.466223:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f769c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.466227:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f769c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.466264:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f7695 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e19 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.466271:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f7695 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e19 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.466277:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013121e200, rc 0) 00000100:00100000:1.0:1746155640.466326:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32266:x1830976125922688:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 281us (418us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155640.466331:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11095 00000100:00100000:0.0:1746155640.469486:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.470523:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125922944 00000100:00100000:2.0:1746155640.470533:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125922944 00000100:00100000:2.0:1746155640.470634:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4703 00000100:00100000:2.0:1746155640.470642:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32266:x1830976125922944:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:2.0:1746155640.470809:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32266:x1830976125922944:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 168us (1328us total) trans 8589945248 rc 0/0 00000100:00100000:2.0:1746155640.470816:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4703 00000100:00100000:0.0:1746155640.477154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.477253:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125923072 00000100:00100000:2.0:1746155640.477261:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125923072 00000100:00100000:2.0:1746155640.477376:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16850 00000100:00100000:2.0:1746155640.477384:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976125923072:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155640.477398:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155640.477412:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f76a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e20 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155640.477454:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125344128:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155640.477888:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155640.478482:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.478583:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.478616:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125923200 00000100:00100000:1.0:1746155640.478621:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125923200 00000100:00100000:1.0:1746155640.478646:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125923328 00000100:00100000:1.0:1746155640.478648:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125923328 00000100:00100000:2.0:1746155640.478658:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16851 00000100:00100000:1.0:1746155640.478671:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16852 00000100:00100000:2.0:1746155640.478672:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a2a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1963:x1830976125923200:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155640.478677:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32268:x1830976125923328:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155640.478681:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155640.478683:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155640.478693:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092e00c00/0x844e5faceb5f76b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e27 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.478693:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e2e expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.478707:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.478709:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.478710:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5f74f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d2b expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.478716:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092e00c00/0x844e5faceb5f76b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e27 expref: 38 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155640.478718:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f763a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17df6 expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155640.478724:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f7506 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d40 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.478729:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092e00c00/0x844e5faceb5f76b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e27 expref: 38 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155640.478730:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.478731:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.478734:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3923968->4194303] (req 3923968->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.478738:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092e00c00, rc 0) 00010000:00010000:1.0:1746155640.478751:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f7506 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d40 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.478761:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f7506 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d40 expref: 23 pid: 1625 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155640.478763:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a2a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976125923200:12345-192.168.202.51@tcp:101:cat.0 Request processed in 98us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.478769:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16851 00000100:00100000:1.0:1746155640.478770:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125344256:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155640.478810:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f763a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17df6 expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155640.478818:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f763a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17df6 expref: 13 pid: 20796 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746155640.478826:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125344384:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155640.479191:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5f74f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d2b expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.479199:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5f74f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d2b expref: 23 pid: 20796 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.479207:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125344512:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155640.479224:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.479981:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125344128:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155640.480000:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f76a3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e20 expref: 23 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.480008:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f76a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e20 expref: 23 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.480019:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012de0bc00, rc 0) 00000100:00100000:3.0:1746155640.480053:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976125923072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2669us (2907us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155640.480058:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16850 00000100:00100000:1.0:1746155640.480499:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125344256:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155640.482923:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125344384:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155640.482950:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125344512:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155640.483181:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3923968->4194303] (req 3923968->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.483196:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5355600, rc 0) 00000100:00100000:1.0:1746155640.483269:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:32268:x1830976125923328:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4591us (4684us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.483277:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16852 00000100:00100000:0.0:1746155640.483563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.483595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.483747:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125923456 00000100:00100000:1.0:1746155640.483752:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125923456 00010000:00010000:1.0:1746155640.483772:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f7506 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d40 expref: 21 pid: 1625 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.483794:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125923584 00000100:00100000:1.0:1746155640.483796:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125923584 00010000:00010000:1.0:1746155640.483804:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f763a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17df6 expref: 14 pid: 20796 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746155640.483816:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8634 00000100:00100000:1.0:1746155640.483822:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976125923456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.483832:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.483849:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f7506 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d40 expref: 21 pid: 1625 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.483858:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f7506 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d40 expref: 21 pid: 1625 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.483874:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012df5ee00/0x844e5faceb5f7506 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d40 expref: 21 pid: 1625 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.483886:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.483905:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976125923456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 83us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.483910:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8634 00000100:00100000:1.0:1746155640.483918:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8635 00000100:00100000:1.0:1746155640.483922:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125923584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.483939:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.483946:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f763a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17df6 expref: 14 pid: 20796 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.483953:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f763a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17df6 expref: 14 pid: 20796 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.483963:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f763a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17df6 expref: 14 pid: 20796 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.483969:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.483981:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125923584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 59us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.483987:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8635 00000100:00100000:0.0:1746155640.487344:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.488224:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125923712 00000100:00100000:2.0:1746155640.488232:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125923712 00010000:00010000:2.0:1746155640.488262:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5f74f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d2b expref: 24 pid: 20796 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155640.488293:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8636 00000100:00100000:2.0:1746155640.488299:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976125923712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155640.488311:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155640.488328:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5f74f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d2b expref: 24 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.488338:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5f74f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d2b expref: 24 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.488359:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a55f7600/0x844e5faceb5f74f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d2b expref: 24 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.488374:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.488375:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.488380:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 19 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.488391:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 19 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.488417:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 19 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155640.488426:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125344640:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155640.488489:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155640.489048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.489156:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125923840 00000100:00100000:1.0:1746155640.489160:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125923840 00000100:00100000:1.0:1746155640.489182:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16853 00000100:00100000:1.0:1746155640.489187:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:32271:x1830976125923840:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155640.489198:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155640.489208:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a626ec00/0x844e5faceb5f76b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e35 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.489224:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 23 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.489229:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155640.489230:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155640.489233:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626ec00/0x844e5faceb5f76b8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e35 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.489256:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 23 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.489264:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 23 pid: 18270 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.489381:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125344768:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155640.489788:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155640.490549:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125344640:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155640.490564:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155640.490594:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125923712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2294us (3257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.490601:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8636 00000100:00100000:0.0:1746155640.491095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.491187:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125924096 00000100:00100000:3.0:1746155640.491192:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125924096 00002000:00100000:3.0:1746155640.491217:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3923968->3928063) req@ffff88009f3ed500 x1830976125924096/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.491225:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ed500 with x1830976125924096 ext(3923968->3928063) 00002000:00010000:3.0:1746155640.491230:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ed500 00000100:00100000:3.0:1746155640.491243:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7988 00000100:00100000:3.0:1746155640.491249:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976125924096:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155640.491377:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976125924096:12345-192.168.202.51@tcp:3:cat.0 Request processed in 128us (282us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155640.491383:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7988 00002000:00100000:3.0:1746155640.491388:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3923968->3928063) req@ffff88009f3ed500 x1830976125924096/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/4536 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.491401:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ed500 with x1830976125924096 ext(3923968->3928063) 00002000:00010000:3.0:1746155640.491404:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f3ed500 00000100:00100000:1.0:1746155640.492020:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125344768:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155640.492042:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a626ec00/0x844e5faceb5f76b8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e35 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.492055:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a626ec00, rc 0) 00000100:00100000:1.0:1746155640.492075:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:32271:x1830976125923840:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2888us (3028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.492082:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16853 00000100:00100000:0.0:1746155640.492466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.492906:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125924224 00000100:00100000:2.0:1746155640.492911:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125924224 00002000:00100000:2.0:1746155640.492941:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1126400->1634303) req@ffff88009f3ee680 x1830976125924224/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.492953:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ee680 with x1830976125924224 ext(1126400->1634303) 00010000:00010000:2.0:1746155640.492959:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 23 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.492971:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 23 pid: 18270 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.492976:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f3ee680 00000100:00100000:2.0:1746155640.493060:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1381 00000100:00100000:2.0:1746155640.493067:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976125924224:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155640.496366:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.496640:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125924352 00000100:00100000:1.0:1746155640.496647:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125924352 00000100:00100000:1.0:1746155640.496698:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16854 00000100:00100000:1.0:1746155640.496709:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:32268:x1830976125924352:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155640.496725:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155640.496741:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e3c expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.496771:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x844e5faceb5f74ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d39 expref: 11 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.496782:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f800/0x844e5faceb5f762c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17def expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155640.496788:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5f750d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d47 expref: 39 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.496793:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.496795:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.496798:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [4194304->4243455] (req 4194304->4243455) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 39 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.496824:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5f750d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d47 expref: 39 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.496832:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5f750d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d47 expref: 39 pid: 20796 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.496843:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125344896:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155640.496924:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f800/0x844e5faceb5f762c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17def expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155640.496941:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f800/0x844e5faceb5f762c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17def expref: 13 pid: 20796 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746155640.496949:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125345024:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155640.496975:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x844e5faceb5f74ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d39 expref: 11 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.496982:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x844e5faceb5f74ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d39 expref: 11 pid: 20796 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.496989:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125345152:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155640.497003:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155640.498478:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125344896:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155640.498487:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125345024:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155640.498493:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125345152:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155640.498556:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [4194304->4243455] (req 4194304->4243455) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 39 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.498567:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5355a00, rc 0) 00000100:00100000:1.0:1746155640.498596:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:32268:x1830976125924352:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1891us (2237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.498603:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16854 00000100:00100000:2.0:1746155640.499185:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1961:x1830976125924224:12345-192.168.202.51@tcp:4:cat.0 Request processed in 6117us (6717us total) trans 21474841560 rc 0/0 00000100:00100000:2.0:1746155640.499193:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1381 00002000:00100000:2.0:1746155640.499199:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1126400->1634303) req@ffff88009f3ee680 x1830976125924224/t21474841560(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/448 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.499207:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ee680 with x1830976125924224 ext(1126400->1634303) 00010000:00010000:2.0:1746155640.499214:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 25 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.499223:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 25 pid: 18270 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.499229:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f3ee680 00000100:00100000:0.0:1746155640.499556:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.499625:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125924480 00000100:00100000:2.0:1746155640.499630:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125924480 00010000:00010000:2.0:1746155640.499648:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f800/0x844e5faceb5f762c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17def expref: 14 pid: 20796 timeout: 869 lvb_type: 1 00000100:00100000:2.0:1746155640.499671:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8637 00000100:00100000:2.0:1746155640.499676:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1962:x1830976125924480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155640.499684:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155640.499698:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f800/0x844e5faceb5f762c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17def expref: 14 pid: 20796 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746155640.499706:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f800/0x844e5faceb5f762c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17def expref: 14 pid: 20796 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746155640.499720:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f800/0x844e5faceb5f762c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17def expref: 14 pid: 20796 timeout: 869 lvb_type: 1 00010000:00010000:2.0:1746155640.499731:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155640.499825:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1962:x1830976125924480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 148us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.499831:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8637 00000100:00100000:0.0:1746155640.502824:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.502867:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.503082:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125924736 00000100:00100000:1.0:1746155640.503082:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125924608 00000100:00100000:2.0:1746155640.503088:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125924736 00000100:00100000:1.0:1746155640.503088:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125924608 00010000:00010000:2.0:1746155640.503112:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x844e5faceb5f74ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d39 expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.503112:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 25 pid: 18270 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155640.503134:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8638 00000100:00100000:1.0:1746155640.503138:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8639 00000100:00100000:2.0:1746155640.503140:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125924736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155640.503145:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976125924608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155640.503151:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.503152:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155640.503166:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x844e5faceb5f74ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d39 expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.503166:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 25 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.503174:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x844e5faceb5f74ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d39 expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.503175:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 25 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.503189:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1c400/0x844e5faceb5f74ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d39 expref: 12 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.503190:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fbebc00/0x844e5faceb5f75c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1126400->1634303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17da9 expref: 25 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.503199:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155640.503203:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.503204:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.503210:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a626ec00/0x844e5faceb5f76b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e35 expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.503217:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626ec00/0x844e5faceb5f76b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e35 expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155640.503238:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976125924736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 99us (370us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155640.503241:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a626ec00/0x844e5faceb5f76b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e35 expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155640.503243:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8638 00000100:00100000:1.0:1746155640.503251:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125345280:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155640.503290:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155640.503360:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.503422:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125924864 00000100:00100000:1.0:1746155640.503426:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125924864 00010000:00010000:1.0:1746155640.503438:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5f750d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d47 expref: 39 pid: 20796 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.503454:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8640 00000100:00100000:1.0:1746155640.503459:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1963:x1830976125924864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.503465:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.503472:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5f750d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d47 expref: 39 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.503480:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5f750d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d47 expref: 39 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.503491:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b1d400/0x844e5faceb5f750d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d47 expref: 39 pid: 20796 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.503500:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.503519:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.503523:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 38 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.503529:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 38 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.503546:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 38 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.503558:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125345408:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155640.504177:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155640.505307:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125345280:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155640.505333:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.505370:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976125924608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2224us (2551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.505377:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8639 00000100:00100000:1.0:1746155640.506654:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125345408:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155640.506669:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.506702:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976125924864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3239us (3338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.506709:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8640 00000100:00100000:0.0:1746155640.508987:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.509046:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125925120 00000100:00100000:2.0:1746155640.509053:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125925120 00002000:00100000:2.0:1746155640.509090:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (4239360->4243455) req@ffff88009f3eca80 x1830976125925120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.509099:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3eca80 with x1830976125925120 ext(4239360->4243455) 00002000:00010000:2.0:1746155640.509104:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3eca80 00000100:00100000:2.0:1746155640.509590:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7989 00000100:00100000:2.0:1746155640.509598:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976125925120:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155640.509898:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.509979:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.509996:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125925376 00000100:00100000:0.0:1746155640.510000:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125925376 00002000:00100000:0.0:1746155640.510020:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a6063800 x1830976125925376/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155640.510027:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6063800 with x1830976125925376 ext(1048576->2097151) 00002000:00010000:0.0:1746155640.510030:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6063800 00000100:00100000:0.0:1746155640.510040:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125925632 00000100:00100000:0.0:1746155640.510042:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125925632 00002000:00100000:0.0:1746155640.510052:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800a6063b80 x1830976125925632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155640.510058:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6063b80 with x1830976125925632 ext(1048576->2097151) 00002000:00010000:0.0:1746155640.510061:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6063b80 00000100:00100000:0.0:1746155640.510084:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7990 00000100:00100000:0.0:1746155640.510090:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976125925376:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155640.510112:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7991 00000100:00100000:1.0:1746155640.510120:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976125925632:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155640.511251:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976125925120:12345-192.168.202.51@tcp:3:cat.0 Request processed in 1651us (2266us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155640.511259:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7989 00002000:00100000:2.0:1746155640.511265:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (4239360->4243455) req@ffff88009f3eca80 x1830976125925120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/4536 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.511273:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3eca80 with x1830976125925120 ext(4239360->4243455) 00002000:00010000:2.0:1746155640.511277:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3eca80 00000100:00100000:0.0:1746155640.519106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.519358:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976125925376:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9265us (9463us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.519370:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7990 00002000:00100000:2.0:1746155640.519381:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a6063800 x1830976125925376/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.519391:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6063800 with x1830976125925376 ext(1048576->2097151) 00002000:00010000:2.0:1746155640.519397:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6063800 00000100:00100000:1.0:1746155640.519464:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125925888 00000100:00100000:1.0:1746155640.519472:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125925888 00000100:00100000:1.0:1746155640.519517:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4704 00000100:00100000:1.0:1746155640.519524:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009461bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32268:x1830976125925888:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155640.519667:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009461bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32268:x1830976125925888:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 143us (568us total) trans 8589945249 rc 0/0 00000100:00100000:1.0:1746155640.519673:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4704 00000100:00100000:1.0:1746155640.522773:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976125925632:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12644us (12784us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155640.522784:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7991 00002000:00100000:1.0:1746155640.522794:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800a6063b80 x1830976125925632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.522803:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6063b80 with x1830976125925632 ext(1048576->2097151) 00002000:00010000:1.0:1746155640.522808:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6063b80 00000100:00100000:0.0:1746155640.533727:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.533860:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125926144 00000100:00100000:3.0:1746155640.533868:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125926144 00000100:00100000:3.0:1746155640.533912:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11096 00000100:00100000:3.0:1746155640.533920:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32274:x1830976125926144:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155640.533949:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.533963:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f76c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e43 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.534051:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f76cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.534063:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f76cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.534071:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f76cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.534081:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5f76d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.534087:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5f76d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.534091:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5f76d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.534835:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f76db lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.534845:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f76db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535045:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f76db lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155640.535054:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155640.535124:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f76cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535130:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f76cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535136:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f76cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535141:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb0a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155640.535144:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f76cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535149:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f76cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535158:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155640.535161:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155640.535164:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f76cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535168:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0a00/0x844e5faceb5f76cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535193:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5f76d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535197:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5f76d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535202:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5f76d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535206:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb1000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155640.535208:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5f76d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535213:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5f76d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535218:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fab9700) 00010000:00010000:3.0:1746155640.535221:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155640.535223:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5f76d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535227:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1000/0x844e5faceb5f76d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.535259:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f76c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e43 expref: 21 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.535269:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f76db lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e43 expref: 20 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.535275:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155640.535279:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155640.535281:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0800, rc 0) 00000100:00100000:3.0:1746155640.535322:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32274:x1830976125926144:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1403us (1602us total) trans 8589945250 rc 0/0 00000100:00100000:3.0:1746155640.535329:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11096 00000100:00100000:0.0:1746155640.538290:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.538371:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125926272 00000100:00100000:1.0:1746155640.538378:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125926272 00000100:00100000:1.0:1746155640.538428:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16855 00000100:00100000:1.0:1746155640.538435:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:32274:x1830976125926272:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155640.538449:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155640.538462:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e4a expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.538485:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.538491:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155640.538493:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155640.538496:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3899392->3915775] (req 3899392->3915775) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 25 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.538543:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.538553:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 20 pid: 10591 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.538568:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125345536:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155640.538633:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155640.540198:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125345536:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155640.540238:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3899392->3915775] (req 3899392->3915775) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 25 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.540250:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a626e200, rc 0) 00000100:00100000:1.0:1746155640.540284:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:32274:x1830976125926272:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1849us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.540291:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16855 00000100:00100000:0.0:1746155640.540481:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.540649:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125926400 00000100:00100000:2.0:1746155640.540655:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125926400 00002000:00100000:2.0:1746155640.540684:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3923968->4194303) req@ffff880130898380 x1830976125926400/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.540788:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898380 with x1830976125926400 ext(3923968->4194303) 00010000:00010000:2.0:1746155640.540796:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 21 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.540807:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 21 pid: 10591 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.540812:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130898380 00000100:00100000:2.0:1746155640.540836:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1382 00000100:00100000:2.0:1746155640.540842:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976125926400:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155640.545565:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976125926400:12345-192.168.202.51@tcp:4:cat.0 Request processed in 4715us (5075us total) trans 21474841561 rc 0/0 00000100:00100000:2.0:1746155640.545576:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1382 00002000:00100000:2.0:1746155640.545586:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3923968->4194303) req@ffff880130898380 x1830976125926400/t21474841561(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/448 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.545595:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898380 with x1830976125926400 ext(3923968->4194303) 00010000:00010000:2.0:1746155640.545602:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 23 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.545616:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 23 pid: 10591 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.545622:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130898380 00000100:00100000:1.0:1746155640.548945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.549074:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.549087:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.549485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.550214:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125926656 00000100:00100000:2.0:1746155640.550224:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125926656 00002000:00100000:2.0:1746155640.550264:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009fb68700 x1830976125926656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.550275:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68700 with x1830976125926656 ext(2097152->3145727) 00002000:00010000:2.0:1746155640.550279:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb68700 00000100:00100000:2.0:1746155640.550298:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125926784 00000100:00100000:2.0:1746155640.550300:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125926784 00002000:00100000:2.0:1746155640.550311:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009fb6b480 x1830976125926784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.550317:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b480 with x1830976125926784 ext(3145728->4194303) 00002000:00010000:2.0:1746155640.550319:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6b480 00000100:00100000:2.0:1746155640.550327:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125927168 00000100:00100000:2.0:1746155640.550329:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125927168 00002000:00100000:2.0:1746155640.550337:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009fb68000 x1830976125927168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.550342:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68000 with x1830976125927168 ext(2097152->3145727) 00010000:00010000:2.0:1746155640.550348:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 23 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.550360:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 23 pid: 10591 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.550366:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb68000 00000100:00100000:2.0:1746155640.550375:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125927296 00000100:00100000:2.0:1746155640.550377:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125927296 00002000:00100000:2.0:1746155640.550385:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3923967) req@ffff88009fb68380 x1830976125927296/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.550392:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68380 with x1830976125927296 ext(3145728->3923967) 00010000:00010000:2.0:1746155640.550395:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 24 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.550402:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 24 pid: 10591 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.550407:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb68380 00000100:00100000:2.0:1746155640.550417:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1383 00000100:00100000:2.0:1746155640.550423:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976125927168:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155640.550720:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1384 00000100:00100000:1.0:1746155640.550727:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125927296:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155640.552070:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7992 00000100:00100000:2.0:1746155640.552077:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976125926656:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155640.552407:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7993 00000100:00100000:3.0:1746155640.552414:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976125926784:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155640.565292:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976125927296:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14555us (15796us total) trans 0 rc 778240/778240 00000100:00100000:1.0:1746155640.565302:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1384 00002000:00100000:1.0:1746155640.565312:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3923967) req@ffff88009fb68380 x1830976125927296/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 778240/778240 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.565320:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68380 with x1830976125927296 ext(3145728->3923967) 00010000:00010000:1.0:1746155640.565329:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 25 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.565340:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 25 pid: 10591 timeout: 869 lvb_type: 0 00002000:00010000:1.0:1746155640.565346:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb68380 00000100:00100000:2.0:1746155640.569762:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976125927168:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19330us (20664us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.569773:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1383 00002000:00100000:2.0:1746155640.569783:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009fb68000 x1830976125927168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.569792:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68000 with x1830976125927168 ext(2097152->3145727) 00010000:00010000:2.0:1746155640.569801:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 23 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.569816:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 23 pid: 10591 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.569823:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fb68000 00000100:00100000:2.0:1746155640.571097:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976125926656:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19015us (22163us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.571106:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7992 00002000:00100000:2.0:1746155640.571114:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009fb68700 x1830976125926656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.571121:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68700 with x1830976125926656 ext(2097152->3145727) 00002000:00010000:2.0:1746155640.571125:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb68700 00000100:00100000:3.0:1746155640.571876:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976125926784:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19459us (22798us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155640.571883:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7993 00002000:00100000:3.0:1746155640.571888:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009fb6b480 x1830976125926784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.571895:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6b480 with x1830976125926784 ext(3145728->4194303) 00002000:00010000:3.0:1746155640.571898:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6b480 00000100:00100000:0.0:1746155640.575844:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.576129:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.576569:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125927552 00000100:00100000:1.0:1746155640.576576:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125927552 00010000:00010000:1.0:1746155640.576603:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 23 pid: 10591 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.576625:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8641 00000100:00100000:1.0:1746155640.576631:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125927552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.576641:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.576657:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 23 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.576666:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 23 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.576682:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5355600/0x844e5faceb5f76aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3923968->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e2e expref: 23 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.576703:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.576705:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.576711:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.576722:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.576745:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.576754:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125345664:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155640.578049:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155640.578307:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125927680 00000100:00100000:2.0:1746155640.578313:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125927680 00000100:00100000:2.0:1746155640.578350:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16856 00000100:00100000:2.0:1746155640.578357:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32271:x1830976125927680:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155640.578369:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155640.578382:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5f76f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e51 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.578400:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.578406:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155640.578407:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155640.578410:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5f76f0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e51 expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.578428:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.578438:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 24 pid: 10591 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155640.578446:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125345792:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155640.579197:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53373c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155640.581023:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125345664:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155640.581038:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.581067:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976125927552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4436us (5230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.581076:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8641 00000100:00100000:0.0:1746155640.581774:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.582044:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125927936 00000100:00100000:3.0:1746155640.582050:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125927936 00002000:00100000:3.0:1746155640.582080:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3899392->3903487) req@ffff880130898a80 x1830976125927936/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.582087:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898a80 with x1830976125927936 ext(3899392->3903487) 00010000:00010000:3.0:1746155640.582094:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 25 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.582106:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 25 pid: 10591 timeout: 869 lvb_type: 0 00000100:00100000:2.0:1746155640.582151:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125345792:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155640.582178:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5f76f0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e51 expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.582193:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880133832800, rc 0) 00000100:00100000:2.0:1746155640.582217:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32271:x1830976125927680:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3860us (6088us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.582222:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16856 00002000:00010000:3.0:1746155640.582327:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130898a80 00000100:00100000:3.0:1746155640.582342:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1385 00000100:00100000:3.0:1746155640.582348:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976125927936:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155640.582473:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976125927936:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 125us (700us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155640.582479:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1385 00002000:00100000:3.0:1746155640.582484:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3899392->3903487) req@ffff880130898a80 x1830976125927936/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/4536 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.582491:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898a80 with x1830976125927936 ext(3899392->3903487) 00010000:00010000:3.0:1746155640.582496:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 25 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.582530:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 25 pid: 10591 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746155640.582536:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130898a80 00000100:00100000:0.0:1746155640.586082:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.586316:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125928192 00000100:00100000:2.0:1746155640.586323:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125928192 00002000:00100000:2.0:1746155640.586355:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3911680->3915775) req@ffff88013089aa00 x1830976125928192/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.586364:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089aa00 with x1830976125928192 ext(3911680->3915775) 00010000:00010000:2.0:1746155640.586372:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 25 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.586386:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 25 pid: 10591 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.586392:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013089aa00 00000100:00100000:2.0:1746155640.586421:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1386 00000100:00100000:2.0:1746155640.586428:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1962:x1830976125928192:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155640.586589:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1962:x1830976125928192:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 160us (1138us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155640.586595:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1386 00002000:00100000:2.0:1746155640.586600:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3911680->3915775) req@ffff88013089aa00 x1830976125928192/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/4536 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.586607:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089aa00 with x1830976125928192 ext(3911680->3915775) 00010000:00010000:2.0:1746155640.586612:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 25 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.586625:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 25 pid: 10591 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.586631:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013089aa00 00000100:00100000:0.0:1746155640.590306:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.590592:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.590664:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125928704 00000100:00100000:2.0:1746155640.590675:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125928704 00000100:00100000:2.0:1746155640.590716:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4705 00000100:00100000:2.0:1746155640.590722:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32274:x1830976125928704:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155640.590961:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:32274:x1830976125928704:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 238us (369us total) trans 8589945251 rc 0/0 00000100:00100000:2.0:1746155640.590968:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4705 00000100:00100000:3.0:1746155640.592295:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125928448 00000100:00100000:3.0:1746155640.592302:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125928448 00002000:00100000:3.0:1746155640.592326:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3899392->3915775) req@ffff880130899c00 x1830976125928448/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 16872/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.592335:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899c00 with x1830976125928448 ext(3899392->3915775) 00010000:00010000:3.0:1746155640.592344:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 25 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.592362:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 25 pid: 10591 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746155640.592368:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130899c00 00000100:00100000:3.0:1746155640.592536:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1387 00000100:00100000:3.0:1746155640.592542:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1961:x1830976125928448:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155640.593338:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976125928448:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 794us (3036us total) trans 21474841562 rc 0/0 00000100:00100000:3.0:1746155640.593344:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1387 00002000:00100000:3.0:1746155640.593350:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3899392->3915775) req@ffff880130899c00 x1830976125928448/t21474841562(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 16872/448 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.593356:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899c00 with x1830976125928448 ext(3899392->3915775) 00010000:00010000:3.0:1746155640.593361:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 27 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.593371:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 27 pid: 10591 timeout: 869 lvb_type: 0 00002000:00010000:3.0:1746155640.593376:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130899c00 00000100:00100000:0.0:1746155640.596191:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.596341:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125928832 00000100:00100000:1.0:1746155640.596349:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125928832 00010000:00010000:1.0:1746155640.596378:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 27 pid: 10591 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.596401:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8642 00000100:00100000:1.0:1746155640.596407:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1962:x1830976125928832:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.596419:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746155640.596432:0:7062:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155640 -> 1746155641 00002000:00010000:1.0:1746155640.596435:0:7062:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155640 -> 1746155641 00010000:00010000:1.0:1746155640.596440:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 27 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.596450:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 27 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.596468:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a626e200/0x844e5faceb5f76e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3899392->3915775) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e4a expref: 27 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.596481:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.596483:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.596488:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5f76f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e51 expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.596495:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5f76f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e51 expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.596542:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5f76f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e51 expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.596552:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125345920:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155640.597007:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155640.598791:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125345920:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155640.598807:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.599401:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1962:x1830976125928832:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2992us (3215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.599411:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8642 00000100:00100000:0.0:1746155640.602408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.602446:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.602531:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125929088 00000100:00100000:3.0:1746155640.602539:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125929088 00002000:00100000:3.0:1746155640.602571:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88013089a300 x1830976125929088/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.602580:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089a300 with x1830976125929088 ext(2097152->3145727) 00002000:00010000:3.0:1746155640.602585:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089a300 00000100:00100000:3.0:1746155640.602596:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125929344 00000100:00100000:3.0:1746155640.602598:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125929344 00002000:00100000:3.0:1746155640.602606:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88013089a680 x1830976125929344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.602611:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089a680 with x1830976125929344 ext(3145728->4194303) 00002000:00010000:3.0:1746155640.602613:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089a680 00000100:00100000:3.0:1746155640.602631:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7994 00000100:00100000:3.0:1746155640.602636:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976125929088:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155640.603676:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7995 00000100:00100000:2.0:1746155640.603683:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125929344:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155640.613097:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125929088:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10452us (10686us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155640.613108:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7994 00002000:00100000:3.0:1746155640.613117:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88013089a300 x1830976125929088/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.613126:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089a300 with x1830976125929088 ext(2097152->3145727) 00002000:00010000:3.0:1746155640.613131:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089a300 00000100:00100000:2.0:1746155640.614749:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976125929344:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11063us (12299us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.614757:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7995 00002000:00100000:2.0:1746155640.614763:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88013089a680 x1830976125929344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.614770:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089a680 with x1830976125929344 ext(3145728->4194303) 00002000:00010000:2.0:1746155640.614774:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089a680 00000100:00100000:0.0:1746155640.622064:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.622173:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125929600 00000100:00100000:2.0:1746155640.622181:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125929600 00002000:00100000:2.0:1746155640.622282:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4243456->5083135) req@ffff880130899f80 x1830976125929600/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.622292:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899f80 with x1830976125929600 ext(4243456->5083135) 00002000:00010000:2.0:1746155640.622296:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899f80 00000100:00100000:2.0:1746155640.622940:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7996 00000100:00100000:2.0:1746155640.622948:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976125929600:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155640.624400:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.624437:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.624517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.624533:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125929728 00000100:00100000:2.0:1746155640.624537:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125929728 00000100:00100000:2.0:1746155640.624557:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125929856 00000100:00100000:2.0:1746155640.624559:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125929856 00000100:00100000:2.0:1746155640.624569:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125929984 00000100:00100000:2.0:1746155640.624571:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125929984 00000100:00100000:2.0:1746155640.624583:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16857 00000100:00100000:2.0:1746155640.624589:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976125929728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155640.624598:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155640.624612:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f76f7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e58 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.624627:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.624630:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.624636:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f76f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e58 expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.624649:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f76f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e58 expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.624662:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc7e200, rc 0) 00000100:00100000:3.0:1746155640.624741:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16858 00000100:00100000:3.0:1746155640.624750:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125929856:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155640.624758:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.624766:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0000/0x844e5faceb5f76fe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e5f expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155640.624794:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125346048:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155640.625908:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1960:x1830976125929728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1313us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.625914:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16857 00000100:00100000:2.0:1746155640.625944:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16859 00000100:00100000:2.0:1746155640.625950:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976125929984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155640.625959:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155640.625968:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5f7705 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e66 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.625980:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.625982:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.625987:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5f7705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e66 expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.625998:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5f7705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e66 expref: 28 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.626005:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc7e600, rc 0) 00000100:00100000:3.0:1746155640.626222:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:2.0:1746155640.626353:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1960:x1830976125929984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 402us (1848us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.626358:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16859 00002000:00010000:3.0:1746155640.632167:0:20200:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155640 -> 1746155641 00002000:00010000:3.0:1746155640.632175:0:20200:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155640 -> 1746155641 00002000:00010000:3.0:1746155640.632179:0:20200:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime: 1746155640 -> 1746155641 00000100:00100000:3.0:1746155640.632198:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125346048:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155640.632224:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0000/0x844e5faceb5f76fe lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e5f expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.632242:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0000/0x844e5faceb5f76fe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e5f expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.632263:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0000, rc 0) 00000100:00100000:3.0:1746155640.632308:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976125929856:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7556us (7869us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155640.632315:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16858 00000100:00100000:2.0:1746155640.634233:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976125929600:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11281us (12171us total) trans 0 rc 839680/839680 00000100:00100000:2.0:1746155640.634242:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7996 00002000:00100000:2.0:1746155640.634252:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4243456->5083135) req@ffff880130899f80 x1830976125929600/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 839680/839680 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.634260:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899f80 with x1830976125929600 ext(4243456->5083135) 00002000:00010000:2.0:1746155640.634265:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899f80 00000100:00100000:0.0:1746155640.647276:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.647766:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125930240 00000100:00100000:2.0:1746155640.647775:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125930240 00002000:00100000:2.0:1746155640.647812:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88013089bb80 x1830976125930240/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.647820:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089bb80 with x1830976125930240 ext(1048576->2097151) 00002000:00010000:2.0:1746155640.647825:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089bb80 00000100:00100000:2.0:1746155640.649650:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7997 00000100:00100000:2.0:1746155640.649661:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125930240:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155640.668280:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125930240:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18614us (21003us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.668291:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7997 00002000:00100000:2.0:1746155640.668300:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88013089bb80 x1830976125930240/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.668308:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089bb80 with x1830976125930240 ext(1048576->2097151) 00002000:00010000:2.0:1746155640.668313:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089bb80 00000100:00100000:0.0:1746155640.674686:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.677671:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125930368 00000100:00100000:3.0:1746155640.677682:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125930368 00000100:00100000:3.0:1746155640.678702:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16860 00000100:00100000:3.0:1746155640.678712:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32279:x1830976125930368:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155640.678727:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.678742:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f770c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e6d expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.678768:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 37 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.678774:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155640.678776:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155640.678780:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f770c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e6d expref: 12 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.678805:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 37 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.678816:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 37 pid: 10591 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.678826:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125346176:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.678924:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.682720:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125346176:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.682748:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f770c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e6d expref: 12 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.682762:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1e00, rc 0) 00000100:00100000:3.0:1746155640.682815:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32279:x1830976125930368:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4105us (8136us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.682823:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16860 00000100:00100000:0.0:1746155640.683317:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.683379:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125930496 00000100:00100000:2.0:1746155640.683384:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125930496 00002000:00100000:2.0:1746155640.683410:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->4243455) req@ffff88013089b480 x1830976125930496/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.683418:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089b480 with x1830976125930496 ext(4194304->4243455) 00010000:00010000:2.0:1746155640.683424:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 38 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.683652:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 38 pid: 10591 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.683659:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013089b480 00000100:00100000:2.0:1746155640.684193:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1388 00000100:00100000:2.0:1746155640.684201:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1960:x1830976125930496:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155640.688196:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976125930496:12345-192.168.202.51@tcp:4:cat.0 Request processed in 3989us (4873us total) trans 17179874238 rc 0/0 00000100:00100000:2.0:1746155640.688207:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1388 00002000:00100000:2.0:1746155640.688216:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->4243455) req@ffff88013089b480 x1830976125930496/t17179874238(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/448 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.688225:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089b480 with x1830976125930496 ext(4194304->4243455) 00010000:00010000:2.0:1746155640.688233:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 40 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:2.0:1746155640.688247:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 40 pid: 10591 timeout: 869 lvb_type: 0 00002000:00010000:2.0:1746155640.688253:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013089b480 00000100:00100000:0.0:1746155640.692363:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.692479:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125930624 00000100:00100000:1.0:1746155640.692533:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125930624 00010000:00010000:1.0:1746155640.692566:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 40 pid: 10591 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.692602:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8643 00000100:00100000:1.0:1746155640.692609:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125930624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.692620:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.692637:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 40 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.692648:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 40 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.692667:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5355a00/0x844e5faceb5f76bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4243455) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e3c expref: 40 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.692693:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.692695:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.692701:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f770c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e6d expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.692708:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f770c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e6d expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.692738:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f770c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e6d expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.692748:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125346304:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155640.692803:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155640.693915:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125346304:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155640.693940:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.693962:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976125930624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1353us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.693969:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8643 00000100:00100000:0.0:1746155640.700781:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.700822:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.700854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.700891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.700939:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125930880 00000100:00100000:0.0:1746155640.700946:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125930880 00002000:00100000:0.0:1746155640.700991:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880130899180 x1830976125930880/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155640.701001:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899180 with x1830976125930880 ext(2097152->3145727) 00002000:00010000:0.0:1746155640.701006:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899180 00000100:00100000:0.0:1746155640.701020:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125931136 00000100:00100000:0.0:1746155640.701022:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125931136 00002000:00100000:0.0:1746155640.701033:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880130898700 x1830976125931136/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155640.701040:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898700 with x1830976125931136 ext(3145728->4194303) 00002000:00010000:0.0:1746155640.701042:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130898700 00000100:00100000:0.0:1746155640.701051:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125931520 00000100:00100000:0.0:1746155640.701053:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125931520 00000100:00100000:3.0:1746155640.701262:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125931392 00000100:00100000:3.0:1746155640.701266:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125931392 00000100:00100000:1.0:1746155640.701330:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7998 00000100:00100000:1.0:1746155640.701338:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976125930880:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155640.701359:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 7999 00000100:00100000:2.0:1746155640.701367:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976125931136:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:0.0:1746155640.701902:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8801317c5880 x1830976125931520/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155640.701910:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c5880 with x1830976125931520 ext(3145728->4194303) 00002000:00010000:0.0:1746155640.701913:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c5880 00000100:00100000:0.0:1746155640.701935:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8000 00000100:00100000:0.0:1746155640.701941:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1962:x1830976125931520:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:3.0:1746155640.701973:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8801317c4a80 x1830976125931392/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.701980:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4a80 with x1830976125931392 ext(2097152->3145727) 00002000:00010000:3.0:1746155640.701983:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c4a80 00000100:00100000:3.0:1746155640.701994:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8001 00000100:00100000:3.0:1746155640.702000:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1962:x1830976125931392:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155640.709651:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1962:x1830976125931136:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8277us (8821us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.709661:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7999 00002000:00100000:2.0:1746155640.709670:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880130898700 x1830976125931136/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.709678:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898700 with x1830976125931136 ext(3145728->4194303) 00002000:00010000:2.0:1746155640.709682:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130898700 00000100:00100000:1.0:1746155640.711061:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976125930880:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9721us (10285us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155640.711069:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 7998 00002000:00100000:1.0:1746155640.711074:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880130899180 x1830976125930880/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.711082:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130899180 with x1830976125930880 ext(2097152->3145727) 00002000:00010000:1.0:1746155640.711086:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130899180 00000100:00100000:3.0:1746155640.715260:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1962:x1830976125931392:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13251us (14360us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155640.715271:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8001 00002000:00100000:3.0:1746155640.715279:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8801317c4a80 x1830976125931392/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.715287:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4a80 with x1830976125931392 ext(2097152->3145727) 00002000:00010000:3.0:1746155640.715292:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c4a80 00000100:00100000:1.0:1746155640.721376:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1962:x1830976125931520:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19426us (20513us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155640.721386:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8000 00002000:00100000:1.0:1746155640.721394:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8801317c5880 x1830976125931520/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.721403:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c5880 with x1830976125931520 ext(3145728->4194303) 00002000:00010000:1.0:1746155640.721408:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c5880 00000100:00100000:0.0:1746155640.727126:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.727187:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125931904 00000100:00100000:1.0:1746155640.727196:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125931904 00002000:00100000:1.0:1746155640.727233:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8801317c7100 x1830976125931904/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.727242:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c7100 with x1830976125931904 ext(4194304->5083135) 00002000:00010000:1.0:1746155640.727247:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317c7100 00000100:00100000:1.0:1746155640.727279:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8002 00000100:00100000:1.0:1746155640.727287:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125931904:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155640.733747:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125931904:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6452us (6617us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155640.733757:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8002 00002000:00100000:1.0:1746155640.733766:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8801317c7100 x1830976125931904/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.733774:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c7100 with x1830976125931904 ext(4194304->5083135) 00002000:00010000:1.0:1746155640.733779:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317c7100 00000100:00100000:0.0:1746155640.747311:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.747372:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125932160 00000100:00100000:3.0:1746155640.747380:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125932160 00000100:00100000:3.0:1746155640.747430:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11097 00000100:00100000:3.0:1746155640.747438:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32283:x1830976125932160:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155640.747457:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.747471:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0200/0x844e5faceb5f7713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e74 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.747581:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.747594:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e04 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.747600:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7680 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e0b expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.747606:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f76db lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e43 expref: 20 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.747858:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.747885:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f76db lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e43 expref: 20 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.747895:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f76db lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e43 expref: 20 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.747906:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125346432:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.748010:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7680 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e0b expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.748017:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7680 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e0b expref: 294 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.748025:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125346560:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.748053:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e04 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.748060:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e04 expref: 8 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.748068:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125346688:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.748087:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.749561:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125346432:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.749570:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125346560:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155640.749652:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.749679:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.749731:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125932288 00000100:00100000:1.0:1746155640.749735:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125932288 00010000:00010000:1.0:1746155640.749755:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7680 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e0b expref: 295 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.749770:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125932416 00000100:00100000:1.0:1746155640.749772:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125932416 00010000:00010000:1.0:1746155640.749778:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f76db lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e43 expref: 21 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:1.0:1746155640.749798:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8644 00000100:00100000:1.0:1746155640.749802:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1961:x1830976125932288:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.749813:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.749817:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7680 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e0b expref: 295 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.749824:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7680 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e0b expref: 295 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.749838:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7680 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e0b expref: 295 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.749853:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155640.749856:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155640.749863:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155640.749868:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.749892:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1961:x1830976125932288:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 89us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.749898:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8644 00000100:00100000:1.0:1746155640.749911:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8645 00000100:00100000:1.0:1746155640.749915:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976125932416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.749921:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.749934:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f76db lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e43 expref: 21 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.749941:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f76db lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e43 expref: 21 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.749951:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f76db lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e43 expref: 21 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:1.0:1746155640.749959:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155640.749961:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155640.749966:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155640.749970:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.749983:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976125932416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 68us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.749988:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8645 00000100:00100000:2.0:1746155640.751086:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062a00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125346688:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155640.751110:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155640.751529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.751568:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125932544 00000100:00100000:3.0:1746155640.751572:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125932544 00010000:00010000:3.0:1746155640.751590:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e04 expref: 9 pid: 27374 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.751612:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8646 00000100:00100000:3.0:1746155640.751617:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976125932544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155640.751624:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155640.751628:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e04 expref: 9 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.751636:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e04 expref: 9 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.751651:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f7664 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e04 expref: 9 pid: 27374 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.751666:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155640.751669:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.751676:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.751682:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155640.751698:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155640.751717:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125932544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 100us (217us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155640.751721:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155640.751722:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8646 00010000:00010000:2.0:1746155640.751728:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155640.751744:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155640.751865:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0200/0x844e5faceb5f7713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e74 expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.751895:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e74 expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.751901:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155640.751903:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155640.751905:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0000, rc 0) 00000100:00100000:2.0:1746155640.751949:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32283:x1830976125932160:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4511us (4644us total) trans 8589945252 rc 0/0 00000100:00100000:2.0:1746155640.751958:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11097 00000100:00100000:0.0:1746155640.759837:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.760990:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125932672 00000100:00100000:3.0:1746155640.761001:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125932672 00000100:00100000:3.0:1746155640.761051:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16861 00000100:00100000:3.0:1746155640.761057:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32283:x1830976125932672:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155640.761072:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.761085:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e7b expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.761106:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5f76f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e51 expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.761113:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5f7705 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e66 expref: 27 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.761118:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.761120:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.761122:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2502656->2732031] (req 2502656->2732031) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 24 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.761144:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5f7705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e66 expref: 27 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.761153:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5f7705 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e66 expref: 27 pid: 1625 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155640.761166:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125346816:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.761243:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5f76f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e51 expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.761250:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5f76f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e51 expref: 24 pid: 10591 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.761256:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125346944:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.761269:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.764490:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125346816:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.764499:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125346944:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.764555:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2502656->2732031] (req 2502656->2732031) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 24 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.764568:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a626fc00, rc 0) 00000100:00100000:3.0:1746155640.764600:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32283:x1830976125932672:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3543us (4772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.764607:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16861 00000100:00100000:0.0:1746155640.765614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.765664:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.766312:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125932928 00000100:00100000:2.0:1746155640.766318:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125932928 00010000:00010000:2.0:1746155640.766343:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5f7705 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e66 expref: 28 pid: 1625 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155640.766352:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125932800 00000100:00100000:3.0:1746155640.766355:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125932800 00010000:00010000:3.0:1746155640.766368:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5f76f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e51 expref: 24 pid: 10591 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.766917:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8647 00000100:00100000:3.0:1746155640.766934:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1962:x1830976125932928:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155640.766945:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155640.766963:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5f7705 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e66 expref: 28 pid: 1625 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746155640.766972:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5f7705 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e66 expref: 28 pid: 1625 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746155640.766990:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e600/0x844e5faceb5f7705 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e66 expref: 28 pid: 1625 timeout: 869 lvb_type: 1 00010000:00010000:3.0:1746155640.767011:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155640.767039:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1962:x1830976125932928:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 115us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.767045:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8647 00000100:00100000:3.0:1746155640.767056:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8648 00000100:00100000:3.0:1746155640.767061:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125932800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155640.767066:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155640.767073:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5f76f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e51 expref: 24 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.767081:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5f76f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e51 expref: 24 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.767095:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880133832800/0x844e5faceb5f76f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e51 expref: 24 pid: 10591 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.767116:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.767118:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.767123:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 23 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.767131:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 23 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.767154:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 23 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155640.767164:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125347072:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155640.767207:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.768445:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125347072:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155640.768457:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155640.768483:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976125932800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1423us (2819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.768488:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8648 00000100:00100000:0.0:1746155640.769330:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.770122:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125933184 00000100:00100000:1.0:1746155640.770128:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125933184 00002000:00100000:1.0:1746155640.770158:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2502656->2506751) req@ffff8801317c7800 x1830976125933184/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.770165:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c7800 with x1830976125933184 ext(2502656->2506751) 00002000:00010000:1.0:1746155640.770170:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c7800 00000100:00100000:1.0:1746155640.770199:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8003 00000100:00100000:1.0:1746155640.770205:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125933184:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155640.770335:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125933184:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 129us (1006us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155640.770341:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8003 00002000:00100000:1.0:1746155640.770346:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2502656->2506751) req@ffff8801317c7800 x1830976125933184/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/4536 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.770353:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c7800 with x1830976125933184 ext(2502656->2506751) 00002000:00010000:1.0:1746155640.770355:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c7800 00000100:00100000:0.0:1746155640.773791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.774151:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.774218:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125933440 00000100:00100000:2.0:1746155640.774218:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125933696 00000100:00100000:3.0:1746155640.774224:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125933440 00000100:00100000:2.0:1746155640.774224:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125933696 00000100:00100000:2.0:1746155640.774253:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11098 00002000:00100000:3.0:1746155640.774254:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2727936->2732031) req@ffff8801317c7b80 x1830976125933440/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746155640.774257:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32287:x1830976125933696:12345-192.168.202.51@tcp:101:cat.0 00002000:00100000:3.0:1746155640.774267:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c7b80 with x1830976125933440 ext(2727936->2732031) 00010000:00010000:2.0:1746155640.774272:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746155640.774273:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c7b80 00010000:00010000:2.0:1746155640.774284:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081000/0x844e5faceb5f772f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e82 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155640.774287:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8004 00000100:00100000:3.0:1746155640.774292:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976125933440:12345-192.168.202.51@tcp:3:multiop.0 00010000:00010000:2.0:1746155640.774351:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080a00/0x844e5faceb5f7736 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774359:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080a00/0x844e5faceb5f7736 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774367:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080a00/0x844e5faceb5f7736 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774374:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081c00/0x844e5faceb5f773d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774377:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081c00/0x844e5faceb5f773d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774380:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081c00/0x844e5faceb5f773d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155640.774419:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976125933440:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 126us (633us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155640.774425:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8004 00002000:00100000:3.0:1746155640.774431:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2727936->2732031) req@ffff8801317c7b80 x1830976125933440/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/4536 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.774437:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c7b80 with x1830976125933440 ext(2727936->2732031) 00002000:00010000:3.0:1746155640.774440:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c7b80 00010000:00010000:2.0:1746155640.774441:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x844e5faceb5f7744 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774446:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x844e5faceb5f7744 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774449:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x844e5faceb5f7744 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155640.774454:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155640.774519:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080a00/0x844e5faceb5f7736 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774522:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080a00/0x844e5faceb5f7736 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774526:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080a00/0x844e5faceb5f7736 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774529:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f080a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155640.774531:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080a00/0x844e5faceb5f7736 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774534:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080a00/0x844e5faceb5f7736 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774540:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155640.774542:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155640.774544:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080a00/0x844e5faceb5f7736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774546:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080a00/0x844e5faceb5f7736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774557:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081c00/0x844e5faceb5f773d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774560:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081c00/0x844e5faceb5f773d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774562:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081c00/0x844e5faceb5f773d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774564:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f081c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155640.774565:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081c00/0x844e5faceb5f773d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774568:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081c00/0x844e5faceb5f773d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774570:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800912d5600) 00010000:00010000:2.0:1746155640.774571:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155640.774572:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081c00/0x844e5faceb5f773d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774575:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081c00/0x844e5faceb5f773d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155640.774595:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081000/0x844e5faceb5f772f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e82 expref: 297 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.774601:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x844e5faceb5f7744 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e82 expref: 296 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.774604:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155640.774606:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155640.774607:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f080c00, rc 0) 00000100:00100000:2.0:1746155640.774620:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32287:x1830976125933696:12345-192.168.202.51@tcp:101:cat.0 Request processed in 364us (471us total) trans 8589945253 rc 0/0 00000100:00100000:2.0:1746155640.774624:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11098 00000100:00100000:0.0:1746155640.777380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.777846:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125933952 00000100:00100000:1.0:1746155640.777852:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125933952 00000100:00100000:1.0:1746155640.777894:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4706 00000100:00100000:1.0:1746155640.777900:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32287:x1830976125933952:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155640.778063:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:32287:x1830976125933952:12345-192.168.202.51@tcp:35:cat.0 Request processed in 163us (689us total) trans 8589945254 rc 0/0 00000100:00100000:1.0:1746155640.778069:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4706 00000100:00100000:0.0:1746155640.780262:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.780345:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125934080 00000100:00100000:3.0:1746155640.780350:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125934080 00000100:00100000:3.0:1746155640.780386:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16862 00000100:00100000:3.0:1746155640.780392:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976125934080:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155640.780405:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.780418:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0x844e5faceb5f7752 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e89 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.780435:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.780437:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.780444:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0x844e5faceb5f7752 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e89 expref: 40 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.780463:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0x844e5faceb5f7752 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e89 expref: 40 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.780472:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ee1400, rc 0) 00000100:00100000:3.0:1746155640.780527:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976125934080:12345-192.168.202.51@tcp:101:cat.0 Request processed in 134us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.780531:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16862 00000100:00100000:0.0:1746155640.796133:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.796182:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.796271:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125934464 00000100:00100000:3.0:1746155640.796282:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125934464 00002000:00100000:3.0:1746155640.796320:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880130c9d500 x1830976125934464/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.796330:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9d500 with x1830976125934464 ext(3145728->4194303) 00002000:00010000:3.0:1746155640.796334:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9d500 00000100:00100000:3.0:1746155640.796348:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125934336 00000100:00100000:3.0:1746155640.796350:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125934336 00002000:00100000:3.0:1746155640.796360:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880130c9ea00 x1830976125934336/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.796366:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ea00 with x1830976125934336 ext(2097152->3145727) 00002000:00010000:3.0:1746155640.796369:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9ea00 00000100:00100000:0.0:1746155640.796385:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.796406:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.796421:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125934976 00000100:00100000:3.0:1746155640.796424:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125934976 00000100:00100000:0.0:1746155640.796429:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125934848 00000100:00100000:0.0:1746155640.796431:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125934848 00002000:00100000:0.0:1746155640.796446:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3375103) req@ffff880130c9fb80 x1830976125934848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 504/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.796451:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3375104->4194303) req@ffff880130c9e680 x1830976125934976/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155640.796454:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9fb80 with x1830976125934848 ext(2097152->3375103) 00002000:00010000:0.0:1746155640.796456:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9fb80 00002000:00100000:3.0:1746155640.796457:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9e680 with x1830976125934976 ext(3375104->4194303) 00002000:00010000:3.0:1746155640.796460:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9e680 00000100:00100000:0.0:1746155640.796469:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8005 00000100:00100000:3.0:1746155640.796474:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8006 00000100:00100000:0.0:1746155640.796475:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1961:x1830976125934464:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155640.796478:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1961:x1830976125934336:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155640.796492:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8007 00000100:00100000:0.0:1746155640.796496:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125934848:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155640.796526:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8008 00000100:00100000:1.0:1746155640.796532:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125934976:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155640.811899:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976125934976:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15358us (15505us total) trans 0 rc 819200/819200 00000100:00100000:1.0:1746155640.811909:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8008 00002000:00100000:1.0:1746155640.811918:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3375104->4194303) req@ffff880130c9e680 x1830976125934976/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 819200/819200 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.811951:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9e680 with x1830976125934976 ext(3375104->4194303) 00002000:00010000:1.0:1746155640.811956:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9e680 00000100:00100000:2.0:1746155640.815156:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125934336:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18662us (18959us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.815168:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8006 00002000:00100000:2.0:1746155640.815180:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880130c9ea00 x1830976125934336/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.815188:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ea00 with x1830976125934336 ext(2097152->3145727) 00002000:00010000:2.0:1746155640.815193:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9ea00 00000100:00100000:2.0:1746155640.818829:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976125934848:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22324us (22414us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.818837:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8007 00002000:00100000:2.0:1746155640.818845:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3375103) req@ffff880130c9fb80 x1830976125934848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 504/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.818854:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9fb80 with x1830976125934848 ext(2097152->3375103) 00002000:00010000:2.0:1746155640.818858:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9fb80 00000100:00100000:0.0:1746155640.821057:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.822318:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125935360 00000100:00100000:2.0:1746155640.822327:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125935360 00002000:00100000:2.0:1746155640.822362:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880130c9f100 x1830976125935360/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.822372:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9f100 with x1830976125935360 ext(4194304->5083135) 00002000:00010000:2.0:1746155640.822376:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9f100 00000100:00100000:2.0:1746155640.822404:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8009 00000100:00100000:2.0:1746155640.822411:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976125935360:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155640.826152:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125934464:12345-192.168.202.51@tcp:3:cat.0 Request processed in 29669us (30019us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155640.826163:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8005 00002000:00100000:1.0:1746155640.826174:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880130c9d500 x1830976125934464/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155640.826187:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9d500 with x1830976125934464 ext(3145728->4194303) 00002000:00010000:1.0:1746155640.826191:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9d500 00000100:00100000:0.0:1746155640.829168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.829268:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125935616 00000100:00100000:1.0:1746155640.829275:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125935616 00000100:00100000:2.0:1746155640.829456:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976125935360:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7044us (8406us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155640.829465:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8009 00002000:00100000:2.0:1746155640.829473:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880130c9f100 x1830976125935360/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.829482:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9f100 with x1830976125935360 ext(4194304->5083135) 00002000:00010000:2.0:1746155640.829486:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9f100 00000100:00100000:1.0:1746155640.829770:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11099 00000100:00100000:1.0:1746155640.829777:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32290:x1830976125935616:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155640.829793:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155640.829806:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x844e5faceb5f7759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e90 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.829887:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x844e5faceb5f7760 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.829899:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x844e5faceb5f7760 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.829908:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x844e5faceb5f7760 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155640.829915:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155640.830016:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e7400/0x844e5faceb5f7759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e90 expref: 23 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.830048:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x844e5faceb5f7760 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e90 expref: 22 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.830055:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155640.830057:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155640.830060:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e6e00, rc 0) 00000100:00100000:1.0:1746155640.830271:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32290:x1830976125935616:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 494us (1109us total) trans 8589945255 rc 0/0 00000100:00100000:1.0:1746155640.830276:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11099 00000100:00100000:0.0:1746155640.845658:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.845749:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125935744 00000100:00100000:3.0:1746155640.845757:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125935744 00000100:00100000:3.0:1746155640.845810:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16863 00000100:00100000:3.0:1746155640.845818:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32290:x1830976125935744:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155640.845832:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.845845:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e97 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.845874:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c286600/0x844e5faceb5f758b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d7f expref: 39 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.845882:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f761e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dd3 expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.845889:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129e28c00/0x844e5faceb5f7592 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d86 expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.845894:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.845895:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.845898:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [798720->1048575] (req 798720->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 13 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.845922:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129e28c00/0x844e5faceb5f7592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d86 expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.845947:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129e28c00/0x844e5faceb5f7592 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d86 expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155640.845957:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125347200:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.846051:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f761e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dd3 expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.846059:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f761e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dd3 expref: 12 pid: 1625 timeout: 869 lvb_type: 1 00000100:00100000:3.0:1746155640.846067:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125347328:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.846103:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c286600/0x844e5faceb5f758b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d7f expref: 39 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.846110:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c286600/0x844e5faceb5f758b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d7f expref: 39 pid: 18270 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.846118:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125347456:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.846134:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.848863:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125347200:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.848872:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125347328:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.848879:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125347456:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.848909:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [798720->1048575] (req 798720->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 13 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.848923:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ee0200, rc 0) 00000100:00100000:3.0:1746155640.848994:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32290:x1830976125935744:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3176us (3342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.849001:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16863 00000100:00100000:0.0:1746155640.849393:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.849523:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125936000 00000100:00100000:3.0:1746155640.849528:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125936000 00010000:00010000:3.0:1746155640.849548:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c286600/0x844e5faceb5f758b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d7f expref: 40 pid: 18270 timeout: 869 lvb_type: 0 00000100:00100000:3.0:1746155640.849577:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8649 00000100:00100000:3.0:1746155640.849583:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125936000:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155640.849595:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155640.849614:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c286600/0x844e5faceb5f758b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d7f expref: 40 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.849623:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c286600/0x844e5faceb5f758b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d7f expref: 40 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.849641:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c286600/0x844e5faceb5f758b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d7f expref: 40 pid: 18270 timeout: 869 lvb_type: 0 00010000:00010000:3.0:1746155640.849654:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155640.849679:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976125936000:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 96us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.849688:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8649 00000100:00100000:0.0:1746155640.850255:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.850544:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125935872 00000100:00100000:1.0:1746155640.850548:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125935872 00010000:00010000:1.0:1746155640.850564:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f761e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dd3 expref: 13 pid: 1625 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746155640.850588:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8650 00000100:00100000:1.0:1746155640.850593:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976125935872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.850601:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.850609:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f761e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dd3 expref: 13 pid: 1625 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.850617:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f761e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dd3 expref: 13 pid: 1625 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.850634:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093ed1200/0x844e5faceb5f761e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dd3 expref: 13 pid: 1625 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.850645:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.850673:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976125935872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 80us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.850678:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8650 00000100:00100000:3.0:1746155640.851319:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.851379:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125936128 00000100:00100000:1.0:1746155640.851382:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125936128 00010000:00010000:1.0:1746155640.851395:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129e28c00/0x844e5faceb5f7592 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d86 expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00000100:00100000:1.0:1746155640.851420:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8651 00000100:00100000:1.0:1746155640.851426:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976125936128:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.851432:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.851440:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff880129e28c00/0x844e5faceb5f7592 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d86 expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.851448:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129e28c00/0x844e5faceb5f7592 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d86 expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.851459:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129e28c00/0x844e5faceb5f7592 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d86 expref: 13 pid: 18270 timeout: 869 lvb_type: 1 00010000:00010000:1.0:1746155640.851468:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.851470:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.851475:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 12 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.851483:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 12 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.851531:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 12 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.851542:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125347584:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155640.851681:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155640.853421:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125347584:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155640.853434:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.853554:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125936128:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2126us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.853561:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8651 00000100:00100000:0.0:1746155640.854316:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.854390:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125936384 00000100:00100000:2.0:1746155640.854396:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125936384 00002000:00100000:2.0:1746155640.854428:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (798720->802815) req@ffff880130c9df80 x1830976125936384/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.854436:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9df80 with x1830976125936384 ext(798720->802815) 00002000:00010000:2.0:1746155640.854440:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9df80 00000100:00100000:2.0:1746155640.854467:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8010 00000100:00100000:2.0:1746155640.854474:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125936384:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155640.854617:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976125936384:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 142us (301us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155640.854622:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8010 00002000:00100000:2.0:1746155640.854628:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (798720->802815) req@ffff880130c9df80 x1830976125936384/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/4536 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.854633:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9df80 with x1830976125936384 ext(798720->802815) 00002000:00010000:2.0:1746155640.854637:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9df80 00000100:00100000:0.0:1746155640.854810:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.854870:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125936512 00000100:00100000:3.0:1746155640.854873:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125936512 00000100:00100000:3.0:1746155640.854962:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16864 00000100:00100000:3.0:1746155640.854968:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1963:x1830976125936512:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155640.854977:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.854988:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7775 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17e9e expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155640.855021:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125347712:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155640.855079:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746155640.855923:0:20200:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime: 1746155640 -> 1746155641 00000100:00100000:3.0:1746155640.855950:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125347712:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155640.855966:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7775 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e9e expref: 28 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.855976:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7775 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e9e expref: 28 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.856001:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a36000, rc 0) 00000100:00100000:3.0:1746155640.856032:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1963:x1830976125936512:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1063us (1221us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155640.856037:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16864 00000100:00100000:0.0:1746155640.857865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.857941:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125936640 00000100:00100000:3.0:1746155640.857947:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125936640 00000100:00100000:3.0:1746155640.857988:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16865 00000100:00100000:3.0:1746155640.857995:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:32290:x1830976125936640:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155640.858006:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.858018:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ea5 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.858039:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129e28400/0x844e5faceb5f7599 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d8d expref: 22 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.858046:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e00600/0x844e5faceb5f7633 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dda expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.858053:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c51a000/0x844e5faceb5f75ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db7 expref: 28 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.858058:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.858060:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155640.858063:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [1048576->1183743] (req 1048576->1183743) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.858086:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c51a000/0x844e5faceb5f75ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db7 expref: 28 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.858095:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c51a000/0x844e5faceb5f75ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db7 expref: 28 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746155640.858105:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125347840:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.858625:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e00600/0x844e5faceb5f7633 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dda expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.858634:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e00600/0x844e5faceb5f7633 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dda expref: 12 pid: 1625 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746155640.858643:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125347968:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.858758:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129e28400/0x844e5faceb5f7599 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d8d expref: 22 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.858766:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129e28400/0x844e5faceb5f7599 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d8d expref: 22 pid: 18270 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155640.858773:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125348096:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.858789:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.859225:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125347840:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155640.859454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.859754:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125936896 00000100:00100000:2.0:1746155640.859758:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125936896 00002000:00100000:2.0:1746155640.859783:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (0->798719) req@ffff880130c9ca80 x1830976125936896/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.859790:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ca80 with x1830976125936896 ext(0->798719) 00002000:00010000:2.0:1746155640.859795:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9ca80 00000100:00100000:3.0:1746155640.859882:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125347968:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.859889:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125348096:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155640.860000:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8011 00000100:00100000:2.0:1746155640.860007:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1963:x1830976125936896:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:3.0:1746155640.860937:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [1048576->1183743] (req 1048576->1183743) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.860949:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a36c00, rc 0) 00000100:00100000:3.0:1746155640.860973:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:32290:x1830976125936640:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2978us (3110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.860982:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16865 00000100:00100000:2.0:1746155640.861151:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.861170:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125937152 00000100:00100000:2.0:1746155640.861172:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.861174:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125937152 00010000:00010000:0.0:1746155640.861191:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129e28400/0x844e5faceb5f7599 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d8d expref: 23 pid: 18270 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155640.862166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.862264:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125937024 00000100:00100000:3.0:1746155640.862268:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125937024 00000100:00100000:2.0:1746155640.862272:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125937280 00000100:00100000:2.0:1746155640.862274:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125937280 00010000:00010000:3.0:1746155640.862282:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e00600/0x844e5faceb5f7633 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dda expref: 13 pid: 1625 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746155640.862283:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c51a000/0x844e5faceb5f75ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db7 expref: 28 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746155640.862298:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8652 00000100:00100000:3.0:1746155640.862301:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8653 00000100:00100000:2.0:1746155640.862303:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976125937152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155640.862305:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1960:x1830976125937280:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155640.862310:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155640.862310:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155640.862324:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c51a000/0x844e5faceb5f75ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db7 expref: 28 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746155640.862324:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129e28400/0x844e5faceb5f7599 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d8d expref: 23 pid: 18270 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155640.862332:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129e28400/0x844e5faceb5f7599 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d8d expref: 23 pid: 18270 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155640.862362:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8654 00000100:00100000:1.0:1746155640.862368:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125937024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.862373:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155640.862454:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c51a000/0x844e5faceb5f75ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db7 expref: 28 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746155640.862472:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129e28400/0x844e5faceb5f7599 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d8d expref: 23 pid: 18270 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155640.862475:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c51a000/0x844e5faceb5f75ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db7 expref: 28 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155640.862483:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155640.862484:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155640.862526:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e00600/0x844e5faceb5f7633 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dda expref: 13 pid: 1625 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746155640.862535:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e00600/0x844e5faceb5f7633 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dda expref: 13 pid: 1625 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746155640.862546:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e00600/0x844e5faceb5f7633 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dda expref: 13 pid: 1625 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746155640.862547:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976125937280:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 241us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.862553:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8653 00010000:00010000:1.0:1746155640.862555:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.862557:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.862562:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.862568:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.862594:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.862604:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125348224:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155640.862646:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976125937152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 342us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.862651:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8652 00000100:00100000:1.0:1746155640.862738:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155640.865011:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1963:x1830976125936896:12345-192.168.202.51@tcp:3:cat.0 Request processed in 4999us (5552us total) trans 0 rc 798720/798720 00000100:00100000:2.0:1746155640.865019:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8011 00002000:00100000:2.0:1746155640.865027:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (0->798719) req@ffff880130c9ca80 x1830976125936896/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 798720/798720 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.865034:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ca80 with x1830976125936896 ext(0->798719) 00002000:00010000:2.0:1746155640.865038:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880130c9ca80 00000100:00100000:1.0:1746155640.865668:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125348224:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155640.865684:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.865705:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125937024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3337us (4532us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.865711:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8654 00000100:00100000:0.0:1746155640.867965:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.868014:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125937536 00000100:00100000:2.0:1746155640.868020:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125937536 00002000:00100000:2.0:1746155640.868127:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1179648->1183743) req@ffff880130c9ce00 x1830976125937536/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.868139:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ce00 with x1830976125937536 ext(1179648->1183743) 00002000:00010000:2.0:1746155640.868143:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9ce00 00000100:00100000:2.0:1746155640.868169:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8012 00000100:00100000:2.0:1746155640.868175:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976125937536:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155640.868356:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976125937536:12345-192.168.202.51@tcp:3:cat.0 Request processed in 180us (397us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155640.868363:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8012 00002000:00100000:2.0:1746155640.868367:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1179648->1183743) req@ffff880130c9ce00 x1830976125937536/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/4536 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.868374:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9ce00 with x1830976125937536 ext(1179648->1183743) 00002000:00010000:2.0:1746155640.868377:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9ce00 00000100:00100000:0.0:1746155640.872358:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.872536:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125937792 00000100:00100000:2.0:1746155640.872544:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125937792 00002000:00100000:2.0:1746155640.872574:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1183744->2097151) req@ffff880130c9e300 x1830976125937792/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.872582:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9e300 with x1830976125937792 ext(1183744->2097151) 00002000:00010000:2.0:1746155640.872587:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9e300 00000100:00100000:2.0:1746155640.872614:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8013 00000100:00100000:2.0:1746155640.872621:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1962:x1830976125937792:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155640.877883:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1962:x1830976125937792:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5254us (5522us total) trans 0 rc 913408/913408 00000100:00100000:2.0:1746155640.877896:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8013 00002000:00100000:2.0:1746155640.877904:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1183744->2097151) req@ffff880130c9e300 x1830976125937792/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 913408/913408 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.877913:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9e300 with x1830976125937792 ext(1183744->2097151) 00002000:00010000:2.0:1746155640.877918:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130c9e300 00000100:00100000:0.0:1746155640.883836:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.883949:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125937920 00000100:00100000:3.0:1746155640.883957:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125937920 00000100:00100000:3.0:1746155640.884005:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16866 00000100:00100000:3.0:1746155640.884012:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:32294:x1830976125937920:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155640.884027:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155640.884040:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f7783 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17eac expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.884064:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 21 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.884071:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155640.884072:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155640.884075:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f7783 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eac expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.884213:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 21 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.884224:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 21 pid: 20200 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155640.884316:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125348352:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155640.884637:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155640.885759:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125348352:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155640.885779:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f7783 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eac expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155640.885789:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094ee0000, rc 0) 00000100:00100000:3.0:1746155640.885815:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:32294:x1830976125937920:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1803us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.885823:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16866 00000100:00100000:0.0:1746155640.887017:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.887131:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125938048 00000100:00100000:2.0:1746155640.887136:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125938048 00002000:00100000:2.0:1746155640.887164:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2502656->2732031) req@ffff880130c9f480 x1830976125938048/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.887179:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9f480 with x1830976125938048 ext(2502656->2732031) 00010000:00010000:2.0:1746155640.887186:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 22 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155640.887197:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 22 pid: 20200 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746155640.887203:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130c9f480 00000100:00100000:2.0:1746155640.887234:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1389 00000100:00100000:2.0:1746155640.887240:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976125938048:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155640.891221:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976125938048:12345-192.168.202.51@tcp:4:cat.0 Request processed in 3973us (4198us total) trans 21474841563 rc 0/0 00000100:00100000:2.0:1746155640.891231:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1389 00002000:00100000:2.0:1746155640.891240:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2502656->2732031) req@ffff880130c9f480 x1830976125938048/t21474841563(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/448 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.891249:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130c9f480 with x1830976125938048 ext(2502656->2732031) 00010000:00010000:2.0:1746155640.891257:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 24 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155640.891278:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 24 pid: 20200 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746155640.891286:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880130c9f480 00000100:00100000:0.0:1746155640.894337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.894392:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125938176 00000100:00100000:1.0:1746155640.894398:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125938176 00010000:00010000:1.0:1746155640.894426:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 24 pid: 20200 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155640.894460:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8655 00000100:00100000:1.0:1746155640.894466:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976125938176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155640.894477:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155640.894493:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 24 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155640.894541:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 24 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155640.894564:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a626fc00/0x844e5faceb5f7728 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2502656->2732031) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e7b expref: 24 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155640.894586:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.894588:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.894593:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f7783 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eac expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.894599:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f7783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eac expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.894692:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f7783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eac expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.894703:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125348480:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155640.894770:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155640.896034:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125348480:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155640.896048:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155640.896070:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976125938176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1604us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.896077:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8655 00000100:00100000:0.0:1746155640.899532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.899996:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.900066:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125938432 00000100:00100000:0.0:1746155640.900073:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125938432 00002000:00100000:0.0:1746155640.900106:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800910d9500 x1830976125938432/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155640.900116:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d9500 with x1830976125938432 ext(2097152->3145727) 00002000:00010000:0.0:1746155640.900121:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910d9500 00000100:00100000:0.0:1746155640.900145:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125938560 00000100:00100000:0.0:1746155640.900147:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125938560 00002000:00100000:0.0:1746155640.900159:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009fb68a80 x1830976125938560/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155640.900165:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68a80 with x1830976125938560 ext(3145728->4194303) 00002000:00010000:0.0:1746155640.900168:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb68a80 00000100:00100000:0.0:1746155640.900180:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8014 00000100:00100000:0.0:1746155640.900186:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976125938432:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155640.900382:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8015 00000100:00100000:2.0:1746155640.900388:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1961:x1830976125938560:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155640.907351:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1960:x1830976125938432:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7156us (7847us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.907362:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8014 00002000:00100000:2.0:1746155640.907372:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800910d9500 x1830976125938432/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.907380:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d9500 with x1830976125938432 ext(2097152->3145727) 00002000:00010000:2.0:1746155640.907385:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910d9500 00000100:00100000:2.0:1746155640.908935:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125938560:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8533us (8926us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155640.908943:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8015 00002000:00100000:2.0:1746155640.908950:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009fb68a80 x1830976125938560/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155640.908957:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68a80 with x1830976125938560 ext(3145728->4194303) 00002000:00010000:2.0:1746155640.908962:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb68a80 00000100:00100000:0.0:1746155640.956823:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155640.957017:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125938944 00000100:00100000:1.0:1746155640.957026:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125938944 00000100:00100000:1.0:1746155640.957079:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11100 00000100:00100000:1.0:1746155640.957086:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:32299:x1830976125938944:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155640.957108:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155640.957122:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131331c00/0x844e5faceb5f778a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17eb3 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.957205:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131331e00/0x844e5faceb5f7791 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957693:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131331e00/0x844e5faceb5f7791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957703:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131331e00/0x844e5faceb5f7791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957716:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131331800/0x844e5faceb5f7798 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957722:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131331800/0x844e5faceb5f7798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957726:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131331800/0x844e5faceb5f7798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957845:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131331600/0x844e5faceb5f779f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957854:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131331600/0x844e5faceb5f779f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957860:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131331600/0x844e5faceb5f779f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155640.957866:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155640.957941:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131331e00/0x844e5faceb5f7791 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957951:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131331e00/0x844e5faceb5f7791 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957956:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131331e00/0x844e5faceb5f7791 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957961:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131331e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155640.957964:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131331e00/0x844e5faceb5f7791 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957970:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131331e00/0x844e5faceb5f7791 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957979:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155640.957981:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155640.957984:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131331e00/0x844e5faceb5f7791 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.957988:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131331e00/0x844e5faceb5f7791 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.958626:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131331800/0x844e5faceb5f7798 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.958633:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131331800/0x844e5faceb5f7798 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.958638:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131331800/0x844e5faceb5f7798 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.958642:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131331800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155640.958644:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131331800/0x844e5faceb5f7798 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.958652:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131331800/0x844e5faceb5f7798 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.958658:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c700) 00010000:00010000:1.0:1746155640.958660:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155640.958662:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131331800/0x844e5faceb5f7798 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.958666:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131331800/0x844e5faceb5f7798 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155640.958703:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131331c00/0x844e5faceb5f778a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eb3 expref: 300 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.958714:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131331600/0x844e5faceb5f779f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eb3 expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.958719:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155640.958721:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155640.958723:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131331600, rc 0) 00000100:00100000:1.0:1746155640.958778:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:32299:x1830976125938944:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1691us (1961us total) trans 8589945256 rc 0/0 00000100:00100000:1.0:1746155640.958785:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11100 00000100:00100000:0.0:1746155640.962059:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.962405:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125939200 00000100:00100000:2.0:1746155640.962413:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125939200 00000100:00100000:2.0:1746155640.962455:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4707 00000100:00100000:2.0:1746155640.962461:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:32299:x1830976125939200:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155640.962724:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:32299:x1830976125939200:12345-192.168.202.51@tcp:35:cat.0 Request processed in 262us (671us total) trans 8589945257 rc 0/0 00000100:00100000:2.0:1746155640.962730:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4707 00000100:00100000:0.0:1746155640.963177:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746155640.963188:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125348608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746155640.963221:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155640.963365:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125348608 00000100:00100000:1.0:1746155640.963370:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125348608 00000100:00100000:1.0:1746155640.963388:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1746155640.963393:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3298:x1830976125348608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746155640.963406:0:8440:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 657391616 pending 27262976 free 3850371072 avail 3848273920 00000100:00100000:1.0:1746155640.963434:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3298:x1830976125348608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155640.963439:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1746155640.963498:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.963529:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125348736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746155640.963538:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125939328 00000100:00100000:2.0:1746155640.963541:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125939328 00000100:00100000:2.0:1746155640.963561:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 751 00000100:00100000:2.0:1746155640.963565:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1961:x1830976125939328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155640.963572:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155640.963590:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131331600/0x844e5faceb5f779f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eb3 expref: 300 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.963601:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155640.963605:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155640.963623:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1961:x1830976125939328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 58us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.963628:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 751 00000100:00100000:0.0:1746155640.963778:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155640.963812:0:21354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125348736 00000100:00100000:3.0:1746155640.963817:0:21354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125348736 00000100:00100000:0.0:1746155640.963823:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125348608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746155640.963835:0:21354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1746155640.963840:0:21354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+59:3298:x1830976125348736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746155640.963849:0:21354:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 679411712 pending 20447232 free 3849322496 avail 3847225344 00000100:00100000:3.0:1746155640.963882:0:21354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+59:3298:x1830976125348736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.963887:0:21354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1746155640.964875:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125348736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746155640.965865:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.965895:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155640.965934:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.966685:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125939456 00000100:00100000:2.0:1746155640.966692:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125939456 00000100:00100000:1.0:1746155640.966713:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125939584 00000100:00100000:1.0:1746155640.966717:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125939584 00000100:00100000:2.0:1746155640.966729:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125939712 00000100:00100000:2.0:1746155640.966731:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125939712 00000100:00100000:1.0:1746155640.966738:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16867 00000100:00100000:1.0:1746155640.966744:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976125939456:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155640.966756:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155640.966771:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131331200/0x844e5faceb5f77ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17eba expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155640.966814:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125348864:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155640.966860:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155640.966869:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16868 00000100:00100000:2.0:1746155640.966876:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976125939584:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155640.966883:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155640.966892:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135f77400/0x844e5faceb5f77b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ec1 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155640.966917:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125348992:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155640.966956:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155640.966957:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16869 00000100:00100000:1.0:1746155640.966963:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125939712:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155640.966969:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155640.966975:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131330a00/0x844e5faceb5f77bb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ec8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155640.966985:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.966987:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155640.966993:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131330a00/0x844e5faceb5f77bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ec8 expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155640.967005:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131330a00/0x844e5faceb5f77bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ec8 expref: 26 pid: 8437 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746155640.968736:0:1625:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime: 1746155640 -> 1746155641 00002000:00010000:3.0:1746155640.968740:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime: 1746155640 -> 1746155641 00002000:00010000:3.0:1746155640.968742:0:1625:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime: 1746155640 -> 1746155641 00000100:00100000:3.0:1746155640.968756:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125348992:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155640.968774:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135f77400/0x844e5faceb5f77b4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ec1 expref: 26 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155640.968784:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135f77400/0x844e5faceb5f77b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ec1 expref: 26 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155640.968789:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131330a00, rc 0) 00010000:00010000:3.0:1746155640.968796:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f77400, rc 0) 00000100:00100000:3.0:1746155640.968814:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125939584:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1939us (2918us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155640.968815:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125939712:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1852us (2890us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155640.968819:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16868 00000100:00100000:1.0:1746155640.968822:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16869 00002000:00010000:2.0:1746155640.969060:0:20796:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime: 1746155640 -> 1746155641 00002000:00010000:2.0:1746155640.969062:0:20796:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime: 1746155640 -> 1746155641 00002000:00010000:2.0:1746155640.969064:0:20796:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime: 1746155640 -> 1746155641 00000100:00100000:2.0:1746155640.969074:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125348864:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155640.969089:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131331200/0x844e5faceb5f77ad lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eba expref: 40 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.969096:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131331200/0x844e5faceb5f77ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eba expref: 40 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155640.969104:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131331200, rc 0) 00000100:00100000:2.0:1746155640.969122:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976125939456:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2378us (3259us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155640.969127:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16867 00000100:00100000:0.0:1746155640.972950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.974615:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125939840 00000100:00100000:2.0:1746155640.974624:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125939840 00000100:00100000:2.0:1746155640.974666:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16870 00000100:00100000:2.0:1746155640.974673:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:32299:x1830976125939840:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155640.974688:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155640.974703:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f76800/0x844e5faceb5f77c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ecf expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.974729:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.974735:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155640.974737:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155640.974740:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f76800/0x844e5faceb5f77c2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ecf expref: 40 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.974764:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.974775:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 11 pid: 20200 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155640.974785:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125349120:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155640.975543:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155640.978077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.978492:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125349120:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155640.978542:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135f76800/0x844e5faceb5f77c2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ecf expref: 40 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.978556:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f76800, rc 0) 00000100:00100000:2.0:1746155640.978593:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:32299:x1830976125939840:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3920us (5650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.978601:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16870 00000100:00100000:3.0:1746155640.978660:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125939968 00000100:00100000:3.0:1746155640.978665:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125939968 00002000:00100000:3.0:1746155640.978694:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (798720->1048575) req@ffff8800910d8e00 x1830976125939968/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.978702:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8e00 with x1830976125939968 ext(798720->1048575) 00010000:00010000:3.0:1746155640.978708:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 12 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155640.978718:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 12 pid: 20200 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746155640.978724:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910d8e00 00000100:00100000:3.0:1746155640.978736:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1390 00000100:00100000:3.0:1746155640.978741:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976125939968:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155640.983903:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125939968:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5153us (5822us total) trans 17179874239 rc 0/0 00000100:00100000:3.0:1746155640.983914:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1390 00002000:00100000:3.0:1746155640.983934:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (798720->1048575) req@ffff8800910d8e00 x1830976125939968/t17179874239(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:711/0 lens 488/448 e 0 to 0 dl 1746155651 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.983942:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8e00 with x1830976125939968 ext(798720->1048575) 00010000:00010000:3.0:1746155640.983951:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 14 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155640.983963:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 14 pid: 20200 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746155640.983970:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910d8e00 00000100:00100000:0.0:1746155640.990433:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155640.990492:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125940096 00000100:00100000:2.0:1746155640.990499:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125940096 00010000:00010000:2.0:1746155640.990558:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 14 pid: 20200 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155640.990585:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8656 00000100:00100000:2.0:1746155640.990591:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976125940096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155640.990604:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155640.990622:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 14 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155640.990637:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 14 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155640.990655:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ee0200/0x844e5faceb5f776e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 798720->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e97 expref: 14 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155640.990671:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.990673:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155640.990678:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f76800/0x844e5faceb5f77c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ecf expref: 39 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.990685:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f76800/0x844e5faceb5f77c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ecf expref: 39 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155640.990711:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135f76800/0x844e5faceb5f77c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ecf expref: 39 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155640.990720:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125349248:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155640.992497:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155640.992538:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125349248:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155640.992551:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155640.992576:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976125940096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1985us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155640.992584:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8656 00000100:00100000:0.0:1746155640.994147:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155640.994287:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125940352 00000100:00100000:3.0:1746155640.994294:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125940352 00002000:00100000:3.0:1746155640.994330:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff8800910d9f80 x1830976125940352/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/0 e 0 to 0 dl 1746155651 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155640.994340:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d9f80 with x1830976125940352 ext(0->1048575) 00002000:00010000:3.0:1746155640.994345:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910d9f80 00000100:00100000:3.0:1746155640.994372:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8016 00000100:00100000:3.0:1746155640.994378:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125940352:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155641.001498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.002476:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125940608 00000100:00100000:1.0:1746155641.002485:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125940608 00000100:00100000:1.0:1746155641.002549:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11101 00000100:00100000:1.0:1746155641.002556:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:32301:x1830976125940608:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155641.002575:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.002589:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131330600/0x844e5faceb5f77c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ed6 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.002679:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131330400/0x844e5faceb5f77d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002690:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131330400/0x844e5faceb5f77d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002700:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131330400/0x844e5faceb5f77d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002713:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131330200/0x844e5faceb5f77d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002717:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131330200/0x844e5faceb5f77d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002722:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131330200/0x844e5faceb5f77d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002814:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131330000/0x844e5faceb5f77de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002823:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131330000/0x844e5faceb5f77de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002829:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131330000/0x844e5faceb5f77de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155641.002837:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155641.002904:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131330400/0x844e5faceb5f77d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002910:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131330400/0x844e5faceb5f77d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002915:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131330400/0x844e5faceb5f77d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002919:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131330400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155641.002933:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131330400/0x844e5faceb5f77d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002939:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131330400/0x844e5faceb5f77d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002948:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155641.002951:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155641.002954:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131330400/0x844e5faceb5f77d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.002958:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131330400/0x844e5faceb5f77d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.004240:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131330200/0x844e5faceb5f77d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.004248:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131330200/0x844e5faceb5f77d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.004253:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131330200/0x844e5faceb5f77d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.004257:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131330200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155641.004260:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131330200/0x844e5faceb5f77d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.004264:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131330200/0x844e5faceb5f77d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.004272:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58cc00) 00010000:00010000:1.0:1746155641.004275:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155641.004277:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131330200/0x844e5faceb5f77d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.004281:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131330200/0x844e5faceb5f77d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155641.004320:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131330600/0x844e5faceb5f77c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ed6 expref: 302 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.004330:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131330000/0x844e5faceb5f77de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ed6 expref: 301 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.004336:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155641.004339:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155641.004341:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131330000, rc 0) 00000100:00100000:1.0:1746155641.004393:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:32301:x1830976125940608:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1836us (2902us total) trans 8589945258 rc 0/0 00000100:00100000:1.0:1746155641.004400:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11101 00000100:00100000:0.0:1746155641.007855:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.008042:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125940864 00000100:00100000:3.0:1746155641.008050:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125940864 00000100:00100000:2.0:1746155641.008141:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125940352:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13760us (13996us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.008150:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8016 00002000:00100000:2.0:1746155641.008160:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff8800910d9f80 x1830976125940352/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:711/0 lens 488/440 e 0 to 0 dl 1746155651 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.008168:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d9f80 with x1830976125940352 ext(0->1048575) 00000100:00100000:3.0:1746155641.008173:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4708 00002000:00010000:2.0:1746155641.008173:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910d9f80 00000100:00100000:3.0:1746155641.008179:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:32301:x1830976125940864:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155641.008321:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:32301:x1830976125940864:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 141us (472us total) trans 8589945259 rc 0/0 00000100:00100000:3.0:1746155641.008326:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4708 00000100:00100000:2.0:1746155641.008491:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.008554:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125940992 00000100:00100000:0.0:1746155641.008558:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125940992 00000100:00100000:0.0:1746155641.008590:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 752 00000100:00100000:0.0:1746155641.008595:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:1962:x1830976125940992:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155641.008603:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155641.008622:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131330000/0x844e5faceb5f77de lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ed6 expref: 302 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.008650:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155641.008654:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155641.008673:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1962:x1830976125940992:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 78us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.008679:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 752 00000100:00100000:0.0:1746155641.019879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.019980:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125941120 00000100:00100000:2.0:1746155641.020030:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125941120 00000100:00100000:2.0:1746155641.020216:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16871 00000100:00100000:2.0:1746155641.020224:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32299:x1830976125941120:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155641.020238:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.020252:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f77ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17edd expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.020276:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.020281:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.020282:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.020284:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f77ec lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17edd expref: 25 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.020303:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.020311:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 27 pid: 20200 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.020318:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125349376:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.020469:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155641.022979:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125349376:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155641.023000:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f77ec lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17edd expref: 25 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.023015:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f77a00, rc 0) 00000100:00100000:2.0:1746155641.023058:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32299:x1830976125941120:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2833us (3185us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.023065:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16871 00000100:00100000:0.0:1746155641.023585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.023742:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125941248 00000100:00100000:2.0:1746155641.023749:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125941248 00002000:00100000:2.0:1746155641.023777:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1183743) req@ffff8800910d8a80 x1830976125941248/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.023786:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8a80 with x1830976125941248 ext(1048576->1183743) 00010000:00010000:2.0:1746155641.023792:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 28 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.023803:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 28 pid: 20200 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746155641.023809:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800910d8a80 00000100:00100000:2.0:1746155641.023835:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1391 00000100:00100000:2.0:1746155641.023842:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976125941248:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155641.031122:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1961:x1830976125941248:12345-192.168.202.51@tcp:4:cat.0 Request processed in 7272us (7528us total) trans 21474841564 rc 0/0 00000100:00100000:2.0:1746155641.031132:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1391 00002000:00100000:2.0:1746155641.031141:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1183743) req@ffff8800910d8a80 x1830976125941248/t21474841564(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/448 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.031149:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8a80 with x1830976125941248 ext(1048576->1183743) 00010000:00010000:2.0:1746155641.031157:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 30 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.031169:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 30 pid: 20200 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746155641.031175:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800910d8a80 00000100:00100000:0.0:1746155641.035879:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.036622:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125941376 00000100:00100000:2.0:1746155641.036630:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125941376 00010000:00010000:2.0:1746155641.036660:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 30 pid: 20200 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.036688:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8657 00000100:00100000:2.0:1746155641.036694:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1960:x1830976125941376:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.036705:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.036721:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 30 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.036731:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 30 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.036748:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a36c00/0x844e5faceb5f777c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ea5 expref: 30 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.036771:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.036772:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.036777:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f77ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17edd expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.036784:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f77ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17edd expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.036807:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f77ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17edd expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.036817:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125349504:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155641.036877:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.044118:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.044630:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125941632 00000100:00100000:3.0:1746155641.044639:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125941632 00002000:00100000:3.0:1746155641.044682:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800910d8380 x1830976125941632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.044692:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8380 with x1830976125941632 ext(1048576->2097151) 00002000:00010000:3.0:1746155641.044696:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910d8380 00000100:00100000:3.0:1746155641.044723:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8017 00000100:00100000:3.0:1746155641.044732:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976125941632:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155641.049243:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125349504:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155641.049266:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.049328:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976125941376:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 12632us (13454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.049337:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8657 00000100:00100000:0.0:1746155641.049614:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.049797:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.049921:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125941760 00000100:00100000:3.0:1746155641.049937:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125941760 00000100:00100000:3.0:1746155641.049974:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125941888 00000100:00100000:3.0:1746155641.049978:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125941888 00000100:00100000:3.0:1746155641.050012:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16872 00000100:00100000:3.0:1746155641.050019:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1961:x1830976125941760:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155641.050036:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.050051:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f77f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ee4 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.050071:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.050073:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.050081:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f77f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ee4 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155641.050095:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f77f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ee4 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155641.050105:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a36000, rc 0) 00000100:00100000:3.0:1746155641.050176:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976125941760:12345-192.168.202.51@tcp:101:cat.0 Request processed in 155us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.050182:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16872 00000100:00100000:3.0:1746155641.050200:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16873 00000100:00100000:3.0:1746155641.050206:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976125941888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155641.050213:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.050224:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f77fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17eeb expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.050234:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.050236:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.050242:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f77fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eeb expref: 30 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155641.050252:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f77fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eeb expref: 30 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155641.050258:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a37a00, rc 0) 00000100:00100000:3.0:1746155641.050280:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1960:x1830976125941888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 74us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.050285:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16873 00000100:00100000:3.0:1746155641.059401:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976125941632:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14662us (15283us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.059411:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8017 00002000:00100000:3.0:1746155641.059421:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800910d8380 x1830976125941632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.059430:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8380 with x1830976125941632 ext(1048576->2097151) 00002000:00010000:3.0:1746155641.059436:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910d8380 00000100:00100000:0.0:1746155641.061411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.061454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.061530:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125942272 00000100:00100000:1.0:1746155641.061538:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125942272 00002000:00100000:1.0:1746155641.061569:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f0d8380 x1830976125942272/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.061576:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8380 with x1830976125942272 ext(0->1048575) 00002000:00010000:1.0:1746155641.061580:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d8380 00000100:00100000:1.0:1746155641.061604:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125942400 00000100:00100000:1.0:1746155641.061606:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125942400 00002000:00100000:1.0:1746155641.061617:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f0d8a80 x1830976125942400/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155641.061620:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8018 00002000:00100000:1.0:1746155641.061624:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8a80 with x1830976125942400 ext(1048576->2097151) 00000100:00100000:0.0:1746155641.061627:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976125942272:12345-192.168.202.51@tcp:3:cat.0 00002000:00010000:1.0:1746155641.061660:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0d8a80 00000100:00100000:1.0:1746155641.061677:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8019 00000100:00100000:1.0:1746155641.061682:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1960:x1830976125942400:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155641.069812:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1960:x1830976125942400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8121us (8349us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155641.069823:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8019 00002000:00100000:1.0:1746155641.069832:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f0d8a80 x1830976125942400/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.069841:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8a80 with x1830976125942400 ext(1048576->2097151) 00002000:00010000:1.0:1746155641.069848:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0d8a80 00000100:00100000:2.0:1746155641.074488:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976125942272:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12852us (13072us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.074498:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8018 00002000:00100000:2.0:1746155641.074520:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f0d8380 x1830976125942272/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.074529:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8380 with x1830976125942272 ext(0->1048575) 00002000:00010000:2.0:1746155641.074534:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d8380 00000100:00100000:0.0:1746155641.082580:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.082659:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.083127:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125942656 00000100:00100000:2.0:1746155641.083135:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125942656 00002000:00100000:2.0:1746155641.083167:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f0da300 x1830976125942656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.083175:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0da300 with x1830976125942656 ext(2097152->3145727) 00002000:00010000:2.0:1746155641.083180:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0da300 00000100:00100000:2.0:1746155641.083793:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125942784 00000100:00100000:2.0:1746155641.083796:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125942784 00000100:00100000:0.0:1746155641.083799:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8020 00000100:00100000:0.0:1746155641.083807:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125942656:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:2.0:1746155641.083809:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009fb6bb80 x1830976125942784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.083814:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6bb80 with x1830976125942784 ext(3145728->4194303) 00002000:00010000:2.0:1746155641.083816:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb6bb80 00000100:00100000:2.0:1746155641.083867:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8021 00000100:00100000:2.0:1746155641.083872:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125942784:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155641.094284:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976125942656:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10468us (11704us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.094294:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8020 00002000:00100000:2.0:1746155641.094304:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f0da300 x1830976125942656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.094313:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0da300 with x1830976125942656 ext(2097152->3145727) 00002000:00010000:2.0:1746155641.094319:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0da300 00000100:00100000:2.0:1746155641.098039:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125942784:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14151us (15365us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.098051:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8021 00002000:00100000:2.0:1746155641.098064:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009fb6bb80 x1830976125942784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.098074:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6bb80 with x1830976125942784 ext(3145728->4194303) 00002000:00010000:2.0:1746155641.098079:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb6bb80 00000100:00100000:0.0:1746155641.122106:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.122297:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125943040 00000100:00100000:2.0:1746155641.122306:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125943040 00000100:00100000:2.0:1746155641.122347:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16874 00000100:00100000:2.0:1746155641.122354:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32306:x1830976125943040:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155641.122368:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.122382:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ef2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.122406:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f770c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e6d expref: 15 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.122415:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0x844e5faceb5f7752 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e89 expref: 39 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.122421:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.122422:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.122425:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2994176->3145727] (req 2994176->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.122449:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0x844e5faceb5f7752 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e89 expref: 39 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.122460:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0x844e5faceb5f7752 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e89 expref: 39 pid: 20200 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746155641.122471:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125349632:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155641.122595:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f770c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e6d expref: 15 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.122603:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f770c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e6d expref: 15 pid: 20200 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.122611:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125349760:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.122628:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155641.125354:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125349632:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.125364:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125349760:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155641.125386:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2994176->3145727] (req 2994176->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.125401:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f76400, rc 0) 00000100:00100000:2.0:1746155641.126146:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32306:x1830976125943040:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3790us (4044us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.126154:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16874 00000100:00100000:0.0:1746155641.127741:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.128196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.128249:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125943168 00000100:00100000:1.0:1746155641.128257:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125943168 00000100:00100000:2.0:1746155641.128260:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125943296 00000100:00100000:2.0:1746155641.128264:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125943296 00010000:00010000:1.0:1746155641.128288:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0x844e5faceb5f7752 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e89 expref: 40 pid: 20200 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746155641.128289:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f770c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e6d expref: 15 pid: 20200 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.128325:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8658 00000100:00100000:2.0:1746155641.128331:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976125943296:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.128342:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155641.128343:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8659 00000100:00100000:1.0:1746155641.128349:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125943168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.128356:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.128360:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f770c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e6d expref: 15 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.128366:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0x844e5faceb5f7752 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e89 expref: 40 pid: 20200 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746155641.128370:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f770c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e6d expref: 15 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.128379:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0x844e5faceb5f7752 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e89 expref: 40 pid: 20200 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746155641.128452:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f770c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e6d expref: 15 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.128486:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094ee1400/0x844e5faceb5f7752 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e89 expref: 40 pid: 20200 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746155641.128524:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.128526:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.128531:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.128538:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.128555:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155641.128567:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.128578:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125349888:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155641.128589:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976125943296:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 257us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.128595:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8658 00000100:00100000:1.0:1746155641.128629:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.130807:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125349888:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155641.130809:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155641.130824:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155641.130854:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976125943168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2505us (3118us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.130861:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8659 00000100:00100000:2.0:1746155641.130862:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125943552 00000100:00100000:2.0:1746155641.130868:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125943552 00002000:00100000:2.0:1746155641.130895:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2994176->2998271) req@ffff88009f0d8e00 x1830976125943552/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.130904:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8e00 with x1830976125943552 ext(2994176->2998271) 00002000:00010000:2.0:1746155641.130907:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d8e00 00000100:00100000:2.0:1746155641.130931:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8022 00000100:00100000:2.0:1746155641.130938:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1963:x1830976125943552:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155641.131064:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1963:x1830976125943552:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 126us (257us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155641.131070:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8022 00002000:00100000:2.0:1746155641.131075:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2994176->2998271) req@ffff88009f0d8e00 x1830976125943552/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/4536 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.131082:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8e00 with x1830976125943552 ext(2994176->2998271) 00002000:00010000:2.0:1746155641.131085:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d8e00 00000100:00100000:0.0:1746155641.134967:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.135042:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125943680 00000100:00100000:2.0:1746155641.135049:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125943680 00000100:00100000:2.0:1746155641.135080:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16875 00000100:00100000:2.0:1746155641.135086:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:32306:x1830976125943680:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155641.135099:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.135113:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ef9 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.135134:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f7783 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eac expref: 31 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.135141:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131330a00/0x844e5faceb5f77bb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ec8 expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.135147:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.135148:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.135151:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->2449407] (req 2097152->2449407) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.135176:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131330a00/0x844e5faceb5f77bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ec8 expref: 24 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.135186:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131330a00/0x844e5faceb5f77bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ec8 expref: 24 pid: 8437 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746155641.135195:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125350016:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155641.136172:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f7783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eac expref: 31 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.136181:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f7783 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eac expref: 31 pid: 20200 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.136190:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125350144:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.136492:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155641.136523:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125350016:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155641.139139:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.140986:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125943808 00000100:00100000:1.0:1746155641.140994:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125943808 00010000:00010000:1.0:1746155641.141023:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131330a00/0x844e5faceb5f77bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ec8 expref: 25 pid: 8437 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.141064:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8660 00000100:00100000:1.0:1746155641.141070:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976125943808:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.141081:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155641.141099:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131330a00/0x844e5faceb5f77bb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ec8 expref: 25 pid: 8437 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746155641.141109:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131330a00/0x844e5faceb5f77bb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ec8 expref: 25 pid: 8437 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746155641.141125:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131330a00/0x844e5faceb5f77bb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ec8 expref: 25 pid: 8437 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746155641.141146:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155641.141183:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976125943808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 112us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.141188:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8660 00000100:00100000:0.0:1746155641.142318:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125350144:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155641.142341:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->2449407] (req 2097152->2449407) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 31 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.142357:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093ed1200, rc 0) 00000100:00100000:0.0:1746155641.142380:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:32306:x1830976125943680:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7294us (7419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.142386:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16875 00000100:00100000:0.0:1746155641.143969:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.144031:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125943936 00000100:00100000:2.0:1746155641.144036:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125943936 00010000:00010000:2.0:1746155641.144054:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f7783 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eac expref: 31 pid: 20200 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.146296:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8661 00000100:00100000:2.0:1746155641.146309:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976125943936:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.146323:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.146343:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f7783 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eac expref: 31 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.146355:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f7783 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eac expref: 31 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.146374:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094ee0000/0x844e5faceb5f7783 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eac expref: 31 pid: 20200 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.146396:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.146398:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.146404:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.146411:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.146436:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 30 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.146447:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125350272:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155641.146521:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155641.148048:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125350272:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155641.148064:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.148101:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1960:x1830976125943936:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1795us (4133us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.148108:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8661 00000100:00100000:0.0:1746155641.150337:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.150386:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125944192 00000100:00100000:2.0:1746155641.150393:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125944192 00002000:00100000:2.0:1746155641.150426:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2445312->2449407) req@ffff88009f0db480 x1830976125944192/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.150435:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0db480 with x1830976125944192 ext(2445312->2449407) 00002000:00010000:2.0:1746155641.150440:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0db480 00000100:00100000:2.0:1746155641.150464:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8023 00000100:00100000:2.0:1746155641.150471:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1962:x1830976125944192:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155641.150630:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1962:x1830976125944192:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 159us (296us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155641.150636:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8023 00002000:00100000:2.0:1746155641.150641:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2445312->2449407) req@ffff88009f0db480 x1830976125944192/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/4536 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.150648:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0db480 with x1830976125944192 ext(2445312->2449407) 00002000:00010000:2.0:1746155641.150650:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0db480 00000100:00100000:0.0:1746155641.162817:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.163044:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125944320 00000100:00100000:2.0:1746155641.163051:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125944320 00000100:00100000:2.0:1746155641.163085:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16876 00000100:00100000:2.0:1746155641.163091:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32301:x1830976125944320:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155641.163106:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.163121:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f00 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.163143:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.163155:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.163156:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.163160:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2633728->3145727] (req 2633728->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.163182:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.163193:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 29 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.163203:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125350400:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.164844:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155641.166107:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125350400:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155641.166132:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2633728->3145727] (req 2633728->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 25 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.166148:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f62800, rc 0) 00000100:00100000:2.0:1746155641.166192:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32301:x1830976125944320:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3099us (3380us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.166199:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16876 00000100:00100000:0.0:1746155641.168562:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.168753:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125944448 00000100:00100000:2.0:1746155641.168760:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125944448 00002000:00100000:2.0:1746155641.168791:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->2449407) req@ffff88009366dc00 x1830976125944448/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.168804:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366dc00 with x1830976125944448 ext(2097152->2449407) 00010000:00010000:2.0:1746155641.168812:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 30 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.168823:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 30 pid: 8437 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746155641.168830:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009366dc00 00000100:00100000:2.0:1746155641.169137:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1392 00000100:00100000:2.0:1746155641.169144:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1960:x1830976125944448:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155641.183315:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125944448:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 14163us (14748us total) trans 21474841565 rc 0/0 00000100:00100000:2.0:1746155641.183325:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1392 00002000:00100000:2.0:1746155641.183334:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->2449407) req@ffff88009366dc00 x1830976125944448/t21474841565(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/448 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.183343:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366dc00 with x1830976125944448 ext(2097152->2449407) 00010000:00010000:2.0:1746155641.183351:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 32 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.183366:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 32 pid: 8437 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746155641.183373:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009366dc00 00000100:00100000:0.0:1746155641.185829:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.186069:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125944576 00000100:00100000:2.0:1746155641.186077:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125944576 00010000:00010000:2.0:1746155641.186105:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 32 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.188618:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8662 00000100:00100000:1.0:1746155641.188729:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1961:x1830976125944576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.188747:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155641.188772:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 32 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.188787:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 32 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.188809:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093ed1200/0x844e5faceb5f7808 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2449407) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef9 expref: 32 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.188837:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.188839:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.188845:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.188852:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.188883:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.188894:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125350528:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155641.188981:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.191187:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.191239:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125944832 00000100:00100000:2.0:1746155641.191246:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125944832 00002000:00100000:2.0:1746155641.191277:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2633728->2637823) req@ffff88009ca96680 x1830976125944832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746155641.191283:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125350528:192.168.202.51@tcp:105: 00002000:00100000:2.0:1746155641.191284:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96680 with x1830976125944832 ext(2633728->2637823) 00002000:00010000:2.0:1746155641.191287:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca96680 00010000:00010000:1.0:1746155641.191299:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.191304:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8024 00000100:00100000:2.0:1746155641.191310:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976125944832:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155641.191329:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976125944576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2701us (5505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.191337:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8662 00000100:00100000:2.0:1746155641.191421:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976125944832:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 110us (238us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155641.191426:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8024 00002000:00100000:2.0:1746155641.191431:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2633728->2637823) req@ffff88009ca96680 x1830976125944832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/4536 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.191437:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96680 with x1830976125944832 ext(2633728->2637823) 00002000:00010000:2.0:1746155641.191440:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca96680 00000100:00100000:0.0:1746155641.198417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.198477:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125944960 00000100:00100000:2.0:1746155641.198484:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125944960 00000100:00100000:2.0:1746155641.198549:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16877 00000100:00100000:2.0:1746155641.198555:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:32301:x1830976125944960:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155641.198570:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.198587:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f07 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.198611:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.198618:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.198619:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.198622:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->3653631] (req 3145728->3653631) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 40 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.198643:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.198652:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 13 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.198662:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125350656:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.198730:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155641.209431:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125350656:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155641.209456:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->3653631] (req 3145728->3653631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 40 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.209471:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e4800, rc 0) 00000100:00100000:2.0:1746155641.209528:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:32301:x1830976125944960:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 10972us (11118us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.209536:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16877 00000100:00100000:0.0:1746155641.211056:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.211269:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125945088 00000100:00100000:2.0:1746155641.211276:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125945088 00002000:00100000:2.0:1746155641.211308:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2994176->3145727) req@ffff88009ca95f80 x1830976125945088/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.211317:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95f80 with x1830976125945088 ext(2994176->3145727) 00010000:00010000:2.0:1746155641.211325:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 14 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.211336:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 14 pid: 8437 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746155641.211342:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca95f80 00000100:00100000:2.0:1746155641.211359:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1393 00000100:00100000:2.0:1746155641.211366:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1963:x1830976125945088:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155641.220643:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1963:x1830976125945088:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 9266us (9579us total) trans 17179874240 rc 0/0 00000100:00100000:3.0:1746155641.220655:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1393 00002000:00100000:3.0:1746155641.220667:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2994176->3145727) req@ffff88009ca95f80 x1830976125945088/t17179874240(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/448 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.220676:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95f80 with x1830976125945088 ext(2994176->3145727) 00010000:00010000:3.0:1746155641.220686:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 16 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.220707:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 16 pid: 8437 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746155641.220714:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca95f80 00000100:00100000:0.0:1746155641.221042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.221093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.221112:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.221125:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125945472 00000100:00100000:0.0:1746155641.221131:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125945472 00000100:00100000:0.0:1746155641.221152:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125945600 00000100:00100000:0.0:1746155641.221153:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125945600 00000100:00100000:0.0:1746155641.221165:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16878 00000100:00100000:0.0:1746155641.221170:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125945472:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155641.221183:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155641.221195:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c51a000/0x844e5faceb5f781d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f15 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.221231:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125350784:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155641.221284:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.221337:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125945344 00000100:00100000:0.0:1746155641.221340:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125945344 00000100:00100000:0.0:1746155641.221359:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11102 00000100:00100000:0.0:1746155641.221364:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:32315:x1830976125945344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155641.221375:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155641.221385:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51be00/0x844e5faceb5f7824 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f0e expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.221458:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51b800/0x844e5faceb5f782b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221469:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51b800/0x844e5faceb5f782b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221477:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51b800/0x844e5faceb5f782b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221488:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f7832 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221493:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f7832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221498:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f7832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221593:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77400/0x844e5faceb5f7839 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221601:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77400/0x844e5faceb5f7839 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221609:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77400/0x844e5faceb5f7839 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:0.0:1746155641.221616:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155641.221675:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51b800/0x844e5faceb5f782b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221681:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51b800/0x844e5faceb5f782b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221686:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51b800/0x844e5faceb5f782b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221691:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c51b800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155641.221694:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51b800/0x844e5faceb5f782b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221699:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51b800/0x844e5faceb5f782b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221707:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155641.221709:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155641.221712:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51b800/0x844e5faceb5f782b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221717:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51b800/0x844e5faceb5f782b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221728:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f7832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221732:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f7832 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221740:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f7832 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221744:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a76f200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155641.221746:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f7832 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221750:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f7832 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221755:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51000) 00010000:00010000:0.0:1746155641.221757:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155641.221759:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f7832 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221763:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f200/0x844e5faceb5f7832 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155641.221790:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51be00/0x844e5faceb5f7824 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f0e expref: 304 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.221798:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77400/0x844e5faceb5f7839 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f0e expref: 303 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.221804:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155641.221805:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155641.221807:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f77400, rc 0) 00000100:00100000:0.0:1746155641.221827:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:32315:x1830976125945344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 463us (786us total) trans 8589945260 rc 0/0 00000100:00100000:0.0:1746155641.221832:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11102 00000100:00100000:0.0:1746155641.221968:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16879 00000100:00100000:0.0:1746155641.221974:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976125945600:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155641.221980:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155641.221987:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135f76e00/0x844e5faceb5f7847 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f1c expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.222008:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125350912:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155641.222040:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.223331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.224803:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125945728 00000100:00100000:1.0:1746155641.224811:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125945728 00010000:00010000:1.0:1746155641.224837:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 18 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.224866:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8663 00000100:00100000:1.0:1746155641.224871:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976125945728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.224879:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.225008:0:1625:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.51@tcp) returned -22 from glimpse AST (req@ffff88009ca94e00 x1830976125350784) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 18 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746155641.225015:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125350912:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155641.225027:0:1625:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 18 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746155641.225035:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135f76e00/0x844e5faceb5f7847 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f1c expref: 32 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155641.225043:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125350784:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155641.225044:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135f76e00/0x844e5faceb5f7847 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f1c expref: 32 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155641.225051:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135f76e00, rc 0) 00010000:00010000:2.0:1746155641.225063:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.225065:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.225070:0:1625:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 39 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.225076:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976125945600:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3103us (3963us total) trans 0 rc 301/301 00010000:00010000:2.0:1746155641.225078:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 39 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.225082:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16879 00010000:00010000:2.0:1746155641.225101:0:1625:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 39 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.225110:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125351040:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155641.225115:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.225152:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125945856 00000100:00100000:3.0:1746155641.225155:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125945856 00000100:00100000:3.0:1746155641.225177:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 753 00000100:00100000:3.0:1746155641.225182:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:1963:x1830976125945856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.225188:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155641.225199:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135f77400/0x844e5faceb5f7839 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f0e expref: 303 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.225216:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155641.225219:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155641.225312:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 18 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.225321:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f76400/0x844e5faceb5f7801 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2994176->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ef2 expref: 18 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.225332:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.225813:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155641.226068:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:1963:x1830976125945856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 884us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.226074:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 753 00000100:00100000:0.0:1746155641.226177:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976125945728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1304us (2847us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.226183:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8663 00000100:00100000:2.0:1746155641.226243:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.226967:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125946112 00000100:00100000:0.0:1746155641.226970:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125946112 00000100:00100000:0.0:1746155641.227105:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4709 00000100:00100000:0.0:1746155641.227111:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:32315:x1830976125946112:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:0.0:1746155641.227749:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:32315:x1830976125946112:12345-192.168.202.51@tcp:35:cat.0 Request processed in 638us (1505us total) trans 8589945261 rc 0/0 00000100:00100000:0.0:1746155641.227755:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4709 00000100:00100000:3.0:1746155641.227916:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125351040:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155641.227951:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c51a000/0x844e5faceb5f781d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f15 expref: 16 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155641.227962:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c51a000/0x844e5faceb5f781d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f15 expref: 16 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155641.227970:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c51a000, rc 0) 00000100:00100000:3.0:1746155641.228005:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976125945472:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6834us (6911us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155641.228011:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16878 00000100:00100000:0.0:1746155641.231952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.232197:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125946368 00000100:00100000:3.0:1746155641.232205:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125946368 00002000:00100000:3.0:1746155641.232242:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3649536->3653631) req@ffff88009f4ff100 x1830976125946368/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.232251:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ff100 with x1830976125946368 ext(3649536->3653631) 00002000:00010000:3.0:1746155641.232255:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4ff100 00000100:00100000:3.0:1746155641.232283:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8025 00000100:00100000:3.0:1746155641.232289:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125946368:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155641.232429:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125946368:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 140us (483us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155641.232435:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8025 00002000:00100000:3.0:1746155641.232440:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3649536->3653631) req@ffff88009f4ff100 x1830976125946368/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/4536 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.232447:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ff100 with x1830976125946368 ext(3649536->3653631) 00002000:00010000:3.0:1746155641.232449:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4ff100 00000100:00100000:0.0:1746155641.239002:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.239094:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125946624 00000100:00100000:2.0:1746155641.239101:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125946624 00002000:00100000:2.0:1746155641.239134:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f4ff480 x1830976125946624/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.239142:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ff480 with x1830976125946624 ext(2097152->3145727) 00002000:00010000:2.0:1746155641.239147:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4ff480 00000100:00100000:2.0:1746155641.239611:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8026 00000100:00100000:2.0:1746155641.239619:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976125946624:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155641.240097:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.240135:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.240150:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.240164:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.240176:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125946880 00000100:00100000:1.0:1746155641.240181:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125946880 00000100:00100000:0.0:1746155641.240189:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:1.0:1746155641.240198:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3653632->4194303) req@ffff88009f4fd880 x1830976125946880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155641.240203:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125947520 00002000:00100000:1.0:1746155641.240204:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd880 with x1830976125946880 ext(3653632->4194303) 00000100:00100000:0.0:1746155641.240206:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125947520 00002000:00010000:1.0:1746155641.240208:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fd880 00000100:00100000:1.0:1746155641.240217:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125947008 00000100:00100000:1.0:1746155641.240220:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125947008 00000100:00100000:0.0:1746155641.240226:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125947648 00000100:00100000:0.0:1746155641.240228:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125947648 00002000:00100000:1.0:1746155641.240230:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3657727) req@ffff88009f4fe680 x1830976125947008/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 504/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.240236:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fe680 with x1830976125947008 ext(2097152->3657727) 00002000:00010000:1.0:1746155641.240239:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fe680 00000100:00100000:0.0:1746155641.240241:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16880 00000100:00100000:0.0:1746155641.240246:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976125947520:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155641.240253:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125947392 00010000:00010000:0.0:1746155641.240254:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155641.240255:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125947392 00002000:00100000:1.0:1746155641.240264:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3657728->4194303) req@ffff88009f4fdc00 x1830976125947392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746155641.240267:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c51ac00/0x844e5faceb5f784e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f23 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746155641.240270:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fdc00 with x1830976125947392 ext(3657728->4194303) 00002000:00010000:1.0:1746155641.240272:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fdc00 00000100:00100000:3.0:1746155641.240281:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16881 00000100:00100000:1.0:1746155641.240282:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8027 00000100:00100000:1.0:1746155641.240287:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1961:x1830976125946880:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155641.240289:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976125947648:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155641.240295:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.240304:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e33c00/0x844e5faceb5f7855 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f2a expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.240305:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125351168:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155641.240327:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125351296:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155641.240365:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8028 00000100:00100000:0.0:1746155641.240369:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155641.240373:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155641.240381:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976125947008:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155641.240470:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8029 00000100:00100000:0.0:1746155641.240475:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125947392:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155641.247930:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125351168:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155641.247959:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c51ac00/0x844e5faceb5f784e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f23 expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.247972:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c51ac00/0x844e5faceb5f784e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f23 expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.247991:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c51ac00, rc 0) 00000100:00100000:2.0:1746155641.248026:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976125947520:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7780us (7860us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155641.248033:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16880 00000100:00100000:3.0:1746155641.248291:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125351296:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155641.248316:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e33c00/0x844e5faceb5f7855 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f2a expref: 32 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155641.248326:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e33c00/0x844e5faceb5f7855 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f2a expref: 32 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155641.248342:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e33c00, rc 0) 00000100:00100000:3.0:1746155641.248360:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976125947648:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8073us (8170us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155641.248366:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16881 00000100:00100000:1.0:1746155641.249275:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125946880:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8986us (10236us total) trans 0 rc 540672/540672 00000100:00100000:1.0:1746155641.249283:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8027 00002000:00100000:1.0:1746155641.249290:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3653632->4194303) req@ffff88009f4fd880 x1830976125946880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 540672/540672 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.249298:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd880 with x1830976125946880 ext(3653632->4194303) 00002000:00010000:1.0:1746155641.249301:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fd880 00000100:00100000:0.0:1746155641.249382:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976125947392:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8905us (9229us total) trans 0 rc 536576/536576 00000100:00100000:0.0:1746155641.249389:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8029 00002000:00100000:0.0:1746155641.249394:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3657728->4194303) req@ffff88009f4fdc00 x1830976125947392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 536576/536576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155641.249400:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fdc00 with x1830976125947392 ext(3657728->4194303) 00002000:00010000:0.0:1746155641.249403:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fdc00 00000100:00100000:2.0:1746155641.252407:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976125946624:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12784us (13406us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.252416:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8026 00002000:00100000:2.0:1746155641.252424:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f4ff480 x1830976125946624/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.252433:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ff480 with x1830976125946624 ext(2097152->3145727) 00002000:00010000:2.0:1746155641.252437:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4ff480 00000100:00100000:0.0:1746155641.254575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.254603:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976125947008:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14230us (14465us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.254611:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8028 00002000:00100000:3.0:1746155641.254619:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3657727) req@ffff88009f4fe680 x1830976125947008/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 504/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.254626:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fe680 with x1830976125947008 ext(2097152->3657727) 00002000:00010000:3.0:1746155641.254630:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fe680 00000100:00100000:2.0:1746155641.254706:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125947776 00000100:00100000:2.0:1746155641.254712:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125947776 00000100:00100000:2.0:1746155641.254738:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16882 00000100:00100000:2.0:1746155641.254744:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32314:x1830976125947776:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155641.254756:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.254771:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f785c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f31 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.254794:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 39 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.254800:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.254802:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.254805:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f785c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f31 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.254828:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 39 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.254843:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 39 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.254853:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125351424:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.254892:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155641.259786:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125351424:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155641.259812:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f785c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f31 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.259826:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090487400, rc 0) 00000100:00100000:2.0:1746155641.259916:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32314:x1830976125947776:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5170us (5345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.259931:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16882 00000100:00100000:0.0:1746155641.260477:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.260532:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125947904 00000100:00100000:3.0:1746155641.260537:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125947904 00002000:00100000:3.0:1746155641.260571:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3653631) req@ffff8800936f7800 x1830976125947904/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.260584:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f7800 with x1830976125947904 ext(3145728->3653631) 00010000:00010000:3.0:1746155641.260590:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 40 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.260716:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 40 pid: 8437 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746155641.260724:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936f7800 00000100:00100000:3.0:1746155641.260751:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1394 00000100:00100000:3.0:1746155641.260758:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125947904:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155641.261023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.261317:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125948160 00000100:00100000:2.0:1746155641.261321:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125948160 00002000:00100000:2.0:1746155641.261337:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800936f6680 x1830976125948160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.261345:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6680 with x1830976125948160 ext(4194304->5083135) 00010000:00010000:2.0:1746155641.261350:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 41 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.261359:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 41 pid: 8437 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746155641.261369:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936f6680 00000100:00100000:2.0:1746155641.261381:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1395 00000100:00100000:2.0:1746155641.261386:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1963:x1830976125948160:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155641.265782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.265881:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125948288 00000100:00100000:3.0:1746155641.265888:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125948288 00000100:00100000:3.0:1746155641.266747:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16883 00000100:00100000:3.0:1746155641.266755:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:32315:x1830976125948288:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155641.266770:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.266783:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e33e00/0x844e5faceb5f7863 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f38 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.266804:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155641.266805:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155641.266809:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e33e00/0x844e5faceb5f7863 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f38 expref: 45 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.266819:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e33e00/0x844e5faceb5f7863 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f38 expref: 45 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.266833:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e33e00, rc 0) 00000100:00100000:3.0:1746155641.266880:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:32315:x1830976125948288:12345-192.168.202.51@tcp:101:cat.0 Request processed in 126us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.266886:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16883 00000100:00100000:2.0:1746155641.270490:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1963:x1830976125948160:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9097us (9460us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155641.270499:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1395 00002000:00100000:2.0:1746155641.270520:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800936f6680 x1830976125948160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.270529:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6680 with x1830976125948160 ext(4194304->5083135) 00010000:00010000:2.0:1746155641.270536:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 43 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.270549:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 43 pid: 8437 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746155641.270555:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936f6680 00000100:00100000:3.0:1746155641.272417:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1961:x1830976125947904:12345-192.168.202.51@tcp:4:cat.0 Request processed in 11655us (11936us total) trans 17179874241 rc 0/0 00000100:00100000:3.0:1746155641.272427:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1394 00002000:00100000:3.0:1746155641.272433:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3653631) req@ffff8800936f7800 x1830976125947904/t17179874241(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/448 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.272440:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f7800 with x1830976125947904 ext(3145728->3653631) 00010000:00010000:3.0:1746155641.272447:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 43 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.272459:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 43 pid: 8437 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746155641.272464:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800936f7800 00000100:00100000:0.0:1746155641.278636:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.278833:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125948416 00000100:00100000:2.0:1746155641.278840:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125948416 00010000:00010000:2.0:1746155641.278867:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 43 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.278902:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8664 00000100:00100000:2.0:1746155641.278908:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1962:x1830976125948416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.279071:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.279093:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 43 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.279104:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 43 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.279122:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948e4800/0x844e5faceb5f7816 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3653631) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f07 expref: 43 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.279163:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.279166:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.279172:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f785c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f31 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.279180:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f785c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f31 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.279188:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.279189:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.279192:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e33e00/0x844e5faceb5f7863 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f38 expref: 42 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.279198:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e33e00/0x844e5faceb5f7863 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f38 expref: 42 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.279220:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094e33e00/0x844e5faceb5f7863 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f38 expref: 42 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.279234:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125351552:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155641.279311:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f785c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f31 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.279318:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125351680:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155641.279373:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155641.280635:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125351552:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155641.281255:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746155641.281428:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125351680:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155641.281442:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.281859:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1962:x1830976125948416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2949us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.281867:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8664 00000100:00100000:0.0:1746155641.282311:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.282626:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125948672 00000100:00100000:3.0:1746155641.282632:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125948672 00002000:00100000:3.0:1746155641.282660:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880094e37b80 x1830976125948672/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.282668:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37b80 with x1830976125948672 ext(2097152->3145727) 00002000:00010000:3.0:1746155641.282672:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e37b80 00000100:00100000:0.0:1746155641.282991:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.283029:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125948928 00000100:00100000:1.0:1746155641.283033:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125948928 00002000:00100000:1.0:1746155641.283047:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880094e35180 x1830976125948928/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155641.283053:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8030 00002000:00100000:1.0:1746155641.283054:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35180 with x1830976125948928 ext(3145728->4194303) 00002000:00010000:1.0:1746155641.283057:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35180 00000100:00100000:3.0:1746155641.283061:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125948672:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155641.284157:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8031 00000100:00100000:1.0:1746155641.284164:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976125948928:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155641.293137:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976125948928:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8967us (10139us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155641.293147:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8031 00002000:00100000:1.0:1746155641.293156:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880094e35180 x1830976125948928/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.293164:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35180 with x1830976125948928 ext(3145728->4194303) 00002000:00010000:1.0:1746155641.293169:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35180 00000100:00100000:3.0:1746155641.294375:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125948672:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11312us (12061us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.294383:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8030 00002000:00100000:3.0:1746155641.294388:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880094e37b80 x1830976125948672/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.294395:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37b80 with x1830976125948672 ext(2097152->3145727) 00002000:00010000:3.0:1746155641.294399:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e37b80 00000100:00100000:0.0:1746155641.301491:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.301565:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.301649:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125949056 00000100:00100000:1.0:1746155641.301657:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125949056 00000100:00100000:1.0:1746155641.301704:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16884 00000100:00100000:1.0:1746155641.301711:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:32314:x1830976125949056:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155641.301725:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.301738:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f786a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f3f expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.301762:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.301770:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155641.301772:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155641.301775:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f786a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f3f expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.301798:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.301808:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 24 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.301817:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125351808:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.301879:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155641.301955:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125949312 00000100:00100000:3.0:1746155641.301958:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125949312 00002000:00100000:3.0:1746155641.301982:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009045c380 x1830976125949312/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.301989:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045c380 with x1830976125949312 ext(4194304->5083135) 00002000:00010000:3.0:1746155641.301992:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045c380 00000100:00100000:3.0:1746155641.302112:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8032 00000100:00100000:3.0:1746155641.302118:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125949312:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155641.303966:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125351808:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.303970:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155641.303989:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f786a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f3f expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.304001:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a886a00, rc 0) 00000100:00100000:1.0:1746155641.304025:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:32314:x1830976125949056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2315us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.304032:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16884 00000100:00100000:0.0:1746155641.304128:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125949440 00000100:00100000:0.0:1746155641.304132:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125949440 00002000:00100000:0.0:1746155641.304154:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (2633728->3145727) req@ffff88012f1f3800 x1830976125949440/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155641.304162:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3800 with x1830976125949440 ext(2633728->3145727) 00010000:00010000:0.0:1746155641.304167:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 25 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746155641.304178:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 25 pid: 8437 timeout: 870 lvb_type: 0 00002000:00010000:0.0:1746155641.304188:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1f3800 00000100:00100000:0.0:1746155641.304217:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1396 00000100:00100000:0.0:1746155641.304223:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125949440:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155641.310767:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125949312:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8641us (9193us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155641.310776:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8032 00002000:00100000:3.0:1746155641.310784:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009045c380 x1830976125949312/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.310793:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045c380 with x1830976125949312 ext(4194304->5083135) 00002000:00010000:3.0:1746155641.310798:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045c380 00000100:00100000:1.0:1746155641.311738:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976125949440:12345-192.168.202.51@tcp:4:cat.0 Request processed in 7513us (7765us total) trans 21474841566 rc 0/0 00000100:00100000:1.0:1746155641.311746:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1396 00002000:00100000:1.0:1746155641.311752:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (2633728->3145727) req@ffff88012f1f3800 x1830976125949440/t21474841566(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/448 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.311760:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3800 with x1830976125949440 ext(2633728->3145727) 00010000:00010000:1.0:1746155641.311766:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 27 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.311780:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 27 pid: 8437 timeout: 870 lvb_type: 0 00002000:00010000:1.0:1746155641.311787:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1f3800 00000100:00100000:0.0:1746155641.315238:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.315900:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125949568 00000100:00100000:1.0:1746155641.315908:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125949568 00000100:00100000:1.0:1746155641.315964:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16885 00000100:00100000:1.0:1746155641.315972:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976125949568:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155641.315985:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.316004:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f7871 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f46 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.316045:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125351936:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155641.316116:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.316549:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.316591:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125949696 00000100:00100000:2.0:1746155641.316596:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125949696 00010000:00010000:2.0:1746155641.316612:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 29 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.316643:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8665 00000100:00100000:2.0:1746155641.316649:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976125949696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.316657:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.316675:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 29 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.317786:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 29 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.317807:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.317809:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.317823:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f786a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f3f expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.317831:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f786a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f3f expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.317863:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f786a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f3f expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.317872:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125352064:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155641.317940:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd540 going to sleep for 11 seconds 00010000:00010000:1.0:1746155641.319663:0:20796:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.51@tcp) returned -22 from glimpse AST (req@ffff88009fb69c00 x1830976125351936) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 29 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.319866:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125352064:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155641.319878:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155641.319964:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f62800/0x844e5faceb5f780f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2633728->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f00 expref: 29 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.319977:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976125949696:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3326us (3426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.319984:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8665 00000100:00100000:1.0:1746155641.319985:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125351936:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155641.320002:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f7871 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f46 expref: 27 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.320011:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f7871 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f46 expref: 27 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.320018:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a886e00, rc 0) 00000100:00100000:1.0:1746155641.320038:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125949568:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4067us (4807us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155641.320044:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16885 00000100:00100000:0.0:1746155641.323761:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.323842:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125949824 00000100:00100000:1.0:1746155641.323850:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125949824 00000100:00100000:1.0:1746155641.323949:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16886 00000100:00100000:1.0:1746155641.323957:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976125949824:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155641.323970:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.323982:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a887000/0x844e5faceb5f7878 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f4d expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.324002:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.324003:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.324010:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a887000/0x844e5faceb5f7878 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f4d expref: 27 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.324022:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a887000/0x844e5faceb5f7878 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f4d expref: 27 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.324032:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a887000, rc 0) 00000100:00100000:1.0:1746155641.324681:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976125949824:12345-192.168.202.51@tcp:101:cat.0 Request processed in 724us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.324687:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16886 00000100:00100000:1.0:1746155641.325842:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.325898:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125950336 00000100:00100000:2.0:1746155641.325903:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125950336 00002000:00100000:2.0:1746155641.325938:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009fb69c00 x1830976125950336/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.325952:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69c00 with x1830976125950336 ext(3145728->4194303) 00002000:00010000:2.0:1746155641.325956:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb69c00 00000100:00100000:2.0:1746155641.325980:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8033 00000100:00100000:0.0:1746155641.326216:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.326237:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.326410:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125950336:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155641.327251:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125950208 00000100:00100000:3.0:1746155641.327256:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125950208 00002000:00100000:3.0:1746155641.327274:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009045d180 x1830976125950208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.327281:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045d180 with x1830976125950208 ext(2097152->3145727) 00002000:00010000:3.0:1746155641.327284:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009045d180 00000100:00100000:3.0:1746155641.327310:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125950592 00000100:00100000:3.0:1746155641.327312:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125950592 00002000:00100000:3.0:1746155641.327324:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009045d500 x1830976125950592/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.327330:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045d500 with x1830976125950592 ext(3145728->4194303) 00002000:00010000:3.0:1746155641.327333:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045d500 00000100:00100000:0.0:1746155641.327338:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8034 00000100:00100000:0.0:1746155641.327350:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1961:x1830976125950208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155641.327382:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8035 00000100:00100000:3.0:1746155641.327388:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125950592:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155641.342442:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1961:x1830976125950208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15090us (16218us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.342452:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8034 00002000:00100000:2.0:1746155641.342462:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009045d180 x1830976125950208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.342470:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045d180 with x1830976125950208 ext(2097152->3145727) 00002000:00010000:2.0:1746155641.342475:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009045d180 00000100:00100000:3.0:1746155641.345179:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125950592:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17785us (18935us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.345189:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8035 00002000:00100000:3.0:1746155641.345197:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009045d500 x1830976125950592/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.345205:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045d500 with x1830976125950592 ext(3145728->4194303) 00002000:00010000:3.0:1746155641.345210:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045d500 00000100:00100000:0.0:1746155641.349968:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.350030:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125950848 00000100:00100000:3.0:1746155641.350038:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125950848 00002000:00100000:3.0:1746155641.350077:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009045d880 x1830976125950848/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.350087:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045d880 with x1830976125950848 ext(4194304->5083135) 00002000:00010000:3.0:1746155641.350093:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045d880 00000100:00100000:3.0:1746155641.350111:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8036 00000100:00100000:3.0:1746155641.350118:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1962:x1830976125950848:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155641.351390:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125950336:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25399us (25545us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.351397:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8033 00002000:00100000:2.0:1746155641.351404:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009fb69c00 x1830976125950336/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.351411:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69c00 with x1830976125950336 ext(3145728->4194303) 00002000:00010000:2.0:1746155641.351415:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fb69c00 00000100:00100000:3.0:1746155641.359701:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1962:x1830976125950848:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9574us (9734us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155641.359711:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8036 00002000:00100000:3.0:1746155641.359721:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009045d880 x1830976125950848/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.359730:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045d880 with x1830976125950848 ext(4194304->5083135) 00002000:00010000:3.0:1746155641.359734:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045d880 00000100:00100000:0.0:1746155641.391332:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.391434:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125950976 00000100:00100000:1.0:1746155641.391441:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125950976 00000100:00100000:1.0:1746155641.391478:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16887 00000100:00100000:1.0:1746155641.391484:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32320:x1830976125950976:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155641.391497:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.391543:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f54 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.391567:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c29b000/0x844e5faceb5f75fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dc5 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.391574:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e00c00/0x844e5faceb5f76b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e27 expref: 41 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.391580:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f7641 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17de8 expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.391585:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.391586:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.391589:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1265664->1630207] (req 1265664->1630207) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.391613:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f7641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17de8 expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.391622:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f7641 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17de8 expref: 11 pid: 10591 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.391632:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125352192:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.391706:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e00c00/0x844e5faceb5f76b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e27 expref: 41 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.391714:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e00c00/0x844e5faceb5f76b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e27 expref: 41 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.391721:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125352320:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.391742:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c29b000/0x844e5faceb5f75fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dc5 expref: 17 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.391749:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c29b000/0x844e5faceb5f75fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dc5 expref: 17 pid: 1625 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.391756:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125352448:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.391766:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.396366:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125352192:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.396380:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125352320:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.396386:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125352448:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.396412:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1265664->1630207] (req 1265664->1630207) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 17 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.396426:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312faa00, rc 0) 00000100:00100000:1.0:1746155641.396475:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32320:x1830976125950976:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4989us (5148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.396482:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16887 00000100:00100000:0.0:1746155641.396543:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.396610:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.396629:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125951232 00000100:00100000:0.0:1746155641.396634:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125951232 00000100:00100000:2.0:1746155641.396635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.396648:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125951104 00000100:00100000:2.0:1746155641.396651:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125951104 00010000:00010000:0.0:1746155641.396655:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e00c00/0x844e5faceb5f76b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e27 expref: 42 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746155641.396670:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f7641 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17de8 expref: 12 pid: 10591 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746155641.396673:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125951360 00000100:00100000:0.0:1746155641.396675:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125951360 00010000:00010000:0.0:1746155641.396682:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c29b000/0x844e5faceb5f75fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dc5 expref: 17 pid: 1625 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.396686:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8666 00000100:00100000:2.0:1746155641.396692:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976125951232:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155641.396695:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8667 00000100:00100000:0.0:1746155641.396700:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125951104:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.396701:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155641.396707:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.396718:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e00c00/0x844e5faceb5f76b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e27 expref: 42 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746155641.396718:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f7641 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17de8 expref: 12 pid: 10591 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746155641.396726:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f7641 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17de8 expref: 12 pid: 10591 timeout: 870 lvb_type: 1 00000100:00080000:1.0:1746155641.396836:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746155641.396856:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8668 00000100:00100000:1.0:1746155641.396862:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976125951360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.396868:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.396997:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e00c00/0x844e5faceb5f76b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e27 expref: 42 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746155641.397023:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f7641 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17de8 expref: 12 pid: 10591 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746155641.397027:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e00c00/0x844e5faceb5f76b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e27 expref: 42 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746155641.397038:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155641.397039:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155641.397056:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125951104:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 356us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.397058:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1960:x1830976125951232:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 366us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.397062:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8667 00000100:00100000:2.0:1746155641.397066:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8666 00010000:00010000:1.0:1746155641.397161:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c29b000/0x844e5faceb5f75fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dc5 expref: 17 pid: 1625 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.397170:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c29b000/0x844e5faceb5f75fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dc5 expref: 17 pid: 1625 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.397181:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c29b000/0x844e5faceb5f75fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17dc5 expref: 17 pid: 1625 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.397202:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.397204:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.397209:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 16 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.397217:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 16 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.397239:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 16 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.397248:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125352576:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155641.397303:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.398309:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125352576:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155641.398320:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155641.398347:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125951360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1485us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.398354:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8668 00000100:00100000:0.0:1746155641.400356:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.400791:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125951616 00000100:00100000:3.0:1746155641.400797:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125951616 00002000:00100000:3.0:1746155641.400822:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e3:0x0] (1265664->1269759) req@ffff88009045ed80 x1830976125951616/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.400828:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045ed80 with x1830976125951616 ext(1265664->1269759) 00002000:00010000:3.0:1746155641.400831:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045ed80 00000100:00100000:3.0:1746155641.400976:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8037 00000100:00100000:3.0:1746155641.400982:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125951616:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155641.401098:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125951616:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 116us (745us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155641.401106:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8037 00002000:00100000:3.0:1746155641.401112:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e3:0x0] (1265664->1269759) req@ffff88009045ed80 x1830976125951616/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/4536 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.401119:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045ed80 with x1830976125951616 ext(1265664->1269759) 00002000:00010000:3.0:1746155641.401121:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045ed80 00000100:00100000:0.0:1746155641.404042:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.404137:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125951872 00000100:00100000:3.0:1746155641.404143:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125951872 00002000:00100000:3.0:1746155641.404166:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e3:0x0] (1626112->1630207) req@ffff88009045df80 x1830976125951872/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.404174:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045df80 with x1830976125951872 ext(1626112->1630207) 00002000:00010000:3.0:1746155641.404179:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045df80 00000100:00100000:3.0:1746155641.404201:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8038 00000100:00100000:3.0:1746155641.404206:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125951872:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155641.404312:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976125951872:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 105us (274us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155641.404318:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8038 00002000:00100000:3.0:1746155641.404323:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e3:0x0] (1626112->1630207) req@ffff88009045df80 x1830976125951872/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/4536 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.404329:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045df80 with x1830976125951872 ext(1626112->1630207) 00002000:00010000:3.0:1746155641.404332:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045df80 00000100:00100000:0.0:1746155641.412331:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.412482:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125952000 00000100:00100000:2.0:1746155641.412490:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125952000 00000100:00100000:2.0:1746155641.412564:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11103 00000100:00100000:2.0:1746155641.412572:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32323:x1830976125952000:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155641.412592:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.412607:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608a00/0x844e5faceb5f7886 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f5b expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.412656:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f788d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.412668:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f788d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.412677:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f788d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.412688:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608600/0x844e5faceb5f7894 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.412693:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608600/0x844e5faceb5f7894 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.412698:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608600/0x844e5faceb5f7894 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.412784:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.412793:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e74 expref: 302 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.412800:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x844e5faceb5f7760 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e90 expref: 21 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.412806:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 5/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.412831:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x844e5faceb5f7760 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e90 expref: 21 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.412842:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x844e5faceb5f7760 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e90 expref: 21 pid: 14234 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.412857:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125352704:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155641.412954:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e74 expref: 302 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.412962:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e74 expref: 302 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.412970:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125352832:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.412988:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.414457:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.414486:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.414526:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125952384 00000100:00100000:3.0:1746155641.414531:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125952384 00000100:00100000:3.0:1746155641.414558:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125952512 00000100:00100000:3.0:1746155641.414560:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125952512 00000100:00100000:2.0:1746155641.414564:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125352704:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.414573:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125352832:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155641.414574:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4710 00000100:00100000:3.0:1746155641.414580:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009461a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:7660:x1830976125952384:12345-192.168.202.51@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1746155641.414587:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155641.414607:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4711 00000100:00100000:2.0:1746155641.414613:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:27127:x1830976125952512:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746155641.414731:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009461a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+304:7660:x1830976125952384:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 150us (275us total) trans 8589945262 rc 0/0 00000100:00100000:2.0:1746155641.414731:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:27127:x1830976125952512:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 117us (242us total) trans 8589945263 rc 0/0 00000100:00100000:3.0:1746155641.414737:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4710 00000100:00100000:2.0:1746155641.414745:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4711 00000100:00100000:0.0:1746155641.416162:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.416201:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125952640 00000100:00100000:1.0:1746155641.416205:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125952640 00000100:00100000:0.0:1746155641.416218:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.416260:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125952768 00000100:00100000:2.0:1746155641.416263:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125952768 00010000:00010000:1.0:1746155641.416268:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e74 expref: 304 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.416277:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x844e5faceb5f7760 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e90 expref: 23 pid: 14234 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.416291:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8669 00000100:00100000:1.0:1746155641.416296:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+304:1962:x1830976125952640:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.416303:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155641.416307:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e74 expref: 304 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.416308:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8670 00000100:00100000:2.0:1746155641.416313:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976125952768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.416316:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e74 expref: 304 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.416320:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.416323:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x844e5faceb5f7760 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e90 expref: 23 pid: 14234 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.416332:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x844e5faceb5f7760 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e90 expref: 23 pid: 14234 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.416332:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f771a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e74 expref: 304 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.416343:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312e6e00/0x844e5faceb5f7760 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e90 expref: 23 pid: 14234 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.416345:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155641.416349:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.416355:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.416360:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.416366:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.416370:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155641.416375:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155641.416383:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155641.416389:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125952768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 76us (171us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155641.416389:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155641.416391:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:1962:x1830976125952640:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 94us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.416394:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8670 00000100:00100000:1.0:1746155641.416397:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8669 00000004:00200000:0.0:1746155641.416408:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:0.0:1746155641.416412:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155641.416421:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416429:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416435:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f788d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416440:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f788d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416444:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f788d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416449:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a608800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155641.416451:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f788d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416457:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f788d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416463:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155641.416465:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155641.416468:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f788d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416471:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f788d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416495:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608600/0x844e5faceb5f7894 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416500:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608600/0x844e5faceb5f7894 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416528:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608600/0x844e5faceb5f7894 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416532:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a608600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155641.416534:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608600/0x844e5faceb5f7894 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416538:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608600/0x844e5faceb5f7894 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416545:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800912d5600) 00010000:00010000:0.0:1746155641.416547:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155641.416549:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608600/0x844e5faceb5f7894 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416553:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608600/0x844e5faceb5f7894 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.416576:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608a00/0x844e5faceb5f7886 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f5b expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.416585:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f5b expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.416591:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155641.416592:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155641.416594:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a608400, rc 0) 00000100:00100000:1.0:1746155641.416809:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32323:x1830976125952000:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4238us (4485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.416814:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11103 00000100:00100000:0.0:1746155641.418251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.418293:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125952896 00000100:00100000:1.0:1746155641.418297:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125952896 00000100:00100000:1.0:1746155641.418330:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16888 00000100:00100000:1.0:1746155641.418336:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976125952896:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.418348:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.418358:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312fb200/0x844e5faceb5f78a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f62 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.418376:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.418378:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.418384:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fb200/0x844e5faceb5f78a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f62 expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.418395:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312fb200/0x844e5faceb5f78a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f62 expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.418408:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fb200, rc 0) 00000100:00100000:1.0:1746155641.418434:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125952896:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 98us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.418438:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16888 00000100:00100000:0.0:1746155641.419551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.419911:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.419943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.419953:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125953024 00000100:00100000:0.0:1746155641.419956:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.419957:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125953024 00000100:00100000:0.0:1746155641.419983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.419991:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125953152 00000100:00100000:2.0:1746155641.419994:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125953152 00000100:00100000:0.0:1746155641.419997:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125953280 00000100:00100000:0.0:1746155641.420000:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125953280 00000100:00100000:3.0:1746155641.420121:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125953408 00000100:00100000:3.0:1746155641.420125:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125953408 00000100:00100000:1.0:1746155641.420459:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125953536 00000100:00100000:1.0:1746155641.420462:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125953536 00000100:00100000:2.0:1746155641.420463:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16889 00000100:00100000:2.0:1746155641.420469:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125953024:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:1.0:1746155641.420478:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16890 00010000:00010000:2.0:1746155641.420479:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155641.420482:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125953152:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:0.0:1746155641.420483:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16891 00010000:00010000:1.0:1746155641.420486:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.420489:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f78a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f69 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.420489:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125953280:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.420491:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312fae00/0x844e5faceb5f78b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f70 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.420496:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.420516:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.420516:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.420518:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.420518:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155641.420518:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6126000/0x844e5faceb5f78b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f77 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.420522:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312fae00/0x844e5faceb5f78b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f70 expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.420523:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f78a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f69 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.420532:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f78a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f69 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.420534:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801312fae00/0x844e5faceb5f78b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f70 expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.420540:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a608200, rc 0) 00010000:00010000:1.0:1746155641.420540:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fae00, rc 0) 00000100:00100000:0.0:1746155641.420548:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125352960:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155641.420563:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125953024:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 94us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.420563:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125953152:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 82us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.420568:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16889 00000100:00100000:1.0:1746155641.420571:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16890 00000100:00100000:1.0:1746155641.420578:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16892 00000100:00100000:1.0:1746155641.420582:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125953536:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.420587:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.420592:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312fb800/0x844e5faceb5f78be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f85 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.420596:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16893 00000100:00100000:2.0:1746155641.420600:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125953408:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.420601:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.420602:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.420605:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.420606:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312fb800/0x844e5faceb5f78be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f85 expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.420609:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a608000/0x844e5faceb5f78c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f7e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.420614:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801312fb800/0x844e5faceb5f78be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f85 expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.420616:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.420617:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.420620:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608000/0x844e5faceb5f78c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f7e expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.420620:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fb800, rc 0) 00010000:00010000:2.0:1746155641.420628:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a608000/0x844e5faceb5f78c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f7e expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155641.420631:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125953536:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 50us (648us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155641.420635:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a608000, rc 0) 00000100:00100000:1.0:1746155641.420636:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16892 00000100:00100000:2.0:1746155641.420654:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125953408:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 54us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.420661:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16893 00000100:00100000:0.0:1746155641.420714:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b0c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746155641.421533:0:18270:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime: 1746155640 -> 1746155641 00002000:00010000:1.0:1746155641.421536:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime: 1746155640 -> 1746155641 00002000:00010000:1.0:1746155641.421538:0:18270:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime: 1746155640 -> 1746155641 00000100:00100000:1.0:1746155641.421554:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125352960:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155641.421572:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6126000/0x844e5faceb5f78b7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f77 expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.421580:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6126000/0x844e5faceb5f78b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f77 expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.421588:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6126000, rc 0) 00000100:00100000:1.0:1746155641.421619:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125953280:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1131us (1675us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155641.421625:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16891 00000100:00100000:0.0:1746155641.424882:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.424930:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125953792 00000100:00100000:1.0:1746155641.424935:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125953792 00000100:00100000:1.0:1746155641.424968:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11104 00000100:00100000:1.0:1746155641.424977:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32323:x1830976125953792:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.424993:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.425003:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fba00/0x844e5faceb5f78cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f8c expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.425091:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.425100:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f5b expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.425107:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.425125:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f5b expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.425132:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f5b expref: 10 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.425140:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125353088:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.425328:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.426877:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.426894:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125353088:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.426908:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155641.426957:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125953920 00000100:00100000:2.0:1746155641.426961:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125953920 00010000:00010000:2.0:1746155641.426982:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f5b expref: 11 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.427002:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8671 00000100:00100000:2.0:1746155641.427008:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125953920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.427016:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.427021:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f5b expref: 11 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.427059:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f5b expref: 11 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.427075:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608400/0x844e5faceb5f789b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f5b expref: 11 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.427087:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.427091:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.427096:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.427101:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.427121:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155641.427139:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.427146:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155641.427155:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976125953920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 146us (281us total) trans 0 rc 0/0 00000004:00200000:1.0:1746155641.427160:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000100:00100000:2.0:1746155641.427161:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8671 00010000:00010000:1.0:1746155641.427267:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fba00/0x844e5faceb5f78cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f8c expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.427294:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f8c expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.427300:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155641.427302:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155641.427304:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fbc00, rc 0) 00000100:00100000:1.0:1746155641.427489:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32323:x1830976125953792:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2511us (2610us total) trans 8589945264 rc 0/0 00000100:00100000:1.0:1746155641.427496:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11104 00000100:00100000:0.0:1746155641.428650:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.428728:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125954048 00000100:00100000:1.0:1746155641.428733:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125954048 00000100:00100000:1.0:1746155641.428758:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11105 00000100:00100000:1.0:1746155641.428764:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32323:x1830976125954048:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.428779:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.428789:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbe00/0x844e5faceb5f78e1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f93 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.428835:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f78e8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.428844:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f8c expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.428850:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f78e8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.428868:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f8c expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.428877:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f8c expref: 11 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.428887:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125353216:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.428962:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.429855:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125353216:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.429868:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f78e8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155641.430463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.430626:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125954176 00000100:00100000:2.0:1746155641.430632:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125954176 00010000:00010000:2.0:1746155641.430653:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f8c expref: 12 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.430672:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8672 00000100:00100000:2.0:1746155641.430678:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125954176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.430686:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.430692:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f8c expref: 12 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.430701:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f8c expref: 12 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.430716:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f78d3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f8c expref: 12 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.430728:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.430732:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f78e8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.430738:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f78e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.430743:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f78e8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.430773:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.430798:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125954176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 119us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.430808:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8672 00010000:00010000:1.0:1746155641.430864:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f78e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.430871:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f78e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155641.430897:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155641.430900:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155641.430911:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f78e8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.430944:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fbe00/0x844e5faceb5f78e1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f93 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.430956:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f78e8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f93 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.430962:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155641.430964:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155641.430966:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fb000, rc 0) 00000100:00100000:1.0:1746155641.431046:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32323:x1830976125954048:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2282us (2397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.431052:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11105 00000100:00100000:0.0:1746155641.432171:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.432238:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125954304 00000100:00100000:1.0:1746155641.432242:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125954304 00000100:00100000:1.0:1746155641.432271:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16894 00000100:00100000:1.0:1746155641.432277:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125954304:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.432287:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.432297:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312fb600/0x844e5faceb5f78ef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17f9a expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.432327:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125353344:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155641.432447:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.433384:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125353344:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155641.433400:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312fb600/0x844e5faceb5f78ef lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f9a expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.433409:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312fb600/0x844e5faceb5f78ef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f9a expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.433417:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fb600, rc 0) 00000100:00100000:1.0:1746155641.433446:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125954304:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1166us (1272us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155641.433452:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16894 00000100:00100000:0.0:1746155641.434558:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.434631:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125954560 00000100:00100000:1.0:1746155641.434636:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125954560 00000100:00100000:1.0:1746155641.434665:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11106 00000100:00100000:1.0:1746155641.434670:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32323:x1830976125954560:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.434681:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.434692:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb400/0x844e5faceb5f78f6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17fa1 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.434753:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa800/0x844e5faceb5f78fd lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.434764:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa800/0x844e5faceb5f78fd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.434772:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa800/0x844e5faceb5f78fd lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155641.434780:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155641.434857:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb400/0x844e5faceb5f78f6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fa1 expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.434868:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa800/0x844e5faceb5f78fd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fa1 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.434875:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155641.434877:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155641.434880:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fa800, rc 0) 00000100:00100000:1.0:1746155641.434914:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32323:x1830976125954560:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 243us (357us total) trans 8589945265 rc 0/0 00000100:00100000:1.0:1746155641.434932:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11106 00000100:00100000:0.0:1746155641.436062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.436089:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.436111:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.436123:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.436133:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125954688 00000100:00100000:0.0:1746155641.436136:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.436138:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125954688 00000100:00100000:0.0:1746155641.436161:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.436307:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125954944 00000100:00100000:2.0:1746155641.436310:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125954944 00000100:00100000:0.0:1746155641.436312:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125955200 00000100:00100000:0.0:1746155641.436315:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125955200 00000100:00100000:2.0:1746155641.436326:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125954816 00000100:00100000:2.0:1746155641.436329:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125954816 00000100:00100000:0.0:1746155641.436331:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125955072 00000100:00100000:0.0:1746155641.436334:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125955072 00000100:00100000:2.0:1746155641.436340:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125955328 00000100:00100000:2.0:1746155641.436342:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125955328 00000100:00100000:0.0:1746155641.436346:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16895 00000100:00100000:1.0:1746155641.436352:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16896 00000100:00100000:0.0:1746155641.436352:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1963:x1830976125954688:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:2.0:1746155641.436358:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16897 00000100:00100000:1.0:1746155641.436358:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1963:x1830976125954944:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:2.0:1746155641.436363:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1963:x1830976125955200:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155641.436376:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.436376:0:20796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.436379:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.436389:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a626ec00/0x844e5faceb5f76b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e35 expref: 26 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.436389:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135f76800/0x844e5faceb5f77c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ecf expref: 40 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.436390:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f785c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f31 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.436396:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312fae00/0x844e5faceb5f78b0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f70 expref: 17 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155641.436396:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312fb200/0x844e5faceb5f78a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f62 expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.436397:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a608000/0x844e5faceb5f78c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f7e expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155641.436402:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f77f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ee4 expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.436403:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f76f7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e58 expref: 31 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.436404:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e33e00/0x844e5faceb5f7863 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f38 expref: 40 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.436408:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.436408:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155641.436408:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.436409:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155641.436409:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.436411:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.436411:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.436411:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.436413:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.436430:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094e33e00/0x844e5faceb5f7863 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f38 expref: 40 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.436430:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f76f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e58 expref: 31 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155641.436430:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f77f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ee4 expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.436439:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f76f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e58 expref: 31 pid: 1625 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746155641.436439:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f77f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ee4 expref: 15 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746155641.436440:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094e33e00/0x844e5faceb5f7863 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f38 expref: 40 pid: 1625 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.436449:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125353728:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.436449:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125353600:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155641.436449:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125353472:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155641.436486:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16898 00000100:00100000:1.0:1746155641.436491:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16899 00000100:00100000:3.0:1746155641.436493:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1963:x1830976125954816:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155641.436493:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312fb200/0x844e5faceb5f78a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f62 expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155641.436496:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1963:x1830976125955072:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155641.436520:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312fb200/0x844e5faceb5f78a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f62 expref: 15 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.436526:0:29728:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.436527:0:10591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.436527:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125353856:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.436535:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f77ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17edd expref: 26 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.436535:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.436541:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f78a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f69 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.436544:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155641.436545:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155641.436546:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f77fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eeb expref: 31 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.436547:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.436551:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155641.436551:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135f76800/0x844e5faceb5f77c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ecf expref: 40 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.436552:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.436554:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.436558:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.436558:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135f76800/0x844e5faceb5f77c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ecf expref: 40 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.436565:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 15 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746155641.436565:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125353984:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.436568:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f77fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eeb expref: 31 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155641.436571:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb68e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125354112:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155641.436576:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150b0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746155641.436580:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f77fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eeb expref: 31 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.436584:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53373c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155641.436588:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125354240:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.436595:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16900 00000100:00100000:1.0:1746155641.436599:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1963:x1830976125955328:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155641.436612:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.436618:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f78a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f69 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.436621:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f786a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f3f expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.436625:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f78a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f69 expref: 17 pid: 8437 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746155641.436627:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312fb800/0x844e5faceb5f78be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f85 expref: 17 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155641.436632:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125354368:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.436632:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a887000/0x844e5faceb5f7878 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f4d expref: 26 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.436638:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.436639:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.436641:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.436654:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a887000/0x844e5faceb5f7878 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f4d expref: 26 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155641.436660:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f77ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17edd expref: 26 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.436662:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a887000/0x844e5faceb5f7878 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f4d expref: 26 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.436668:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f77ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17edd expref: 26 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.436669:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125354496:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155641.436675:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125354624:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.436828:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801312fb800/0x844e5faceb5f78be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f85 expref: 17 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.436836:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801312fb800/0x844e5faceb5f78be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f85 expref: 17 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.436842:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125354752:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.436860:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f786a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f3f expref: 31 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.436865:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f786a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f3f expref: 31 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.437158:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125354880:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155641.437210:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a608000/0x844e5faceb5f78c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f7e expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.437219:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a608000/0x844e5faceb5f78c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f7e expref: 15 pid: 8437 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746155641.437226:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155641.437227:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125355008:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155641.437247:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f785c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f31 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.437253:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f785c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f31 expref: 15 pid: 1625 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.437260:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125355136:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.437273:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b52bd540 going to sleep for 11 seconds 00010000:00010000:1.0:1746155641.437348:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801312fae00/0x844e5faceb5f78b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f70 expref: 17 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.437357:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801312fae00/0x844e5faceb5f78b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f70 expref: 17 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.437365:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125355264:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155641.437375:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125353472:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.437386:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a626ec00/0x844e5faceb5f76b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e35 expref: 26 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.437394:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a626ec00/0x844e5faceb5f76b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e35 expref: 26 pid: 10591 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.437401:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125355392:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.437413:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.437422:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125353600:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155641.437422:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdedf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125353856:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.437463:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.437814:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb68e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125354112:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.437828:0:10591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.437878:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125353984:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155641.437892:0:20796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.437962:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125354240:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155641.438571:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.438608:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125955584 00000100:00100000:1.0:1746155641.438612:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125955584 00002000:00100000:1.0:1746155641.438641:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e3:0x0] (1265664->1630207) req@ffff88012cdef800 x1830976125955584/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.438649:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdef800 with x1830976125955584 ext(1265664->1630207) 00010000:00010000:1.0:1746155641.438655:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 16 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.438662:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125354496:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.438663:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 16 pid: 20796 timeout: 870 lvb_type: 0 00002000:00010000:1.0:1746155641.438668:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdef800 00000100:00100000:2.0:1746155641.438670:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125354752:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.438682:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125353728:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.438682:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1397 00000100:00100000:1.0:1746155641.438688:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1962:x1830976125955584:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155641.438741:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125354368:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.439008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.439115:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125955456 00000100:00100000:0.0:1746155641.439118:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125955456 00010000:00010000:0.0:1746155641.439132:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fb200/0x844e5faceb5f78a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f62 expref: 16 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746155641.439165:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8673 00000100:00100000:0.0:1746155641.439170:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1962:x1830976125955456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155641.439178:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155641.439191:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312fb200/0x844e5faceb5f78a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f62 expref: 16 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746155641.439266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.439272:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125354880:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.439295:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.439308:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.439313:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125354624:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.439327:0:29728:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.439328:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125355008:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155641.439341:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125956096 00000100:00100000:3.0:1746155641.439343:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125956096 00010000:00010000:3.0:1746155641.439356:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135f76800/0x844e5faceb5f77c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ecf expref: 41 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746155641.439359:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312fb200/0x844e5faceb5f78a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f62 expref: 16 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746155641.439375:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312fb200/0x844e5faceb5f78a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f62 expref: 16 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746155641.439384:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125956352 00000100:00100000:3.0:1746155641.439387:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125956352 00010000:00010000:0.0:1746155641.439393:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155641.439411:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1962:x1830976125955456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 240us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.439416:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8673 00000100:00100000:0.0:1746155641.439430:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8674 00000100:00100000:0.0:1746155641.439435:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1963:x1830976125956096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155641.439441:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155641.439448:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135f76800/0x844e5faceb5f77c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ecf expref: 41 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746155641.439454:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135f76800/0x844e5faceb5f77c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ecf expref: 41 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746155641.439468:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135f76800/0x844e5faceb5f77c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ecf expref: 41 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746155641.439475:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155641.439491:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1963:x1830976125956096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 55us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.439495:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8674 00010000:00010000:3.0:1746155641.439700:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801312fb800/0x844e5faceb5f78be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f85 expref: 18 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746155641.439718:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8675 00000100:00100000:3.0:1746155641.439723:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1963:x1830976125956352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.439730:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155641.439748:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801312fb800/0x844e5faceb5f78be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f85 expref: 18 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.439755:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801312fb800/0x844e5faceb5f78be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f85 expref: 18 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.439771:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312fb800/0x844e5faceb5f78be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f85 expref: 18 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.439788:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155641.439805:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1963:x1830976125956352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 82us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.439810:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8675 00000100:00100000:1.0:1746155641.441916:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e34700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125355264:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.441967:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125355392:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.441991:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.442050:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125355136:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.442067:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.442221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.442253:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.442265:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.442287:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.442304:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.442306:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125955712 00000100:00100000:0.0:1746155641.442309:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125955968 00000100:00100000:1.0:1746155641.442310:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125955712 00000100:00100000:0.0:1746155641.442312:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125955968 00000100:00100000:2.0:1746155641.442315:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155641.442327:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f76f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e58 expref: 32 pid: 1625 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746155641.442327:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f78a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f69 expref: 17 pid: 8437 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746155641.442329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.442339:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.442339:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125956480 00000100:00100000:0.0:1746155641.442340:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125956736 00000100:00100000:1.0:1746155641.442341:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125956480 00000100:00100000:0.0:1746155641.442342:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125956736 00010000:00010000:1.0:1746155641.442349:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f77fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eeb expref: 33 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746155641.442349:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608000/0x844e5faceb5f78c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f7e expref: 15 pid: 8437 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746155641.442353:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.442357:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125955840 00000100:00100000:1.0:1746155641.442358:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125956224 00000100:00100000:1.0:1746155641.442359:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125956224 00000100:00100000:0.0:1746155641.442359:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125955840 00000100:00100000:2.0:1746155641.442364:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125956608 00010000:00010000:0.0:1746155641.442365:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f77f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ee4 expref: 18 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746155641.442367:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125956608 00010000:00010000:1.0:1746155641.442367:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a887000/0x844e5faceb5f7878 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f4d expref: 27 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746155641.442373:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125956864 00000100:00100000:0.0:1746155641.442375:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125956864 00000100:00100000:1.0:1746155641.442376:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125956992 00000100:00100000:1.0:1746155641.442377:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125956992 00010000:00010000:0.0:1746155641.442381:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f786a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f3f expref: 34 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.442382:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f77ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17edd expref: 28 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.442384:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801312fae00/0x844e5faceb5f78b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f70 expref: 18 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746155641.442391:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8676 00000100:00100000:0.0:1746155641.442396:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1960:x1830976125955712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155641.442404:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155641.442416:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f76f7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e58 expref: 34 pid: 1625 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746155641.442424:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f76f7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e58 expref: 34 pid: 1625 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746155641.442529:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f76f7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e58 expref: 34 pid: 1625 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746155641.442540:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155641.442566:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1960:x1830976125955712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 169us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.442638:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8677 00000100:00100000:2.0:1746155641.442643:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8678 00000100:00100000:1.0:1746155641.442644:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1960:x1830976125955968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155641.442648:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125956736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.442652:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.442655:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155641.442663:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f78a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f69 expref: 18 pid: 8437 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746155641.442665:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a608000/0x844e5faceb5f78c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f7e expref: 15 pid: 8437 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746155641.442670:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f78a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f69 expref: 18 pid: 8437 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746155641.442678:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8679 00010000:00010000:2.0:1746155641.442678:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a608000/0x844e5faceb5f78c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f7e expref: 15 pid: 8437 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746155641.442680:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f78a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f69 expref: 18 pid: 8437 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746155641.442684:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8676 00000100:00100000:3.0:1746155641.442686:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1960:x1830976125956480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.442688:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155641.442690:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a608000/0x844e5faceb5f78c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f7e expref: 15 pid: 8437 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.442693:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155641.442698:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8680 00010000:00010000:2.0:1746155641.442701:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155641.442703:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f77fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eeb expref: 32 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.442703:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125955968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 59us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.442703:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976125955840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155641.442708:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8677 00010000:00010000:0.0:1746155641.442710:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155641.442712:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f77fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eeb expref: 32 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746155641.442715:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125956736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 67us (427us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155641.442719:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f77f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ee4 expref: 18 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.442720:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8681 00010000:00010000:3.0:1746155641.442722:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f77fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17eeb expref: 32 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746155641.442723:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8678 00000100:00100000:1.0:1746155641.442724:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976125956224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155641.442726:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f77f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ee4 expref: 18 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746155641.442730:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155641.442731:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.442733:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8682 00000100:00100000:2.0:1746155641.442737:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1963:x1830976125956864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155641.442737:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5a36000/0x844e5faceb5f77f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ee4 expref: 18 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746155641.442738:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a887000/0x844e5faceb5f7878 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f4d expref: 28 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746155641.442743:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155641.442746:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a887000/0x844e5faceb5f7878 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f4d expref: 28 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746155641.442747:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976125956480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 63us (481us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155641.442748:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155641.442750:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.442752:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f786a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f3f expref: 31 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.442753:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8679 00010000:00010000:0.0:1746155641.442753:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.442755:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a887000/0x844e5faceb5f7878 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f4d expref: 28 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:0.0:1746155641.442758:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.442760:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f786a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f3f expref: 31 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.442766:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8683 00000100:00100000:3.0:1746155641.442771:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125956992:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.442771:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155641.442773:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155641.442775:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f786a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f3f expref: 30 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.442777:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.442782:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.442783:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.442784:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801312fae00/0x844e5faceb5f78b0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f70 expref: 16 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.442784:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976125956224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 60us (467us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155641.442786:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.442787:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976125955840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 84us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.442789:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8681 00010000:00010000:3.0:1746155641.442791:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801312fae00/0x844e5faceb5f78b0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f70 expref: 16 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746155641.442792:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.442793:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8680 00000100:00100000:1.0:1746155641.442799:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8684 00010000:00010000:3.0:1746155641.442800:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312fae00/0x844e5faceb5f78b0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f70 expref: 16 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:2.0:1746155641.442803:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155641.442804:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125956608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.442807:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155641.442810:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155641.442812:0:20796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.442815:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1963:x1830976125956864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 78us (475us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155641.442817:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f77ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17edd expref: 26 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746155641.442818:0:20796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.442820:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8682 00000100:00100000:3.0:1746155641.442821:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125956992:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 50us (466us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155641.442823:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f77ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17edd expref: 26 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.442825:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8683 00010000:00010000:0.0:1746155641.442831:0:20796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.442833:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.442833:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135f77a00/0x844e5faceb5f77ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17edd expref: 26 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746155641.442837:0:20796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.442839:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.442840:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.442842:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155641.442843:0:20796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.442844:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.442850:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.442850:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.442852:0:20796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6126a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155641.442855:0:20796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.442856:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.442861:0:20796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.442862:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.442862:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155641.442866:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092e00c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155641.442869:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.442869:0:20796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.442871:0:29728:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.442873:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125956608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 68us (542us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155641.442873:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6126a00/0x844e5faceb5f790b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.442877:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8684 00010000:00010000:3.0:1746155641.442878:0:29728:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.442879:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.442887:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.442892:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e00c00/0x844e5faceb5f792e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.442893:0:29728:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.442899:0:29728:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.442900:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976125954688:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 6549us (6840us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.442907:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16895 00010000:00010000:3.0:1746155641.442908:0:29728:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.442913:0:29728:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800948e4800 already unused, calling callback (ffffffffa0879d70) 00000100:00100000:2.0:1746155641.442915:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1963:x1830976125955328:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 6316us (6753us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155641.442916:0:29728:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.442931:0:29728:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.442931:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.442933:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16900 00010000:00010000:3.0:1746155641.442940:0:29728:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.442947:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125957120 00010000:00010000:3.0:1746155641.442948:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f7920 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.442950:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125957120 00010000:00010000:1.0:1746155641.442961:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094e33e00/0x844e5faceb5f7863 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f38 expref: 40 pid: 1625 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.442972:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976125954816:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 6480us (6847us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.442975:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8685 00000100:00100000:3.0:1746155641.442978:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16898 00000100:00100000:1.0:1746155641.442980:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976125957120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.442985:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155641.442992:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094e33e00/0x844e5faceb5f7863 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f38 expref: 40 pid: 1625 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.442999:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094e33e00/0x844e5faceb5f7863 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f38 expref: 40 pid: 1625 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.443014:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e33e00/0x844e5faceb5f7863 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f38 expref: 40 pid: 1625 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.443023:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155641.443034:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976125957120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 55us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.443039:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8685 00000100:00100000:0.0:1746155641.443560:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976125955584:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 4872us (4990us total) trans 17179874242 rc 0/0 00000100:00100000:0.0:1746155641.443565:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1397 00002000:00100000:0.0:1746155641.443571:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e3:0x0] (1265664->1630207) req@ffff88012cdef800 x1830976125955584/t17179874242(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/448 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155641.443577:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdef800 with x1830976125955584 ext(1265664->1630207) 00010000:00010000:0.0:1746155641.443582:0:25391:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 17 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746155641.443595:0:25391:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 17 pid: 20796 timeout: 870 lvb_type: 0 00002000:00010000:0.0:1746155641.443600:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdef800 00000100:00100000:2.0:1746155641.443659:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.444238:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125957248 00000100:00100000:1.0:1746155641.444242:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125957248 00010000:00010000:1.0:1746155641.444256:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626ec00/0x844e5faceb5f76b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e35 expref: 25 pid: 10591 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.444286:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8686 00000100:00100000:1.0:1746155641.444291:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976125957248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.444297:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155641.444305:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a626ec00/0x844e5faceb5f76b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e35 expref: 25 pid: 10591 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.444311:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a626ec00/0x844e5faceb5f76b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e35 expref: 25 pid: 10591 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.444322:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a626ec00/0x844e5faceb5f76b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e35 expref: 25 pid: 10591 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.444329:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.444331:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.444333:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.444338:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.444361:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155641.444379:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976125957248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 88us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.444384:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8686 00010000:00010000:0.0:1746155641.444416:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.444423:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.444436:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.444442:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.444448:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.444453:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312fac00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155641.444455:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.444459:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.444468:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.444472:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312fac00/0x844e5faceb5f7912 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.444519:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976125954944:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 8161us (8429us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.444523:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16896 00000100:00100000:0.0:1746155641.445303:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.445362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.445434:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125957376 00000100:00100000:2.0:1746155641.445438:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125957376 00010000:00010000:2.0:1746155641.445456:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 17 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.445481:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125957504 00000100:00100000:2.0:1746155641.445483:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125957504 00010000:00010000:2.0:1746155641.445491:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f785c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f31 expref: 18 pid: 1625 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.445528:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8687 00000100:00100000:2.0:1746155641.445533:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976125957376:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.445539:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.445550:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 18 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.445558:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 18 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.445569:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312faa00/0x844e5faceb5f787f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1630207) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f54 expref: 18 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.445579:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.445580:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.445583:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.445589:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.445605:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.445623:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976125957376:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 90us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.445627:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8687 00000100:00100000:2.0:1746155641.445635:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8688 00000100:00100000:2.0:1746155641.445639:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976125957504:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.445644:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.445652:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f785c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f31 expref: 16 pid: 1625 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.445659:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f785c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f31 expref: 16 pid: 1625 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.445669:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f785c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f31 expref: 16 pid: 1625 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.445676:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.445677:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.445679:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.445684:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.445692:0:10591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.445694:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155641.445700:0:10591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.445706:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976125957504:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 67us (345us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155641.445707:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.445711:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8688 00010000:00010000:0.0:1746155641.445714:0:10591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.445717:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.445719:0:10591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.445729:0:10591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.445730:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.445737:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.445738:0:10591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312fa000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155641.445743:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.445744:0:10591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.445748:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a609600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155641.445749:0:10591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.445750:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.445756:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.445756:0:10591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.445761:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f7927 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.445764:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.445769:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a609600/0x844e5faceb5f7919 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.445810:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976125955072:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 9313us (9672us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.445813:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a15bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976125955200:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 9449us (9700us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.445816:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16899 00000100:00100000:3.0:1746155641.445819:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16897 00000100:00100000:0.0:1746155641.447160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.447363:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125957760 00000100:00100000:1.0:1746155641.447368:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125957760 00000100:00100000:1.0:1746155641.447399:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11107 00000100:00100000:1.0:1746155641.447405:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32323:x1830976125957760:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:1.0:1746155641.447439:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155641.447458:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f78e8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17f93 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.447472:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155641.447475:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155641.447496:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.447538:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cad expref: 21 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.447545:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 302 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.447555:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f756f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d6a expref: 21 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.447560:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29a600/0x844e5faceb5f75df lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db0 expref: 21 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.447566:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x844e5faceb5f7744 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e82 expref: 302 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.447572:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.447592:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x844e5faceb5f7744 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e82 expref: 302 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.447602:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x844e5faceb5f7744 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e82 expref: 302 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.447612:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125355520:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.447680:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29a600/0x844e5faceb5f75df lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db0 expref: 21 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.447688:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29a600/0x844e5faceb5f75df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db0 expref: 21 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.447695:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910da300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125355648:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.447717:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f756f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d6a expref: 21 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.447724:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f756f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d6a expref: 21 pid: 14234 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.448203:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910da680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125355776:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.448244:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 302 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.448250:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 302 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.448257:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910db480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125355904:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.448283:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cad expref: 21 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.448289:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cad expref: 21 pid: 14234 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.448295:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125356032:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.448308:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.448842:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.448878:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125958016 00000100:00100000:2.0:1746155641.448881:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125958016 00000100:00100000:0.0:1746155641.448891:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155641.448897:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29a600/0x844e5faceb5f75df lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db0 expref: 22 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.448913:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125957888 00000100:00100000:2.0:1746155641.448915:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125957888 00010000:00010000:2.0:1746155641.448935:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x844e5faceb5f7744 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e82 expref: 303 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.448950:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8689 00000100:00100000:3.0:1746155641.448958:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976125958016:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155641.448963:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8690 00010000:00010000:3.0:1746155641.448966:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155641.448968:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:1961:x1830976125957888:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.448973:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29a600/0x844e5faceb5f75df lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db0 expref: 22 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.448977:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.448981:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x844e5faceb5f7744 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e82 expref: 303 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.448982:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29a600/0x844e5faceb5f75df lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db0 expref: 22 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.448989:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x844e5faceb5f7744 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e82 expref: 303 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.449016:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155641.449020:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.449026:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155641.449027:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.449030:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.449035:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155641.449052:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976125958016:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 95us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.449052:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+303:1961:x1830976125957888:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 84us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.449058:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8689 00000100:00100000:2.0:1746155641.449061:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8690 00010000:00010000:1.0:1746155641.449199:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x844e5faceb5f7744 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17e82 expref: 302 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.449207:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125355520:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.449212:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c29a600/0x844e5faceb5f75df lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17db0 expref: 21 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.449224:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910da300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125355648:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155641.450254:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.450308:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.450313:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125958272 00000100:00100000:3.0:1746155641.450318:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125958272 00000100:00100000:3.0:1746155641.450342:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4712 00000100:00100000:3.0:1746155641.450347:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:23568:x1830976125958272:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746155641.450351:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125958400 00000100:00100000:2.0:1746155641.450355:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125958400 00010000:00010000:2.0:1746155641.450369:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 302 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.450375:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910da680 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125355776:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.450383:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910db480 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125355904:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.450386:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8691 00000100:00100000:1.0:1746155641.450388:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125356032:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.450391:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:1960:x1830976125958400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.450398:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.450402:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 302 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.450409:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 302 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.450463:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155641.450483:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:23568:x1830976125958272:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 134us (230us total) trans 8589945266 rc 0/0 00000100:00100000:3.0:1746155641.450489:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4712 00010000:00010000:2.0:1746155641.450583:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136b1d000/0x844e5faceb5f7481 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cc9 expref: 302 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.450593:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.450596:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.450602:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.450717:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1960:x1830976125958400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 240us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.450723:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8691 00000100:00100000:0.0:1746155641.450858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.450891:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125958528 00000100:00100000:2.0:1746155641.450894:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125958528 00010000:00010000:2.0:1746155641.450905:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cad expref: 22 pid: 14234 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.450936:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8692 00000100:00100000:2.0:1746155641.450941:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976125958528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.450947:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.450950:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cad expref: 22 pid: 14234 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.450957:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cad expref: 22 pid: 14234 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.450965:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131443800/0x844e5faceb5f7442 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17cad expref: 22 pid: 14234 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.450974:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.450976:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.450980:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.451007:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976125958528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 66us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.451013:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8692 00000100:00100000:2.0:1746155641.453905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.453984:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125958656 00000100:00100000:3.0:1746155641.453991:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125958656 00010000:00010000:3.0:1746155641.454015:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f756f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d6a expref: 21 pid: 14234 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.454038:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8693 00000100:00100000:3.0:1746155641.454044:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1961:x1830976125958656:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.454057:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155641.454061:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f756f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d6a expref: 21 pid: 14234 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.454071:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f756f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d6a expref: 21 pid: 14234 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.454087:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36e00/0x844e5faceb5f756f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17d6a expref: 21 pid: 14234 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.454099:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155641.454103:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.454109:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.454115:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.454145:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155641.454178:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155641.454186:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976125958656:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 141us (288us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155641.454187:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155641.454192:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8693 00000040:00080000:1.0:1746155641.455294:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3571, 88 off301160 00000004:00080000:1.0:1746155641.455301:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770604797940ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155641.455345:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3577, 88 off301952 00000004:00080000:1.0:1746155641.455349:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770604846400ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155641.455368:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3578, 88 off302040 00000004:00080000:1.0:1746155641.455371:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770604867691ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155641.455378:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3572, 88 off301248 00000004:00080000:1.0:1746155641.455380:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770604877252ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155641.455388:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3573, 88 off301336 00000004:00080000:1.0:1746155641.455390:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770604887305ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155641.455399:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3579, 88 off302128 00000004:00080000:1.0:1746155641.455403:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770604899587ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155641.455639:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3580, 88 off302216 00000004:00080000:1.0:1746155641.455645:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770605141532ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155641.455670:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3581, 88 off302304 00000004:00080000:1.0:1746155641.455674:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770605170667ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155641.455681:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3574, 88 off301424 00000004:00080000:1.0:1746155641.455685:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770605182487ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155641.455705:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3582, 88 off302392 00000004:00080000:1.0:1746155641.455708:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770605205023ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155641.455713:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3575, 88 off301512 00000004:00080000:1.0:1746155641.455716:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770605212785ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155641.455724:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3583, 88 off302480 00000004:00080000:1.0:1746155641.455727:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770605223703ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155641.455732:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3576, 88 off301600 00000004:00080000:1.0:1746155641.455957:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770605231895ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155641.455979:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3577, 88 off301688 00000004:00080000:1.0:1746155641.455984:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770605480626ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155641.455992:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3578, 88 off301776 00000004:00080000:1.0:1746155641.455994:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770605491053ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155641.456001:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3579, 88 off301864 00000004:00080000:1.0:1746155641.456003:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770605499985ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155641.456011:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3584, 88 off302568 00000004:00080000:1.0:1746155641.456014:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770605510931ns, next at 716011101328ns, rc = 0 00000004:00010000:1.0:1746155641.473618:0:27374:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012cdef480 reply state ffff880093985000 transno 8589945267 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155641.473631:0:27374:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746155641.473733:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:32323:x1830976125957760:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 26324us (26571us total) trans 8589945267 rc 0/0 00000100:00100000:1.0:1746155641.473740:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11107 00000001:00080000:0.0:1746155641.473783:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945261 is committed 00000001:00080000:0.0:1746155641.473810:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945267 is committed 00000004:00080000:0.0:1746155641.473814:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2769 committed 00000004:00080000:0.0:1746155641.473819:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2758 committed 00000004:00080000:0.0:1746155641.473825:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2757 committed 00000004:00080000:0.0:1746155641.473827:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2756 committed 00000004:00080000:0.0:1746155641.473828:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2755 committed 00000004:00080000:0.0:1746155641.473830:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2768 committed 00000004:00080000:0.0:1746155641.473832:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2754 committed 00000004:00080000:0.0:1746155641.473833:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2767 committed 00000004:00080000:0.0:1746155641.473835:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2753 committed 00000004:00080000:0.0:1746155641.473836:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2766 committed 00000004:00080000:0.0:1746155641.473839:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2765 committed 00000004:00080000:0.0:1746155641.473841:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2764 committed 00000004:00080000:0.0:1746155641.473842:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2752 committed 00000004:00080000:0.0:1746155641.473844:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2751 committed 00000004:00080000:0.0:1746155641.473845:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2763 committed 00000004:00080000:0.0:1746155641.473847:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2762 committed 00000004:00080000:0.0:1746155641.473848:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2750 committed 00000001:00080000:0.0:1746155641.473862:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945255 is committed 00000001:00080000:0.0:1746155641.473872:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945263 is committed 00000001:00080000:0.0:1746155641.473898:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945266 is committed 00000001:00080000:0.0:1746155641.473902:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945262 is committed 00000100:00100000:0.0:1746155641.474080:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125356160:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155641.474081:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125356288:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746155641.474083:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.474090:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.474096:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.474101:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a887a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155641.474104:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.474109:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155641.474118:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.474119:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125356544:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746155641.474121:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155641.474124:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155641.474127:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.474132:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887a00/0x844e5faceb5f7935 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155641.474145:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155641.474146:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125356800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155641.474146:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125356416:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.474161:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125357056:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155641.474162:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.474175:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155641.474176:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125357312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155641.474183:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125356288 00000100:00100000:0.0:1746155641.474184:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125357568:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155641.474188:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.474189:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125356288 00000100:00100000:0.0:1746155641.474197:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155641.474199:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125357824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.474209:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125358080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155641.474210:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.474219:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125356544 00000100:00100000:1.0:1746155641.474221:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125356544 00000100:00100000:0.0:1746155641.474221:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.474240:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125356800 00000100:00100000:1.0:1746155641.474243:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125356800 00000100:00100000:0.0:1746155641.474249:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125357056 00000100:00100000:0.0:1746155641.474252:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125357056 00000100:00100000:1.0:1746155641.474254:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125357312 00000100:00100000:1.0:1746155641.474256:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125357312 00000100:00100000:0.0:1746155641.474269:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125357568 00000100:00100000:1.0:1746155641.474270:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125357824 00000100:00100000:0.0:1746155641.474271:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125357568 00000100:00100000:1.0:1746155641.474272:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125357824 00000100:00100000:1.0:1746155641.474278:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125358080 00000100:00100000:1.0:1746155641.474280:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125358080 00000100:00100000:0.0:1746155641.474282:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16901 00000100:00100000:0.0:1746155641.474287:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3296:x1830976125356288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155641.474288:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16902 00000100:00100000:1.0:1746155641.474293:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3298:x1830976125356544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155641.474319:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16903 00000100:00100000:2.0:1746155641.474324:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3296:x1830976125356800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155641.474429:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+63:3298:x1830976125356544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (282us total) trans 17179874243 rc 0/0 00000100:00100000:1.0:1746155641.474434:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16902 00000100:00100000:1.0:1746155641.474444:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16904 00000100:00100000:1.0:1746155641.474453:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3298:x1830976125357056:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155641.474551:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3298:x1830976125357056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (374us total) trans 21474841568 rc 0/0 00000100:00100000:1.0:1746155641.474556:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16904 00000100:00100000:1.0:1746155641.474566:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16905 00000100:00100000:1.0:1746155641.474569:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976125357312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155641.474623:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:1.0:1746155641.474626:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155641.474628:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746155641.474629:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155641.474631:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746155641.474668:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3296:x1830976125357312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 98us (479us total) trans 21474841569 rc 0/0 00000100:00100000:1.0:1746155641.474673:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16905 00000100:00100000:0.0:1746155641.474683:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+62:3296:x1830976125356288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 395us (563us total) trans 17179874244 rc 0/0 00000100:00100000:2.0:1746155641.474684:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976125356800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 361us (521us total) trans 21474841567 rc 0/0 00000100:00100000:1.0:1746155641.474684:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16906 00000100:00100000:1.0:1746155641.474688:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3296:x1830976125357824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.474689:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16901 00000100:00100000:2.0:1746155641.474691:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16903 00000100:00100000:0.0:1746155641.474699:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16907 00000100:00100000:2.0:1746155641.474702:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16908 00000100:00100000:0.0:1746155641.474704:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3298:x1830976125357568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155641.474706:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+57:3298:x1830976125358080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155641.474755:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3296:x1830976125357824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (543us total) trans 21474841570 rc 0/0 00000100:00100000:1.0:1746155641.474760:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16906 00000100:00100000:2.0:1746155641.474768:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3298:x1830976125358080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (545us total) trans 21474841571 rc 0/0 00000100:00100000:2.0:1746155641.474772:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16908 00000100:00080000:1.0:1746155641.474773:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746155641.474775:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155641.474783:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+62:3298:x1830976125357568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (584us total) trans 17179874245 rc 0/0 00000100:00100000:0.0:1746155641.474788:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16907 00000100:00100000:1.0:1746155641.474791:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.474798:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125356416 00000100:00100000:0.0:1746155641.474800:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125356416 00000100:00100000:1.0:1746155641.474803:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125356928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.474813:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16909 00000100:00100000:0.0:1746155641.474817:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3297:x1830976125356416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155641.474819:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.474830:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125357440:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155641.474835:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9d880/2, rc 0, transno 17179874244 00000100:00100000:3.0:1746155641.474842:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125356288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155641.474842:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746155641.474850:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf4a80/2, rc 0, transno 21474841567 00000100:00100000:1.0:1746155641.474851:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125357952:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.474853:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125356800:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155641.474858:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf4e00/2, rc 0, transno 21474841569 00000100:00100000:3.0:1746155641.474861:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125357312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155641.474861:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746155641.474866:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f703480/2, rc 0, transno 21474841570 00000100:00100000:3.0:1746155641.474868:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125357824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155641.474877:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125356928 00000100:00100000:1.0:1746155641.474879:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125356928 00000100:00100000:3.0:1746155641.474890:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746155641.474890:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125357440 00000100:00100000:1.0:1746155641.474892:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125357440 00000100:00100000:3.0:1746155641.474894:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125358208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155641.474899:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16910 00000100:00100000:1.0:1746155641.474902:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3297:x1830976125356928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155641.474999:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125357952 00000100:00100000:2.0:1746155641.475002:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125357952 00000100:00100000:2.0:1746155641.475014:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16911 00000100:00100000:2.0:1746155641.475018:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+65:3297:x1830976125357440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.475332:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.475332:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+66:3297:x1830976125356928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 428us (512us total) trans 17179874246 rc 0/0 00000100:00100000:1.0:1746155641.475337:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16910 00000100:00100000:1.0:1746155641.475346:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125358208 00000100:00100000:1.0:1746155641.475348:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125358208 00000100:00100000:1.0:1746155641.475357:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16912 00000100:00100000:1.0:1746155641.475360:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+66:3297:x1830976125357952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.475400:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+59:3297:x1830976125356416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 581us (607us total) trans 21474841572 rc 0/0 00000100:00100000:0.0:1746155641.475406:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16909 00000100:00100000:2.0:1746155641.475409:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3297:x1830976125357440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 386us (562us total) trans 17179874247 rc 0/0 00000100:00100000:2.0:1746155641.475414:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16911 00000100:00100000:0.0:1746155641.475417:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16913 00000100:00100000:0.0:1746155641.475421:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3296:x1830976125358208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155641.475429:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+66:3297:x1830976125357952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (567us total) trans 17179874248 rc 0/0 00000100:00100000:1.0:1746155641.475433:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16912 00000004:00080000:1.0:1746155641.475457:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf6a00/2, rc 0, transno 21474841572 00000100:00100000:1.0:1746155641.475460:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125356416:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155641.475466:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9dc00/2, rc 0, transno 17179874246 00000100:00100000:1.0:1746155641.475468:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125356928:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155641.475473:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9ed80/2, rc 0, transno 17179874247 00000100:00100000:1.0:1746155641.475475:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125357440:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155641.475480:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fff5c00/2, rc 0, transno 17179874248 00000100:00100000:1.0:1746155641.475482:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125357952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.475494:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3296:x1830976125358208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (165us total) trans 17179874249 rc 0/0 00000100:00100000:0.0:1746155641.475499:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16913 00000100:00100000:0.0:1746155641.475556:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.475576:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125356672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.475591:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.475599:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125357184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.475603:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125356160 00000100:00100000:3.0:1746155641.475607:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125356160 00000100:00100000:0.0:1746155641.475609:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.475616:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125357696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155641.475620:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125356672 00000100:00100000:3.0:1746155641.475622:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125356672 00000100:00100000:0.0:1746155641.475626:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155641.475630:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125357184 00000100:00100000:3.0:1746155641.475632:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125357184 00000100:00100000:3.0:1746155641.475639:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125357696 00000100:00100000:3.0:1746155641.475640:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125357696 00000004:00080000:0.0:1746155641.475649:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9d180/2, rc 0, transno 17179874243 00000100:00100000:0.0:1746155641.475652:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125356544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.475655:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16914 00000004:00080000:0.0:1746155641.475657:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf5880/2, rc 0, transno 21474841568 00000100:00100000:3.0:1746155641.475659:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3295:x1830976125356160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.475660:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125357056:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155641.475665:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9c700/2, rc 0, transno 17179874245 00000100:00100000:0.0:1746155641.475667:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125357568:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155641.475671:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f701c00/2, rc 0, transno 21474841571 00000100:00100000:0.0:1746155641.475673:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125358080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.475731:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16915 00000100:00100000:0.0:1746155641.475736:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3295:x1830976125356672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.475813:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3295:x1830976125356672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (221us total) trans 17179874250 rc 0/0 00000100:00100000:0.0:1746155641.475817:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16915 00000100:00100000:0.0:1746155641.475827:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16916 00000100:00100000:0.0:1746155641.475831:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3295:x1830976125357184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.475896:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3295:x1830976125357184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (284us total) trans 17179874251 rc 0/0 00000100:00100000:0.0:1746155641.475903:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16916 00000100:00100000:0.0:1746155641.475912:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16917 00000100:00100000:0.0:1746155641.475917:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3295:x1830976125357696:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155641.476038:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9c380/2, rc 0, transno 17179874250 00000100:00100000:0.0:1746155641.476041:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125356672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155641.476048:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130c9f800/2, rc 0, transno 17179874251 00000100:00100000:0.0:1746155641.476051:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130c9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125357184:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.476196:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3295:x1830976125356160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 536us (638us total) trans 21474841573 rc 0/0 00000100:00100000:3.0:1746155641.476202:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16914 00000004:00080000:3.0:1746155641.476220:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6063100/2, rc 0, transno 17179874249 00000004:00080000:1.0:1746155641.476223:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf7b80/2, rc 0, transno 21474841573 00000100:00100000:3.0:1746155641.476224:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125358208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155641.476227:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125356160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.477089:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3295:x1830976125357696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1170us (1459us total) trans 21474841574 rc 0/0 00000100:00100000:0.0:1746155641.477096:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16917 00000004:00080000:1.0:1746155641.477305:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f700000/2, rc 0, transno 21474841574 00000100:00100000:1.0:1746155641.477310:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125357696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.478070:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.478224:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125958784 00000100:00100000:1.0:1746155641.478232:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125958784 00000100:00100000:1.0:1746155641.478261:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11108 00000100:00100000:1.0:1746155641.478267:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32323:x1830976125958784:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.478284:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.478298:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887800/0x844e5faceb5f793c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17fa8 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.478340:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887800/0x844e5faceb5f793c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fa8 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.478351:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887800/0x844e5faceb5f793c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fa8 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.478370:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155641.478373:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155641.478375:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a887800, rc 0) 00000100:00100000:1.0:1746155641.478418:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32323:x1830976125958784:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 151us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.478423:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11108 00000100:00100000:0.0:1746155641.480491:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.480728:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125958912 00000100:00100000:2.0:1746155641.480735:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125958912 00000100:00100000:2.0:1746155641.480770:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11109 00000100:00100000:2.0:1746155641.480776:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32323:x1830976125958912:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155641.480789:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.480803:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608a00/0x844e5faceb5f7943 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17faf expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.480865:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a609200/0x844e5faceb5f794a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.480874:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a609200/0x844e5faceb5f794a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.480882:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a609200/0x844e5faceb5f794a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155641.480903:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155641.480906:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155641.480929:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a609200/0x844e5faceb5f794a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.480948:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608a00/0x844e5faceb5f7943 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17faf expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.480961:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a609200/0x844e5faceb5f794a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17faf expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.480968:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.480970:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155641.480977:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a609200, rc 0) 00000100:00100000:2.0:1746155641.481007:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32323:x1830976125958912:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 231us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.481013:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11109 00000100:00100000:2.0:1746155641.484170:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.484652:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.484678:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.484737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.484788:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125959168 00000100:00100000:3.0:1746155641.484794:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125959168 00000100:00100000:3.0:1746155641.484835:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125959424 00000100:00100000:3.0:1746155641.484837:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125959424 00000100:00100000:3.0:1746155641.484847:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125959680 00000100:00100000:3.0:1746155641.484849:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125959680 00000100:00100000:3.0:1746155641.484856:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125959040 00000100:00100000:3.0:1746155641.484858:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125959040 00000100:00100000:3.0:1746155641.484867:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16918 00000100:00100000:1.0:1746155641.484877:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16919 00000100:00100000:1.0:1746155641.484885:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125959424:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.484899:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.484913:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a887000/0x844e5faceb5f7951 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17fcb expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155641.484945:0:9235:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e3:0x0] initial LVB size: 2097152, mtime: 0x68143879, atime: 0x68143878, ctime: 0x68143879, blocks: 0x821 00010000:00010000:1.0:1746155641.484961:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.484962:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155641.484968:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16920 00010000:00010000:1.0:1746155641.484969:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a887000/0x844e5faceb5f7951 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fcb expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155641.484976:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125959680:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.484982:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a887000/0x844e5faceb5f7951 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fcb expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155641.484984:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.484991:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a887000, rc 0) 00010000:00010000:0.0:1746155641.484994:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f7958 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17fd9 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155641.485010:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e2:0x0] initial LVB size: 4194304, mtime: 0x68143879, atime: 0x68143879, ctime: 0x68143879, blocks: 0x1029 00010000:00010000:0.0:1746155641.485019:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155641.485020:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155641.485024:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f7958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd9 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155641.485028:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125959424:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 144us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.485034:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16919 00010000:00010000:0.0:1746155641.485034:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f7958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd9 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155641.485041:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fbc00, rc 0) 00000100:00100000:1.0:1746155641.485048:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16921 00000100:00100000:1.0:1746155641.485053:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976125959040:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.485058:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155641.485059:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125959680:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 84us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.485063:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16920 00010000:00010000:1.0:1746155641.485065:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a886600/0x844e5faceb5f795f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17fb6 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155641.485074:0:9235:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e1:0x0] initial LVB size: 1048576, mtime: 0x68143879, atime: 0x68143879, ctime: 0x68143879, blocks: 0x7e9 00010000:00010000:1.0:1746155641.485080:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.485082:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.485085:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a886600/0x844e5faceb5f795f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fb6 expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155641.485090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155641.485093:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a886600/0x844e5faceb5f795f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fb6 expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.485099:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a886600, rc 0) 00000100:00100000:1.0:1746155641.485113:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125959040:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 60us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.485118:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16921 00000100:00100000:1.0:1746155641.485126:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125959296 00000100:00100000:1.0:1746155641.485128:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125959296 00000100:00100000:0.0:1746155641.485132:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.485143:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125959552 00000100:00100000:1.0:1746155641.485145:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125959552 00000100:00100000:1.0:1746155641.485155:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16922 00000100:00100000:1.0:1746155641.485159:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125959296:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.485165:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.485171:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f7966 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17fc4 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155641.485173:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16923 00000100:00100000:0.0:1746155641.485179:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976125959552:12345-192.168.202.51@tcp:101:lfs.0 00002000:00010000:1.0:1746155641.485181:0:9235:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x68143878, atime: 0x68143878, ctime: 0x68143878, blocks: 0x81d 00010000:00010000:0.0:1746155641.485187:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.485188:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.485189:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.485192:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f7966 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fc4 expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155641.485194:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312fb800/0x844e5faceb5f796d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17fd2 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.485200:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f7966 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fc4 expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746155641.485204:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e4:0x0] initial LVB size: 5079552, mtime: 0x68143879, atime: 0x68143879, ctime: 0x68143879, blocks: 0x1711 00010000:00010000:1.0:1746155641.485206:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a886a00, rc 0) 00010000:00010000:0.0:1746155641.485212:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155641.485214:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155641.485218:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fb800/0x844e5faceb5f796d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd2 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155641.485221:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125959296:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 62us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.485225:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16922 00010000:00010000:0.0:1746155641.485226:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312fb800/0x844e5faceb5f796d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd2 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155641.485233:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fb800, rc 0) 00000100:00100000:0.0:1746155641.485249:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125959552:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 70us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.485253:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16923 00000100:00100000:3.0:1746155641.485280:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125959168:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155641.485287:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.485295:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7974 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17fbd expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155641.485307:0:29728:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x68143879, atime: 0x68143879, ctime: 0x68143879, blocks: 0x821 00010000:00010000:3.0:1746155641.485315:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.485316:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.485320:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7974 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fbd expref: 15 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155641.485328:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7974 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fbd expref: 15 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155641.485333:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3ba00, rc 0) 00000100:00100000:3.0:1746155641.485354:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125959168:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 481us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.485358:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16918 00000100:00100000:0.0:1746155641.491300:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.491890:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125959936 00000100:00100000:2.0:1746155641.491898:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125959936 00000100:00100000:2.0:1746155641.492316:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8039 00000100:00100000:2.0:1746155641.492324:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125959936:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155641.492359:0:25391:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a609400/0x844e5faceb5f797b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.492371:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.492373:0:25391:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.492377:0:25391:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a609400/0x844e5faceb5f797b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.492389:0:25391:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a609400/0x844e5faceb5f797b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.495800:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.495820:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.495848:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.495860:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.495878:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125960320 00000100:00100000:2.0:1746155641.495885:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125960320 00000100:00100000:2.0:1746155641.495937:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125960448 00000100:00100000:2.0:1746155641.495939:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125960448 00000100:00100000:2.0:1746155641.495952:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125960832 00000100:00100000:2.0:1746155641.495953:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125960832 00000100:00100000:2.0:1746155641.495970:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125960704 00000100:00100000:2.0:1746155641.495971:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125960704 00000100:00100000:2.0:1746155641.495985:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8040 00000100:00100000:2.0:1746155641.495992:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125960320:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155641.496019:0:31253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7982 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.496031:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.496033:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.496038:0:31253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7982 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.496048:0:31253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7982 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.496517:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8041 00000100:00100000:1.0:1746155641.496525:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125960448:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155641.496539:0:31252:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a886c00/0x844e5faceb5f7989 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.496545:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.496546:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.496548:0:31252:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886c00/0x844e5faceb5f7989 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.496555:0:31252:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a886c00/0x844e5faceb5f7989 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.497180:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8042 00000100:00100000:3.0:1746155641.497187:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976125960832:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155641.497204:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7990 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.497212:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.497213:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.497216:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7990 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.497224:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7990 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.497647:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8043 00000100:00100000:1.0:1746155641.497653:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976125960704:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155641.497666:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a887e00/0x844e5faceb5f7997 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.497672:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.497673:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.497676:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a887e00/0x844e5faceb5f7997 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.497683:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a887e00/0x844e5faceb5f7997 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.498149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.498166:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125961344 00000100:00100000:2.0:1746155641.498171:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125961344 00000100:00100000:2.0:1746155641.498200:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8044 00000100:00100000:2.0:1746155641.498204:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1961:x1830976125961344:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155641.498216:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094e11000/0x844e5faceb5f799e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.498223:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.498224:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.498227:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e11000/0x844e5faceb5f799e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.498234:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e11000/0x844e5faceb5f799e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.498721:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.498731:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125961472 00000100:00100000:1.0:1746155641.498734:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125961472 00000100:00100000:3.0:1746155641.498755:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.498865:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125961728 00000100:00100000:1.0:1746155641.498868:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125961728 00000100:00100000:3.0:1746155641.498875:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8045 00000100:00100000:3.0:1746155641.498882:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1960:x1830976125961472:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:1.0:1746155641.498885:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8046 00000100:00100000:1.0:1746155641.498890:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+21:1962:x1830976125961728:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155641.498898:0:31251:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3bc00/0x844e5faceb5f79a5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.498902:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f79ac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.498905:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.498907:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.498910:0:31251:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3bc00/0x844e5faceb5f79a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.498933:0:31251:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3bc00/0x844e5faceb5f79a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.499142:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.499144:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.499147:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f79ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.499158:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f79ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.503407:0:25391:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a609400/0x844e5faceb5f797b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.503422:0:25391:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a609400/0x844e5faceb5f797b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.503429:0:25391:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a609400/0x844e5faceb5f797b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.503435:0:25391:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a609400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155641.503439:0:25391:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a609400/0x844e5faceb5f797b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.503447:0:25391:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a609400/0x844e5faceb5f797b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.503468:0:25391:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a609400/0x844e5faceb5f797b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.503474:0:25391:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a609400/0x844e5faceb5f797b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25391 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.503571:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1961:x1830976125959936:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 11243us (12272us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.503580:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8039 00010000:00010000:1.0:1746155641.506481:0:31252:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a886c00/0x844e5faceb5f7989 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.506496:0:31252:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886c00/0x844e5faceb5f7989 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.506535:0:31252:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a886c00/0x844e5faceb5f7989 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.506542:0:31252:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a886c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155641.506546:0:31252:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a886c00/0x844e5faceb5f7989 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.506553:0:31252:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a886c00/0x844e5faceb5f7989 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.506568:0:31252:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a886c00/0x844e5faceb5f7989 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.506574:0:31252:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a886c00/0x844e5faceb5f7989 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.506710:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+21:1961:x1830976125960448:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 10181us (10883us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155641.506723:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8041 00010000:00010000:2.0:1746155641.508855:0:31253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7982 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.508870:0:31253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7982 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.508877:0:31253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.508883:0:31253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a608800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155641.508887:0:31253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7982 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.508894:0:31253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7982 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.508912:0:31253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7982 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.508929:0:31253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7982 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.508997:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1961:x1830976125960320:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 13001us (13201us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.509006:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8040 00010000:00010000:3.0:1746155641.512406:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7990 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.512422:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7990 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.512428:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.512439:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3ac00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155641.512442:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7990 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.512448:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7990 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.512464:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7990 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.512469:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7990 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.512585:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1961:x1830976125960832:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 15394us (16730us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.512593:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8042 00010000:00010000:1.0:1746155641.513399:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a887e00/0x844e5faceb5f7997 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.513409:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a887e00/0x844e5faceb5f7997 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.513415:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a887e00/0x844e5faceb5f7997 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.513420:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a887e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155641.513423:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a887e00/0x844e5faceb5f7997 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.513429:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a887e00/0x844e5faceb5f7997 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.513439:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a887e00/0x844e5faceb5f7997 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.513445:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a887e00/0x844e5faceb5f7997 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.513490:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125960704:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 15835us (17627us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155641.513497:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8043 00010000:00010000:2.0:1746155641.515794:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094e11000/0x844e5faceb5f799e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.515807:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094e11000/0x844e5faceb5f799e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.515814:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094e11000/0x844e5faceb5f799e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.515819:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e11000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155641.515822:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e11000/0x844e5faceb5f799e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.515828:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e11000/0x844e5faceb5f799e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.515844:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094e11000/0x844e5faceb5f799e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.515855:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e11000/0x844e5faceb5f799e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.515929:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976125961344:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 17711us (17767us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.515938:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8044 00010000:00010000:1.0:1746155641.520985:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f79ac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.520999:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f79ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.521006:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f79ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.521012:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a886e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155641.521016:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f79ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.521023:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f79ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.521038:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f79ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.521044:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a886e00/0x844e5faceb5f79ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.521203:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1962:x1830976125961728:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 22308us (22443us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155641.521212:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8046 00010000:00010000:3.0:1746155641.522736:0:31251:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3bc00/0x844e5faceb5f79a5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.522747:0:31251:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3bc00/0x844e5faceb5f79a5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.522753:0:31251:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fd3bc00/0x844e5faceb5f79a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.522759:0:31251:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3bc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155641.522762:0:31251:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd3bc00/0x844e5faceb5f79a5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.522769:0:31251:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fd3bc00/0x844e5faceb5f79a5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.522780:0:31251:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fd3bc00/0x844e5faceb5f79a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.522786:0:31251:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3bc00/0x844e5faceb5f79a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.522846:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125961472:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 23963us (24124us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.522853:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8045 00000100:00100000:2.0:1746155641.528012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.528075:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125961984 00000100:00100000:0.0:1746155641.528083:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125961984 00000100:00100000:0.0:1746155641.528127:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11110 00000100:00100000:0.0:1746155641.528135:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32323:x1830976125961984:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:0.0:1746155641.528171:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155641.528192:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a609200/0x844e5faceb5f794a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17faf expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.528225:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155641.528229:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155641.528306:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f79b3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.528317:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f79b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.528324:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f79b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00010000:0.0:1746155641.528464:0:27374:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800910ca680 reply state ffff88009f8b7000 transno 8589945268 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f79b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155641.528470:0:27374:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746155641.528548:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32323:x1830976125961984:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 414us (543us total) trans 8589945268 rc 0/0 00000100:00100000:0.0:1746155641.528554:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11110 00010000:00010000:1.0:1746155641.529950:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f79b3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.529959:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f79b3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.529969:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f79b3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.529974:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6126800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155641.529977:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f79b3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.529982:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f79b3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.529992:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155641.529994:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155641.529996:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f79b3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155641.530001:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f79b3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155641.530136:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.530201:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125962112 00000100:00100000:2.0:1746155641.530207:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125962112 00000100:00100000:2.0:1746155641.530577:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16924 00000100:00100000:2.0:1746155641.530584:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:32323:x1830976125962112:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155641.530596:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.530611:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008e3b8a00/0x844e5faceb5f79ba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17fe0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.530632:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a886600/0x844e5faceb5f795f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fb6 expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.530639:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.530641:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.530643:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e3b8a00/0x844e5faceb5f79ba lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe0 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.530723:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a886600/0x844e5faceb5f795f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fb6 expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.530738:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a886600/0x844e5faceb5f795f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fb6 expref: 15 pid: 9235 timeout: 870 lvb_type: 1 00000100:00100000:2.0:1746155641.530747:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125358336:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.531119:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b259de40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155641.534968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.535133:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125962240 00000100:00100000:3.0:1746155641.535141:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125962240 00010000:00010000:3.0:1746155641.535175:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a886600/0x844e5faceb5f795f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fb6 expref: 16 pid: 9235 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746155641.535211:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8694 00000100:00100000:3.0:1746155641.535219:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125962240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.535230:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155641.535246:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a886600/0x844e5faceb5f795f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fb6 expref: 16 pid: 9235 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.535256:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a886600/0x844e5faceb5f795f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fb6 expref: 16 pid: 9235 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.535279:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.535281:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.535286:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e3b8a00/0x844e5faceb5f79ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe0 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.535293:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008e3b8a00/0x844e5faceb5f79ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe0 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.535316:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008e3b8a00/0x844e5faceb5f79ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe0 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.535327:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125358464:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155641.535345:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a886600/0x844e5faceb5f795f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fb6 expref: 16 pid: 9235 timeout: 870 lvb_type: 1 00000100:00100000:0.0:1746155641.535362:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125358336:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155641.535380:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008e3b8a00/0x844e5faceb5f79ba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe0 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.535388:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e3b8a00, rc 0) 00000100:00100000:0.0:1746155641.536021:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:32323:x1830976125962112:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5436us (5885us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.536027:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16924 00000100:00100000:3.0:1746155641.536118:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.538441:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.538525:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125962368 00000100:00100000:1.0:1746155641.538530:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125962368 00000100:00100000:3.0:1746155641.538531:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125358464:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155641.538547:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155641.539132:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16925 00000100:00100000:1.0:1746155641.539139:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:32323:x1830976125962368:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:3.0:1746155641.539147:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125962240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3929us (4185us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155641.539152:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155641.539154:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8694 00010000:00010000:1.0:1746155641.539164:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a886000/0x844e5faceb5f79c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17fe7 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.539209:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7974 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fbd expref: 16 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.539218:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.539220:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.539223:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886000/0x844e5faceb5f79c1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe7 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.539245:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7974 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fbd expref: 16 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.539255:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7974 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fbd expref: 16 pid: 29728 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.539267:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125358592:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.539322:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.540334:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125358592:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.540351:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a886000/0x844e5faceb5f79c1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe7 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.540362:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a886000, rc 0) 00000100:00100000:1.0:1746155641.540394:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:32323:x1830976125962368:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1255us (1956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.540400:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16925 00000100:00100000:0.0:1746155641.541215:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.541285:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125962496 00000100:00100000:3.0:1746155641.541290:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125962496 00010000:00010000:3.0:1746155641.541307:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7974 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fbd expref: 16 pid: 29728 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746155641.541329:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8695 00000100:00100000:3.0:1746155641.541335:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125962496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.541345:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155641.541360:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7974 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fbd expref: 16 pid: 29728 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.541369:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7974 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fbd expref: 16 pid: 29728 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.541386:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7974 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fbd expref: 16 pid: 29728 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.541401:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.541403:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.541408:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a886000/0x844e5faceb5f79c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe7 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.541414:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886000/0x844e5faceb5f79c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe7 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.541435:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a886000/0x844e5faceb5f79c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe7 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.541443:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125358720:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155641.541520:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155641.542661:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125358720:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155641.542674:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155641.542695:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125962496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1360us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.542703:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8695 00000100:00100000:0.0:1746155641.542977:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.543072:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125962624 00000100:00100000:1.0:1746155641.543077:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125962624 00000100:00100000:1.0:1746155641.543112:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16926 00000100:00100000:1.0:1746155641.543118:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:32323:x1830976125962624:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.543129:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.543140:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a886400/0x844e5faceb5f79c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17fee expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.543165:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f7966 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fc4 expref: 16 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.543171:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.543173:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.543175:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886400/0x844e5faceb5f79c8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fee expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.543193:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f7966 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fc4 expref: 16 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.543202:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f7966 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fc4 expref: 16 pid: 9235 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.543211:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125358848:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.543263:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.544802:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125358848:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.544820:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a886400/0x844e5faceb5f79c8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fee expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.544831:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a886400, rc 0) 00000100:00100000:1.0:1746155641.544865:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:32323:x1830976125962624:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1746us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.544871:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16926 00000100:00100000:0.0:1746155641.545152:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.545187:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125962752 00000100:00100000:3.0:1746155641.545192:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125962752 00010000:00010000:3.0:1746155641.545207:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f7966 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fc4 expref: 16 pid: 9235 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746155641.545230:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8696 00000100:00100000:3.0:1746155641.545234:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125962752:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.545241:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155641.545255:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f7966 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fc4 expref: 16 pid: 9235 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.545262:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f7966 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fc4 expref: 16 pid: 9235 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.545274:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f7966 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fc4 expref: 16 pid: 9235 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.545282:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.545283:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.545287:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a886400/0x844e5faceb5f79c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fee expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.545291:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886400/0x844e5faceb5f79c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fee expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.545306:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a886400/0x844e5faceb5f79c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fee expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.545312:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125358976:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155641.545357:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155641.546334:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125358976:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155641.546347:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155641.546372:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976125962752:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1136us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.546378:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8696 00000100:00100000:0.0:1746155641.546532:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.546562:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125962880 00000100:00100000:1.0:1746155641.546639:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125962880 00000100:00100000:1.0:1746155641.546660:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16927 00000100:00100000:1.0:1746155641.546665:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:32323:x1830976125962880:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.546676:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.546687:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a887c00/0x844e5faceb5f79cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ff5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.546705:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a887000/0x844e5faceb5f7951 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fcb expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.546711:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.546713:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.546715:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a887c00/0x844e5faceb5f79cf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ff5 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.546732:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a887000/0x844e5faceb5f7951 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fcb expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.546742:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a887000/0x844e5faceb5f7951 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fcb expref: 15 pid: 9235 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.546750:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125359104:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.546894:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.547654:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125359104:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.547670:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a887c00/0x844e5faceb5f79cf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ff5 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.547684:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a887c00, rc 0) 00000100:00100000:1.0:1746155641.547702:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:32323:x1830976125962880:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1037us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.547707:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16927 00000100:00100000:0.0:1746155641.547882:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.548022:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125963008 00000100:00100000:3.0:1746155641.548026:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125963008 00010000:00010000:3.0:1746155641.548039:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a887000/0x844e5faceb5f7951 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fcb expref: 15 pid: 9235 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746155641.548094:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8697 00000100:00100000:3.0:1746155641.548100:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125963008:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.548107:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155641.548122:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a887000/0x844e5faceb5f7951 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fcb expref: 15 pid: 9235 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.548131:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a887000/0x844e5faceb5f7951 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fcb expref: 15 pid: 9235 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.548144:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a887000/0x844e5faceb5f7951 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fcb expref: 15 pid: 9235 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.548157:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.548159:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.548163:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a887c00/0x844e5faceb5f79cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ff5 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.548169:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a887c00/0x844e5faceb5f79cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ff5 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.548186:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a887c00/0x844e5faceb5f79cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ff5 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.548194:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125359232:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155641.548242:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155641.549184:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125359232:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155641.549196:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155641.549216:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125963008:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1116us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.549222:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8697 00000100:00100000:0.0:1746155641.549439:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.549485:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125963136 00000100:00100000:1.0:1746155641.549489:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125963136 00000100:00100000:1.0:1746155641.549725:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16928 00000100:00100000:1.0:1746155641.549732:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:32323:x1830976125963136:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.549742:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.549751:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f17ffc expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.549769:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312fb800/0x844e5faceb5f796d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd2 expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.549776:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.549778:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.549780:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ffc expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.549797:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312fb800/0x844e5faceb5f796d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd2 expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.549806:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312fb800/0x844e5faceb5f796d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd2 expref: 15 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.549818:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125359360:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.549863:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.550688:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.550744:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125963264 00000100:00100000:3.0:1746155641.550748:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125963264 00000100:00100000:1.0:1746155641.550749:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125359360:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.550763:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fb800/0x844e5faceb5f796d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd2 expref: 16 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:1.0:1746155641.550763:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ffc expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.550773:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a887a00, rc 0) 00000100:00100000:1.0:1746155641.550798:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:32323:x1830976125963136:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1067us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.550803:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16928 00000100:00100000:3.0:1746155641.551127:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8698 00000100:00100000:3.0:1746155641.551138:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976125963264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.551147:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155641.551162:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312fb800/0x844e5faceb5f796d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd2 expref: 15 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.551171:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312fb800/0x844e5faceb5f796d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd2 expref: 15 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.551185:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312fb800/0x844e5faceb5f796d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd2 expref: 15 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.551194:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.551195:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.551199:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ffc expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.551205:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ffc expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.551223:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ffc expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.551231:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125359488:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155641.551280:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155641.553017:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125359488:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155641.553031:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155641.553051:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125963264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1918us (2364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.553058:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8698 00000100:00100000:0.0:1746155641.553409:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.553462:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125963392 00000100:00100000:1.0:1746155641.553465:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125963392 00000100:00100000:1.0:1746155641.553665:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16929 00000100:00100000:1.0:1746155641.553671:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:32323:x1830976125963392:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155641.553681:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.553692:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18003 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.553711:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f7958 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd9 expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.553717:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.553719:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.553722:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18003 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.553744:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f7958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd9 expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.553753:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f7958 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd9 expref: 16 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:1.0:1746155641.553761:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125359616:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.553807:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.554693:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125359616:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.554708:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18003 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.554718:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a886a00, rc 0) 00000100:00100000:1.0:1746155641.554746:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:32323:x1830976125963392:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1075us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.554752:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16929 00000100:00100000:0.0:1746155641.554979:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.555253:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125963520 00000100:00100000:3.0:1746155641.555258:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125963520 00010000:00010000:3.0:1746155641.555277:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f7958 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd9 expref: 16 pid: 20796 timeout: 870 lvb_type: 1 00000100:00100000:3.0:1746155641.555306:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8699 00000100:00100000:3.0:1746155641.555312:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125963520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.555323:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155641.555341:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f7958 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd9 expref: 16 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.555351:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f7958 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd9 expref: 16 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.555365:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312fbc00/0x844e5faceb5f7958 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fd9 expref: 16 pid: 20796 timeout: 870 lvb_type: 1 00010000:00010000:3.0:1746155641.555375:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.555377:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.555382:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18003 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.555388:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18003 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.555405:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18003 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.555413:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125359744:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155641.555460:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155641.556815:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125359744:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155641.556828:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155641.556857:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125963520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1545us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.556863:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8699 00000100:00100000:0.0:1746155641.557538:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.557573:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.557614:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125963648 00000100:00100000:2.0:1746155641.557619:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125963648 00000100:00100000:1.0:1746155641.557634:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125963904 00000100:00100000:1.0:1746155641.557638:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125963904 00000100:00100000:2.0:1746155641.557658:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16930 00000100:00100000:1.0:1746155641.557688:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16931 00000100:00100000:1.0:1746155641.557698:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976125963904:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155641.557842:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155641.557845:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155640 -> 1746155641 00002000:00010000:1.0:1746155641.557847:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155640 -> 1746155641 00002000:00010000:1.0:1746155641.557849:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155640 -> 1746155642 00002000:00010000:1.0:1746155641.557851:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:2.0:1746155641.557857:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125963648:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:1.0:1746155641.557879:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125963904:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 184us (305us total) trans 21474841575 rc 0/0 00000100:00100000:1.0:1746155641.557885:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16931 00000100:00100000:0.0:1746155641.557917:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:2.0:1746155641.557965:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155641.557968:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:2.0:1746155641.557970:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:2.0:1746155641.557972:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155641 -> 1746155642 00002000:00010000:2.0:1746155641.557973:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:0.0:1746155641.557974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.557992:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.557996:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976125963648:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 332us (458us total) trans 17179874252 rc 0/0 00000100:00100000:2.0:1746155641.558002:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16930 00000100:00100000:1.0:1746155641.558002:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125964160 00000100:00100000:1.0:1746155641.558005:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125964160 00000100:00100000:2.0:1746155641.558011:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125963776 00000100:00100000:2.0:1746155641.558013:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125963776 00000100:00100000:2.0:1746155641.558026:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125964032 00000100:00100000:2.0:1746155641.558027:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125964032 00000100:00100000:0.0:1746155641.558038:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.558073:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125964288 00000100:00100000:2.0:1746155641.558076:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125964288 00000100:00100000:1.0:1746155641.558082:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16932 00000100:00100000:3.0:1746155641.558088:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16933 00000100:00100000:1.0:1746155641.558088:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125964160:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:3.0:1746155641.558095:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976125963776:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:2.0:1746155641.558104:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16934 00000100:00100000:2.0:1746155641.558110:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125964032:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155641.558159:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:1.0:1746155641.558165:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:1.0:1746155641.558167:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:1.0:1746155641.558168:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155641 -> 1746155642 00002000:00010000:3.0:1746155641.558169:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155641.558170:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00002000:00010000:3.0:1746155641.558171:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:3.0:1746155641.558173:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:2.0:1746155641.558173:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155641.558175:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155641 -> 1746155642 00002000:00010000:3.0:1746155641.558176:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:2.0:1746155641.558176:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:2.0:1746155641.558178:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155640 -> 1746155641 00002000:00010000:2.0:1746155641.558179:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155641 -> 1746155642 00002000:00010000:2.0:1746155641.558181:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155641.558190:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1961:x1830976125964160:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 103us (273us total) trans 17179874253 rc 0/0 00000100:00100000:3.0:1746155641.558193:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1961:x1830976125963776:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 99us (219us total) trans 21474841576 rc 0/0 00000100:00100000:1.0:1746155641.558195:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16932 00000100:00100000:3.0:1746155641.558199:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16933 00000100:00100000:2.0:1746155641.558199:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1961:x1830976125964032:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 89us (205us total) trans 17179874254 rc 0/0 00000100:00100000:2.0:1746155641.558204:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16934 00000100:00100000:1.0:1746155641.558207:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16935 00000100:00100000:1.0:1746155641.558212:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976125964288:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155641.558267:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155641.558270:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:1.0:1746155641.558271:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:1.0:1746155641.558273:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155641 -> 1746155642 00002000:00010000:1.0:1746155641.558274:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746155641.558304:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a15b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1961:x1830976125964288:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 91us (265us total) trans 21474841577 rc 0/0 00000100:00100000:1.0:1746155641.558313:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16935 00000100:00100000:0.0:1746155641.560614:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.560980:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125964544 00000100:00100000:3.0:1746155641.560987:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125964544 00000100:00100000:3.0:1746155641.561130:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4713 00000100:00100000:3.0:1746155641.561137:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32323:x1830976125964544:12345-192.168.202.51@tcp:35:lfs.0 00000004:00010000:3.0:1746155641.561179:0:14236:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x35e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa800/0x844e5faceb5f78fd lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fa1 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.561221:0:14236:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155641.561232:0:14236:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887800/0x844e5faceb5f793c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fa8 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.561244:0:14236:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155641.561268:0:14236:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887800/0x844e5faceb5f793c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fa8 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.561279:0:14236:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887800/0x844e5faceb5f793c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fa8 expref: 9 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.561290:0:14236:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14236:1830976125359872:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155641.561967:0:14236:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155641.566155:0:14236:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14236:1830976125359872:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.566176:0:14236:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00000100:00100000:0.0:1746155641.566223:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.566277:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125964672 00000100:00100000:3.0:1746155641.566282:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125964672 00010000:00010000:3.0:1746155641.566306:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887800/0x844e5faceb5f793c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fa8 expref: 10 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.566383:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8700 00000100:00100000:3.0:1746155641.566390:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976125964672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.566400:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155641.566405:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887800/0x844e5faceb5f793c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fa8 expref: 10 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.566415:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887800/0x844e5faceb5f793c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fa8 expref: 10 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.566432:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a887800/0x844e5faceb5f793c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fa8 expref: 10 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.566455:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155641.566458:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155641.566465:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155641.566470:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155641.566486:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155641.566813:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976125964672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 422us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.566819:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8700 00010000:00010000:3.0:1746155641.566837:0:14236:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155641.566843:0:14236:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00000040:00080000:3.0:1746155641.567365:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3580, 88 off301952 00000004:00080000:3.0:1746155641.567370:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770716866874ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155641.568109:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3585, 88 off302656 00000004:00080000:3.0:1746155641.568114:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770717610933ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155641.568751:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3586, 88 off302744 00000004:00080000:3.0:1746155641.568755:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770718252224ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155641.568764:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3581, 88 off302040 00000004:00080000:3.0:1746155641.568766:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770718263050ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155641.568773:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3582, 88 off302128 00000004:00080000:3.0:1746155641.568775:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770718272603ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155641.568780:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3587, 88 off302832 00000004:00080000:3.0:1746155641.568782:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770718279553ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155641.568788:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3588, 88 off302920 00000004:00080000:3.0:1746155641.568790:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770718287053ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155641.568796:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3589, 88 off303008 00000004:00080000:3.0:1746155641.568798:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770718295553ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155641.568804:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3583, 88 off302216 00000004:00080000:3.0:1746155641.568806:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770718303530ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155641.568842:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3591, 88 off303192 00000004:00080000:3.0:1746155641.568845:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770718342243ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155641.568853:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3584, 88 off302304 00000004:00080000:3.0:1746155641.568855:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770718351758ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155641.568860:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3592, 88 off303280 00000004:00080000:3.0:1746155641.568863:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770718359923ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155641.568869:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3585, 88 off302392 00000004:00080000:3.0:1746155641.568871:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770718368023ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155641.568877:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3586, 88 off302480 00000004:00080000:3.0:1746155641.568878:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770718375657ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155641.568885:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3587, 88 off302568 00000004:00080000:3.0:1746155641.568887:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770718383872ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155641.568892:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3588, 88 off302656 00000004:00080000:3.0:1746155641.568894:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770718391302ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155641.568900:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3593, 88 off303368 00000004:00080000:3.0:1746155641.568902:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770718398787ns, next at 716011101328ns, rc = 0 00000004:00010000:3.0:1746155641.582170:0:14236:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f882d80 reply state ffff88012df37800 transno 8589945269 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00000100:00100000:3.0:1746155641.582183:0:14236:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746155641.582191:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155641.582194:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155641.582201:0:14236:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa800/0x844e5faceb5f78fd lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fa1 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746155641.582253:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945268 is committed 00000001:00080000:1.0:1746155641.582260:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945269 is committed 00000004:00080000:1.0:1746155641.582264:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2777 committed 00000004:00080000:1.0:1746155641.582281:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2767 committed 00000004:00080000:1.0:1746155641.582291:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2766 committed 00000004:00080000:1.0:1746155641.582293:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2765 committed 00000004:00080000:1.0:1746155641.582294:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2764 committed 00000004:00080000:1.0:1746155641.582295:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2776 committed 00000004:00080000:1.0:1746155641.582296:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2763 committed 00000004:00080000:1.0:1746155641.582297:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2775 committed 00000004:00080000:1.0:1746155641.582299:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2762 committed 00000004:00080000:1.0:1746155641.582300:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2774 committed 00000004:00080000:1.0:1746155641.582301:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2773 committed 00000004:00080000:1.0:1746155641.582302:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2772 committed 00000004:00080000:1.0:1746155641.582303:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2761 committed 00000004:00080000:1.0:1746155641.582304:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2760 committed 00000004:00080000:1.0:1746155641.582305:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2771 committed 00000004:00080000:1.0:1746155641.582306:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2770 committed 00000004:00080000:1.0:1746155641.582307:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2759 committed 00010000:00080000:3.0:1746155641.582370:0:14236:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746155641.582381:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32323:x1830976125964544:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 21245us (21772us total) trans 8589945269 rc 0/0 00000100:00100000:3.0:1746155641.582390:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4713 00000100:00100000:0.0:1746155641.582448:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125360256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155641.582449:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125360000:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746155641.582452:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 00010000:00010000:2.0:1746155641.582459:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 00010000:00010000:2.0:1746155641.582464:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 00010000:00010000:2.0:1746155641.582469:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3a600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155641.582473:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 00010000:00010000:2.0:1746155641.582478:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 00000100:00100000:0.0:1746155641.582484:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.582486:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125360128:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746155641.582489:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.582492:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155641.582494:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 00010000:00010000:2.0:1746155641.582498:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a600/0x844e5faceb5f79e4 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 00000100:00100000:1.0:1746155641.582522:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.582528:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125360768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155641.582537:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125360640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.582548:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.582562:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125361280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.582575:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.582585:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125361792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.582596:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.582617:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.582630:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125361152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.582631:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125360256 00000100:00100000:0.0:1746155641.582636:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125360256 00000100:00100000:1.0:1746155641.582652:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.582731:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125360128 00000100:00100000:0.0:1746155641.582734:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125360128 00000100:00100000:1.0:1746155641.582739:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125361664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155641.582753:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155641.582829:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125360768 00000100:00100000:2.0:1746155641.582830:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125361792 00000100:00100000:0.0:1746155641.582830:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125361280 00000100:00100000:3.0:1746155641.582833:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125360768 00000100:00100000:2.0:1746155641.582833:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125361792 00000100:00100000:0.0:1746155641.582833:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125361280 00000100:00100000:0.0:1746155641.582844:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125360640 00000100:00100000:0.0:1746155641.582845:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125360640 00000100:00100000:3.0:1746155641.582848:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125361664 00000100:00100000:2.0:1746155641.582848:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125361152 00000100:00100000:3.0:1746155641.582850:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125361664 00000100:00100000:2.0:1746155641.582850:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125361152 00000100:00100000:0.0:1746155641.582852:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16936 00000100:00100000:0.0:1746155641.582856:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+63:3298:x1830976125360256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155641.582858:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16937 00000100:00100000:2.0:1746155641.582861:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16938 00000100:00100000:3.0:1746155641.582862:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+72:3297:x1830976125360128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155641.582865:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+72:3298:x1830976125361280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.582910:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16939 00000100:00100000:3.0:1746155641.582914:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+72:3298:x1830976125360768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155641.582986:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155641.582989:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:3.0:1746155641.582990:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155641.582991:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:0.0:1746155641.582993:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155642 -> 1746155642 00002000:00010000:3.0:1746155641.582994:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:0.0:1746155641.582995:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00002000:00010000:3.0:1746155641.582996:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:3.0:1746155641.582998:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155642 -> 1746155642 00002000:00010000:3.0:1746155641.582999:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155641.583002:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+74:3298:x1830976125361280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (425us total) trans 17179874255 rc 0/0 00000100:00100000:2.0:1746155641.583007:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16938 00000100:00100000:2.0:1746155641.583017:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16940 00000100:00100000:2.0:1746155641.583021:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+73:3298:x1830976125361792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.583460:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+64:3298:x1830976125360256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 602us (974us total) trans 21474841578 rc 0/0 00000100:00100000:3.0:1746155641.583461:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+74:3298:x1830976125360768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 544us (911us total) trans 17179874256 rc 0/0 00000100:00100000:0.0:1746155641.583466:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16936 00000100:00100000:3.0:1746155641.583489:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16939 00000100:00100000:0.0:1746155641.583492:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16941 00000100:00100000:0.0:1746155641.583498:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+63:3297:x1830976125360640:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155641.583518:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16942 00000100:00100000:3.0:1746155641.583524:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+73:3297:x1830976125361664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.583606:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+74:3297:x1830976125361664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (851us total) trans 17179874258 rc 0/0 00000100:00100000:3.0:1746155641.583611:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16942 00000100:00100000:3.0:1746155641.583620:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16943 00000100:00100000:3.0:1746155641.583624:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+63:3297:x1830976125361152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155641.583649:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:0.0:1746155641.583652:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155641.583654:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155641.583656:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155641.583657:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155641.583677:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+65:3297:x1830976125360640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 180us (1059us total) trans 21474841579 rc 0/0 00000100:00100000:0.0:1746155641.583682:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16941 00000100:00100000:3.0:1746155641.583695:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+64:3297:x1830976125361152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (1042us total) trans 21474841580 rc 0/0 00000100:00100000:3.0:1746155641.583701:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16943 00000100:00100000:0.0:1746155641.583706:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155641.583711:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125360000 00000100:00100000:3.0:1746155641.583713:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125360000 00000100:00100000:0.0:1746155641.583721:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125360512:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155641.583727:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16944 00000100:00100000:3.0:1746155641.583731:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+64:3296:x1830976125360000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.583737:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.583744:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125361024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.583756:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.583763:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125361536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.583774:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.583783:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00002000:00010000:3.0:1746155641.583786:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:0.0:1746155641.583787:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125360384:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155641.583789:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:3.0:1746155641.583790:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:3.0:1746155641.583792:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155642 -> 1746155642 00002000:00010000:3.0:1746155641.583793:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155641.583798:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.583805:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125360896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.583810:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+65:3296:x1830976125360000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (103us total) trans 21474841581 rc 0/0 00000100:00100000:3.0:1746155641.583814:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16944 00000100:00100000:0.0:1746155641.583816:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155641.583820:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125360512 00000100:00100000:0.0:1746155641.583822:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125361408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155641.583823:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125360512 00000100:00100000:3.0:1746155641.583829:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125361024 00000100:00100000:3.0:1746155641.583830:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125361024 00000100:00100000:0.0:1746155641.583831:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155641.583835:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125361536 00000100:00100000:3.0:1746155641.583836:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125361536 00000100:00100000:0.0:1746155641.583836:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125361920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.583841:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125360384 00000100:00100000:3.0:1746155641.583842:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125360384 00000100:00100000:0.0:1746155641.583846:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155641.583848:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125360896 00000100:00100000:3.0:1746155641.583849:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125360896 00000100:00100000:3.0:1746155641.583854:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125361408 00000100:00100000:3.0:1746155641.583856:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125361408 00000100:00100000:3.0:1746155641.583861:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125361920 00000100:00100000:3.0:1746155641.583862:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125361920 00000100:00100000:3.0:1746155641.583868:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16945 00000004:00080000:0.0:1746155641.583871:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f880000/2, rc 0, transno 21474841581 00000100:00100000:3.0:1746155641.583872:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3296:x1830976125360512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.583875:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125360000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.583888:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16946 00000100:00100000:0.0:1746155641.583894:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+76:3296:x1830976125361024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.583956:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+69:3296:x1830976125360512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (218us total) trans 21474841582 rc 0/0 00000100:00100000:3.0:1746155641.583961:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16945 00000100:00100000:3.0:1746155641.583970:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16947 00000100:00100000:3.0:1746155641.583974:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+68:3296:x1830976125361536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.583984:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+77:3296:x1830976125361024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (226us total) trans 17179874259 rc 0/0 00000100:00100000:0.0:1746155641.583990:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16946 00000100:00100000:0.0:1746155641.584000:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16948 00000100:00100000:0.0:1746155641.584005:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3296:x1830976125360384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155641.584039:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+69:3296:x1830976125361536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (264us total) trans 21474841583 rc 0/0 00000100:00100000:3.0:1746155641.584044:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16947 00000100:00100000:3.0:1746155641.584051:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16949 00000100:00100000:3.0:1746155641.584055:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3296:x1830976125360896:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155641.584067:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155641.584070:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:0.0:1746155641.584072:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:0.0:1746155641.584073:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155642 -> 1746155642 00002000:00010000:0.0:1746155641.584075:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155641.584093:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+69:3296:x1830976125360384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (293us total) trans 21474841584 rc 0/0 00000100:00100000:0.0:1746155641.584098:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16948 00000100:00100000:0.0:1746155641.584107:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16950 00000100:00100000:0.0:1746155641.584110:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3296:x1830976125361408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155641.584113:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:3.0:1746155641.584116:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:3.0:1746155641.584118:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:3.0:1746155641.584119:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155642 -> 1746155642 00002000:00010000:3.0:1746155641.584121:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:3.0:1746155641.584138:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:3296:x1830976125360896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (321us total) trans 17179874260 rc 0/0 00000100:00100000:3.0:1746155641.584143:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16949 00000100:00100000:3.0:1746155641.584152:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16951 00000100:00100000:3.0:1746155641.584156:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3296:x1830976125361920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.584176:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+69:3296:x1830976125361408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (343us total) trans 21474841585 rc 0/0 00000100:00100000:0.0:1746155641.584180:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16950 00000004:00080000:0.0:1746155641.584199:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f881500/2, rc 0, transno 21474841578 00000100:00100000:0.0:1746155641.584203:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125360256:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155641.584210:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910c8700/2, rc 0, transno 17179874256 00000100:00100000:0.0:1746155641.584217:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125360768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.584218:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:3296:x1830976125361920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (370us total) trans 17179874261 rc 0/0 00000100:00100000:3.0:1746155641.584222:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16951 00000004:00080000:0.0:1746155641.584223:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910ca300/2, rc 0, transno 17179874255 00000100:00100000:0.0:1746155641.584226:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125361280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155641.584236:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f882680/2, rc 0, transno 21474841584 00000100:00100000:0.0:1746155641.584239:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125360384:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155641.584244:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910cad80/2, rc 0, transno 17179874260 00000100:00100000:0.0:1746155641.584246:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125360896:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155641.584251:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f880380/2, rc 0, transno 21474841585 00000100:00100000:0.0:1746155641.584253:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125361408:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155641.584258:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910c8000/2, rc 0, transno 17179874261 00000100:00100000:0.0:1746155641.584260:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125361920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155641.584265:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f880700/2, rc 0, transno 21474841582 00000100:00100000:0.0:1746155641.584267:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125360512:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155641.584272:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910cb100/2, rc 0, transno 17179874259 00002000:00010000:3.0:1746155641.584273:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:0.0:1746155641.584274:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125361024:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155641.584275:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:3.0:1746155641.584277:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:3.0:1746155641.584279:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155642 -> 1746155642 00000004:00080000:0.0:1746155641.584279:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f881880/2, rc 0, transno 21474841583 00002000:00010000:3.0:1746155641.584280:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:0.0:1746155641.584281:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125361536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155641.584294:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+77:3297:x1830976125360128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1432us (1771us total) trans 17179874262 rc 0/0 00000100:00100000:3.0:1746155641.584298:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16937 00000004:00080000:3.0:1746155641.584315:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910cb480/2, rc 0, transno 17179874262 00000100:00100000:3.0:1746155641.584318:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125360128:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155641.584325:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f883800/2, rc 0, transno 21474841579 00000100:00100000:3.0:1746155641.584327:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125360640:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155641.584333:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f881c00/2, rc 0, transno 21474841580 00000100:00100000:3.0:1746155641.584335:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125361152:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155641.584339:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910c8e00/2, rc 0, transno 17179874258 00000100:00100000:3.0:1746155641.584342:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125361664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155641.584892:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+76:3298:x1830976125361792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1869us (2293us total) trans 17179874257 rc 0/0 00000100:00100000:2.0:1746155641.584897:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16940 00000004:00080000:0.0:1746155641.584959:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910c9f80/2, rc 0, transno 17179874257 00000100:00100000:0.0:1746155641.584963:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125361792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.585020:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125362048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.585040:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155641.585053:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125362048 00000100:00100000:2.0:1746155641.585056:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125362048 00000100:00100000:2.0:1746155641.585069:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16952 00000100:00100000:2.0:1746155641.585073:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3296:x1830976125362048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155641.585159:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3296:x1830976125362048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (118us total) trans 17179874263 rc 0/0 00000100:00100000:2.0:1746155641.585164:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16952 00000004:00080000:0.0:1746155641.585169:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6062d80/2, rc 0, transno 17179874263 00000100:00100000:0.0:1746155641.585172:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125362048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.585640:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.585984:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125964800 00000100:00100000:2.0:1746155641.585988:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125964800 00000100:00100000:2.0:1746155641.586024:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11111 00000100:00100000:2.0:1746155641.586034:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32323:x1830976125964800:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155641.586050:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.586064:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f79eb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1800a expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.586104:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f79eb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1800a expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.586115:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f79eb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1800a expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.586128:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.586130:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155641.586133:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbce000, rc 0) 00000100:00100000:2.0:1746155641.586174:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32323:x1830976125964800:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 141us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.586178:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11111 00000100:00100000:0.0:1746155641.589091:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.589177:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125965056 00000100:00100000:3.0:1746155641.589186:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125965056 00000100:00100000:3.0:1746155641.589233:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4714 00000100:00100000:3.0:1746155641.589240:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32323:x1830976125965056:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155641.589461:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32323:x1830976125965056:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 220us (376us total) trans 8589945270 rc 0/0 00000100:00100000:3.0:1746155641.589468:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4714 00000100:00100000:0.0:1746155641.612005:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.612058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.612147:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125965312 00000100:00100000:2.0:1746155641.612155:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125965312 00000100:00100000:2.0:1746155641.612198:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125965568 00000100:00100000:2.0:1746155641.612200:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125965568 00000100:00100000:2.0:1746155641.612217:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11112 00000100:00100000:2.0:1746155641.612224:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32333:x1830976125965312:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155641.612226:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11113 00000100:00100000:3.0:1746155641.612235:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32332:x1830976125965568:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155641.612244:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.612246:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.612259:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcea00/0x844e5faceb5f79f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18011 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.612260:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b000/0x844e5faceb5f79f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18018 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.612351:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a000/0x844e5faceb5f7a00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.612357:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7a07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155641.612361:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a000/0x844e5faceb5f7a00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.612370:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a000/0x844e5faceb5f7a00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.612370:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7a07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.612376:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7a07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155641.612381:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7a0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.612383:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7a15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155641.612387:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7a0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.612397:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7a0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.612484:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x844e5faceb5f7a1c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.612490:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x844e5faceb5f7a1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.612493:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155641.612495:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x844e5faceb5f7a1c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155641.612521:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155641.612564:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155641.612587:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a000/0x844e5faceb5f7a00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.612593:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a000/0x844e5faceb5f7a00 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.612598:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a000/0x844e5faceb5f7a00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.612602:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3a000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155641.612606:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a000/0x844e5faceb5f7a00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.612611:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a000/0x844e5faceb5f7a00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.612618:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0ba00/0x844e5faceb5f7a2a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.612625:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0ba00/0x844e5faceb5f7a2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.612630:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0ba00/0x844e5faceb5f7a2a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155641.612635:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155641.612667:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7a07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.612673:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7a07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.612677:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7a07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155641.612682:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155641.612685:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155641.612688:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a000/0x844e5faceb5f7a00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.612693:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3a000/0x844e5faceb5f7a00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.612712:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012de0b400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155641.612716:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7a07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.612721:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7a07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.612727:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155641.612729:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155641.612731:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7a07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.612735:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0b400/0x844e5faceb5f7a07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.613133:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7a15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.613139:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7a15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.613142:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7a15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.613146:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012de0bc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155641.613148:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7a15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.613152:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7a15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.613158:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0a00) 00010000:00010000:2.0:1746155641.613160:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155641.613162:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7a15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155641.613167:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0bc00/0x844e5faceb5f7a15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155641.613190:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7a0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.613195:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7a0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.613196:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcea00/0x844e5faceb5f79f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18011 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.613200:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7a0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.613204:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3ba00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155641.613206:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7a0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.613206:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0ba00/0x844e5faceb5f7a2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18011 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.613210:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7a0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.613212:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.613213:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155641.613216:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012de0ba00, rc 0) 00010000:00010000:3.0:1746155641.613217:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0a00) 00010000:00010000:3.0:1746155641.613219:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155641.613221:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7a0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.613225:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ba00/0x844e5faceb5f7a0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.613248:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b000/0x844e5faceb5f79f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18018 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.613260:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x844e5faceb5f7a1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18018 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.613264:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155641.613266:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155641.613267:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3b800, rc 0) 00000100:00100000:2.0:1746155641.613526:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32333:x1830976125965312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1301us (1528us total) trans 8589945272 rc 0/0 00000100:00100000:2.0:1746155641.613531:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11112 00000100:00100000:3.0:1746155641.613587:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32332:x1830976125965568:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1353us (1527us total) trans 8589945271 rc 0/0 00000100:00100000:3.0:1746155641.613593:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11113 00000100:00100000:0.0:1746155641.618588:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.618650:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125965696 00000100:00100000:3.0:1746155641.618659:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125965696 00000100:00100000:3.0:1746155641.618699:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16953 00000100:00100000:3.0:1746155641.618706:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32333:x1830976125965696:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155641.618721:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.618737:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7a38 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1801f expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.618762:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008e3b8a00/0x844e5faceb5f79ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe0 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.618768:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155641.618770:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155641.618773:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7a38 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1801f expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.618796:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008e3b8a00/0x844e5faceb5f79ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe0 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.618806:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008e3b8a00/0x844e5faceb5f79ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe0 expref: 16 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.618815:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125362176:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155641.618902:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a24c240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.619398:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.619467:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125965952 00000100:00100000:3.0:1746155641.619470:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125965952 00000100:00100000:3.0:1746155641.619527:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4715 00000100:00100000:3.0:1746155641.619533:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009461b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32332:x1830976125965952:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155641.619678:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009461b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32332:x1830976125965952:12345-192.168.202.51@tcp:35:cat.0 Request processed in 145us (280us total) trans 8589945273 rc 0/0 00000100:00100000:3.0:1746155641.619684:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4715 00000100:00100000:0.0:1746155641.620681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.621143:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125362176:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.621162:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7a38 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1801f expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.621175:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3aa00, rc 0) 00000100:00100000:3.0:1746155641.621215:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32333:x1830976125965696:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2510us (2633us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.621222:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16953 00000100:00100000:0.0:1746155641.621389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.621478:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125966080 00000100:00100000:2.0:1746155641.621482:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125966080 00000100:00100000:3.0:1746155641.621497:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125966336 00000100:00100000:3.0:1746155641.621517:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125966336 00000100:00100000:3.0:1746155641.621545:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11114 00000100:00100000:3.0:1746155641.621551:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32328:x1830976125966336:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155641.621564:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.621576:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608a00/0x844e5faceb5f7a3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18026 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.621635:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.621646:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x844e5faceb5f7a1c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18018 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.621652:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0ba00/0x844e5faceb5f7a2a lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18011 expref: 7 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.621657:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155641.621678:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0ba00/0x844e5faceb5f7a2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18011 expref: 7 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.621686:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0ba00/0x844e5faceb5f7a2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18011 expref: 7 pid: 14234 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.621696:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125362304:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.621756:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x844e5faceb5f7a1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18018 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.621763:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x844e5faceb5f7a1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18018 expref: 290 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.621774:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125362432:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155641.621788:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008e3b8a00/0x844e5faceb5f79ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe0 expref: 17 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.621796:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a24ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155641.621809:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8701 00000100:00100000:2.0:1746155641.621815:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125966080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.621823:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.621843:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008e3b8a00/0x844e5faceb5f79ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe0 expref: 17 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.621855:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008e3b8a00/0x844e5faceb5f79ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe0 expref: 17 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.621871:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008e3b8a00/0x844e5faceb5f79ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe0 expref: 17 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.621894:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.621896:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.621901:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7a38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1801f expref: 15 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.621908:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7a38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1801f expref: 15 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.621939:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7a38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1801f expref: 15 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.621947:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125362560:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155641.621981:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bf203c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.622613:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.622674:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125966464 00000100:00100000:3.0:1746155641.622678:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125966464 00000100:00100000:3.0:1746155641.622697:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16954 00000100:00100000:3.0:1746155641.622702:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:32332:x1830976125966464:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155641.622709:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.622717:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b000/0x844e5faceb5f7a4d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1802d expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.622728:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.622729:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.622732:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b000/0x844e5faceb5f7a4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1802d expref: 40 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.622740:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b000/0x844e5faceb5f7a4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1802d expref: 40 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.622747:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3b000, rc 0) 00000100:00100000:3.0:1746155641.622771:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:32332:x1830976125966464:12345-192.168.202.51@tcp:101:cat.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.622776:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16954 00000100:00100000:0.0:1746155641.624332:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.624355:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125362304:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155641.624365:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125362432:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.624382:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155641.624382:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125966592 00000100:00100000:2.0:1746155641.624386:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125966592 00010000:00010000:2.0:1746155641.624406:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0ba00/0x844e5faceb5f7a2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18011 expref: 8 pid: 14234 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.624438:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8702 00000100:00100000:2.0:1746155641.624444:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976125966592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.624456:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.624460:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0ba00/0x844e5faceb5f7a2a lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18011 expref: 8 pid: 14234 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.624469:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0ba00/0x844e5faceb5f7a2a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18011 expref: 8 pid: 14234 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.624486:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012de0ba00/0x844e5faceb5f7a2a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18011 expref: 8 pid: 14234 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.624498:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.624527:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.624534:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155641.624539:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.624987:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976125966592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 541us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.624993:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8702 00000100:00100000:1.0:1746155641.625184:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.625619:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125966720 00000100:00100000:0.0:1746155641.625624:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125966720 00010000:00010000:0.0:1746155641.625639:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x844e5faceb5f7a1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18018 expref: 291 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746155641.625669:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8703 00000100:00100000:0.0:1746155641.625674:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1961:x1830976125966720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155641.625681:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155641.625683:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125362560:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155641.625684:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x844e5faceb5f7a1c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18018 expref: 291 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.625693:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155641.625693:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x844e5faceb5f7a1c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18018 expref: 291 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746155641.625709:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b800/0x844e5faceb5f7a1c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18018 expref: 291 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.625721:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125966080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3906us (5041us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155641.625721:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155641.625725:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155641.625727:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8701 00010000:00010000:0.0:1746155641.625731:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.625737:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155641.625751:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155641.625757:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155641.625764:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1961:x1830976125966720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 91us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.625769:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8703 00010000:00010000:2.0:1746155641.625770:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155641.625785:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155641.625899:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608a00/0x844e5faceb5f7a3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18026 expref: 291 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.625912:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18026 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.625928:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.625930:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155641.625933:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a608800, rc 0) 00000100:00100000:2.0:1746155641.626388:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32328:x1830976125966336:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4836us (4998us total) trans 8589945274 rc 0/0 00000100:00100000:2.0:1746155641.626394:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11114 00000100:00100000:0.0:1746155641.626497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.626780:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125966848 00000100:00100000:2.0:1746155641.626784:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125966848 00000100:00100000:0.0:1746155641.626799:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.626803:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125966976 00000100:00100000:2.0:1746155641.626805:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125966976 00000100:00100000:0.0:1746155641.626815:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11115 00000100:00100000:2.0:1746155641.626824:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11116 00000100:00100000:2.0:1746155641.626829:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32333:x1830976125966976:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155641.626844:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.626855:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f7a5b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1803b expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.626888:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f7a5b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1803b expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.626901:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f7a5b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1803b expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.626913:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.626915:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155641.626927:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbcf000, rc 0) 00000100:00100000:0.0:1746155641.627063:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32332:x1830976125966848:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155641.627071:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155641.627072:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32333:x1830976125966976:12345-192.168.202.51@tcp:101:cat.0 Request processed in 243us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.627077:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11116 00010000:00010000:0.0:1746155641.627077:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6127200/0x844e5faceb5f7a62 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18034 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.627332:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6127200/0x844e5faceb5f7a62 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18034 expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.627345:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6127200/0x844e5faceb5f7a62 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18034 expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.627357:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155641.627359:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155641.627361:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6127200, rc 0) 00000100:00100000:0.0:1746155641.627390:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32332:x1830976125966848:12345-192.168.202.51@tcp:101:cat.0 Request processed in 570us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.627395:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11115 00000100:00100000:0.0:1746155641.630258:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.630338:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125967232 00000100:00100000:3.0:1746155641.630346:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125967232 00002000:00100000:3.0:1746155641.630381:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fc51f80 x1830976125967232/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.630389:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc51f80 with x1830976125967232 ext(0->1048575) 00002000:00010000:3.0:1746155641.630393:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc51f80 00000100:00100000:3.0:1746155641.630464:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8047 00000100:00100000:3.0:1746155641.630471:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1963:x1830976125967232:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155641.636892:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.636958:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.638945:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125967744 00000100:00100000:1.0:1746155641.638949:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125967488 00000100:00100000:1.0:1746155641.638954:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125967488 00000100:00100000:0.0:1746155641.638954:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125967744 00002000:00100000:1.0:1746155641.638993:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fc50000 x1830976125967488/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.639001:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc50000 with x1830976125967488 ext(0->1048575) 00002000:00010000:1.0:1746155641.639007:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc50000 00000100:00100000:0.0:1746155641.639586:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11117 00000100:00100000:0.0:1746155641.639594:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32335:x1830976125967744:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155641.639605:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155641.639619:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9600/0x844e5faceb5f7a69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18042 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.639692:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8400/0x844e5faceb5f7a70 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639702:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8400/0x844e5faceb5f7a70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639709:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8400/0x844e5faceb5f7a70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639722:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8e00/0x844e5faceb5f7a77 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639726:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8e00/0x844e5faceb5f7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639729:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8e00/0x844e5faceb5f7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155641.639765:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1963:x1830976125967232:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9294us (9512us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.639772:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8047 00002000:00100000:3.0:1746155641.639778:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fc51f80 x1830976125967232/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.639783:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc51f80 with x1830976125967232 ext(0->1048575) 00002000:00010000:3.0:1746155641.639786:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc51f80 00000100:00100000:3.0:1746155641.639803:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8048 00000100:00100000:3.0:1746155641.639808:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125967488:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:0.0:1746155641.639811:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9200/0x844e5faceb5f7a7e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639819:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9200/0x844e5faceb5f7a7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639824:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9200/0x844e5faceb5f7a7e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:0.0:1746155641.639830:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155641.639893:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8400/0x844e5faceb5f7a70 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639899:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8400/0x844e5faceb5f7a70 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639904:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8400/0x844e5faceb5f7a70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639908:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e3b8400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155641.639911:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8400/0x844e5faceb5f7a70 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639916:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8400/0x844e5faceb5f7a70 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639938:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155641.639941:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155641.639944:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8400/0x844e5faceb5f7a70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639948:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8400/0x844e5faceb5f7a70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639962:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8e00/0x844e5faceb5f7a77 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639966:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8e00/0x844e5faceb5f7a77 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639970:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8e00/0x844e5faceb5f7a77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639973:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008e3b8e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155641.639974:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8e00/0x844e5faceb5f7a77 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639978:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8e00/0x844e5faceb5f7a77 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639982:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51f00) 00010000:00010000:0.0:1746155641.639984:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155641.639986:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8e00/0x844e5faceb5f7a77 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.639990:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b8e00/0x844e5faceb5f7a77 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.640015:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9600/0x844e5faceb5f7a69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18042 expref: 11 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.640024:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9200/0x844e5faceb5f7a7e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18042 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.640029:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155641.640031:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155641.640032:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e3b9200, rc 0) 00000100:00100000:0.0:1746155641.640108:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32335:x1830976125967744:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 516us (3150us total) trans 8589945275 rc 0/0 00000100:00100000:0.0:1746155641.640114:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11117 00000100:00100000:0.0:1746155641.647602:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.647640:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.647667:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125968000 00000100:00100000:2.0:1746155641.647675:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125968000 00000100:00100000:1.0:1746155641.647689:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125968128 00000100:00100000:1.0:1746155641.647693:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125968128 00000100:00100000:1.0:1746155641.647716:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16955 00000100:00100000:1.0:1746155641.647723:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:32333:x1830976125968128:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155641.647723:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11118 00000100:00100000:0.0:1746155641.647731:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32335:x1830976125968000:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155641.647738:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155641.647744:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155641.647746:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1746155641.647752:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a887600/0x844e5faceb5f7a8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18050 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.647769:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9200/0x844e5faceb5f7a7e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18042 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.647775:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a886000/0x844e5faceb5f79c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe7 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.647782:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155641.647784:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155641.647787:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a887600/0x844e5faceb5f7a8c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18050 expref: 30 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.647788:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbcf000/0x844e5faceb5f7a5b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1803b expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.647797:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155641.647801:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155641.647808:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6127400/0x844e5faceb5f7a93 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18049 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.647811:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a886000/0x844e5faceb5f79c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe7 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.647826:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a886000/0x844e5faceb5f79c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe7 expref: 17 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.647837:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125362688:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155641.647847:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.647857:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f79eb lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1800a expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.647862:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6127200/0x844e5faceb5f7a62 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18034 expref: 290 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.647868:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 5/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155641.647882:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6127200/0x844e5faceb5f7a62 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18034 expref: 290 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.647890:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6127200/0x844e5faceb5f7a62 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18034 expref: 290 pid: 15474 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.647896:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.647897:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125362816:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155641.647940:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f79eb lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1800a expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.647948:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f79eb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1800a expref: 7 pid: 27374 timeout: 870 lvb_type: 0 00000100:00100000:0.0:1746155641.647955:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b883480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125362944:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155641.647971:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013150bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155641.649874:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976125967488:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10059us (12983us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.649884:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8048 00002000:00100000:3.0:1746155641.649892:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fc50000 x1830976125967488/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.649906:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc50000 with x1830976125967488 ext(0->1048575) 00002000:00010000:3.0:1746155641.649915:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc50000 00000100:00100000:1.0:1746155641.650844:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125362688:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.650871:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a887600/0x844e5faceb5f7a8c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18050 expref: 30 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.650884:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a887600, rc 0) 00000100:00100000:1.0:1746155641.650916:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:32333:x1830976125968128:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3193us (3274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.650930:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16955 00000100:00100000:0.0:1746155641.652616:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.652644:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.652667:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125968256 00000100:00100000:0.0:1746155641.652671:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.652673:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125968256 00010000:00010000:3.0:1746155641.652701:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886000/0x844e5faceb5f79c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe7 expref: 18 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.652722:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125968384 00000100:00100000:2.0:1746155641.652723:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125968512 00000100:00100000:3.0:1746155641.652725:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125968384 00000100:00100000:2.0:1746155641.652726:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125968512 00010000:00010000:3.0:1746155641.652734:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f79eb lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1800a expref: 8 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.652738:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6127200/0x844e5faceb5f7a62 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18034 expref: 291 pid: 15474 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.652747:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8704 00000100:00100000:2.0:1746155641.652750:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8705 00000100:00100000:3.0:1746155641.652752:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1961:x1830976125968256:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155641.652754:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125968384:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.652762:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.652762:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.652766:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f79eb lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1800a expref: 8 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.652773:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f79eb lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1800a expref: 8 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.652778:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a886000/0x844e5faceb5f79c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe7 expref: 18 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.652784:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a886000/0x844e5faceb5f79c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe7 expref: 18 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.652790:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.652795:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155641.652801:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155641.652806:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.652832:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976125968384:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 76us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.652837:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8705 00000100:00100000:2.0:1746155641.652849:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8706 00000100:00100000:2.0:1746155641.652854:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1960:x1830976125968512:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.652859:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.652863:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6127200/0x844e5faceb5f7a62 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18034 expref: 291 pid: 15474 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.652871:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6127200/0x844e5faceb5f7a62 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18034 expref: 291 pid: 15474 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.652880:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.652882:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155641.652888:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155641.652893:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155641.652906:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.652932:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1960:x1830976125968512:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 77us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.652938:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8706 00010000:00010000:3.0:1746155641.652966:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a886000/0x844e5faceb5f79c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fe7 expref: 18 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.652968:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6127200/0x844e5faceb5f7a62 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18034 expref: 290 pid: 15474 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.652981:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc50380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125362816:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.652982:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.652983:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.652988:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a887600/0x844e5faceb5f7a8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18050 expref: 29 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.652989:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbce000/0x844e5faceb5f79eb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1800a expref: 7 pid: 27374 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.652995:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a887600/0x844e5faceb5f7a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18050 expref: 29 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.652997:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b883480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125362944:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155641.653010:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155641.653016:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155641.653017:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a887600/0x844e5faceb5f7a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18050 expref: 29 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.653020:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155641.653026:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125363072:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155641.653065:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a24ca80 going to sleep for 11 seconds 00000040:00080000:2.0:1746155641.653569:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3589, 88 off302744 00000004:00080000:2.0:1746155641.653574:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770803070783ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155641.653629:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3594, 88 off303456 00000004:00080000:2.0:1746155641.653633:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770803129647ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155641.653645:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3595, 88 off303544 00000004:00080000:2.0:1746155641.653647:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770803144128ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155641.653653:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3590, 88 off302832 00000004:00080000:2.0:1746155641.653656:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770803153018ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155641.653662:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3591, 88 off302920 00000004:00080000:2.0:1746155641.653664:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770803161128ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155641.653670:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3596, 88 off303632 00000004:00080000:2.0:1746155641.653672:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770803169467ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155641.653678:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3597, 88 off303720 00000004:00080000:2.0:1746155641.653680:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770803176778ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155641.653685:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3598, 88 off303808 00000004:00080000:2.0:1746155641.653688:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770803184746ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155641.653693:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3592, 88 off303008 00000004:00080000:2.0:1746155641.653696:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770803192780ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155641.653701:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3599, 88 off303896 00000004:00080000:2.0:1746155641.653703:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770803200193ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155641.653731:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3594, 88 off303192 00000004:00080000:2.0:1746155641.653734:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770803231618ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155641.653742:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3600, 88 off303984 00000004:00080000:2.0:1746155641.653745:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770803241482ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155641.653751:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3595, 88 off303280 00000004:00080000:2.0:1746155641.653753:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770803250038ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155641.653759:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3596, 88 off303368 00000004:00080000:2.0:1746155641.653761:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770803258242ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155641.653767:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3597, 88 off303456 00000004:00080000:2.0:1746155641.653769:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770803266242ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155641.653775:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3598, 88 off303544 00000004:00080000:2.0:1746155641.653777:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 770803274042ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155641.653783:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3601, 88 off304072 00000004:00080000:2.0:1746155641.653786:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 770803282638ns, next at 716011101328ns, rc = 0 00000100:00100000:2.0:1746155641.657159:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.657177:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125968640 00000100:00100000:2.0:1746155641.657184:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125968640 00000100:00100000:2.0:1746155641.657215:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11119 00000100:00100000:2.0:1746155641.657223:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32333:x1830976125968640:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155641.657237:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.657251:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18057 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.657292:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155641.657299:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.657311:0:27374:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155641.657320:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.657329:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155641.657332:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155641.657334:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.657339:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c51aa00, rc 0) 00000100:00100000:2.0:1746155641.657381:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32333:x1830976125968640:12345-192.168.202.51@tcp:101:cat.0 Request processed in 158us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.657386:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11119 00000100:00100000:3.0:1746155641.657683:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125363072:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155641.657696:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155641.657713:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976125968256:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4960us (5101us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.657720:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8704 00000100:00100000:0.0:1746155641.658989:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.659103:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125968768 00000100:00100000:1.0:1746155641.659109:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125968768 00000100:00100000:1.0:1746155641.659136:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16956 00000100:00100000:1.0:1746155641.659142:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32332:x1830976125968768:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155641.659154:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.659168:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a887800/0x844e5faceb5f7aa8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1805e expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.659186:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.659187:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.659193:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a887800/0x844e5faceb5f7aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1805e expref: 25 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.659209:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a887800/0x844e5faceb5f7aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1805e expref: 25 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.659217:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a887800, rc 0) 00000100:00100000:1.0:1746155641.659241:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32332:x1830976125968768:12345-192.168.202.51@tcp:101:cat.0 Request processed in 99us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.659246:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16956 00000100:00100000:0.0:1746155641.663467:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.663492:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125968896 00000100:00100000:0.0:1746155641.663499:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125968896 00000100:00100000:0.0:1746155641.663551:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11120 00000100:00100000:0.0:1746155641.663558:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32332:x1830976125968896:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155641.663575:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155641.663589:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18065 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.663635:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18065 expref: 291 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.663645:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18065 expref: 291 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.663655:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155641.663657:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155641.663661:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.663666:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e3b9a00, rc 0) 00000100:00100000:0.0:1746155641.663701:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32332:x1830976125968896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 144us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.663706:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11120 00010000:00010000:3.0:1746155641.685192:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18049 expref: 12 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.685207:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155641.685210:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746155641.685213:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.685223:0:15474:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.685230:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.685237:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18065 expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.685243:0:15474:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18065 expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.685249:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18065 expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.685280:0:15474:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18065 expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.685292:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125363200:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155641.685363:0:15474:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.685371:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125363328:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155641.685388:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316300 going to sleep for 11 seconds 00000001:00080000:1.0:1746155641.685786:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945275 is committed 00000001:00080000:1.0:1746155641.685795:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945276 is committed 00000004:00080000:1.0:1746155641.685800:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2785 committed 00000004:00080000:1.0:1746155641.685806:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2776 committed 00000004:00080000:1.0:1746155641.685810:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2775 committed 00000004:00080000:1.0:1746155641.685812:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2774 committed 00000004:00080000:1.0:1746155641.685813:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2773 committed 00000004:00080000:1.0:1746155641.685815:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2784 committed 00000004:00080000:1.0:1746155641.685816:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2772 committed 00000004:00080000:1.0:1746155641.685818:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2783 committed 00000004:00080000:1.0:1746155641.685819:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2771 committed 00000004:00080000:1.0:1746155641.685820:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2782 committed 00000004:00080000:1.0:1746155641.685822:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2781 committed 00000004:00080000:1.0:1746155641.685823:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2780 committed 00000004:00080000:1.0:1746155641.685824:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2770 committed 00000004:00080000:1.0:1746155641.685825:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2769 committed 00000004:00080000:1.0:1746155641.685827:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2779 committed 00000004:00080000:1.0:1746155641.685828:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2778 committed 00000004:00080000:1.0:1746155641.685829:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2768 committed 00000001:00080000:1.0:1746155641.685833:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945274 is committed 00000001:00080000:1.0:1746155641.685843:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945270 is committed 00000100:00100000:0.0:1746155641.686071:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125363712:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.686104:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.686121:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125364224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.686132:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.686146:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746155641.686150:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125363840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.686162:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.686171:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125364352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.686182:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.686204:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125363712 00000100:00100000:0.0:1746155641.686209:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125363712 00000100:00100000:0.0:1746155641.686235:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125364224 00000100:00100000:0.0:1746155641.686237:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125364224 00000100:00100000:0.0:1746155641.686246:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125363840 00000100:00100000:0.0:1746155641.686248:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125363840 00000100:00100000:0.0:1746155641.686255:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125364352 00000100:00100000:0.0:1746155641.686256:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125364352 00000100:00100000:0.0:1746155641.686357:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16957 00000100:00100000:0.0:1746155641.686364:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+72:3295:x1830976125363712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155641.686525:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155641.686528:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:0.0:1746155641.686530:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:0.0:1746155641.686532:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155642 -> 1746155642 00002000:00010000:0.0:1746155641.686533:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155641.686559:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:3295:x1830976125363712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 196us (455us total) trans 21474841586 rc 0/0 00000100:00100000:0.0:1746155641.686564:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16957 00000100:00100000:0.0:1746155641.686577:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16958 00000100:00100000:0.0:1746155641.686582:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+72:3295:x1830976125364224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.686647:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:3295:x1830976125364224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (513us total) trans 21474841587 rc 0/0 00000100:00100000:0.0:1746155641.686651:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16958 00000100:00100000:0.0:1746155641.686659:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16959 00000100:00100000:0.0:1746155641.686663:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+72:3295:x1830976125363840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155641.686724:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:3295:x1830976125363840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (561us total) trans 21474841588 rc 0/0 00000100:00100000:0.0:1746155641.686728:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16959 00000100:00100000:0.0:1746155641.686736:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16960 00000100:00100000:0.0:1746155641.686739:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+72:3295:x1830976125364352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155641.687057:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125363456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155641.687078:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.687288:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125363584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155641.687660:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125363968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155641.687676:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155641.687894:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125364480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.687911:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.687945:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125363456 00000100:00100000:1.0:1746155641.687949:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125363456 00000100:00100000:1.0:1746155641.687970:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125363968 00000100:00100000:1.0:1746155641.687972:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125363968 00000100:00100000:1.0:1746155641.687983:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16961 00000100:00100000:1.0:1746155641.687988:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+74:3297:x1830976125363456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155641.688078:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155641.688081:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:1.0:1746155641.688082:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:1.0:1746155641.688084:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155642 -> 1746155642 00002000:00010000:1.0:1746155641.688086:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155641.688104:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3297:x1830976125363456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (1026us total) trans 21474841589 rc 0/0 00000100:00100000:1.0:1746155641.688109:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16961 00000100:00100000:1.0:1746155641.688120:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16962 00000100:00100000:1.0:1746155641.688125:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+74:3297:x1830976125363968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155641.688193:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125364992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.688211:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746155641.688235:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b883480/2, rc 0, transno 21474841589 00000100:00100000:3.0:1746155641.688239:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125363456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155641.688253:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125364480 00000100:00100000:3.0:1746155641.688255:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125364480 00000100:00100000:3.0:1746155641.688269:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125364992 00000100:00100000:3.0:1746155641.688270:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125364992 00000100:00100000:3.0:1746155641.688278:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16963 00000100:00100000:3.0:1746155641.688282:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+78:3297:x1830976125364480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155641.688369:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746155641.688371:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:3.0:1746155641.688373:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:3.0:1746155641.688374:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155642 -> 1746155642 00002000:00010000:3.0:1746155641.688376:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:3.0:1746155641.688394:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+79:3297:x1830976125364480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (482us total) trans 17179874264 rc 0/0 00000100:00100000:3.0:1746155641.688398:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16963 00000100:00100000:3.0:1746155641.688408:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16964 00000100:00100000:3.0:1746155641.688412:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+78:3297:x1830976125364992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.688474:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+79:3297:x1830976125364992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (262us total) trans 17179874265 rc 0/0 00000100:00100000:3.0:1746155641.688478:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16964 00000004:00080000:3.0:1746155641.688515:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6062680/2, rc 0, transno 17179874264 00000100:00100000:3.0:1746155641.688521:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125364480:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155641.688527:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6060e00/2, rc 0, transno 17179874265 00000100:00100000:3.0:1746155641.688529:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125364992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.688569:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125365504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.688582:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155641.688595:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125365504 00000100:00100000:3.0:1746155641.688596:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125365504 00000100:00100000:3.0:1746155641.688606:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16965 00000100:00100000:3.0:1746155641.688609:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+79:3297:x1830976125365504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155641.688671:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+80:3297:x1830976125365504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (87us total) trans 17179874266 rc 0/0 00000100:00100000:3.0:1746155641.688675:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16965 00000004:00080000:3.0:1746155641.688689:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdedf80/2, rc 0, transno 17179874266 00000100:00100000:3.0:1746155641.688692:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125365504:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.688798:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+75:3295:x1830976125364352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2058us (2614us total) trans 21474841590 rc 0/0 00000100:00100000:0.0:1746155641.688803:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16960 00000100:00100000:0.0:1746155641.688825:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125364864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.688842:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.688853:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125365376:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.688866:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.688877:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746155641.688880:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125364736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.688891:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.688898:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125365248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.688908:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155641.688929:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125364864 00000100:00100000:0.0:1746155641.688932:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125364864 00000100:00100000:0.0:1746155641.688945:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125365376 00000100:00100000:0.0:1746155641.688946:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125365376 00000100:00100000:0.0:1746155641.688954:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125364736 00000100:00100000:0.0:1746155641.688956:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125364736 00000100:00100000:0.0:1746155641.688962:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125365248 00000100:00100000:0.0:1746155641.688963:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125365248 00000100:00100000:0.0:1746155641.688970:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16966 00000100:00100000:0.0:1746155641.688973:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+83:3296:x1830976125364864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.689046:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:3296:x1830976125364864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (203us total) trans 17179874267 rc 0/0 00000100:00100000:0.0:1746155641.689051:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16966 00000100:00100000:0.0:1746155641.689060:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16967 00000100:00100000:0.0:1746155641.689064:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+83:3296:x1830976125365376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.689130:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:3296:x1830976125365376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (263us total) trans 17179874268 rc 0/0 00000100:00100000:0.0:1746155641.689135:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16967 00000100:00100000:0.0:1746155641.689144:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16968 00000100:00100000:0.0:1746155641.689148:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+83:3296:x1830976125364736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155641.689209:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:0.0:1746155641.689212:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:0.0:1746155641.689214:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:0.0:1746155641.689215:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155642 -> 1746155642 00002000:00010000:0.0:1746155641.689217:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:0.0:1746155641.689233:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:3296:x1830976125364736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (341us total) trans 17179874269 rc 0/0 00000100:00100000:0.0:1746155641.689238:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16968 00000100:00100000:0.0:1746155641.689249:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16969 00000100:00100000:0.0:1746155641.689253:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+83:3296:x1830976125365248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155641.689319:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:3296:x1830976125365248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (409us total) trans 17179874270 rc 0/0 00000100:00100000:0.0:1746155641.689323:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16969 00000004:00080000:0.0:1746155641.689344:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6060a80/2, rc 0, transno 17179874269 00000100:00100000:0.0:1746155641.689347:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125364736:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155641.689353:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f880a80/2, rc 0, transno 17179874270 00000100:00100000:0.0:1746155641.689355:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125365248:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155641.689360:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6061500/2, rc 0, transno 17179874267 00000100:00100000:0.0:1746155641.689362:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125364864:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155641.689366:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f881180/2, rc 0, transno 17179874268 00000100:00100000:0.0:1746155641.689368:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125365376:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155641.689382:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac6680/2, rc 0, transno 21474841588 00000100:00100000:0.0:1746155641.689384:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125363840:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155641.689389:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac4a80/2, rc 0, transno 21474841590 00000100:00100000:0.0:1746155641.689392:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125364352:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155641.689397:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac6300/2, rc 0, transno 21474841586 00000100:00100000:0.0:1746155641.689399:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125363712:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155641.689405:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac5500/2, rc 0, transno 21474841587 00000100:00100000:0.0:1746155641.689407:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125364224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155641.689567:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.689583:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125364096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155641.689599:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.689608:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125364608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155641.689620:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.689628:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125365120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155641.689640:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.689671:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125363584 00000100:00100000:1.0:1746155641.689674:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125363584 00000100:00100000:1.0:1746155641.689687:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125364096 00000100:00100000:1.0:1746155641.689689:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125364096 00000100:00100000:1.0:1746155641.689698:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125364608 00000100:00100000:1.0:1746155641.689699:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125364608 00000100:00100000:1.0:1746155641.689706:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125365120 00000100:00100000:1.0:1746155641.689707:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125365120 00000100:00100000:1.0:1746155641.689712:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16970 00000100:00100000:1.0:1746155641.689716:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3298:x1830976125363584:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155641.689806:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155641.689808:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:1.0:1746155641.689810:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:1.0:1746155641.689812:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155642 -> 1746155642 00002000:00010000:1.0:1746155641.689813:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746155641.689834:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3298:x1830976125363584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (267us total) trans 21474841591 rc 0/0 00000100:00100000:1.0:1746155641.689839:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16970 00000100:00100000:1.0:1746155641.689850:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16971 00000100:00100000:1.0:1746155641.689854:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+76:3298:x1830976125364096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155641.689938:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a15b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+77:3298:x1830976125364096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (337us total) trans 21474841592 rc 0/0 00000100:00100000:1.0:1746155641.689944:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16971 00000100:00100000:1.0:1746155641.689953:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16972 00000100:00100000:1.0:1746155641.689957:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3298:x1830976125364608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155641.690021:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155641.690024:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155641 -> 1746155641 00002000:00010000:1.0:1746155641.690026:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155641 -> 1746155641 00002000:00010000:1.0:1746155641.690028:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155642 -> 1746155642 00002000:00010000:1.0:1746155641.690029:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155641.690044:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+86:3298:x1830976125364608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (423us total) trans 17179874271 rc 0/0 00000100:00100000:1.0:1746155641.690048:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16972 00000100:00100000:1.0:1746155641.690056:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16973 00000100:00100000:1.0:1746155641.690060:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3298:x1830976125365120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155641.690124:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+86:3298:x1830976125365120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (482us total) trans 17179874272 rc 0/0 00000100:00100000:1.0:1746155641.690128:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16973 00000004:00080000:1.0:1746155641.690148:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac7100/2, rc 0, transno 21474841591 00000100:00100000:1.0:1746155641.690151:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125363584:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155641.690156:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac4380/2, rc 0, transno 21474841592 00000100:00100000:1.0:1746155641.690158:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125364096:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155641.690163:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6061c00/2, rc 0, transno 17179874271 00000100:00100000:1.0:1746155641.690166:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125364608:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155641.690170:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6061f80/2, rc 0, transno 17179874272 00000100:00100000:1.0:1746155641.690172:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125365120:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155641.690230:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:1.0:1746155641.690232:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155641.690233:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746155641.690234:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155641.690236:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746155641.690257:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+77:3297:x1830976125363968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2132us (2580us total) trans 21474841593 rc 0/0 00000100:00100000:1.0:1746155641.690262:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16962 00000004:00080000:1.0:1746155641.690357:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac6a00/2, rc 0, transno 21474841593 00000100:00100000:1.0:1746155641.690360:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125363968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155641.692131:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.692140:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125363328:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155641.692218:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.692220:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125969024 00000100:00100000:3.0:1746155641.692225:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125969024 00000100:00100000:3.0:1746155641.692247:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125969152 00000100:00100000:3.0:1746155641.692249:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125969152 00000100:00100000:3.0:1746155641.692271:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4716 00000100:00100000:3.0:1746155641.692277:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32333:x1830976125969024:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:3.0:1746155641.692353:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32333:x1830976125969024:12345-192.168.202.51@tcp:49:cat.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.692359:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4716 00000100:00100000:3.0:1746155641.692371:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4717 00000100:00100000:3.0:1746155641.692375:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32332:x1830976125969152:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:3.0:1746155641.692406:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32332:x1830976125969152:12345-192.168.202.51@tcp:49:cat.0 Request processed in 30us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.692411:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4717 00000100:00100000:0.0:1746155641.692951:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125363200:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155641.692980:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6127400/0x844e5faceb5f7a93 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18049 expref: 9 pid: 15474 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746155641.692994:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18049 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.693009:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6126800, rc 0) 00000100:00100000:0.0:1746155641.693029:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32335:x1830976125968000:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 45300us (45435us total) trans 8589945276 rc 0/0 00000100:00100000:0.0:1746155641.693035:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11118 00000100:00100000:0.0:1746155641.695837:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.695886:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125969280 00000100:00100000:2.0:1746155641.695893:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125969280 00000100:00100000:2.0:1746155641.695947:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16974 00000100:00100000:2.0:1746155641.695954:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32335:x1830976125969280:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155641.696015:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.696029:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1806c expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.696052:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a887c00/0x844e5faceb5f79cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ff5 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.696059:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.696061:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.696064:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1900544->1908735] (req 1900544->1908735) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 17 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.696093:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a887c00/0x844e5faceb5f79cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ff5 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.696103:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a887c00/0x844e5faceb5f79cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ff5 expref: 15 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.696115:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125365632:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.696194:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155641.697862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.697982:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125969792 00000100:00100000:3.0:1746155641.697987:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125969792 00002000:00100000:3.0:1746155641.698016:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800910c9c00 x1830976125969792/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.698024:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c9c00 with x1830976125969792 ext(1048576->2097151) 00002000:00010000:3.0:1746155641.698028:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c9c00 00000100:00100000:3.0:1746155641.698054:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8049 00000100:00100000:3.0:1746155641.698060:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1961:x1830976125969792:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155641.698134:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.698164:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125365632:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155641.698181:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1900544->1908735] (req 1900544->1908735) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 17 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.698193:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090487c00, rc 0) 00000100:00100000:0.0:1746155641.698217:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32335:x1830976125969280:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2265us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.698223:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16974 00000100:00100000:2.0:1746155641.698360:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125969920 00000100:00100000:2.0:1746155641.698364:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125969920 00010000:00010000:2.0:1746155641.698379:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a887c00/0x844e5faceb5f79cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ff5 expref: 16 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.698404:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8707 00000100:00100000:2.0:1746155641.698409:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125969920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.698417:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155641.698431:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a887c00/0x844e5faceb5f79cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ff5 expref: 16 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.698441:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a887c00/0x844e5faceb5f79cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ff5 expref: 16 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.698457:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a887c00/0x844e5faceb5f79cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ff5 expref: 16 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.698469:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.698471:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.698477:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.698483:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.698522:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 16 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.698533:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125365760:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155641.698571:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.702933:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.702984:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125969536 00000100:00100000:1.0:1746155641.702991:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125969536 00002000:00100000:1.0:1746155641.703025:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009ff69180 x1830976125969536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.703034:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff69180 with x1830976125969536 ext(1048576->2097151) 00002000:00010000:1.0:1746155641.703045:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff69180 00000100:00100000:1.0:1746155641.703077:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8050 00000100:00100000:1.0:1746155641.703083:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125969536:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155641.703474:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125365760:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155641.703488:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.703558:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976125969920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5147us (5423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.703566:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8707 00000100:00100000:0.0:1746155641.704728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.705661:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125970176 00000100:00100000:3.0:1746155641.705667:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125970176 00002000:00100000:3.0:1746155641.705696:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1900544->1904639) req@ffff88009ff68380 x1830976125970176/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.705709:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff68380 with x1830976125970176 ext(1900544->1904639) 00002000:00010000:3.0:1746155641.705713:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff68380 00000100:00100000:3.0:1746155641.705737:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8051 00000100:00100000:3.0:1746155641.705744:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125970176:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155641.705840:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125970176:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 96us (1296us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155641.705846:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8051 00002000:00100000:3.0:1746155641.705851:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1900544->1904639) req@ffff88009ff68380 x1830976125970176/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/4536 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.705857:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff68380 with x1830976125970176 ext(1900544->1904639) 00002000:00010000:3.0:1746155641.705860:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff68380 00000100:00100000:3.0:1746155641.706854:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1961:x1830976125969792:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8792us (8993us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.706862:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8049 00002000:00100000:3.0:1746155641.706868:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800910c9c00 x1830976125969792/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.706875:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c9c00 with x1830976125969792 ext(1048576->2097151) 00002000:00010000:3.0:1746155641.706879:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c9c00 00000100:00100000:1.0:1746155641.713264:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976125969536:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10170us (10337us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155641.713276:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8050 00002000:00100000:1.0:1746155641.713289:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009ff69180 x1830976125969536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.713298:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff69180 with x1830976125969536 ext(1048576->2097151) 00002000:00010000:1.0:1746155641.713303:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ff69180 00000100:00100000:0.0:1746155641.715968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.716009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.716087:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125970560 00000100:00100000:1.0:1746155641.716095:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125970560 00002000:00100000:1.0:1746155641.716129:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e3:0x0] (1904640->1908735) req@ffff88009ff6aa00 x1830976125970560/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.716137:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6aa00 with x1830976125970560 ext(1904640->1908735) 00002000:00010000:1.0:1746155641.716142:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6aa00 00000100:00100000:1.0:1746155641.716173:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8052 00000100:00100000:1.0:1746155641.716182:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976125970560:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155641.716376:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976125970560:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 193us (362us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155641.716383:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8052 00002000:00100000:1.0:1746155641.716390:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e3:0x0] (1904640->1908735) req@ffff88009ff6aa00 x1830976125970560/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/4536 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.716396:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6aa00 with x1830976125970560 ext(1904640->1908735) 00002000:00010000:1.0:1746155641.716399:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6aa00 00000100:00100000:2.0:1746155641.716493:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125970304 00000100:00100000:2.0:1746155641.716497:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125970304 00000100:00100000:2.0:1746155641.716551:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16975 00000100:00100000:2.0:1746155641.716559:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:32333:x1830976125970304:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155641.716569:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.716586:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f080e00/0x844e5faceb5f7abd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18073 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.716613:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a886400/0x844e5faceb5f79c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fee expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.716621:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.716622:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.716626:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f080e00/0x844e5faceb5f7abd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18073 expref: 31 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.716656:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a886400/0x844e5faceb5f79c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fee expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.716668:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a886400/0x844e5faceb5f79c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fee expref: 16 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.716684:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125365888:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.716755:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.721275:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.721294:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125365888:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155641.721321:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f080e00/0x844e5faceb5f7abd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18073 expref: 31 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.721337:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f080e00, rc 0) 00000100:00100000:3.0:1746155641.721339:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125970688 00000100:00100000:3.0:1746155641.721346:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125970688 00010000:00010000:3.0:1746155641.721374:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886400/0x844e5faceb5f79c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fee expref: 17 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.721390:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:32333:x1830976125970304:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4832us (5426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.721397:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16975 00000100:00100000:3.0:1746155641.721412:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8708 00000100:00100000:3.0:1746155641.721419:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976125970688:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155641.721434:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155641.721453:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a886400/0x844e5faceb5f79c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fee expref: 17 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.721463:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a886400/0x844e5faceb5f79c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fee expref: 17 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.721483:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a886400/0x844e5faceb5f79c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17fee expref: 17 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.721499:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.721523:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.721528:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f080e00/0x844e5faceb5f7abd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18073 expref: 30 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.721539:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f080e00/0x844e5faceb5f7abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18073 expref: 30 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.721563:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f080e00/0x844e5faceb5f7abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18073 expref: 30 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.721573:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125366016:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155641.721627:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.721761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.721967:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125970944 00000100:00100000:1.0:1746155641.721971:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125970944 00000100:00100000:1.0:1746155641.721992:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4718 00000100:00100000:1.0:1746155641.721997:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32335:x1830976125970944:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155641.722177:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32335:x1830976125970944:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 179us (415us total) trans 8589945277 rc 0/0 00000100:00100000:1.0:1746155641.722182:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4718 00000100:00100000:2.0:1746155641.722581:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.722696:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125366016:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155641.722705:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155641.722874:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125971072 00000100:00100000:0.0:1746155641.722878:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125971072 00000100:00100000:3.0:1746155641.722914:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125970688:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1495us (1645us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.722935:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8708 00000100:00100000:0.0:1746155641.722988:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16976 00000100:00100000:0.0:1746155641.722994:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32332:x1830976125971072:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155641.723003:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155641.723014:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090487a00/0x844e5faceb5f7ac4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1807a expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.723027:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155641.723028:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155641.723032:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090487a00/0x844e5faceb5f7ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1807a expref: 26 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.723041:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090487a00/0x844e5faceb5f7ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1807a expref: 26 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155641.723049:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090487a00, rc 0) 00000100:00100000:0.0:1746155641.723080:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:32332:x1830976125971072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 86us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.723085:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16976 00000100:00100000:2.0:1746155641.728042:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.728091:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.728208:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.728419:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125971456 00000100:00100000:0.0:1746155641.728427:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125971456 00002000:00100000:0.0:1746155641.728472:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009fc52d80 x1830976125971456/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155641.728481:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc52d80 with x1830976125971456 ext(1048576->2097151) 00002000:00010000:0.0:1746155641.728487:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc52d80 00000100:00100000:0.0:1746155641.728538:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125971584 00000100:00100000:0.0:1746155641.728544:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125971584 00002000:00100000:0.0:1746155641.728564:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fc51880 x1830976125971584/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 504/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155641.728570:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc51880 with x1830976125971584 ext(1048576->2097151) 00002000:00010000:0.0:1746155641.728573:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc51880 00000100:00100000:0.0:1746155641.728587:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125971840 00000100:00100000:0.0:1746155641.728591:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125971840 00002000:00100000:0.0:1746155641.728607:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009fc53480 x1830976125971840/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155641.728613:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc53480 with x1830976125971840 ext(1048576->2097151) 00002000:00010000:0.0:1746155641.728616:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc53480 00000100:00100000:0.0:1746155641.728633:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8053 00000100:00100000:0.0:1746155641.728642:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976125971456:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155641.729930:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8054 00000100:00100000:1.0:1746155641.729939:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125971584:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155641.730096:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8055 00000100:00100000:3.0:1746155641.730106:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125971840:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155641.738808:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976125971456:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10158us (10766us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.738818:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8053 00002000:00100000:2.0:1746155641.738827:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009fc52d80 x1830976125971456/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.738836:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc52d80 with x1830976125971456 ext(1048576->2097151) 00002000:00010000:2.0:1746155641.738841:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc52d80 00000100:00100000:1.0:1746155641.744876:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125971584:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 14930us (16778us total) trans 0 rc 1040384/1040384 00000100:00100000:1.0:1746155641.744886:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8054 00002000:00100000:1.0:1746155641.744896:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fc51880 x1830976125971584/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 504/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.744911:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc51880 with x1830976125971584 ext(1048576->2097151) 00002000:00010000:1.0:1746155641.744926:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc51880 00000100:00100000:3.0:1746155641.750938:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976125971840:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20826us (22722us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.750947:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8055 00002000:00100000:3.0:1746155641.750956:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009fc53480 x1830976125971840/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.750965:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc53480 with x1830976125971840 ext(1048576->2097151) 00002000:00010000:3.0:1746155641.750969:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc53480 00000100:00100000:0.0:1746155641.759154:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.759237:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.761100:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125971968 00000100:00100000:2.0:1746155641.761106:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125972096 00000100:00100000:2.0:1746155641.761113:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125972096 00000100:00100000:1.0:1746155641.761113:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125971968 00000100:00100000:2.0:1746155641.761160:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16977 00000100:00100000:2.0:1746155641.761167:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976125972096:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155641.761182:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.761195:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f081600/0x844e5faceb5f7acb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18088 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.761198:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16978 00000100:00100000:1.0:1746155641.761203:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125971968:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155641.761208:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.761216:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136424800/0x844e5faceb5f7ad2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18081 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.761236:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125366144:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155641.761239:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125366272:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155641.761936:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.761962:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.762369:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.762407:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125972224 00000100:00100000:2.0:1746155641.762411:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125972224 00000100:00100000:2.0:1746155641.762438:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16979 00000100:00100000:2.0:1746155641.762444:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:32332:x1830976125972224:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155641.762452:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.762462:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f081c00/0x844e5faceb5f7ad9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1808f expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.762479:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 18 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.762485:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.762487:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155641.762490:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f081c00/0x844e5faceb5f7ad9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1808f expref: 41 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.762533:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 18 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.762547:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 18 pid: 18270 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.762558:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125366400:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155641.762598:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca299c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746155641.763730:0:18270:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18003 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.763752:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc50380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125366144:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155641.763776:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f081600/0x844e5faceb5f7acb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18088 expref: 32 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.763784:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f081600/0x844e5faceb5f7acb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18088 expref: 32 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.763804:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f081600, rc 0) 00000100:00100000:2.0:1746155641.763830:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976125972096:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2663us (4593us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155641.763837:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16977 00010000:00010000:1.0:1746155641.763901:0:8437:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ffc expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.763926:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125366272:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155641.763945:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136424800/0x844e5faceb5f7ad2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18081 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.763952:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136424800/0x844e5faceb5f7ad2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18081 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155641.763962:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136424800, rc 0) 00000100:00100000:1.0:1746155641.763978:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125971968:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2775us (4831us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155641.763983:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16978 00000100:00100000:0.0:1746155641.764314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.764370:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125972352 00000100:00100000:2.0:1746155641.764375:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125972352 00002000:00100000:2.0:1746155641.764398:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1900544->1908735) req@ffff880131495880 x1830976125972352/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 8680/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.764406:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495880 with x1830976125972352 ext(1900544->1908735) 00010000:00010000:2.0:1746155641.764412:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 17 pid: 18270 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.764426:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 17 pid: 18270 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746155641.764432:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131495880 00000100:00100000:2.0:1746155641.764445:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1398 00000100:00100000:2.0:1746155641.764451:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976125972352:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155641.764566:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125366400:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.764580:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f081c00/0x844e5faceb5f7ad9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1808f expref: 41 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.764591:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f081c00, rc 0) 00000100:00100000:3.0:1746155641.764611:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:32332:x1830976125972224:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2167us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.764616:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16979 00000100:00100000:2.0:1746155641.765391:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976125972352:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 939us (1077us total) trans 17179874273 rc 0/0 00000100:00100000:2.0:1746155641.765397:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1398 00002000:00100000:2.0:1746155641.765403:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1900544->1908735) req@ffff880131495880 x1830976125972352/t17179874273(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 8680/448 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.765410:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495880 with x1830976125972352 ext(1900544->1908735) 00010000:00010000:2.0:1746155641.765415:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 19 pid: 18270 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.765424:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 19 pid: 18270 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746155641.765429:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131495880 00000100:00100000:0.0:1746155641.767617:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.767683:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.767901:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125972480 00000100:00100000:3.0:1746155641.767908:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125972480 00000100:00100000:3.0:1746155641.767957:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16980 00000100:00100000:3.0:1746155641.767965:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32333:x1830976125972480:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155641.767980:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.767993:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b1ddce00/0x844e5faceb5f7ae0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18096 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.768015:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ffc expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.768022:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155641.768023:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155641.768026:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1ddce00/0x844e5faceb5f7ae0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18096 expref: 20 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.768193:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125972608 00000100:00100000:1.0:1746155641.768197:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125972608 00010000:00010000:1.0:1746155641.768213:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 21 pid: 18270 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.768230:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8709 00000100:00100000:1.0:1746155641.768235:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976125972608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.768242:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746155641.768259:0:7063:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155641 -> 1746155642 00002000:00010000:1.0:1746155641.768261:0:7063:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155641 -> 1746155642 00010000:00010000:1.0:1746155641.768266:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 21 pid: 18270 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.768277:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 21 pid: 18270 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.768293:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090487c00/0x844e5faceb5f7ab6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1900544->1908735) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1806c expref: 21 pid: 18270 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.768305:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.768307:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.768313:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f081c00/0x844e5faceb5f7ad9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1808f expref: 40 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.768320:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f081c00/0x844e5faceb5f7ad9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1808f expref: 40 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.768344:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f081c00/0x844e5faceb5f7ad9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1808f expref: 40 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.768355:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125366528:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155641.768454:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ffc expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.768928:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a180 going to sleep for 11 seconds 00010000:00010000:3.0:1746155641.769271:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ffc expref: 14 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.769282:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125366656:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155641.769823:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.771174:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125366528:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155641.771193:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155641.771221:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976125972608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2985us (3536us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.771229:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8709 00000100:00100000:0.0:1746155641.771341:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.771399:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125366656:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.771415:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b1ddce00/0x844e5faceb5f7ae0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18096 expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.771429:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1ddce00, rc 0) 00000100:00100000:3.0:1746155641.771458:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32333:x1830976125972480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3494us (3846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.771464:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16980 00000100:00100000:1.0:1746155641.771723:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125972736 00000100:00100000:1.0:1746155641.771728:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125972736 00010000:00010000:1.0:1746155641.771745:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ffc expref: 15 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.771758:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8710 00000100:00100000:1.0:1746155641.771764:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976125972736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.771772:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155641.771788:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ffc expref: 15 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.771798:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ffc expref: 15 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.771821:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a887a00/0x844e5faceb5f79d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f17ffc expref: 15 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.772162:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.772164:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.772170:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1ddce00/0x844e5faceb5f7ae0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18096 expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.772178:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1ddce00/0x844e5faceb5f7ae0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18096 expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.772200:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1ddce00/0x844e5faceb5f7ae0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18096 expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.772210:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125366784:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155641.772580:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.772811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.772933:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125972864 00000100:00100000:3.0:1746155641.772937:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125972864 00000100:00100000:3.0:1746155641.772956:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16981 00000100:00100000:3.0:1746155641.772961:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:32328:x1830976125972864:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155641.772971:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.772983:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1809d expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.772999:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18003 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.773005:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155641.773006:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155641.773009:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3289088->4194303] (req 3289088->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 27 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.773029:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18003 expref: 15 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.773038:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18003 expref: 15 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.773047:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125366912:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155641.773287:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.773819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.773873:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125973120 00000100:00100000:2.0:1746155641.773877:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125973120 00002000:00100000:2.0:1746155641.773899:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009f881f80 x1830976125973120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.773907:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881f80 with x1830976125973120 ext(1048576->2097151) 00002000:00010000:2.0:1746155641.773912:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f881f80 00000100:00100000:2.0:1746155641.773934:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8056 00000100:00100000:2.0:1746155641.773940:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1960:x1830976125973120:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155641.775938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.775956:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125973248 00000100:00100000:0.0:1746155641.775960:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125973248 00010000:00010000:0.0:1746155641.775981:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18003 expref: 16 pid: 8437 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.776048:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125366912:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.776066:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3289088->4194303] (req 3289088->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 27 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.776076:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a608600, rc 0) 00000100:00100000:3.0:1746155641.776101:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:32328:x1830976125972864:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3140us (3291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.776108:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16981 00000100:00100000:1.0:1746155641.777658:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125366784:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155641.777676:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155641.777703:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976125972736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5939us (6363us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.777711:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8710 00000100:00100000:1.0:1746155641.777745:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8711 00000100:00100000:1.0:1746155641.777751:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125973248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.777760:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155641.777778:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18003 expref: 16 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.777788:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18003 expref: 16 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.777804:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a886a00/0x844e5faceb5f79dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18003 expref: 16 pid: 8437 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.777815:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.777817:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.777822:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 26 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.777829:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 26 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.777849:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 26 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.777857:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125367040:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155641.777893:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.780139:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.780187:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125973504 00000100:00100000:2.0:1746155641.780194:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125973504 00002000:00100000:2.0:1746155641.780225:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f882d80 x1830976125973504/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.780233:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882d80 with x1830976125973504 ext(2097152->3145727) 00002000:00010000:2.0:1746155641.780237:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f882d80 00000100:00100000:2.0:1746155641.780267:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8057 00000100:00100000:2.0:1746155641.780274:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976125973504:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155641.783712:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1960:x1830976125973120:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9763us (9884us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.783722:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8056 00002000:00100000:3.0:1746155641.783731:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009f881f80 x1830976125973120/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.783741:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881f80 with x1830976125973120 ext(1048576->2097151) 00002000:00010000:3.0:1746155641.783746:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f881f80 00000100:00100000:1.0:1746155641.784752:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910da300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125367040:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155641.784772:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155641.784807:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976125973248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7056us (8873us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.784814:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8711 00000100:00100000:0.0:1746155641.786308:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.786354:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125973760 00000100:00100000:3.0:1746155641.786368:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125973760 00002000:00100000:3.0:1746155641.786404:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3289088->3293183) req@ffff88009f882300 x1830976125973760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.786412:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882300 with x1830976125973760 ext(3289088->3293183) 00002000:00010000:3.0:1746155641.786415:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f882300 00000100:00100000:3.0:1746155641.786431:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8058 00000100:00100000:3.0:1746155641.786437:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976125973760:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155641.786598:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976125973760:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 161us (293us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155641.786604:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8058 00002000:00100000:3.0:1746155641.786609:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3289088->3293183) req@ffff88009f882300 x1830976125973760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/4536 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.786616:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882300 with x1830976125973760 ext(3289088->3293183) 00002000:00010000:3.0:1746155641.786618:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f882300 00000100:00100000:2.0:1746155641.787046:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976125973504:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6772us (6913us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.787052:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8057 00002000:00100000:2.0:1746155641.787056:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f882d80 x1830976125973504/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.787062:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882d80 with x1830976125973504 ext(2097152->3145727) 00002000:00010000:2.0:1746155641.787066:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f882d80 00000100:00100000:0.0:1746155641.792278:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.793633:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125973888 00000100:00100000:3.0:1746155641.793641:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125973888 00000100:00100000:3.0:1746155641.793686:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16982 00000100:00100000:3.0:1746155641.793693:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:32332:x1830976125973888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155641.793712:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.793725:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180a4 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.793744:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.793746:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.793753:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 42 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.793765:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 42 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.793774:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a608400, rc 0) 00000100:00100000:3.0:1746155641.794069:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:32332:x1830976125973888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 374us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.794075:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16982 00000100:00100000:0.0:1746155641.799283:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.799350:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125974016 00000100:00100000:3.0:1746155641.799357:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125974016 00000100:00100000:0.0:1746155641.799368:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.802246:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125974144 00000100:00100000:3.0:1746155641.802255:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125974144 00000100:00100000:1.0:1746155641.802275:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16983 00000100:00100000:1.0:1746155641.802285:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:32328:x1830976125974016:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:3.0:1746155641.802295:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16984 00000100:00100000:3.0:1746155641.802299:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:32333:x1830976125974144:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155641.802302:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.802306:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.802316:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7afc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180b2 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.802316:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180ab expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.802337:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 26 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.802337:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b1ddce00/0x844e5faceb5f7ae0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18096 expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.802343:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155641.802344:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155641.802344:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 43 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.802347:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7afc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b2 expref: 32 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.802349:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.802350:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.802352:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [4194304->4227071] (req 4194304->4227071) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 43 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.802370:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 26 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.802370:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 43 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.802380:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 43 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.802395:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125367296:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.802410:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 26 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:3.0:1746155641.802418:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125367168:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155641.802480:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00010000:00010000:1.0:1746155641.802490:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b1ddce00/0x844e5faceb5f7ae0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18096 expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.802518:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b1ddce00/0x844e5faceb5f7ae0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18096 expref: 18 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.802526:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125367424:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.802562:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.807141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.807242:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125974400 00000100:00100000:2.0:1746155641.807249:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125974400 00002000:00100000:2.0:1746155641.807284:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f701f80 x1830976125974400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.807292:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f701f80 with x1830976125974400 ext(2097152->3145727) 00010000:00010000:2.0:1746155641.807300:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 44 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.807317:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 44 pid: 20796 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746155641.807324:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f701f80 00000100:00100000:2.0:1746155641.807353:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1399 00000100:00100000:2.0:1746155641.807360:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976125974400:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155641.808044:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.808060:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.808065:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdeea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125367168:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155641.808070:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125974656 00000100:00100000:0.0:1746155641.808073:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125974656 00010000:00010000:3.0:1746155641.808084:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7afc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b2 expref: 32 pid: 9235 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746155641.808088:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009fff4a80 x1830976125974656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155641.808094:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4a80 with x1830976125974656 ext(3145728->4194303) 00010000:00010000:3.0:1746155641.808096:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a608200, rc 0) 00010000:00010000:0.0:1746155641.808098:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 45 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746155641.808105:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 45 pid: 20796 timeout: 870 lvb_type: 0 00002000:00010000:0.0:1746155641.808110:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff4a80 00000100:00100000:0.0:1746155641.808122:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125974912 00000100:00100000:0.0:1746155641.808124:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125974912 00000100:00100000:3.0:1746155641.808131:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:32333:x1830976125974144:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5830us (8762us total) trans 0 rc 0/0 00002000:00100000:0.0:1746155641.808133:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009fff5f80 x1830976125974912/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155641.808137:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16984 00002000:00100000:0.0:1746155641.808138:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5f80 with x1830976125974912 ext(2097152->3145727) 00010000:00010000:0.0:1746155641.808142:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 27 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:0.0:1746155641.808148:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 27 pid: 20796 timeout: 870 lvb_type: 0 00002000:00010000:0.0:1746155641.808152:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff5f80 00000100:00100000:3.0:1746155641.808158:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1400 00000100:00100000:0.0:1746155641.808161:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1401 00000100:00100000:3.0:1746155641.808163:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1961:x1830976125974656:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155641.808165:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976125974912:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155641.809058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.809108:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125975168 00000100:00100000:2.0:1746155641.809111:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125975168 00002000:00100000:2.0:1746155641.809127:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3289087) req@ffff88009fff7b80 x1830976125975168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.809134:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7b80 with x1830976125975168 ext(3145728->3289087) 00010000:00010000:2.0:1746155641.809138:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 29 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.809146:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 29 pid: 20796 timeout: 870 lvb_type: 0 00002000:00010000:2.0:1746155641.809151:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff7b80 00000100:00100000:1.0:1746155641.809208:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125367296:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155641.809216:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125367424:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155641.809235:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [4194304->4227071] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 46 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.809244:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c51b400, rc 0) 00000100:00100000:1.0:1746155641.809260:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:32328:x1830976125974016:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6978us (9985us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.809266:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16983 00000100:00100000:2.0:1746155641.810831:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1402 00000100:00100000:2.0:1746155641.810841:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976125975168:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155641.813910:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.815327:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.815573:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125975296 00000100:00100000:1.0:1746155641.815581:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125975296 00002000:00100000:1.0:1746155641.815620:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3289088->4194303) req@ffff88012cdeea00 x1830976125975296/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.815629:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeea00 with x1830976125975296 ext(3289088->4194303) 00010000:00010000:1.0:1746155641.815636:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 31 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.815646:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 31 pid: 20796 timeout: 870 lvb_type: 0 00002000:00010000:1.0:1746155641.815652:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdeea00 00000100:00100000:1.0:1746155641.815668:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1403 00000100:00100000:1.0:1746155641.815675:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976125975296:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155641.816383:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125975424 00000100:00100000:1.0:1746155641.816386:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125975424 00010000:00010000:1.0:1746155641.816402:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b1ddce00/0x844e5faceb5f7ae0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18096 expref: 19 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.816422:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8712 00000100:00100000:1.0:1746155641.816427:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976125975424:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.816435:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155641.816448:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b1ddce00/0x844e5faceb5f7ae0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18096 expref: 19 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.816456:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b1ddce00/0x844e5faceb5f7ae0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18096 expref: 19 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.816474:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b1ddce00/0x844e5faceb5f7ae0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18096 expref: 19 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.816490:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155641.816523:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976125975424:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 95us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.816529:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8712 00000100:00100000:1.0:1746155641.818267:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976125974912:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10097us (10203us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155641.818275:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1401 00002000:00100000:1.0:1746155641.818283:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009fff5f80 x1830976125974912/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.818291:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff5f80 with x1830976125974912 ext(2097152->3145727) 00010000:00010000:1.0:1746155641.818298:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 31 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.818308:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 31 pid: 20796 timeout: 870 lvb_type: 0 00002000:00010000:1.0:1746155641.818314:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff5f80 00000100:00100000:3.0:1746155641.823076:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1961:x1830976125974656:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14904us (15024us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.823086:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1400 00002000:00100000:3.0:1746155641.823094:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009fff4a80 x1830976125974656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.823109:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff4a80 with x1830976125974656 ext(3145728->4194303) 00010000:00010000:3.0:1746155641.823116:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 45 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.823128:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 45 pid: 20796 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746155641.823134:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fff4a80 00000100:00100000:3.0:1746155641.825169:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976125975168:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14325us (16105us total) trans 0 rc 143360/143360 00000100:00100000:3.0:1746155641.825176:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1402 00002000:00100000:3.0:1746155641.825184:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3289087) req@ffff88009fff7b80 x1830976125975168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 143360/143360 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.825192:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fff7b80 with x1830976125975168 ext(3145728->3289087) 00010000:00010000:3.0:1746155641.825198:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 29 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:3.0:1746155641.825208:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 29 pid: 20796 timeout: 870 lvb_type: 0 00002000:00010000:3.0:1746155641.825213:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fff7b80 00000100:00100000:1.0:1746155641.826948:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1961:x1830976125974400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19585us (19811us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155641.826955:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1399 00002000:00100000:1.0:1746155641.826960:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f701f80 x1830976125974400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.826967:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f701f80 with x1830976125974400 ext(2097152->3145727) 00010000:00010000:1.0:1746155641.826973:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 43 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.826982:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 43 pid: 20796 timeout: 870 lvb_type: 0 00002000:00010000:1.0:1746155641.826987:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f701f80 00000100:00100000:1.0:1746155641.831270:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976125975296:12345-192.168.202.51@tcp:4:cat.0 Request processed in 15586us (17357us total) trans 21474841594 rc 0/0 00000100:00100000:1.0:1746155641.831280:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1403 00002000:00100000:1.0:1746155641.831291:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3289088->4194303) req@ffff88012cdeea00 x1830976125975296/t21474841594(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/448 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.831300:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeea00 with x1830976125975296 ext(3289088->4194303) 00010000:00010000:1.0:1746155641.831309:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 29 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.831321:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 29 pid: 20796 timeout: 870 lvb_type: 0 00002000:00010000:1.0:1746155641.831328:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdeea00 00000100:00100000:0.0:1746155641.832390:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.832457:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125975552 00000100:00100000:1.0:1746155641.832463:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125975552 00000100:00100000:3.0:1746155641.832626:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16985 00000100:00100000:3.0:1746155641.832634:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:32332:x1830976125975552:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155641.832646:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.832659:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a609000/0x844e5faceb5f7b03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180b9 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.832676:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155641.832680:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a609000/0x844e5faceb5f7b03 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b9 expref: 30 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.832689:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a609000/0x844e5faceb5f7b03 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b9 expref: 30 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.832697:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a609000, rc 0) 00000100:00100000:3.0:1746155641.834882:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:32332:x1830976125975552:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2243us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.834889:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16985 00000100:00100000:0.0:1746155641.835427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.835491:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125975680 00000100:00100000:1.0:1746155641.835497:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125975680 00010000:00010000:1.0:1746155641.835568:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 43 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:1.0:1746155641.835596:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8713 00000100:00100000:1.0:1746155641.835606:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1960:x1830976125975680:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155641.835617:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155641.835634:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 43 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.835642:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 43 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.835661:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7aee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180a4 expref: 43 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:1.0:1746155641.835687:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.835689:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155641.835694:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 42 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.835701:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 42 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.835727:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 42 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155641.835737:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125367552:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155641.837184:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.838189:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.838410:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125975808 00000100:00100000:2.0:1746155641.838416:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125975808 00010000:00010000:2.0:1746155641.838436:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 30 pid: 20796 timeout: 870 lvb_type: 0 00000100:00100000:2.0:1746155641.838467:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8714 00000100:00100000:2.0:1746155641.838474:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1962:x1830976125975808:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.838482:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746155641.838494:0:9789:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155641 -> 1746155642 00010000:00010000:2.0:1746155641.838499:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 30 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.838525:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 30 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.838541:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a608600/0x844e5faceb5f7ae7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3289088->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1809d expref: 30 pid: 20796 timeout: 870 lvb_type: 0 00010000:00010000:2.0:1746155641.838565:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.838566:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.838571:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7afc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b2 expref: 31 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.838578:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7afc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b2 expref: 31 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.838585:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.838586:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.838589:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a609000/0x844e5faceb5f7b03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b9 expref: 29 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.838600:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a609000/0x844e5faceb5f7b03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b9 expref: 29 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.838621:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a609000/0x844e5faceb5f7b03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b9 expref: 29 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.838630:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125367680:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155641.838682:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7afc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b2 expref: 31 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.838690:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125367808:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155641.838707:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.838960:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125367552:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155641.838978:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155641.839012:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976125975680:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3409us (3584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.839019:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8713 00000100:00100000:0.0:1746155641.839492:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.839572:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125976064 00000100:00100000:1.0:1746155641.839576:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125976064 00002000:00100000:1.0:1746155641.839599:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4222976->4227071) req@ffff8800a0d4c000 x1830976125976064/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.839612:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4c000 with x1830976125976064 ext(4222976->4227071) 00002000:00010000:1.0:1746155641.839615:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d4c000 00000100:00100000:1.0:1746155641.839626:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8059 00000100:00100000:1.0:1746155641.839631:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976125976064:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155641.839733:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976125976064:12345-192.168.202.51@tcp:3:cat.0 Request processed in 102us (242us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155641.839739:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8059 00002000:00100000:1.0:1746155641.839743:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4222976->4227071) req@ffff8800a0d4c000 x1830976125976064/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/4536 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.839749:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4c000 with x1830976125976064 ext(4222976->4227071) 00002000:00010000:1.0:1746155641.839752:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d4c000 00000100:00100000:2.0:1746155641.840265:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125367680:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155641.840272:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125367808:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155641.840282:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.840299:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976125975808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1826us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.840305:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8714 00000100:00100000:0.0:1746155641.844577:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.844620:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125976320 00000100:00100000:2.0:1746155641.844628:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125976320 00002000:00100000:2.0:1746155641.844667:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a0d4f800 x1830976125976320/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.844675:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4f800 with x1830976125976320 ext(2097152->3145727) 00002000:00010000:2.0:1746155641.844680:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4f800 00000100:00100000:2.0:1746155641.844706:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8060 00000100:00100000:2.0:1746155641.844714:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1961:x1830976125976320:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155641.845105:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.845126:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.845172:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.845734:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125976704 00000100:00100000:3.0:1746155641.845738:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125976704 00002000:00100000:3.0:1746155641.845755:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a0d4f100 x1830976125976704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.845762:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4f100 with x1830976125976704 ext(2097152->3145727) 00002000:00010000:3.0:1746155641.845765:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4f100 00000100:00100000:3.0:1746155641.845774:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125976832 00000100:00100000:3.0:1746155641.845775:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125976832 00002000:00100000:3.0:1746155641.845782:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a0d4ed80 x1830976125976832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.845788:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4ed80 with x1830976125976832 ext(3145728->4194303) 00002000:00010000:3.0:1746155641.845790:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4ed80 00000100:00100000:3.0:1746155641.845798:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125977088 00000100:00100000:3.0:1746155641.845800:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125977088 00002000:00100000:3.0:1746155641.845809:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a62a0000 x1830976125977088/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.845814:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a0000 with x1830976125977088 ext(3145728->4194303) 00002000:00010000:3.0:1746155641.845817:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a0000 00000100:00100000:3.0:1746155641.845826:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8061 00000100:00100000:3.0:1746155641.845831:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976125976704:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155641.846160:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8062 00000100:00100000:1.0:1746155641.846167:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976125976832:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155641.847523:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8063 00000100:00100000:3.0:1746155641.847530:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125977088:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155641.852015:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1961:x1830976125976320:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7294us (7436us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.852026:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8060 00002000:00100000:2.0:1746155641.852037:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a0d4f800 x1830976125976320/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.852713:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4f800 with x1830976125976320 ext(2097152->3145727) 00002000:00010000:2.0:1746155641.852718:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4f800 00000100:00100000:3.0:1746155641.857205:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976125976704:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11364us (12090us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.857216:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8061 00002000:00100000:3.0:1746155641.857225:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a0d4f100 x1830976125976704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.857234:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4f100 with x1830976125976704 ext(2097152->3145727) 00002000:00010000:3.0:1746155641.857238:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4f100 00000100:00100000:3.0:1746155641.860788:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125977088:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13248us (15603us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155641.860798:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8063 00002000:00100000:3.0:1746155641.860808:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a62a0000 x1830976125977088/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.860816:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a0000 with x1830976125977088 ext(3145728->4194303) 00002000:00010000:3.0:1746155641.860822:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a62a0000 00000100:00100000:0.0:1746155641.861037:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.861186:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125977216 00000100:00100000:3.0:1746155641.861192:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125977216 00000100:00100000:3.0:1746155641.861496:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16986 00000100:00100000:3.0:1746155641.861521:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32333:x1830976125977216:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155641.861533:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.861545:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7b0a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180c0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.861564:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.861571:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155641.861572:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155641.861575:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7b0a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c0 expref: 19 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.861599:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 41 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.861609:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 41 pid: 8437 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155641.861619:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125367936:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155641.861676:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155641.862561:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976125976832:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16393us (17431us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155641.862568:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8062 00002000:00100000:1.0:1746155641.862574:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a0d4ed80 x1830976125976832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.862581:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d4ed80 with x1830976125976832 ext(3145728->4194303) 00002000:00010000:1.0:1746155641.862585:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d4ed80 00000100:00100000:3.0:1746155641.862814:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125367936:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155641.862830:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7b0a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c0 expref: 19 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.862845:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a608400, rc 0) 00000100:00100000:3.0:1746155641.862875:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32333:x1830976125977216:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1373us (1839us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.862881:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16986 00000100:00100000:0.0:1746155641.865205:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.865258:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125977344 00000100:00100000:1.0:1746155641.865264:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125977344 00002000:00100000:1.0:1746155641.865302:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->4227071) req@ffff8800a62a2680 x1830976125977344/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.865309:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a2680 with x1830976125977344 ext(4194304->4227071) 00010000:00010000:1.0:1746155641.865316:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 42 pid: 8437 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155641.865327:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 42 pid: 8437 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746155641.865388:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a62a2680 00000100:00100000:1.0:1746155641.865469:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1404 00000100:00100000:1.0:1746155641.865475:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976125977344:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155641.866796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.867404:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976125977344:12345-192.168.202.51@tcp:4:cat.0 Request processed in 1928us (2203us total) trans 17179874274 rc 0/0 00000100:00100000:1.0:1746155641.867412:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1404 00002000:00100000:1.0:1746155641.867418:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->4227071) req@ffff8800a62a2680 x1830976125977344/t17179874274(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/448 e 0 to 0 dl 1746155652 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.867425:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a2680 with x1830976125977344 ext(4194304->4227071) 00010000:00010000:1.0:1746155641.867431:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 44 pid: 8437 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155641.867441:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 44 pid: 8437 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746155641.867447:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a62a2680 00000100:00100000:3.0:1746155641.867740:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125977472 00000100:00100000:3.0:1746155641.867744:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125977472 00000100:00100000:3.0:1746155641.867772:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16987 00000100:00100000:3.0:1746155641.867776:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1962:x1830976125977472:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155641.867785:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.867797:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7b11 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180c7 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155641.867833:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125368064:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155641.867927:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155641.869447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.869525:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125977600 00000100:00100000:2.0:1746155641.869530:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125977600 00010000:00010000:2.0:1746155641.869556:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 46 pid: 8437 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155641.869582:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8715 00000100:00100000:2.0:1746155641.869587:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1960:x1830976125977600:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155641.869596:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746155641.869613:0:9789:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155641 -> 1746155642 00010000:00010000:2.0:1746155641.869617:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 46 pid: 8437 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155641.869627:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 46 pid: 8437 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155641.869802:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.869803:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.869810:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7b0a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c0 expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.869817:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7b0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c0 expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.869897:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7b0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c0 expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155641.869908:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125368192:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155641.869965:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00010000:00010000:3.0:1746155641.870188:0:9235:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.51@tcp) returned -22 from glimpse AST (req@ffff88008e26f480 x1830976125368064) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 46 pid: 8437 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155641.870205:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c51b400/0x844e5faceb5f7af5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4227071) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ab expref: 46 pid: 8437 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155641.870228:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125368064:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155641.870248:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7b11 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c7 expref: 45 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155641.870262:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7b11 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c7 expref: 45 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155641.870268:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a609200, rc 0) 00000100:00100000:3.0:1746155641.870288:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1962:x1830976125977472:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2511us (3494us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155641.870294:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16987 00000100:00100000:2.0:1746155641.872729:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125368192:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155641.872742:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155641.873481:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1960:x1830976125977600:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3892us (4036us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.873491:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8715 00000100:00100000:0.0:1746155641.873954:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.874111:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125977728 00000100:00100000:3.0:1746155641.874117:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125977728 00000100:00100000:3.0:1746155641.875416:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16988 00000100:00100000:3.0:1746155641.875424:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:32332:x1830976125977728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155641.875440:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155641.875453:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7b18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180ce expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.875473:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.875475:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155641.875481:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7b18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ce expref: 44 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.875494:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7b18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ce expref: 44 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155641.875527:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a608600, rc 0) 00000100:00100000:3.0:1746155641.875567:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:32332:x1830976125977728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 144us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.875572:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16988 00000100:00100000:0.0:1746155641.876532:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155641.876573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.876630:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125978240 00000100:00100000:1.0:1746155641.876635:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125978240 00002000:00100000:1.0:1746155641.876661:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a01d1f80 x1830976125978240/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.876670:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d1f80 with x1830976125978240 ext(3145728->4194303) 00002000:00010000:1.0:1746155641.876674:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01d1f80 00000100:00100000:1.0:1746155641.876699:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125978112 00000100:00100000:1.0:1746155641.876701:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125978112 00002000:00100000:1.0:1746155641.876712:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a01d3480 x1830976125978112/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.876718:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d3480 with x1830976125978112 ext(3145728->4194303) 00002000:00010000:1.0:1746155641.876721:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d3480 00000100:00100000:2.0:1746155641.876723:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8064 00000100:00100000:2.0:1746155641.876729:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125978240:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155641.877332:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8065 00000100:00100000:1.0:1746155641.877338:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976125978112:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155641.879457:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.880262:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125978496 00000100:00100000:3.0:1746155641.880268:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125978496 00002000:00100000:3.0:1746155641.880299:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800910d8700 x1830976125978496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.880308:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8700 with x1830976125978496 ext(4194304->5083135) 00002000:00010000:3.0:1746155641.880314:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910d8700 00000100:00100000:3.0:1746155641.880342:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8066 00000100:00100000:3.0:1746155641.880349:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1962:x1830976125978496:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155641.888182:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125978240:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11445us (11643us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155641.888193:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8064 00002000:00100000:2.0:1746155641.888202:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a01d1f80 x1830976125978240/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.888212:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d1f80 with x1830976125978240 ext(3145728->4194303) 00002000:00010000:2.0:1746155641.888217:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01d1f80 00000100:00100000:1.0:1746155641.890702:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3298:1830976125368320:0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.890748:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.890793:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125368832:0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.890812:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.890829:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746155641.890833:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125368704:0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.890845:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.890864:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125368832 00000100:00100000:1.0:1746155641.890870:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125368832 00000100:00100000:1.0:1746155641.890895:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125368704 00000100:00100000:1.0:1746155641.890897:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125368704 00000100:00100000:1.0:1746155641.890910:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1746155641.890928:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+86:3298:x1830976125368832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.890961:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+86:3298:x1830976125368832:12345-0@lo:400:kworker.0 Request processed in 45us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.890966:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1746155641.890976:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1746155641.890980:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3298:x1830976125368704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.890995:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+77:3298:x1830976125368704:12345-0@lo:400:kworker.0 Request processed in 16us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.891000:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1746155641.891022:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125368704:0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.891029:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125368832:0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.891055:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1830976125368448:0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.891073:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.891085:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830976125368960:0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.891096:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.891106:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746155641.891110:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830976125368576:0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.891121:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155641.891137:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125368448 00000100:00100000:1.0:1746155641.891139:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125368448 00000100:00100000:1.0:1746155641.891159:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125368960 00000100:00100000:1.0:1746155641.891161:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125368960 00000100:00100000:1.0:1746155641.891169:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125368576 00000100:00100000:1.0:1746155641.891171:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125368576 00000100:00100000:1.0:1746155641.891182:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1746155641.891187:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830976125368448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.891212:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1830976125368448:12345-0@lo:400:kworker.0 Request processed in 25us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.891215:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1746155641.891220:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1746155641.891223:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830976125368960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.891227:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1746155641.891231:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830976125368576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.891249:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1830976125368576:12345-0@lo:400:kworker.0 Request processed in 17us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155641.891253:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1746155641.891254:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1830976125368960:12345-0@lo:400:kworker.0 Request processed in 32us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155641.891259:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:1.0:1746155641.891264:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155641.891279:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1830976125368576:0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.891285:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1830976125368448:0@lo:400:kworker.0 00000100:00100000:3.0:1746155641.891327:0:14231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125368320 00000100:00100000:3.0:1746155641.891330:0:14231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125368320 00000100:00100000:3.0:1746155641.891349:0:14231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1746155641.891353:0:14231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3298:x1830976125368320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746155641.891379:0:14231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a039050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3298:x1830976125368320:12345-0@lo:400:kworker.0 Request processed in 26us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155641.891384:0:14231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1746155641.891640:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1830976125368960:0@lo:400:kworker.0 00000100:00100000:0.0:1746155641.891946:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3298:1830976125368320:0@lo:400:kworker.0 00000100:00100000:1.0:1746155641.893302:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976125978112:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15960us (16724us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155641.893310:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8065 00002000:00100000:1.0:1746155641.893318:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a01d3480 x1830976125978112/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155641.893325:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d3480 with x1830976125978112 ext(3145728->4194303) 00002000:00010000:1.0:1746155641.893330:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d3480 00000100:00100000:3.0:1746155641.894389:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1962:x1830976125978496:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14037us (14932us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155641.894396:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8066 00002000:00100000:3.0:1746155641.894401:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800910d8700 x1830976125978496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.894408:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8700 with x1830976125978496 ext(4194304->5083135) 00002000:00010000:3.0:1746155641.894411:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910d8700 00000100:00100000:0.0:1746155641.901626:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.901721:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125978624 00000100:00100000:2.0:1746155641.901728:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125978624 00000100:00100000:2.0:1746155641.901775:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16989 00000100:00100000:2.0:1746155641.901782:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976125978624:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155641.901798:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155641.901812:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fdac800/0x844e5faceb5f7b1f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180d5 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155641.901832:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.901834:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155641.901841:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdac800/0x844e5faceb5f7b1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180d5 expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.901854:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fdac800/0x844e5faceb5f7b1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180d5 expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155641.901864:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdac800, rc 0) 00000100:00100000:2.0:1746155641.901912:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976125978624:12345-192.168.202.51@tcp:101:cat.0 Request processed in 130us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155641.901925:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16989 00000100:00100000:0.0:1746155641.913222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155641.913422:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125978880 00000100:00100000:3.0:1746155641.913429:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125978880 00002000:00100000:3.0:1746155641.913464:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009ca95c00 x1830976125978880/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/0 e 0 to 0 dl 1746155652 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155641.913474:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95c00 with x1830976125978880 ext(4194304->5083135) 00002000:00010000:3.0:1746155641.913478:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca95c00 00000100:00100000:3.0:1746155641.915572:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8067 00000100:00100000:3.0:1746155641.915586:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976125978880:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155641.929239:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976125978880:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13648us (16014us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155641.929249:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8067 00002000:00100000:2.0:1746155641.929259:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009ca95c00 x1830976125978880/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:712/0 lens 488/440 e 0 to 0 dl 1746155652 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155641.929269:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95c00 with x1830976125978880 ext(4194304->5083135) 00002000:00010000:2.0:1746155641.929274:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca95c00 00000100:00100000:0.0:1746155641.935656:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155641.938129:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125979136 00000100:00100000:2.0:1746155641.938139:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125979136 00000100:00100000:2.0:1746155641.938186:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4719 00000100:00100000:2.0:1746155641.938193:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32333:x1830976125979136:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155641.938365:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32333:x1830976125979136:12345-192.168.202.51@tcp:35:cat.0 Request processed in 172us (2716us total) trans 8589945278 rc 0/0 00000100:00100000:2.0:1746155641.938371:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4719 00000100:00100000:0.0:1746155641.947036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155641.947124:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125979392 00000100:00100000:1.0:1746155641.947131:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125979392 00000100:00100000:1.0:1746155641.947172:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11121 00000100:00100000:1.0:1746155641.947178:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32340:x1830976125979392:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155641.947201:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155641.947215:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130887800/0x844e5faceb5f7b26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180dc expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.947294:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130887a00/0x844e5faceb5f7b2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947303:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130887a00/0x844e5faceb5f7b2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947313:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130887a00/0x844e5faceb5f7b2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947323:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886800/0x844e5faceb5f7b34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947327:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130886800/0x844e5faceb5f7b34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947332:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130886800/0x844e5faceb5f7b34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947416:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130887e00/0x844e5faceb5f7b3b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947422:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130887e00/0x844e5faceb5f7b3b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947426:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130887e00/0x844e5faceb5f7b3b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155641.947434:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155641.947495:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130887a00/0x844e5faceb5f7b2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947529:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130887a00/0x844e5faceb5f7b2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947690:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130887a00/0x844e5faceb5f7b2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947695:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130887a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155641.947698:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130887a00/0x844e5faceb5f7b2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947703:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130887a00/0x844e5faceb5f7b2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947711:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155641.947713:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155641.947716:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130887a00/0x844e5faceb5f7b2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947719:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130887a00/0x844e5faceb5f7b2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947740:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886800/0x844e5faceb5f7b34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947744:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130886800/0x844e5faceb5f7b34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947749:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130886800/0x844e5faceb5f7b34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947752:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130886800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155641.947753:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130886800/0x844e5faceb5f7b34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947760:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130886800/0x844e5faceb5f7b34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947765:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c500) 00010000:00010000:1.0:1746155641.947767:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155641.947768:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130886800/0x844e5faceb5f7b34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947772:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130886800/0x844e5faceb5f7b34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155641.947803:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130887800/0x844e5faceb5f7b26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180dc expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.947811:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130887e00/0x844e5faceb5f7b3b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180dc expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155641.947816:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155641.947818:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155641.947820:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130887e00, rc 0) 00000100:00100000:1.0:1746155641.948292:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32340:x1830976125979392:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1112us (1262us total) trans 8589945279 rc 0/0 00000100:00100000:1.0:1746155641.948299:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11121 00000100:00100000:0.0:1746155642.035244:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.035309:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125979520 00000100:00100000:2.0:1746155642.035319:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125979520 00000100:00100000:2.0:1746155642.035385:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16990 00000100:00100000:2.0:1746155642.035393:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32340:x1830976125979520:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155642.035408:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.035423:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180e3 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.035446:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7b0a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c0 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.035453:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7b18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ce expref: 43 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.035459:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.035461:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.035464:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3407872->4194303] (req 3407872->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.035494:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7b18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ce expref: 43 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.035533:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7b18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ce expref: 43 pid: 9235 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.035544:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125369088:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.035617:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7b0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c0 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.035625:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7b0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c0 expref: 21 pid: 9235 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.035633:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125369216:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.035647:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00000100:00080000:1.0:1746155642.035892:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155642.039170:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125369088:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.039702:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125369216:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.039725:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3407872->4194303] (req 3407872->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.039741:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdad600, rc 0) 00000100:00100000:2.0:1746155642.039791:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:32340:x1830976125979520:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4397us (4554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.039799:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16990 00000100:00100000:0.0:1746155642.040275:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.040388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.040580:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125979648 00000100:00100000:2.0:1746155642.040586:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125979648 00010000:00010000:2.0:1746155642.040613:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7b18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ce expref: 44 pid: 9235 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.040630:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125979776 00000100:00100000:2.0:1746155642.040631:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125979776 00010000:00010000:2.0:1746155642.040637:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7b0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c0 expref: 21 pid: 9235 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.040662:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8716 00000100:00100000:2.0:1746155642.040669:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976125979648:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.040680:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155642.040697:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8717 00010000:00010000:2.0:1746155642.040699:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7b18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ce expref: 44 pid: 9235 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.040705:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976125979776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.040709:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7b18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ce expref: 44 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.040713:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1746155642.040752:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746155642.040841:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7b0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c0 expref: 21 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.040841:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7b18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ce expref: 44 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.040850:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7b0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c0 expref: 21 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.040860:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a608400/0x844e5faceb5f7b0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180c0 expref: 21 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.040881:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.040883:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.040889:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.040894:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.040931:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.040942:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125369344:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155642.040989:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316300 going to sleep for 11 seconds 00010000:00010000:2.0:1746155642.041168:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.041189:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1961:x1830976125979648:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 520us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.041199:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8716 00000100:00100000:3.0:1746155642.043255:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125369344:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155642.043269:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.043310:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976125979776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2605us (2920us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.043319:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8717 00000100:00100000:0.0:1746155642.043769:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.043823:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125980032 00000100:00100000:2.0:1746155642.043828:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125980032 00002000:00100000:2.0:1746155642.043856:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3407872->3411967) req@ffff88012f1f1880 x1830976125980032/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.043864:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1880 with x1830976125980032 ext(3407872->3411967) 00002000:00010000:2.0:1746155642.043868:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f1880 00000100:00100000:2.0:1746155642.043951:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8068 00000100:00100000:2.0:1746155642.043958:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976125980032:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155642.044289:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976125980032:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 330us (519us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155642.044295:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8068 00002000:00100000:2.0:1746155642.044300:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3407872->3411967) req@ffff88012f1f1880 x1830976125980032/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/4536 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.044307:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1880 with x1830976125980032 ext(3407872->3411967) 00002000:00010000:2.0:1746155642.044310:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f1880 00000100:00100000:0.0:1746155642.053314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.055942:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125980160 00000100:00100000:2.0:1746155642.055952:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125980160 00000100:00100000:2.0:1746155642.056009:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16991 00000100:00100000:2.0:1746155642.056018:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:32340:x1830976125980160:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155642.056033:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.056046:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180ea expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.056073:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7afc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b2 expref: 33 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.056081:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a609000/0x844e5faceb5f7b03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b9 expref: 28 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.056087:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.056089:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.056092:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->3194879] (req 3145728->3194879) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.056117:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a609000/0x844e5faceb5f7b03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b9 expref: 28 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.056127:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a609000/0x844e5faceb5f7b03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b9 expref: 28 pid: 9235 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.056142:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125369472:192.168.202.51@tcp:104: 00000100:00080000:0.0:1746155642.056331:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746155642.056381:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7afc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b2 expref: 33 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.056390:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7afc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b2 expref: 33 pid: 9235 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.056398:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125369600:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.056757:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.057625:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125369472:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.060857:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125369600:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.060886:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->3194879] (req 3145728->3194879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 33 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.060903:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdad800, rc 0) 00000100:00100000:2.0:1746155642.060965:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:32340:x1830976125980160:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4948us (7656us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.060973:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16991 00000100:00100000:0.0:1746155642.062149:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.063211:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125980288 00000100:00100000:3.0:1746155642.063219:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125980288 00010000:00010000:3.0:1746155642.063262:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a609000/0x844e5faceb5f7b03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b9 expref: 29 pid: 9235 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.063553:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8718 00000100:00100000:3.0:1746155642.063561:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976125980288:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.063572:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.063590:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a609000/0x844e5faceb5f7b03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b9 expref: 29 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.063601:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a609000/0x844e5faceb5f7b03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b9 expref: 29 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.063625:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a609000/0x844e5faceb5f7b03 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b9 expref: 29 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.063657:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.063696:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125980288:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 136us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.063702:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8718 00000100:00080000:0.0:1746155642.063780:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155642.065205:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.067032:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.067171:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125980672 00000100:00100000:3.0:1746155642.067178:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125980672 00010000:00010000:3.0:1746155642.067204:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7afc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b2 expref: 33 pid: 9235 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.067229:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8719 00000100:00100000:3.0:1746155642.067235:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1960:x1830976125980672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.067246:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.067269:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7afc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b2 expref: 33 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.067282:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7afc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b2 expref: 33 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.067304:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7afc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180b2 expref: 33 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.067315:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.067317:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.067323:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.067330:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.067361:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.067372:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125369728:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155642.067418:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.067624:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125980544 00000100:00100000:1.0:1746155642.067628:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125980544 00000100:00100000:1.0:1746155642.067657:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11122 00000100:00100000:1.0:1746155642.067663:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32344:x1830976125980544:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155642.067677:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155642.067689:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130886a00/0x844e5faceb5f7b57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180f1 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746155642.067723:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746155642.067764:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130887000/0x844e5faceb5f7b5e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.067773:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130887000/0x844e5faceb5f7b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.067781:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130887000/0x844e5faceb5f7b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.067793:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130887200/0x844e5faceb5f7b65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.067798:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130887200/0x844e5faceb5f7b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.067803:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130887200/0x844e5faceb5f7b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.067891:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5f7b6c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.067898:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5f7b6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.067903:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5f7b6c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155642.067911:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155642.067996:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130887000/0x844e5faceb5f7b5e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068005:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130887000/0x844e5faceb5f7b5e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068011:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130887000/0x844e5faceb5f7b5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068015:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130887000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155642.068018:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130887000/0x844e5faceb5f7b5e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068024:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130887000/0x844e5faceb5f7b5e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068031:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155642.068033:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155642.068037:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130887000/0x844e5faceb5f7b5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068041:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130887000/0x844e5faceb5f7b5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068061:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130887200/0x844e5faceb5f7b65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068066:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130887200/0x844e5faceb5f7b65 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068070:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130887200/0x844e5faceb5f7b65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068074:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130887200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155642.068076:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130887200/0x844e5faceb5f7b65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068083:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130887200/0x844e5faceb5f7b65 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068088:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c000) 00010000:00010000:1.0:1746155642.068090:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155642.068091:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130887200/0x844e5faceb5f7b65 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068095:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130887200/0x844e5faceb5f7b65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.068123:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130886a00/0x844e5faceb5f7b57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180f1 expref: 291 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.068131:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5f7b6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180f1 expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.068136:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155642.068137:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155642.068139:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130886000, rc 0) 00000100:00100000:1.0:1746155642.068174:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32344:x1830976125980544:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 511us (2970us total) trans 8589945280 rc 0/0 00000100:00100000:1.0:1746155642.068179:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11122 00000100:00100000:3.0:1746155642.069253:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125369728:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155642.069267:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.069290:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976125980672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2055us (2262us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.069296:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8719 00000100:00100000:0.0:1746155642.070068:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.070088:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125980928 00000100:00100000:2.0:1746155642.070093:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125980928 00000100:00100000:0.0:1746155642.070098:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:2.0:1746155642.070121:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3190784->3194879) req@ffff88012f1f3100 x1830976125980928/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.070128:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3100 with x1830976125980928 ext(3190784->3194879) 00002000:00010000:2.0:1746155642.070132:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3100 00000100:00100000:1.0:1746155642.070142:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125981184 00000100:00100000:2.0:1746155642.070146:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8069 00000100:00100000:1.0:1746155642.070146:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125981184 00000100:00100000:2.0:1746155642.070152:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1963:x1830976125980928:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155642.070178:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4720 00000100:00100000:1.0:1746155642.070183:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009461b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32344:x1830976125981184:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155642.070476:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1963:x1830976125980928:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 322us (408us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155642.070482:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8069 00002000:00100000:2.0:1746155642.070487:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3190784->3194879) req@ffff88012f1f3100 x1830976125980928/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/4536 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.070562:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3100 with x1830976125980928 ext(3190784->3194879) 00002000:00010000:2.0:1746155642.070565:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3100 00000100:00100000:1.0:1746155642.070590:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009461b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32344:x1830976125981184:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 406us (490us total) trans 8589945281 rc 0/0 00000100:00100000:1.0:1746155642.070596:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4720 00000100:00100000:0.0:1746155642.073003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.073077:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125981440 00000100:00100000:1.0:1746155642.073083:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125981440 00000100:00080000:0.0:1746155642.073156:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155642.073211:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4721 00000100:00100000:1.0:1746155642.073217:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32340:x1830976125981440:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155642.073362:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32340:x1830976125981440:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 144us (363us total) trans 8589945282 rc 0/0 00000100:00100000:1.0:1746155642.073368:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4721 00000100:00100000:0.0:1746155642.119937:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.121575:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125981696 00000100:00100000:1.0:1746155642.121585:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125981696 00000100:00100000:1.0:1746155642.121635:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11123 00000100:00100000:1.0:1746155642.121642:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32348:x1830976125981696:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155642.121668:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155642.121682:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5f7b7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180f8 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.121769:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130887400/0x844e5faceb5f7b81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.121779:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130887400/0x844e5faceb5f7b81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.121788:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130887400/0x844e5faceb5f7b81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.121798:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886400/0x844e5faceb5f7b88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.121803:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130886400/0x844e5faceb5f7b88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.121808:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130886400/0x844e5faceb5f7b88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.121888:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130887c00/0x844e5faceb5f7b8f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.121896:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130887c00/0x844e5faceb5f7b8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.121901:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130887c00/0x844e5faceb5f7b8f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155642.121908:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155642.121992:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130887400/0x844e5faceb5f7b81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.121998:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130887400/0x844e5faceb5f7b81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.122003:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130887400/0x844e5faceb5f7b81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.122007:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130887400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155642.122010:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130887400/0x844e5faceb5f7b81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.122015:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130887400/0x844e5faceb5f7b81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.122024:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155642.122026:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155642.122029:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130887400/0x844e5faceb5f7b81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.122036:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130887400/0x844e5faceb5f7b81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.122062:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886400/0x844e5faceb5f7b88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.122066:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130886400/0x844e5faceb5f7b88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.122069:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130886400/0x844e5faceb5f7b88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.122073:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130886400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155642.122075:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130886400/0x844e5faceb5f7b88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.122078:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130886400/0x844e5faceb5f7b88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.122083:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c500) 00010000:00010000:1.0:1746155642.122085:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155642.122086:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130886400/0x844e5faceb5f7b88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.122090:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130886400/0x844e5faceb5f7b88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.122124:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130886200/0x844e5faceb5f7b7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180f8 expref: 294 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.122134:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130887c00/0x844e5faceb5f7b8f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180f8 expref: 293 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.122144:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155642.122146:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155642.122148:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130887c00, rc 0) 00000100:00100000:1.0:1746155642.122192:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32348:x1830976125981696:12345-192.168.202.51@tcp:101:cat.0 Request processed in 550us (2261us total) trans 8589945283 rc 0/0 00000100:00100000:1.0:1746155642.122197:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11123 00000100:00100000:0.0:1746155642.126874:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.126932:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.126992:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125982080 00000100:00100000:2.0:1746155642.127000:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125982080 00000100:00100000:2.0:1746155642.127056:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 754 00000100:00100000:2.0:1746155642.127063:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1963:x1830976125982080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.127075:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155642.127098:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130887c00/0x844e5faceb5f7b8f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180f8 expref: 293 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.127122:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155642.127126:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.127159:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:1963:x1830976125982080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 97us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.127164:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 754 00000100:00100000:3.0:1746155642.127614:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125981952 00000100:00100000:3.0:1746155642.127619:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125981952 00000100:00100000:3.0:1746155642.127642:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4722 00000100:00100000:3.0:1746155642.127647:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32348:x1830976125981952:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155642.127784:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32348:x1830976125981952:12345-192.168.202.51@tcp:35:cat.0 Request processed in 136us (917us total) trans 8589945284 rc 0/0 00000100:00100000:3.0:1746155642.127789:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4722 00000100:00100000:0.0:1746155642.129720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.129759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.129843:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125982208 00000100:00100000:2.0:1746155642.129849:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125982208 00000100:00100000:2.0:1746155642.129883:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125982336 00000100:00100000:2.0:1746155642.129885:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125982336 00000100:00100000:2.0:1746155642.129900:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16992 00000100:00100000:2.0:1746155642.129906:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1961:x1830976125982208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155642.129927:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.129941:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fdacc00/0x844e5faceb5f7b9d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f180ff expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.129982:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125369856:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155642.130041:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.130160:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16993 00000100:00100000:3.0:1746155642.130166:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976125982336:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155642.130173:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.130181:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7ba4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18106 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.130203:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125369984:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155642.130225:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00002000:00010000:3.0:1746155642.133012:0:9235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime: 1746155641 -> 1746155642 00000100:00100000:3.0:1746155642.133035:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125369984:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155642.133060:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7ba4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18106 expref: 29 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.133070:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7ba4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18106 expref: 29 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.133080:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a609400, rc 0) 00000100:00100000:3.0:1746155642.133115:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976125982336:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2949us (3354us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155642.133120:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16993 00002000:00010000:2.0:1746155642.133493:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155641 -> 1746155642 00000100:00100000:2.0:1746155642.133531:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125369856:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155642.133547:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fdacc00/0x844e5faceb5f7b9d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ff expref: 44 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.133556:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fdacc00/0x844e5faceb5f7b9d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ff expref: 44 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.133578:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdacc00, rc 0) 00000100:00100000:2.0:1746155642.133601:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1961:x1830976125982208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3695us (3885us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155642.133606:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16992 00000100:00100000:0.0:1746155642.138863:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.139688:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125982592 00000100:00100000:2.0:1746155642.139696:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125982592 00002000:00100000:2.0:1746155642.139732:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f0d9880 x1830976125982592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.139740:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d9880 with x1830976125982592 ext(0->1048575) 00002000:00010000:2.0:1746155642.139744:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d9880 00000100:00100000:2.0:1746155642.139767:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8070 00000100:00100000:2.0:1746155642.139774:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1960:x1830976125982592:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155642.151390:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1960:x1830976125982592:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11605us (12523us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155642.151402:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8070 00002000:00100000:2.0:1746155642.151415:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f0d9880 x1830976125982592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.151425:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d9880 with x1830976125982592 ext(0->1048575) 00002000:00010000:2.0:1746155642.151430:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d9880 00000100:00100000:0.0:1746155642.163220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.164100:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125982848 00000100:00100000:2.0:1746155642.164109:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125982848 00000100:00100000:2.0:1746155642.164376:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11124 00000100:00100000:2.0:1746155642.164385:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32351:x1830976125982848:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155642.164409:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.164423:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac600/0x844e5faceb5f7bab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1810d expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.165642:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad000/0x844e5faceb5f7bb2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165656:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad000/0x844e5faceb5f7bb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165667:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad000/0x844e5faceb5f7bb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165683:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f7bb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165689:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f7bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165695:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f7bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165817:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac400/0x844e5faceb5f7bc0 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165831:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac400/0x844e5faceb5f7bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165838:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac400/0x844e5faceb5f7bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:2.0:1746155642.165847:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155642.165946:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad000/0x844e5faceb5f7bb2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165953:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad000/0x844e5faceb5f7bb2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165958:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad000/0x844e5faceb5f7bb2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165964:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fdad000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155642.165967:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad000/0x844e5faceb5f7bb2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165973:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad000/0x844e5faceb5f7bb2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165983:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155642.165986:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155642.165990:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad000/0x844e5faceb5f7bb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.165995:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad000/0x844e5faceb5f7bb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.166023:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f7bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.166032:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f7bb9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.166037:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f7bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.166040:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fdade00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155642.166042:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f7bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.166046:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f7bb9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.166053:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800912d5000) 00010000:00010000:2.0:1746155642.166055:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155642.166058:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f7bb9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.166062:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f7bb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155642.166107:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac600/0x844e5faceb5f7bab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1810d expref: 16 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.166119:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac400/0x844e5faceb5f7bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1810d expref: 15 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.166125:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155642.166127:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155642.166129:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdac400, rc 0) 00000100:00100000:2.0:1746155642.166187:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32351:x1830976125982848:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1801us (2974us total) trans 8589945285 rc 0/0 00000100:00100000:2.0:1746155642.166195:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11124 00000100:00100000:0.0:1746155642.167575:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.167693:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125982976 00000100:00100000:3.0:1746155642.167701:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125982976 00000100:00100000:3.0:1746155642.167762:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16994 00000100:00100000:3.0:1746155642.167771:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1962:x1830976125982976:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155642.167785:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.167797:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a608200/0x844e5faceb5f7bce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18114 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.167852:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125370112:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155642.167950:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.168876:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.169006:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125983104 00000100:00100000:0.0:1746155642.169010:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125983104 00000100:00100000:0.0:1746155642.169039:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16995 00000100:00100000:0.0:1746155642.169045:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976125983104:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155642.169052:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.169061:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f64200/0x844e5faceb5f7bd5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1811b expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.169085:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125370240:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155642.169479:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.170665:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.171558:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125983232 00000100:00100000:2.0:1746155642.171563:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125983232 00000100:00100000:2.0:1746155642.171860:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 755 00000100:00100000:2.0:1746155642.171867:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1963:x1830976125983232:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.171877:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155642.171896:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac400/0x844e5faceb5f7bc0 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1810d expref: 15 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.171908:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155642.171921:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.171956:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1963:x1830976125983232:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 90us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.171961:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 755 00000100:00100000:1.0:1746155642.172733:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125370112:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155642.172755:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a608200/0x844e5faceb5f7bce lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18114 expref: 44 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.172764:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a608200/0x844e5faceb5f7bce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18114 expref: 44 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.172775:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a608200, rc 0) 00000100:00100000:1.0:1746155642.172793:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1962:x1830976125982976:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5025us (5223us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155642.172798:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16994 00000100:00100000:0.0:1746155642.172945:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb6aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125370240:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155642.172960:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f64200/0x844e5faceb5f7bd5 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1811b expref: 29 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.172968:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f64200/0x844e5faceb5f7bd5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1811b expref: 29 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.172979:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f64200, rc 0) 00000100:00100000:0.0:1746155642.172993:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976125983104:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3950us (4119us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155642.172998:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16995 00000100:00100000:0.0:1746155642.174220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.174249:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.174264:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125983616 00000100:00100000:2.0:1746155642.174269:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125983616 00000100:00100000:1.0:1746155642.174295:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125983488 00002000:00100000:2.0:1746155642.174299:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fb6aa00 x1830976125983616/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155642.174299:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125983488 00002000:00100000:2.0:1746155642.174306:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6aa00 with x1830976125983616 ext(1048576->2097151) 00002000:00010000:2.0:1746155642.174310:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6aa00 00002000:00100000:1.0:1746155642.174314:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fb69f80 x1830976125983488/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.174321:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69f80 with x1830976125983488 ext(0->1048575) 00002000:00010000:1.0:1746155642.174324:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb69f80 00000100:00100000:2.0:1746155642.174496:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8071 00000100:00100000:2.0:1746155642.174526:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1961:x1830976125983616:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155642.174560:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8072 00000100:00100000:2.0:1746155642.174570:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976125983488:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155642.175865:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.175945:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125983872 00000100:00100000:0.0:1746155642.175950:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125983872 00000100:00100000:0.0:1746155642.175974:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16996 00000100:00100000:0.0:1746155642.175979:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:32348:x1830976125983872:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155642.175987:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.176000:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f64c00/0x844e5faceb5f7bdc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18122 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.176025:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 22 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.176034:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155642.176036:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155642.176039:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f64c00/0x844e5faceb5f7bdc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18122 expref: 44 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.176073:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 22 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.176084:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 22 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.176093:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125370368:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.176154:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25300 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.177214:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125370368:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.177231:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f64c00/0x844e5faceb5f7bdc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18122 expref: 44 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.177241:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f64c00, rc 0) 00000100:00100000:2.0:1746155642.177261:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:32348:x1830976125983872:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1282us (1398us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.177266:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16996 00000100:00100000:0.0:1746155642.177568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.178732:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125984000 00000100:00100000:2.0:1746155642.178739:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125984000 00002000:00100000:2.0:1746155642.178769:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (3407872->4194303) req@ffff88009fb68e00 x1830976125984000/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.178777:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68e00 with x1830976125984000 ext(3407872->4194303) 00010000:00010000:2.0:1746155642.178783:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 24 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.178795:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 24 pid: 18270 timeout: 871 lvb_type: 0 00002000:00010000:2.0:1746155642.178802:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb68e00 00000100:00100000:2.0:1746155642.178831:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1405 00000100:00100000:2.0:1746155642.178837:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976125984000:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155642.183753:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976125983488:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9175us (9490us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155642.183766:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8072 00002000:00100000:2.0:1746155642.183779:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fb69f80 x1830976125983488/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.183788:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69f80 with x1830976125983488 ext(0->1048575) 00002000:00010000:2.0:1746155642.183794:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb69f80 00000100:00100000:1.0:1746155642.189692:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976125983616:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15181us (15465us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155642.189701:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8071 00002000:00100000:1.0:1746155642.189711:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fb6aa00 x1830976125983616/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.189719:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb6aa00 with x1830976125983616 ext(1048576->2097151) 00002000:00010000:1.0:1746155642.189723:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb6aa00 00000100:00100000:0.0:1746155642.196359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.196525:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125984128 00000100:00100000:2.0:1746155642.196533:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125984128 00000100:00100000:2.0:1746155642.196581:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16997 00000100:00100000:2.0:1746155642.196589:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32351:x1830976125984128:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155642.196604:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.196618:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fdad400/0x844e5faceb5f7be3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18129 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.196641:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155642.196646:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdad400/0x844e5faceb5f7be3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18129 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.196656:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fdad400/0x844e5faceb5f7be3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18129 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.196664:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdad400, rc 0) 00000100:00100000:2.0:1746155642.196710:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:32351:x1830976125984128:12345-192.168.202.51@tcp:101:cat.0 Request processed in 121us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.196716:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16997 00000100:00100000:3.0:1746155642.197088:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976125984000:12345-192.168.202.51@tcp:4:cat.0 Request processed in 18249us (19518us total) trans 17179874275 rc 0/0 00000100:00100000:3.0:1746155642.197095:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1405 00002000:00100000:3.0:1746155642.197102:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (3407872->4194303) req@ffff88009fb68e00 x1830976125984000/t17179874275(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/448 e 0 to 0 dl 1746155653 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.197110:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb68e00 with x1830976125984000 ext(3407872->4194303) 00010000:00010000:3.0:1746155642.197115:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 23 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.197126:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 23 pid: 18270 timeout: 871 lvb_type: 0 00002000:00010000:3.0:1746155642.197132:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fb68e00 00000100:00100000:0.0:1746155642.200784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.201808:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125984256 00000100:00100000:3.0:1746155642.201815:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125984256 00010000:00010000:3.0:1746155642.201844:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 23 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.201964:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8720 00000100:00100000:3.0:1746155642.201971:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976125984256:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.201985:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.202003:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 23 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.202015:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 23 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.202034:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fdad600/0x844e5faceb5f7b49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180e3 expref: 23 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.202051:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.202053:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.202060:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f64c00/0x844e5faceb5f7bdc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18122 expref: 43 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.202067:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f64c00/0x844e5faceb5f7bdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18122 expref: 43 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.202074:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.202075:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.202077:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdad400/0x844e5faceb5f7be3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18129 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.202083:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdad400/0x844e5faceb5f7be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18129 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.202107:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008fdad400/0x844e5faceb5f7be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18129 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.202117:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125370496:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155642.202295:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f64c00/0x844e5faceb5f7bdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18122 expref: 43 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.202304:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125370624:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155642.202321:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.203803:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125370496:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155642.203811:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125370624:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155642.203824:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.203847:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976125984256:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1877us (3071us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.203854:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8720 00000100:00100000:0.0:1746155642.208146:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.208252:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125984512 00000100:00100000:3.0:1746155642.208261:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125984512 00002000:00100000:3.0:1746155642.208304:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8801317c5c00 x1830976125984512/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.208314:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c5c00 with x1830976125984512 ext(2097152->3145727) 00002000:00010000:3.0:1746155642.208319:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317c5c00 00000100:00100000:3.0:1746155642.208352:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8073 00000100:00100000:3.0:1746155642.208360:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1962:x1830976125984512:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155642.215047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.215081:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.215105:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125985024 00000100:00100000:0.0:1746155642.215106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.215113:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125985024 00000100:00100000:1.0:1746155642.215127:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125984768 00000100:00100000:1.0:1746155642.215130:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125984768 00000100:00100000:0.0:1746155642.215135:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.215224:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125985152 00000100:00100000:2.0:1746155642.215229:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125985152 00002000:00100000:2.0:1746155642.215252:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8801317c4380 x1830976125985152/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.215265:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4380 with x1830976125985152 ext(3145728->4194303) 00002000:00010000:2.0:1746155642.215270:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317c4380 00000100:00100000:2.0:1746155642.215288:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125985536 00000100:00100000:2.0:1746155642.215291:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125985536 00002000:00100000:2.0:1746155642.215301:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3194880->4194303) req@ffff8801317c4000 x1830976125985536/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.215307:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4000 with x1830976125985536 ext(3194880->4194303) 00002000:00010000:2.0:1746155642.215310:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c4000 00000100:00100000:2.0:1746155642.215321:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8074 00000100:00100000:2.0:1746155642.215327:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1963:x1830976125985152:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:1.0:1746155642.215967:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8801317c5f80 x1830976125984768/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.215975:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c5f80 with x1830976125984768 ext(2097152->3145727) 00002000:00010000:1.0:1746155642.215978:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317c5f80 00000100:00100000:1.0:1746155642.215993:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8075 00000100:00100000:1.0:1746155642.216000:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1962:x1830976125985536:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155642.216333:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8076 00000100:00100000:2.0:1746155642.216339:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1963:x1830976125984768:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:1.0:1746155642.218983:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8801317c5500 x1830976125985024/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.219025:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c5500 with x1830976125985024 ext(2097152->3145727) 00002000:00010000:1.0:1746155642.219030:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c5500 00000100:00100000:1.0:1746155642.219064:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8077 00000100:00100000:1.0:1746155642.219072:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1962:x1830976125985024:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155642.221040:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.221058:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.221072:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125985792 00000100:00100000:1.0:1746155642.221078:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125985792 00000100:00100000:0.0:1746155642.221145:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125985664 00000100:00100000:0.0:1746155642.221148:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125985664 00000100:00100000:0.0:1746155642.221176:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11125 00000100:00100000:0.0:1746155642.221181:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32352:x1830976125985664:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155642.221195:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.221210:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f64200/0x844e5faceb5f7bea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18130 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.221255:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7bf1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.221265:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7bf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.221273:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7bf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.221283:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f7bf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.221287:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f7bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.221291:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f7bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.221373:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.221381:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18026 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.221386:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.221412:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18026 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.221423:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18026 expref: 292 pid: 27374 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.221432:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125370752:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155642.221482:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949540 going to sleep for 11 seconds 00000100:00080000:0.0:1746155642.221495:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155642.222397:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16998 00000100:00100000:1.0:1746155642.222406:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:32344:x1830976125985792:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155642.222418:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155642.222429:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18137 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.222448:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7a38 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1801f expref: 25 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.222454:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b000/0x844e5faceb5f7a4d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1802d expref: 47 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.222459:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.222460:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.222463:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [462848->1048575] (req 462848->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 47 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.222484:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b000/0x844e5faceb5f7a4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1802d expref: 47 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.222492:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b000/0x844e5faceb5f7a4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1802d expref: 47 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.222500:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125370880:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155642.222559:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7a38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1801f expref: 25 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.222567:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7a38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1801f expref: 25 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.222574:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125371008:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.222588:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25480 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.223778:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1962:x1830976125984512:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15413us (15635us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155642.223788:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8073 00002000:00100000:3.0:1746155642.223797:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8801317c5c00 x1830976125984512/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.223810:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c5c00 with x1830976125984512 ext(2097152->3145727) 00002000:00010000:3.0:1746155642.223815:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317c5c00 00000100:00100000:1.0:1746155642.227616:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125370880:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.227628:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125371008:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155642.227655:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [462848->1048575] (req 462848->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 45 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.227669:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0df400, rc 0) 00000100:00100000:1.0:1746155642.227707:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:32344:x1830976125985792:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5303us (6646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.227713:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125370752:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.227717:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16998 00010000:00010000:2.0:1746155642.227729:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155642.229606:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.229827:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125985920 00000100:00100000:3.0:1746155642.229837:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125985920 00010000:00010000:3.0:1746155642.229866:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18026 expref: 293 pid: 27374 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.229903:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8721 00000100:00100000:3.0:1746155642.229910:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1960:x1830976125985920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.229932:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.229937:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18026 expref: 293 pid: 27374 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.229946:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18026 expref: 293 pid: 27374 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.230414:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a608800/0x844e5faceb5f7a46 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18026 expref: 293 pid: 27374 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.230438:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.230443:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.230451:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.230456:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.230474:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.230565:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1963:x1830976125985152:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15236us (15456us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155642.230573:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8074 00002000:00100000:2.0:1746155642.230580:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8801317c4380 x1830976125985152/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.230588:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4380 with x1830976125985152 ext(3145728->4194303) 00002000:00010000:2.0:1746155642.230591:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317c4380 00010000:00010000:2.0:1746155642.230612:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230617:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155642.230651:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155642.230654:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155642.230667:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230675:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230682:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7bf1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230688:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7bf1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230692:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7bf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230697:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f65400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155642.230699:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7bf1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230704:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7bf1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230711:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155642.230713:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155642.230716:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7bf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230722:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7bf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230732:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f7bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230736:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f7bf8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230740:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f7bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230743:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5a37a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155642.230745:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f7bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230748:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f7bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230752:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51900) 00010000:00010000:2.0:1746155642.230754:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155642.230756:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f7bf8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230759:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f7bf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.230785:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f64200/0x844e5faceb5f7bea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18130 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.230794:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18130 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.230803:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155642.230805:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155642.230806:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a36000, rc 0) 00000100:00100000:3.0:1746155642.230923:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:1960:x1830976125985920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1003us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.230929:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8721 00000100:00100000:2.0:1746155642.231761:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32352:x1830976125985664:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 10577us (10723us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.231767:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11125 00000100:00100000:0.0:1746155642.232583:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.232825:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.232948:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.232982:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125986304 00000100:00100000:1.0:1746155642.232988:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125986304 00000100:00100000:1.0:1746155642.233029:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 16999 00000100:00100000:1.0:1746155642.233036:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:32348:x1830976125986304:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155642.233049:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155642.233063:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f0dfc00/0x844e5faceb5f7c0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1813e expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.233086:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 35 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.233093:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155642.233094:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155642.233097:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f0dfc00/0x844e5faceb5f7c0d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1813e expref: 29 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.233121:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 35 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.233130:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 35 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.233140:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125371136:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.233198:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25480 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.233624:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125986176 00000100:00100000:1.0:1746155642.233624:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125986048 00000100:00100000:3.0:1746155642.233628:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125986176 00000100:00100000:1.0:1746155642.233628:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125986048 00010000:00010000:3.0:1746155642.233643:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7a38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1801f expref: 24 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.233643:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b000/0x844e5faceb5f7a4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1802d expref: 45 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.233661:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8722 00000100:00100000:1.0:1746155642.233666:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1960:x1830976125986048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.233674:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.233690:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b000/0x844e5faceb5f7a4d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1802d expref: 45 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.233699:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b000/0x844e5faceb5f7a4d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1802d expref: 45 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.233713:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3b000/0x844e5faceb5f7a4d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1802d expref: 45 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.233726:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155642.233744:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1960:x1830976125986048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 78us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.233749:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8722 00000100:00100000:1.0:1746155642.233779:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8723 00000100:00100000:1.0:1746155642.233784:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1962:x1830976125986176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.233790:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.233796:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7a38 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1801f expref: 24 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.233804:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7a38 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1801f expref: 24 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.233814:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7a38 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1801f expref: 24 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.233822:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.233823:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.233828:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 43 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.233834:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 43 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.233852:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 43 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.233860:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125371264:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155642.233895:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.239004:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1962:x1830976125985536:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22996us (23859us total) trans 0 rc 999424/999424 00000100:00100000:2.0:1746155642.239005:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125371136:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.239015:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8075 00002000:00100000:1.0:1746155642.239024:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3194880->4194303) req@ffff8801317c4000 x1830976125985536/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 999424/999424 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746155642.239029:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f0dfc00/0x844e5faceb5f7c0d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1813e expref: 29 pid: 18270 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746155642.239037:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4000 with x1830976125985536 ext(3194880->4194303) 00010000:00010000:2.0:1746155642.239043:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0dfc00, rc 0) 00010000:00010000:1.0:1746155642.239045:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 34 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.239061:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:32348:x1830976125986304:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6026us (6236us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155642.239061:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 34 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.239067:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 16999 00002000:00010000:1.0:1746155642.239067:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317c4000 00000100:00100000:0.0:1746155642.240145:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.240406:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125986432 00000100:00100000:1.0:1746155642.240413:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125986432 00002000:00100000:1.0:1746155642.240444:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3194879) req@ffff8801317c6300 x1830976125986432/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.240451:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6300 with x1830976125986432 ext(3145728->3194879) 00010000:00010000:1.0:1746155642.240456:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 34 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.240467:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 34 pid: 18270 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746155642.240473:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317c6300 00000100:00100000:1.0:1746155642.240500:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1406 00000100:00100000:1.0:1746155642.240534:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1961:x1830976125986432:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155642.242113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.242193:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125371264:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155642.242212:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155642.242242:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1962:x1830976125986176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8456us (9293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.242250:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8723 00000100:00100000:2.0:1746155642.242438:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125986688 00000100:00100000:2.0:1746155642.242443:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125986688 00002000:00100000:2.0:1746155642.242464:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e1:0x0] (462848->466943) req@ffff88009f882a00 x1830976125986688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.242472:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882a00 with x1830976125986688 ext(462848->466943) 00002000:00010000:2.0:1746155642.242476:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f882a00 00000100:00100000:2.0:1746155642.242494:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8078 00000100:00100000:2.0:1746155642.242499:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976125986688:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155642.242875:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976125986688:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 374us (765us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155642.242882:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8078 00002000:00100000:2.0:1746155642.242887:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e1:0x0] (462848->466943) req@ffff88009f882a00 x1830976125986688/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/4536 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.242893:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882a00 with x1830976125986688 ext(462848->466943) 00002000:00010000:2.0:1746155642.242896:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f882a00 00000100:00100000:2.0:1746155642.243274:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976125984768:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26935us (28192us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155642.243280:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8076 00002000:00100000:2.0:1746155642.243284:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8801317c5f80 x1830976125984768/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.243291:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c5f80 with x1830976125984768 ext(2097152->3145727) 00002000:00010000:2.0:1746155642.243294:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801317c5f80 00000100:00100000:1.0:1746155642.246234:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:1961:x1830976125986432:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5693us (6084us total) trans 21474841595 rc 0/0 00000100:00100000:1.0:1746155642.246244:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1406 00002000:00100000:1.0:1746155642.246253:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3194879) req@ffff8801317c6300 x1830976125986432/t21474841595(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/448 e 0 to 0 dl 1746155653 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.246261:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6300 with x1830976125986432 ext(3145728->3194879) 00010000:00010000:1.0:1746155642.246269:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 36 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.246282:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 36 pid: 18270 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746155642.246288:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317c6300 00000100:00100000:1.0:1746155642.247257:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1962:x1830976125985024:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28185us (32216us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155642.247264:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8077 00002000:00100000:1.0:1746155642.247270:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8801317c5500 x1830976125985024/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.247277:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c5500 with x1830976125985024 ext(2097152->3145727) 00010000:00010000:1.0:1746155642.247282:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 34 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.247291:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 34 pid: 18270 timeout: 871 lvb_type: 0 00002000:00010000:1.0:1746155642.247297:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317c5500 00000100:00100000:0.0:1746155642.247661:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.248215:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.248575:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125986816 00000100:00100000:2.0:1746155642.248582:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125986816 00000100:00100000:2.0:1746155642.248608:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125986944 00000100:00100000:2.0:1746155642.248609:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125986944 00000100:00100000:2.0:1746155642.248634:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17000 00000100:00100000:2.0:1746155642.248640:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1962:x1830976125986816:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155642.248653:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.248665:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3e84600/0x844e5faceb5f7c14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18145 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.248702:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125371392:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155642.248752:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.248768:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17001 00000100:00100000:2.0:1746155642.248773:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1963:x1830976125986944:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155642.248779:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.248786:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84000/0x844e5faceb5f7c1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1814c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.248796:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.248797:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.248803:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84000/0x844e5faceb5f7c1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1814c expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.248815:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84000/0x844e5faceb5f7c1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1814c expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.248824:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e84000, rc 0) 00000100:00100000:2.0:1746155642.248838:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1963:x1830976125986944:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 65us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.248842:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17001 00000100:00080000:1.0:1746155642.248893:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155642.248969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.249094:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125987072 00000100:00100000:1.0:1746155642.249097:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125987072 00000100:00100000:1.0:1746155642.249114:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17002 00000100:00100000:1.0:1746155642.249118:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1963:x1830976125987072:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155642.249125:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155642.249131:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f0dea00/0x844e5faceb5f7c22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18153 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.249141:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.249142:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.249146:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f0dea00/0x844e5faceb5f7c22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18153 expref: 17 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.249155:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f0dea00/0x844e5faceb5f7c22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18153 expref: 17 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.249162:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0dea00, rc 0) 00000100:00100000:1.0:1746155642.249285:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1963:x1830976125987072:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 60us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.249292:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17002 00000100:00100000:0.0:1746155642.251412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.251449:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.251952:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125987200 00000100:00100000:2.0:1746155642.251958:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125987200 00000100:00100000:0.0:1746155642.251968:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.252001:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.252088:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125987328 00000100:00100000:1.0:1746155642.252088:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125987456 00000100:00100000:2.0:1746155642.252090:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125987328 00000100:00100000:1.0:1746155642.252091:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125987456 00000100:00100000:2.0:1746155642.252101:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125987584 00000100:00100000:2.0:1746155642.252103:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125987584 00000100:00100000:1.0:1746155642.252109:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17003 00000100:00100000:1.0:1746155642.252115:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1963:x1830976125987200:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00100000:0.0:1746155642.252117:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17004 00000100:00100000:2.0:1746155642.252122:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17005 00000100:00100000:0.0:1746155642.252125:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1963:x1830976125987328:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00100000:2.0:1746155642.252126:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1963:x1830976125987456:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155642.252127:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.252131:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.252133:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.252141:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3e85c00/0x844e5faceb5f7c29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18168 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.252141:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a626ec00/0x844e5faceb5f7c30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18161 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.252147:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d592000/0x844e5faceb5f7c37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1815a expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.252156:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.252159:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.252159:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.252161:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.252165:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d592000/0x844e5faceb5f7c37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1815a expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.252165:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a626ec00/0x844e5faceb5f7c30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18161 expref: 19 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.252175:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d592000/0x844e5faceb5f7c37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1815a expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.252175:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a626ec00/0x844e5faceb5f7c30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18161 expref: 19 pid: 4461 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155642.252176:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125371520:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155642.252183:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d592000, rc 0) 00010000:00010000:0.0:1746155642.252183:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a626ec00, rc 0) 00000100:00100000:1.0:1746155642.252211:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1963:x1830976125987200:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 96us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.252213:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1963:x1830976125987328:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 90us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.252216:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17003 00000100:00100000:0.0:1746155642.252219:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17004 00000100:00100000:2.0:1746155642.252220:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.252229:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17006 00000100:00100000:1.0:1746155642.252233:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:32351:x1830976125987584:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155642.252239:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155642.252244:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d592200/0x844e5faceb5f7c3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1816f expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.252255:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155642.252258:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d592200/0x844e5faceb5f7c3e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1816f expref: 35 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.252266:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d592200/0x844e5faceb5f7c3e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1816f expref: 35 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.252272:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d592200, rc 0) 00000100:00100000:1.0:1746155642.252286:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:32351:x1830976125987584:12345-192.168.202.51@tcp:101:cat.0 Request processed in 53us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.252291:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17006 00000100:00100000:0.0:1746155642.253875:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.253957:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125987712 00000100:00100000:1.0:1746155642.253962:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125987712 00010000:00010000:1.0:1746155642.253985:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 35 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.254005:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8724 00000100:00100000:1.0:1746155642.254011:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1963:x1830976125987712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.254019:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.254036:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 35 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.254046:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 35 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.254062:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.254064:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.254068:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f0dfc00/0x844e5faceb5f7c0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1813e expref: 28 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.254075:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f0dfc00/0x844e5faceb5f7c0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1813e expref: 28 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.254081:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.254082:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.254085:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d592200/0x844e5faceb5f7c3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1816f expref: 35 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.254092:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d592200/0x844e5faceb5f7c3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1816f expref: 35 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.254114:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d592200/0x844e5faceb5f7c3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1816f expref: 35 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.254124:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125371648:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155642.254178:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f0dfc00/0x844e5faceb5f7c0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1813e expref: 28 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.254186:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125371776:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155642.254204:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a900 going to sleep for 11 seconds 00002000:00010000:2.0:1746155642.254652:0:18270:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime: 1746155641 -> 1746155642 00002000:00010000:2.0:1746155642.254656:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime: 1746155641 -> 1746155642 00000100:00100000:2.0:1746155642.254667:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125371392:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155642.254685:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a3e84600/0x844e5faceb5f7c14 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18145 expref: 17 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.254695:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e84600/0x844e5faceb5f7c14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18145 expref: 17 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.254717:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e84600, rc 0) 00010000:00010000:3.0:1746155642.254725:0:8437:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.51@tcp) returned -22 from glimpse AST (req@ffff88009c211880 x1830976125371520) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 35 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.254737:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1962:x1830976125986816:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 6097us (7078us total) trans 0 rc 301/301 00010000:00010000:3.0:1746155642.254741:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7b50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->3194879) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180ea expref: 35 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.254743:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17000 00000100:00100000:3.0:1746155642.254755:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125371520:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155642.254770:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3e85c00/0x844e5faceb5f7c29 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18168 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.254779:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e85c00/0x844e5faceb5f7c29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18168 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.254785:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e85c00, rc 0) 00000100:00100000:3.0:1746155642.254804:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1963:x1830976125987456:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 2677us (2836us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155642.254810:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17005 00000100:00100000:0.0:1746155642.255049:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.255084:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125987840 00000100:00100000:3.0:1746155642.255087:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125987840 00000100:00100000:2.0:1746155642.255105:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17007 00000100:00100000:2.0:1746155642.255111:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:32344:x1830976125987840:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155642.255121:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.255129:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18176 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.255143:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a887600/0x844e5faceb5f7a8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18050 expref: 34 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.255155:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84000/0x844e5faceb5f7c1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1814c expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.255160:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a887800/0x844e5faceb5f7aa8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1805e expref: 30 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.255165:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.255167:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.255169:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [1048576->1384447] (req 1048576->1384447) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 30 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.255184:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a887800/0x844e5faceb5f7aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1805e expref: 30 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.255194:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a887800/0x844e5faceb5f7aa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1805e expref: 30 pid: 10591 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.255202:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125371904:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.255695:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84000/0x844e5faceb5f7c1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1814c expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.255704:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84000/0x844e5faceb5f7c1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1814c expref: 16 pid: 8437 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.255712:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125372032:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.255735:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a887600/0x844e5faceb5f7a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18050 expref: 34 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.255742:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a887600/0x844e5faceb5f7a8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18050 expref: 34 pid: 10591 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.255749:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125372160:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.255763:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca299c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.257594:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125371776:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155642.257602:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.257635:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125371648:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155642.257652:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.257655:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125988096 00000100:00100000:3.0:1746155642.257660:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125988096 00000100:00100000:1.0:1746155642.257677:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1963:x1830976125987712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3666us (3807us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.257685:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8724 00000100:00100000:3.0:1746155642.257690:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11126 00000100:00100000:3.0:1746155642.257696:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32352:x1830976125988096:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155642.257708:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.257719:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459e00/0x844e5faceb5f7c4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1817d expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.257788:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7c53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.257800:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18130 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.257806:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7c53 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.257825:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18130 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.257833:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18130 expref: 8 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.257842:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125372288:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155642.257903:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.258819:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125371904:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.258826:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125372032:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.258832:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125372160:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.258848:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [1048576->1384447] (req 1048576->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 30 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.258858:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e84a00, rc 0) 00000100:00100000:2.0:1746155642.258889:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:32344:x1830976125987840:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3777us (3839us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.258895:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17007 00000100:00100000:3.0:1746155642.259108:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125372288:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155642.259118:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7c53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155642.259601:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.259631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.259689:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125988352 00000100:00100000:1.0:1746155642.259693:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125988352 00002000:00100000:1.0:1746155642.259718:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f582a00 x1830976125988352/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.259725:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f582a00 with x1830976125988352 ext(2097152->3145727) 00002000:00010000:1.0:1746155642.259729:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f582a00 00000100:00100000:1.0:1746155642.260329:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125988608 00000100:00100000:1.0:1746155642.260332:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125988608 00002000:00100000:1.0:1746155642.260347:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f583100 x1830976125988608/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.260354:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f583100 with x1830976125988608 ext(3145728->4194303) 00002000:00010000:1.0:1746155642.260357:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f583100 00000100:00100000:1.0:1746155642.260409:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8079 00000100:00100000:1.0:1746155642.260421:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1963:x1830976125988352:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155642.260430:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8080 00000100:00100000:2.0:1746155642.260437:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1963:x1830976125988608:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155642.260646:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.260666:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125988736 00000100:00100000:1.0:1746155642.260669:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125988736 00010000:00010000:1.0:1746155642.260683:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84000/0x844e5faceb5f7c1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1814c expref: 17 pid: 8437 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746155642.260755:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8725 00000100:00100000:1.0:1746155642.260760:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1962:x1830976125988736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.260768:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.260779:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84000/0x844e5faceb5f7c1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1814c expref: 17 pid: 8437 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746155642.260788:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84000/0x844e5faceb5f7c1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1814c expref: 17 pid: 8437 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746155642.260803:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84000/0x844e5faceb5f7c1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1814c expref: 17 pid: 8437 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746155642.260819:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155642.260840:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1962:x1830976125988736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.260845:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8725 00000100:00100000:0.0:1746155642.261627:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.261645:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125988864 00000100:00100000:0.0:1746155642.261648:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125988864 00010000:00010000:0.0:1746155642.261663:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18130 expref: 9 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.261686:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8726 00000100:00100000:0.0:1746155642.261691:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976125988864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155642.261698:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155642.261702:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18130 expref: 9 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.261714:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18130 expref: 9 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.261727:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a36000/0x844e5faceb5f7bff lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18130 expref: 9 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.261740:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155642.261744:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7c53 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.261751:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7c53 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.261757:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7c53 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.261772:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155642.261789:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976125988864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 98us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.261795:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8726 00010000:00010000:3.0:1746155642.262446:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7c53 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.262453:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7c53 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155642.262470:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155642.262590:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459e00/0x844e5faceb5f7c4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1817d expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.262607:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7c53 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1817d expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.262613:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.262615:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155642.262617:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f459400, rc 0) 00000100:00100000:3.0:1746155642.262637:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32352:x1830976125988096:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 4941us (5035us total) trans 8589945286 rc 0/0 00000100:00100000:3.0:1746155642.262644:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11126 00000100:00100000:0.0:1746155642.264537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.264758:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.264788:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.265125:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125988992 00000100:00100000:0.0:1746155642.265133:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125988992 00010000:00010000:0.0:1746155642.265157:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a887600/0x844e5faceb5f7a8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18050 expref: 38 pid: 10591 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.265193:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125989120 00000100:00100000:0.0:1746155642.265195:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125989120 00010000:00010000:0.0:1746155642.265203:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a887800/0x844e5faceb5f7aa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1805e expref: 30 pid: 10591 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.265218:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8727 00000100:00100000:0.0:1746155642.265224:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+38:1963:x1830976125988992:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155642.265234:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155642.265251:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a887600/0x844e5faceb5f7a8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18050 expref: 38 pid: 10591 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.265261:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a887600/0x844e5faceb5f7a8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18050 expref: 38 pid: 10591 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.265280:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a887600/0x844e5faceb5f7a8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18050 expref: 38 pid: 10591 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.265292:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155642.265313:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+37:1963:x1830976125988992:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 89us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.265319:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8727 00000100:00100000:0.0:1746155642.265331:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8728 00000100:00100000:0.0:1746155642.265335:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125989120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155642.265341:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155642.265346:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a887800/0x844e5faceb5f7aa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1805e expref: 30 pid: 10591 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.265354:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a887800/0x844e5faceb5f7aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1805e expref: 30 pid: 10591 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.265368:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a887800/0x844e5faceb5f7aa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1805e expref: 30 pid: 10591 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.265376:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.265377:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.265383:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 29 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.265391:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 29 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.265415:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 29 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.265426:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f57c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125372416:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155642.265469:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.265565:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125989504 00000100:00100000:3.0:1746155642.265569:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125989504 00002000:00100000:3.0:1746155642.265594:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009c211c00 x1830976125989504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.265602:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211c00 with x1830976125989504 ext(3145728->4194303) 00002000:00010000:3.0:1746155642.265606:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c211c00 00000100:00100000:3.0:1746155642.265631:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8081 00000100:00100000:3.0:1746155642.265636:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1960:x1830976125989504:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155642.266257:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.266277:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125989760 00000100:00100000:2.0:1746155642.266281:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125989760 00002000:00100000:2.0:1746155642.266297:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009c211500 x1830976125989760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.266303:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211500 with x1830976125989760 ext(3145728->4194303) 00002000:00010000:2.0:1746155642.266307:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c211500 00000100:00100000:2.0:1746155642.266322:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8082 00000100:00100000:2.0:1746155642.266327:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976125989760:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155642.267266:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.267442:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125989632 00000100:00100000:3.0:1746155642.267446:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125989632 00002000:00100000:3.0:1746155642.267465:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009c212a00 x1830976125989632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.267472:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212a00 with x1830976125989632 ext(2097152->3145727) 00002000:00010000:3.0:1746155642.267475:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c212a00 00000100:00100000:3.0:1746155642.267494:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8083 00000100:00100000:3.0:1746155642.267499:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976125989632:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155642.268706:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1963:x1830976125988608:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8267us (9071us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155642.268713:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8080 00002000:00100000:2.0:1746155642.268719:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f583100 x1830976125988608/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.268726:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f583100 with x1830976125988608 ext(3145728->4194303) 00002000:00010000:2.0:1746155642.268730:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f583100 00000100:00100000:0.0:1746155642.271099:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f57c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125372416:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155642.271117:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.271201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.271212:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976125989120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5874us (6454us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.271221:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8728 00000100:00100000:3.0:1746155642.271223:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125990144 00000100:00100000:3.0:1746155642.271228:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125990144 00000100:00100000:3.0:1746155642.271256:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11127 00000100:00100000:3.0:1746155642.271262:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32352:x1830976125990144:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155642.271279:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.271282:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746155642.271302:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7c53 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1817d expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.271313:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.271317:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155642.271324:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459600/0x844e5faceb5f7c61 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18184 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.271386:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7c68 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.271396:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7c68 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.271403:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7c68 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.271411:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7c68 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.271416:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7c68 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.271421:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7c68 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.271426:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f458e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155642.271429:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7c68 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.271434:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7c68 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.271439:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.271441:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155642.271443:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7c68 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.271447:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7c68 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.271463:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459600/0x844e5faceb5f7c61 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18184 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.271474:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459600/0x844e5faceb5f7c61 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18184 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.271481:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f459600, rc 0) 00000100:00100000:3.0:1746155642.271497:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32352:x1830976125990144:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 236us (298us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155642.271524:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11127 00000100:00100000:1.0:1746155642.271920:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1963:x1830976125988352:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11490us (12310us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155642.271929:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8079 00002000:00100000:1.0:1746155642.271936:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f582a00 x1830976125988352/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.271945:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f582a00 with x1830976125988352 ext(2097152->3145727) 00002000:00010000:1.0:1746155642.271948:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f582a00 00000100:00100000:0.0:1746155642.273300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.274021:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125990400 00000100:00100000:1.0:1746155642.274029:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125990400 00002000:00100000:1.0:1746155642.274062:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1380352->1384447) req@ffff88009f57c700 x1830976125990400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.274071:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57c700 with x1830976125990400 ext(1380352->1384447) 00002000:00010000:1.0:1746155642.274076:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f57c700 00000100:00100000:1.0:1746155642.274091:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8084 00000100:00100000:1.0:1746155642.274097:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976125990400:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155642.274243:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976125990400:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 145us (945us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155642.274249:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8084 00002000:00100000:1.0:1746155642.274254:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1380352->1384447) req@ffff88009f57c700 x1830976125990400/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/4536 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.274260:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57c700 with x1830976125990400 ext(1380352->1384447) 00002000:00010000:1.0:1746155642.274263:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f57c700 00000100:00100000:0.0:1746155642.280253:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.280302:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125990656 00000100:00100000:2.0:1746155642.280310:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125990656 00000100:00100000:2.0:1746155642.280345:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4723 00000100:00100000:2.0:1746155642.280352:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32352:x1830976125990656:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:3.0:1746155642.280624:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1960:x1830976125989504:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 14986us (15833us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155642.280633:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8081 00002000:00100000:3.0:1746155642.280641:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009c211c00 x1830976125989504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.280649:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211c00 with x1830976125989504 ext(3145728->4194303) 00002000:00010000:3.0:1746155642.280653:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c211c00 00000100:00100000:2.0:1746155642.280824:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32352:x1830976125990656:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 472us (578us total) trans 8589945287 rc 0/0 00000100:00100000:2.0:1746155642.280831:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4723 00010000:00010000:3.0:1746155642.283055:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746155642.283324:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976125989760:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 16991us (17062us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155642.283336:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8082 00002000:00100000:2.0:1746155642.283345:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009c211500 x1830976125989760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.283354:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211500 with x1830976125989760 ext(3145728->4194303) 00002000:00010000:2.0:1746155642.283359:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c211500 00000100:00100000:0.0:1746155642.286103:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.286135:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.286565:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976125989632:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 19063us (19297us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155642.286574:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8083 00002000:00100000:3.0:1746155642.286583:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009c212a00 x1830976125989632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.286591:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212a00 with x1830976125989632 ext(2097152->3145727) 00002000:00010000:3.0:1746155642.286596:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c212a00 00000100:00100000:3.0:1746155642.286621:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125990784 00000100:00100000:3.0:1746155642.286627:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125990784 00000100:00100000:3.0:1746155642.286654:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125990912 00000100:00100000:3.0:1746155642.286655:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125990912 00000100:00100000:3.0:1746155642.286669:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17008 00000100:00100000:3.0:1746155642.286674:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976125990784:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155642.286684:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.286698:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f7c6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1818b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.286735:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cded500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125372544:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155642.286777:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.286792:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17009 00000100:00100000:3.0:1746155642.286798:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1963:x1830976125990912:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155642.286804:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.286812:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f0df000/0x844e5faceb5f7c76 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18192 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.286832:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125372672:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155642.286849:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.286963:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.287167:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125991168 00000100:00100000:2.0:1746155642.287171:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125991168 00000100:00100000:2.0:1746155642.287192:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4724 00000100:00100000:2.0:1746155642.287197:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32344:x1830976125991168:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155642.287344:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32344:x1830976125991168:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 146us (380us total) trans 8589945288 rc 0/0 00000100:00100000:2.0:1746155642.287350:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4724 00002000:00010000:2.0:1746155642.289224:0:29728:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime: 1746155641 -> 1746155642 00002000:00010000:2.0:1746155642.289229:0:29728:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime: 1746155641 -> 1746155642 00000100:00100000:2.0:1746155642.289242:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125372672:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155642.289243:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cded500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125372544:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155642.289262:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f7c6f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1818b expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.289263:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f0df000/0x844e5faceb5f7c76 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18192 expref: 34 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.289274:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f7c6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1818b expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.289274:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f0df000/0x844e5faceb5f7c76 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18192 expref: 34 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.289281:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0df000, rc 0) 00010000:00010000:3.0:1746155642.289285:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f459a00, rc 0) 00000100:00100000:2.0:1746155642.289304:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1963:x1830976125990912:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2506us (3169us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155642.289305:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976125990784:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2630us (3208us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155642.289311:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17008 00000100:00100000:2.0:1746155642.289314:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17009 00000100:00100000:0.0:1746155642.295178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.296159:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125991424 00000100:00100000:3.0:1746155642.296168:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125991424 00002000:00100000:3.0:1746155642.296205:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f57d880 x1830976125991424/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.296214:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57d880 with x1830976125991424 ext(4194304->5083135) 00002000:00010000:3.0:1746155642.296219:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f57d880 00000100:00100000:3.0:1746155642.296251:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8085 00000100:00100000:3.0:1746155642.296257:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1963:x1830976125991424:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155642.299424:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.299481:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.299568:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125991936 00000100:00100000:2.0:1746155642.299576:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125991936 00002000:00100000:2.0:1746155642.299608:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f57df80 x1830976125991936/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.299616:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57df80 with x1830976125991936 ext(4194304->5083135) 00002000:00010000:2.0:1746155642.299621:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f57df80 00000100:00100000:2.0:1746155642.299637:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8086 00000100:00100000:2.0:1746155642.299643:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976125991936:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155642.299671:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125991680 00000100:00100000:3.0:1746155642.299675:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125991680 00000100:00100000:3.0:1746155642.299700:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11128 00000100:00100000:3.0:1746155642.299705:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32355:x1830976125991680:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155642.299718:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.299732:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x844e5faceb5f7c7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18199 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.299808:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7c84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.299819:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7c84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.299831:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7c84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.299841:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7c8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.299846:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7c8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.299850:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7c8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.299944:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b000/0x844e5faceb5f7c92 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.299952:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b000/0x844e5faceb5f7c92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.299957:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b000/0x844e5faceb5f7c92 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:3.0:1746155642.299964:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155642.300027:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7c84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300033:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7c84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300038:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7c84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300042:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3b400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155642.300045:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7c84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300051:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7c84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300060:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155642.300062:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155642.300065:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7c84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300069:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7c84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300094:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7c8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300099:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7c8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300103:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7c8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300107:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3aa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155642.300108:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7c8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300112:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7c8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300118:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0a00) 00010000:00010000:3.0:1746155642.300119:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155642.300121:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7c8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300125:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7c8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155642.300154:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x844e5faceb5f7c7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18199 expref: 17 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.300163:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b000/0x844e5faceb5f7c92 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18199 expref: 16 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.300168:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.300170:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155642.300171:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3b000, rc 0) 00000100:00100000:3.0:1746155642.300220:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32355:x1830976125991680:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 515us (803us total) trans 8589945289 rc 0/0 00000100:00100000:3.0:1746155642.300227:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11128 00000100:00100000:3.0:1746155642.303045:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1963:x1830976125991424:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6778us (7867us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155642.303055:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8085 00002000:00100000:3.0:1746155642.303066:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f57d880 x1830976125991424/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.303075:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57d880 with x1830976125991424 ext(4194304->5083135) 00002000:00010000:3.0:1746155642.303080:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f57d880 00000100:00100000:2.0:1746155642.314606:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976125991936:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14956us (15117us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155642.314616:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8086 00002000:00100000:2.0:1746155642.314626:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f57df80 x1830976125991936/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.314636:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57df80 with x1830976125991936 ext(4194304->5083135) 00002000:00010000:2.0:1746155642.314641:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f57df80 00000100:00100000:2.0:1746155642.321862:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.321887:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125992064 00000100:00100000:2.0:1746155642.321895:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125992064 00000100:00100000:2.0:1746155642.321941:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17010 00000100:00100000:2.0:1746155642.321948:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976125992064:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155642.321961:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.321979:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c69f200/0x844e5faceb5f7ca0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181a0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.322025:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125372800:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155642.322123:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.322138:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125992192 00000100:00100000:0.0:1746155642.322142:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125992192 00000100:00100000:0.0:1746155642.322173:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17011 00000100:00100000:0.0:1746155642.322179:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1962:x1830976125992192:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155642.322192:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.322201:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9400/0x844e5faceb5f7ca7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181a7 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.322226:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f57e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125372928:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155642.322781:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca299c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.322845:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.329698:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.329786:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125992320 00000100:00100000:2.0:1746155642.329794:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125992320 00000100:00100000:2.0:1746155642.329833:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17012 00000100:00100000:2.0:1746155642.329839:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:32355:x1830976125992320:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155642.329853:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.329867:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181ae expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.329889:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f080e00/0x844e5faceb5f7abd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18073 expref: 36 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.329897:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f0dea00/0x844e5faceb5f7c22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18153 expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.329903:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090487a00/0x844e5faceb5f7ac4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1807a expref: 28 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.329907:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.329909:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.329924:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1396736->1835007] (req 1396736->1835007) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 36 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.329950:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090487a00/0x844e5faceb5f7ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1807a expref: 28 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.329959:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090487a00/0x844e5faceb5f7ac4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1807a expref: 28 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.329968:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125373056:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155642.329993:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125372800:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155642.330014:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c69f200/0x844e5faceb5f7ca0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181a0 expref: 22 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.330023:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c69f200/0x844e5faceb5f7ca0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181a0 expref: 22 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.330025:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f0dea00/0x844e5faceb5f7c22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18153 expref: 15 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.330031:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f0dea00/0x844e5faceb5f7c22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18153 expref: 15 pid: 20796 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.330037:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125373184:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155642.330040:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c69f200, rc 0) 00010000:00010000:2.0:1746155642.330054:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f080e00/0x844e5faceb5f7abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18073 expref: 36 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.330060:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976125992064:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8113us (8205us total) trans 0 rc 301/301 00010000:00010000:2.0:1746155642.330060:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f080e00/0x844e5faceb5f7abd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18073 expref: 36 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.330066:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17010 00000100:00100000:2.0:1746155642.330066:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125373312:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.330077:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.330165:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f57e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125372928:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155642.330179:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9400/0x844e5faceb5f7ca7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181a7 expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.330189:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9400/0x844e5faceb5f7ca7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181a7 expref: 36 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.330199:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d9400, rc 0) 00000100:00100000:1.0:1746155642.330214:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1962:x1830976125992192:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8037us (8091us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155642.330220:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17011 00000100:00100000:2.0:1746155642.334228:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125373056:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155642.334670:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.334832:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125992448 00000100:00100000:2.0:1746155642.334838:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125992448 00010000:00010000:2.0:1746155642.334867:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090487a00/0x844e5faceb5f7ac4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1807a expref: 29 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.334919:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8729 00000100:00100000:2.0:1746155642.334927:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976125992448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.334938:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155642.334956:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090487a00/0x844e5faceb5f7ac4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1807a expref: 29 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.334966:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090487a00/0x844e5faceb5f7ac4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1807a expref: 29 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.334984:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090487a00/0x844e5faceb5f7ac4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1807a expref: 29 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.334999:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.335042:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125992448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 115us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.335048:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8729 00000100:00100000:2.0:1746155642.341303:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125373184:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.341877:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125373312:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.341902:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1396736->1835007] (req 1396736->1835007) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 34 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.341927:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c69fa00, rc 0) 00000100:00100000:2.0:1746155642.342275:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:32355:x1830976125992320:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 12434us (12582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.342283:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17012 00000100:00100000:0.0:1746155642.343095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.343139:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125992704 00000100:00100000:2.0:1746155642.343145:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125992704 00000100:00100000:2.0:1746155642.343271:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17013 00000100:00100000:2.0:1746155642.343279:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976125992704:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155642.343291:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.343304:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c69f000/0x844e5faceb5f7cb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181b5 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.343341:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125373440:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155642.343346:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.343392:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.343480:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125992832 00000100:00100000:1.0:1746155642.343484:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125992832 00000100:00100000:1.0:1746155642.343525:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17014 00000100:00100000:1.0:1746155642.343531:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1963:x1830976125992832:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155642.343539:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155642.343547:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2800/0x844e5faceb5f7cbc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181bc expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.343581:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.343597:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125992960 00000100:00100000:1.0:1746155642.343600:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125373568:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155642.343600:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125992960 00000100:00100000:0.0:1746155642.343623:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17015 00000100:00100000:1.0:1746155642.343626:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.343628:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:1962:x1830976125992960:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155642.343634:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.343640:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9e00/0x844e5faceb5f7cc3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181c3 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.343654:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.343668:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9e00/0x844e5faceb5f7cc3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181c3 expref: 37 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.343676:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9e00/0x844e5faceb5f7cc3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181c3 expref: 37 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.343686:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d9e00, rc 0) 00000100:00100000:1.0:1746155642.343815:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:1962:x1830976125992960:12345-192.168.202.51@tcp:101:cat.0 Request processed in 185us (233us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155642.343821:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17015 00000100:00100000:0.0:1746155642.344162:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.344233:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125992576 00000100:00100000:2.0:1746155642.344236:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125992576 00010000:00010000:2.0:1746155642.344250:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f0dea00/0x844e5faceb5f7c22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18153 expref: 16 pid: 20796 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.344279:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8730 00000100:00100000:2.0:1746155642.344287:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125992576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.344295:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155642.344312:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f0dea00/0x844e5faceb5f7c22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18153 expref: 16 pid: 20796 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746155642.344321:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f0dea00/0x844e5faceb5f7c22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18153 expref: 16 pid: 20796 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746155642.344335:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f0dea00/0x844e5faceb5f7c22 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18153 expref: 16 pid: 20796 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746155642.344352:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.344379:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125992576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 91us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.344385:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8730 00000100:00100000:3.0:1746155642.349841:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.349979:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125993088 00000100:00100000:2.0:1746155642.349986:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125993088 00010000:00010000:2.0:1746155642.350012:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f080e00/0x844e5faceb5f7abd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18073 expref: 36 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.350029:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125373440:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155642.350054:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c69f000/0x844e5faceb5f7cb5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181b5 expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.350065:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c69f000/0x844e5faceb5f7cb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181b5 expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.350681:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c69f000, rc 0) 00000100:00100000:0.0:1746155642.350721:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976125992704:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7442us (7626us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155642.350727:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17013 00000100:00100000:2.0:1746155642.350768:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8731 00000100:00100000:2.0:1746155642.350777:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+36:1961:x1830976125993088:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.350793:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155642.350807:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f080e00/0x844e5faceb5f7abd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18073 expref: 36 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.350818:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f080e00/0x844e5faceb5f7abd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18073 expref: 36 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.350833:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f080e00/0x844e5faceb5f7abd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18073 expref: 36 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.350846:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.350848:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.350854:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 35 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.350859:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125373568:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155642.350866:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 35 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.350878:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2800/0x844e5faceb5f7cbc lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181bc expref: 35 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.350885:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2800/0x844e5faceb5f7cbc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181bc expref: 35 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.350891:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 35 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.350894:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06d2800, rc 0) 00000100:00100000:2.0:1746155642.350900:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125373696:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155642.350921:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1963:x1830976125992832:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7380us (7563us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155642.350926:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17014 00000100:00100000:2.0:1746155642.350953:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.351889:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125373696:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155642.351899:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.352575:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1961:x1830976125993088:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1799us (2740us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.352583:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8731 00000100:00100000:1.0:1746155642.353470:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.353689:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125993344 00000100:00100000:3.0:1746155642.353695:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125993344 00002000:00100000:3.0:1746155642.353961:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1396736->1400831) req@ffff88009f0d9180 x1830976125993344/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.353971:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d9180 with x1830976125993344 ext(1396736->1400831) 00002000:00010000:3.0:1746155642.353976:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0d9180 00000100:00100000:3.0:1746155642.354003:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8087 00000100:00100000:3.0:1746155642.354010:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1961:x1830976125993344:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155642.354196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.354289:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125993600 00000100:00100000:2.0:1746155642.354293:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125993600 00000100:00100000:2.0:1746155642.354325:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4725 00000100:00100000:2.0:1746155642.354330:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32351:x1830976125993600:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155642.354712:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1961:x1830976125993344:12345-192.168.202.51@tcp:3:cat.0 Request processed in 701us (1242us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155642.354717:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8087 00002000:00100000:3.0:1746155642.354727:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1396736->1400831) req@ffff88009f0d9180 x1830976125993344/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/4536 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.354734:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d9180 with x1830976125993344 ext(1396736->1400831) 00002000:00010000:3.0:1746155642.354737:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0d9180 00000100:00100000:2.0:1746155642.354882:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32351:x1830976125993600:12345-192.168.202.51@tcp:35:cat.0 Request processed in 551us (686us total) trans 8589945290 rc 0/0 00000100:00100000:2.0:1746155642.354889:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4725 00000100:00100000:0.0:1746155642.363227:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.363292:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125993856 00000100:00100000:3.0:1746155642.363300:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125993856 00002000:00100000:3.0:1746155642.363337:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1830912->1835007) req@ffff88009f57fb80 x1830976125993856/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.363352:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57fb80 with x1830976125993856 ext(1830912->1835007) 00002000:00010000:3.0:1746155642.363357:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f57fb80 00000100:00100000:3.0:1746155642.363391:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8088 00000100:00100000:3.0:1746155642.363399:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1960:x1830976125993856:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155642.363810:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1960:x1830976125993856:12345-192.168.202.51@tcp:3:cat.0 Request processed in 409us (588us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155642.363820:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8088 00002000:00100000:3.0:1746155642.363826:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1830912->1835007) req@ffff88009f57fb80 x1830976125993856/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/4536 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.363833:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57fb80 with x1830976125993856 ext(1830912->1835007) 00002000:00010000:3.0:1746155642.363836:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f57fb80 00000100:00100000:0.0:1746155642.365807:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.365877:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125994112 00000100:00100000:2.0:1746155642.365884:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125994112 00000100:00100000:2.0:1746155642.365931:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4726 00000100:00100000:2.0:1746155642.365938:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094619c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32355:x1830976125994112:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155642.366119:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094619c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32355:x1830976125994112:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 179us (314us total) trans 8589945291 rc 0/0 00000100:00100000:2.0:1746155642.366125:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4726 00000100:00100000:0.0:1746155642.398625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.398724:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125994240 00000100:00100000:3.0:1746155642.398731:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125994240 00000100:00100000:3.0:1746155642.398774:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11129 00000100:00100000:3.0:1746155642.398782:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32361:x1830976125994240:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155642.398801:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.398814:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7cca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181ca expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.398860:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7cd1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.398870:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.398879:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.398890:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x844e5faceb5f7cd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.398895:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x844e5faceb5f7cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.398900:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x844e5faceb5f7cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.398989:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7cdf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.398996:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7cdf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399001:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7cdf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155642.399023:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155642.399027:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155642.399037:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7cdf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399044:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7cdf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399050:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399055:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7cd1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399060:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7cd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399068:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3b400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155642.399071:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7cd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399077:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7cd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399084:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155642.399087:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155642.399090:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7cd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399094:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b400/0x844e5faceb5f7cd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399118:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x844e5faceb5f7cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399122:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x844e5faceb5f7cd8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399126:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x844e5faceb5f7cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399130:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd3b200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155642.399132:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x844e5faceb5f7cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399137:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x844e5faceb5f7cd8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399142:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0f00) 00010000:00010000:3.0:1746155642.399144:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155642.399147:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x844e5faceb5f7cd8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399151:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b200/0x844e5faceb5f7cd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.399172:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3aa00/0x844e5faceb5f7cca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ca expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.399182:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7cdf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ca expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.399187:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.399188:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155642.399190:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd3ac00, rc 0) 00000100:00100000:3.0:1746155642.399227:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32361:x1830976125994240:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 447us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.399232:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11129 00000100:00100000:0.0:1746155642.402175:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.402203:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.402231:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.402253:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.402316:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125994368 00000100:00100000:2.0:1746155642.402324:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125994368 00000100:00100000:1.0:1746155642.402339:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125994624 00000100:00100000:1.0:1746155642.402342:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125994624 00000100:00100000:2.0:1746155642.402353:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125994496 00000100:00100000:2.0:1746155642.402355:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125994496 00000100:00100000:1.0:1746155642.402358:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125994752 00000100:00100000:1.0:1746155642.402359:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125994752 00000100:00100000:1.0:1746155642.402372:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17016 00000100:00100000:1.0:1746155642.402378:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125994368:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155642.402390:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155642.402395:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17017 00000100:00100000:2.0:1746155642.402402:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125994624:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155642.402403:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3200/0x844e5faceb5f7ce6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181d1 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.402409:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.402417:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c69e800/0x844e5faceb5f7ced lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181df expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.402443:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125373824:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155642.402451:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125373952:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155642.402497:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.402524:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17018 00000100:00100000:1.0:1746155642.402529:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1960:x1830976125994496:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155642.402534:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155642.402540:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7cf4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181d8 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.402557:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125374080:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155642.402618:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17019 00000100:00100000:0.0:1746155642.402623:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1960:x1830976125994752:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155642.402628:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.402634:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8e00/0x844e5faceb5f7cfb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181e6 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.402643:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.402645:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.402650:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8e00/0x844e5faceb5f7cfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181e6 expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.402661:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8e00/0x844e5faceb5f7cfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181e6 expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.402669:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d8e00, rc 0) 00000100:00100000:2.0:1746155642.402759:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.402759:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.402850:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1960:x1830976125994752:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 225us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.402855:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17019 00002000:00010000:2.0:1746155642.407996:0:8436:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime: 1746155641 -> 1746155642 00002000:00010000:2.0:1746155642.408002:0:8436:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime: 1746155641 -> 1746155642 00000100:00100000:0.0:1746155642.408010:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125374080:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155642.408013:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125373952:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155642.408034:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c69e800/0x844e5faceb5f7ced lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181df expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.408036:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7cf4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181d8 expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.408047:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c69e800/0x844e5faceb5f7ced lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181df expref: 19 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.408047:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7cf4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181d8 expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.408059:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06d3a00, rc 0) 00010000:00010000:2.0:1746155642.408073:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c69e800, rc 0) 00000100:00100000:0.0:1746155642.408090:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125994496:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5560us (5858us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155642.408093:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125994624:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5691us (5889us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155642.408098:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17018 00000100:00100000:1.0:1746155642.408168:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125373824:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155642.408183:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3200/0x844e5faceb5f7ce6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181d1 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.408192:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3200/0x844e5faceb5f7ce6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181d1 expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.408202:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06d3200, rc 0) 00000100:00100000:1.0:1746155642.408216:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a15b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125994368:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5838us (6046us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155642.408582:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17017 00000100:00100000:1.0:1746155642.408588:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17016 00000100:00100000:0.0:1746155642.409978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.410060:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125995008 00000100:00100000:3.0:1746155642.410066:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125995008 00000100:00100000:3.0:1746155642.410103:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11130 00000100:00100000:3.0:1746155642.410110:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32361:x1830976125995008:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155642.410123:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.410137:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181ed expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.410208:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.410219:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b000/0x844e5faceb5f7c92 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18199 expref: 17 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.410226:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7cdf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ca expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.410232:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.410254:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7cdf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ca expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.410263:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7cdf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ca expref: 10 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.410273:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fff6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125374208:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155642.410345:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b000/0x844e5faceb5f7c92 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18199 expref: 17 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.410352:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b000/0x844e5faceb5f7c92 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18199 expref: 17 pid: 19870 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.410359:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cded500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125374336:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155642.410380:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.412251:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.412449:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fff6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125374208:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155642.412457:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cded500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125374336:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155642.412472:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155642.412683:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.412846:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125995264 00000100:00100000:2.0:1746155642.412851:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125995264 00010000:00010000:2.0:1746155642.412874:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b000/0x844e5faceb5f7c92 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18199 expref: 18 pid: 19870 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.412891:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125995136 00000100:00100000:2.0:1746155642.412893:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125995136 00010000:00010000:2.0:1746155642.412900:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7cdf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ca expref: 11 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.412928:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8732 00000100:00100000:2.0:1746155642.412934:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976125995264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.412944:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155642.412948:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b000/0x844e5faceb5f7c92 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18199 expref: 18 pid: 19870 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.412956:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b000/0x844e5faceb5f7c92 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18199 expref: 18 pid: 19870 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.413003:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8733 00000100:00100000:1.0:1746155642.413010:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976125995136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.413026:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.413030:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7cdf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ca expref: 11 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.413203:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3b000/0x844e5faceb5f7c92 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18199 expref: 18 pid: 19870 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.413235:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7cdf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ca expref: 11 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.413246:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd3ac00/0x844e5faceb5f7cdf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ca expref: 11 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.413254:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155642.413258:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.413265:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.413270:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.413296:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155642.413324:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976125995136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 314us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.413330:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8733 00010000:00010000:0.0:1746155642.413455:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.413462:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155642.413475:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155642.413585:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ed expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.413595:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ed expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.413601:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155642.413603:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155642.413604:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f459400, rc 0) 00000100:00100000:0.0:1746155642.413632:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32361:x1830976125995008:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3523us (3656us total) trans 8589945292 rc 0/0 00000100:00100000:0.0:1746155642.413637:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11130 00010000:00010000:2.0:1746155642.413778:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155642.413781:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.413806:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976125995264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 872us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.413811:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8732 00000100:00100000:0.0:1746155642.415737:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.415820:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125995392 00000100:00100000:2.0:1746155642.415826:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125995392 00000100:00100000:2.0:1746155642.415863:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11131 00000100:00100000:2.0:1746155642.415870:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32361:x1830976125995392:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155642.415887:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.415900:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e200/0x844e5faceb5f7d17 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181f4 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.415972:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e000/0x844e5faceb5f7d1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.415983:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ed expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.415989:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e000/0x844e5faceb5f7d1e lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.416010:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ed expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.416019:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ed expref: 11 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.416030:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125374464:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.416208:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.417300:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.417320:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125374464:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155642.417365:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125995520 00000100:00100000:3.0:1746155642.417369:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125995520 00010000:00010000:3.0:1746155642.417384:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ed expref: 12 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.417421:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8734 00000100:00100000:3.0:1746155642.417426:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976125995520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.417434:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.417439:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ed expref: 12 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.417448:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ed expref: 12 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.417462:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459400/0x844e5faceb5f7d09 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ed expref: 12 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.417486:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.417491:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e000/0x844e5faceb5f7d1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.417498:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e000/0x844e5faceb5f7d1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.417525:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e000/0x844e5faceb5f7d1e lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.417535:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.417566:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976125995520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 139us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.417572:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8734 00010000:00010000:2.0:1746155642.417620:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e000/0x844e5faceb5f7d1e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.417627:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e000/0x844e5faceb5f7d1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.417633:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e000/0x844e5faceb5f7d1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155642.417658:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155642.417662:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155642.417679:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e000/0x844e5faceb5f7d1e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.417698:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e200/0x844e5faceb5f7d17 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181f4 expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.417709:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e000/0x844e5faceb5f7d1e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181f4 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.417714:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155642.417716:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155642.417718:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c69e000, rc 0) 00000100:00100000:2.0:1746155642.417738:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32361:x1830976125995392:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1869us (2005us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.417743:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11131 00000100:00100000:0.0:1746155642.420335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.420357:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.420379:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.420421:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125995648 00000100:00100000:3.0:1746155642.420427:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125995648 00000100:00100000:3.0:1746155642.420452:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125995904 00000100:00100000:3.0:1746155642.420453:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125995904 00000100:00100000:1.0:1746155642.420461:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125995776 00000100:00100000:1.0:1746155642.420464:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125995776 00000100:00100000:3.0:1746155642.420465:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17020 00000100:00100000:3.0:1746155642.420470:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125995648:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:1.0:1746155642.420480:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17021 00010000:00010000:3.0:1746155642.420482:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155642.420483:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976125995904:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155642.420489:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.420495:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f459800/0x844e5faceb5f7d25 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f181fb expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.420496:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2c00/0x844e5faceb5f7d2c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18209 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.420546:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125374592:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155642.420546:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125374720:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155642.420590:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.420604:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17022 00000100:00100000:2.0:1746155642.420611:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1961:x1830976125995776:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155642.420617:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.420624:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c69e600/0x844e5faceb5f7d33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18202 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.420645:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125374848:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155642.420990:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.421060:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.421569:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125374720:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155642.421590:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2c00/0x844e5faceb5f7d2c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18209 expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.421599:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2c00/0x844e5faceb5f7d2c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18209 expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.421621:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06d2c00, rc 0) 00000100:00100000:1.0:1746155642.421642:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1961:x1830976125995904:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1157us (1283us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155642.421648:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17021 00000100:00100000:2.0:1746155642.422309:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125374848:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155642.422322:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c69e600/0x844e5faceb5f7d33 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18202 expref: 17 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.422331:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c69e600/0x844e5faceb5f7d33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18202 expref: 17 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.422338:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c69e600, rc 0) 00000100:00100000:2.0:1746155642.422365:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125995776:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1754us (1984us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155642.422371:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17022 00000100:00100000:3.0:1746155642.422443:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125374592:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155642.422456:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f459800/0x844e5faceb5f7d25 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181fb expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.422464:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f459800/0x844e5faceb5f7d25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181fb expref: 17 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.422471:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f459800, rc 0) 00000100:00100000:3.0:1746155642.422489:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976125995648:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2019us (2159us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155642.422494:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17020 00000100:00100000:0.0:1746155642.424233:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.424280:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125996160 00000100:00100000:2.0:1746155642.424286:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125996160 00000100:00100000:2.0:1746155642.424314:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11132 00000100:00100000:2.0:1746155642.424321:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32361:x1830976125996160:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155642.424331:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.424343:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e800/0x844e5faceb5f7d3a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18210 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.424407:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e400/0x844e5faceb5f7d41 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.424417:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e400/0x844e5faceb5f7d41 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.424424:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e400/0x844e5faceb5f7d41 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155642.424436:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155642.424535:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e800/0x844e5faceb5f7d3a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18210 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.424549:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e400/0x844e5faceb5f7d41 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18210 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.424555:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155642.424557:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155642.424559:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c69e400, rc 0) 00000100:00100000:2.0:1746155642.424583:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32361:x1830976125996160:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 263us (354us total) trans 8589945293 rc 0/0 00000100:00100000:2.0:1746155642.424588:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11132 00000100:00100000:0.0:1746155642.426096:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.426128:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.426168:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.426210:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125996288 00000100:00100000:3.0:1746155642.426215:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125996288 00000100:00100000:1.0:1746155642.426229:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125996544 00000100:00100000:3.0:1746155642.426232:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125996800 00000100:00100000:3.0:1746155642.426233:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125996800 00000100:00100000:1.0:1746155642.426233:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125996544 00000100:00100000:3.0:1746155642.426242:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17023 00000100:00100000:3.0:1746155642.426246:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125996288:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:1.0:1746155642.426253:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17024 00000100:00100000:1.0:1746155642.426259:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125996800:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155642.426267:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.426274:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.426278:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 43 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.426282:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155642.426283:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155642.426285:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.426285:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f64c00/0x844e5faceb5f7bdc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18122 expref: 43 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.426292:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a626ec00/0x844e5faceb5f7c30 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18161 expref: 17 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.426299:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdad400/0x844e5faceb5f7be3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18129 expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.426303:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 43 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.426305:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.426306:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.426308:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.426310:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 43 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.426318:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125374976:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155642.426323:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fdad400/0x844e5faceb5f7be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18129 expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.426332:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fdad400/0x844e5faceb5f7be3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18129 expref: 20 pid: 9235 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.426340:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125375104:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155642.426370:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.426385:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17025 00010000:00010000:1.0:1746155642.426388:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a626ec00/0x844e5faceb5f7c30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18161 expref: 17 pid: 4461 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155642.426391:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125996544:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155642.426396:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a626ec00/0x844e5faceb5f7c30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18161 expref: 17 pid: 4461 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746155642.426404:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125375232:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155642.426407:0:19959:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.426416:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.426425:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155642.426426:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155642.426427:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f64c00/0x844e5faceb5f7bdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18122 expref: 43 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.426428:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.426439:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f64c00/0x844e5faceb5f7bdc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18122 expref: 43 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.426444:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.426446:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125375360:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155642.426452:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 32 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.426460:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125375488:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.426460:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.426481:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.426958:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.426984:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.427012:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.427136:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125996416 00000100:00100000:3.0:1746155642.427140:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125996416 00000100:00100000:2.0:1746155642.427146:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125996672 00000100:00100000:2.0:1746155642.427150:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125996672 00000100:00100000:3.0:1746155642.427161:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125996928 00000100:00100000:3.0:1746155642.427163:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125996928 00000100:00100000:1.0:1746155642.427179:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17026 00000100:00100000:3.0:1746155642.427184:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17027 00000100:00100000:1.0:1746155642.427186:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1960:x1830976125996416:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:3.0:1746155642.427190:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1960:x1830976125996672:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:2.0:1746155642.427192:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17028 00000100:00100000:2.0:1746155642.427198:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1960:x1830976125996928:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155642.427204:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.427206:0:9235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.427214:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f081c00/0x844e5faceb5f7ad9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1808f expref: 43 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.427214:0:29728:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.427216:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 27 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.427221:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d592000/0x844e5faceb5f7c37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1815a expref: 18 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.427222:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155642.427223:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155642.427224:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f0dfc00/0x844e5faceb5f7c0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1813e expref: 27 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.427225:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.427228:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008fdac800/0x844e5faceb5f7b1f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180d5 expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.427230:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8e00/0x844e5faceb5f7cfb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181e6 expref: 18 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.427231:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.427232:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.427233:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.427240:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d592200/0x844e5faceb5f7c3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1816f expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.427240:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 27 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.427245:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008fdac800/0x844e5faceb5f7b1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180d5 expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.427246:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.427247:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.427248:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 27 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.427249:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.427250:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008fdac800/0x844e5faceb5f7b1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180d5 expref: 20 pid: 18270 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746155642.427256:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125375744:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.427256:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125375616:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.427263:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d592200/0x844e5faceb5f7c3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1816f expref: 32 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.427271:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d592200/0x844e5faceb5f7c3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1816f expref: 32 pid: 20796 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.427277:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a600 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.427278:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125375872:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155642.427280:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d592000/0x844e5faceb5f7c37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1815a expref: 18 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.427285:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d592000/0x844e5faceb5f7c37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1815a expref: 18 pid: 20796 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746155642.427288:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125376000:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155642.427300:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f081c00/0x844e5faceb5f7ad9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1808f expref: 43 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.427306:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8e00/0x844e5faceb5f7cfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181e6 expref: 18 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.427307:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f081c00/0x844e5faceb5f7ad9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1808f expref: 43 pid: 20796 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.427311:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125376128:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.427313:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8e00/0x844e5faceb5f7cfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181e6 expref: 18 pid: 9235 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746155642.427319:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c600 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.427320:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125376256:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.427341:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f0dfc00/0x844e5faceb5f7c0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1813e expref: 27 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.427352:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f0dfc00/0x844e5faceb5f7c0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1813e expref: 27 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.427360:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125376384:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.427375:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.428620:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125375104:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.428627:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125375232:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.428632:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125375360:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155642.428643:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.428650:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125375488:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155642.428650:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.428662:0:19959:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.428690:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125374976:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.428697:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125997056 00010000:00010000:3.0:1746155642.428699:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.428702:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125997056 00002000:00100000:2.0:1746155642.428725:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1396736->1835007) req@ffff8800910daa00 x1830976125997056/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.428732:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910daa00 with x1830976125997056 ext(1396736->1835007) 00010000:00010000:2.0:1746155642.428738:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 33 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.428745:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 33 pid: 18270 timeout: 871 lvb_type: 0 00002000:00010000:2.0:1746155642.428750:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800910daa00 00000100:00100000:2.0:1746155642.428774:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1407 00000100:00100000:2.0:1746155642.428780:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1963:x1830976125997056:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155642.431447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.431535:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125997184 00000100:00100000:1.0:1746155642.431541:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125997184 00010000:00010000:1.0:1746155642.431565:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a626ec00/0x844e5faceb5f7c30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18161 expref: 19 pid: 4461 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746155642.431597:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8735 00000100:00100000:1.0:1746155642.431603:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1960:x1830976125997184:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.431613:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155642.431826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.431841:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125997440 00000100:00100000:0.0:1746155642.431844:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125997440 00002000:00100000:0.0:1746155642.431866:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e1:0x0] (462848->1048575) req@ffff8800910da300 x1830976125997440/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155642.431873:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910da300 with x1830976125997440 ext(462848->1048575) 00010000:00010000:0.0:1746155642.431879:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 44 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.431888:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 44 pid: 18270 timeout: 871 lvb_type: 0 00002000:00010000:0.0:1746155642.431894:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910da300 00000100:00100000:0.0:1746155642.431906:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1408 00000100:00100000:0.0:1746155642.431923:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1960:x1830976125997440:12345-192.168.202.51@tcp:4:cat.0 00010000:00010000:1.0:1746155642.432129:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a626ec00/0x844e5faceb5f7c30 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18161 expref: 19 pid: 4461 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746155642.432139:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a626ec00/0x844e5faceb5f7c30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18161 expref: 19 pid: 4461 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746155642.432155:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a626ec00/0x844e5faceb5f7c30 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18161 expref: 19 pid: 4461 timeout: 871 lvb_type: 1 00010000:00010000:1.0:1746155642.432170:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.432196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.432199:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1960:x1830976125997184:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 596us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.432205:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8735 00000100:00100000:1.0:1746155642.432218:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125997312 00000100:00100000:1.0:1746155642.432220:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125997312 00010000:00010000:1.0:1746155642.432228:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdad400/0x844e5faceb5f7be3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18129 expref: 21 pid: 9235 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.432240:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8736 00000100:00100000:1.0:1746155642.432245:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976125997312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.432251:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.432257:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fdad400/0x844e5faceb5f7be3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18129 expref: 21 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.432265:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fdad400/0x844e5faceb5f7be3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18129 expref: 21 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.432274:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fdad400/0x844e5faceb5f7be3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18129 expref: 21 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.432282:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155642.432296:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976125997312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 50us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.432301:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8736 00000100:00100000:3.0:1746155642.434163:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.434218:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125375744:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.434226:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125997568 00000100:00100000:1.0:1746155642.434230:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125997568 00010000:00010000:1.0:1746155642.434249:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f64c00/0x844e5faceb5f7bdc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18122 expref: 46 pid: 9235 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.434258:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125376000:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.434273:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8737 00000100:00100000:1.0:1746155642.434279:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1960:x1830976125997568:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.434286:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155642.434296:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125376128:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155642.434298:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f64c00/0x844e5faceb5f7bdc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18122 expref: 46 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.434306:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f64c00/0x844e5faceb5f7bdc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18122 expref: 46 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.434312:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.434320:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f64c00/0x844e5faceb5f7bdc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18122 expref: 46 pid: 9235 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.434330:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.434331:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.434335:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.434342:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.434343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.434353:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125997952 00000100:00100000:3.0:1746155642.434356:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125997952 00010000:00010000:1.0:1746155642.434361:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155642.434368:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008fdac800/0x844e5faceb5f7b1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180d5 expref: 20 pid: 18270 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746155642.434382:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1960:x1830976125997568:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 103us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.436011:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8738 00000100:00100000:3.0:1746155642.436022:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1962:x1830976125997952:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.436032:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.436046:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008fdac800/0x844e5faceb5f7b1f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180d5 expref: 20 pid: 18270 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.436055:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008fdac800/0x844e5faceb5f7b1f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180d5 expref: 20 pid: 18270 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.436068:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fdac800/0x844e5faceb5f7b1f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180d5 expref: 20 pid: 18270 timeout: 871 lvb_type: 1 00000100:00100000:1.0:1746155642.436070:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8737 00010000:00010000:3.0:1746155642.436081:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.436101:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976125997952:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 82us (1757us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155642.436102:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.436106:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8738 00010000:00010000:1.0:1746155642.436109:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.436124:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.436130:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.436137:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.436141:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06d3a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155642.436144:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.436150:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.436159:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.436165:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7d56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.436179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.436194:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125998208 00000100:00100000:3.0:1746155642.436197:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125998208 00000100:00100000:1.0:1746155642.436198:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125996800:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 9939us (10029us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.436205:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17024 00010000:00010000:3.0:1746155642.436208:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f081c00/0x844e5faceb5f7ad9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1808f expref: 45 pid: 20796 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.436221:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8739 00000100:00100000:3.0:1746155642.436226:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1963:x1830976125998208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.436871:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.436882:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f081c00/0x844e5faceb5f7ad9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1808f expref: 45 pid: 20796 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.436891:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f081c00/0x844e5faceb5f7ad9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1808f expref: 45 pid: 20796 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.436902:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f081c00/0x844e5faceb5f7ad9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1808f expref: 45 pid: 20796 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.436919:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.436935:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1963:x1830976125998208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 708us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.436940:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8739 00000100:00100000:3.0:1746155642.436988:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.436995:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1963:x1830976125997056:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8214us (8352us total) trans 21474841596 rc 0/0 00000100:00100000:2.0:1746155642.437003:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1407 00002000:00100000:2.0:1746155642.437011:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1396736->1835007) req@ffff8800910daa00 x1830976125997056/t21474841596(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/448 e 0 to 0 dl 1746155653 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.437019:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910daa00 with x1830976125997056 ext(1396736->1835007) 00010000:00010000:2.0:1746155642.437026:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 35 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.437035:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 35 pid: 18270 timeout: 871 lvb_type: 0 00002000:00010000:2.0:1746155642.437041:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800910daa00 00000100:00100000:2.0:1746155642.437050:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125997696 00000100:00100000:2.0:1746155642.437052:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125997696 00002000:00100000:2.0:1746155642.437065:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1384447) req@ffff88009045f100 x1830976125997696/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.437071:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045f100 with x1830976125997696 ext(1048576->1384447) 00010000:00010000:2.0:1746155642.437076:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 28 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.437082:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 28 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.437083:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125375616:192.168.202.51@tcp:104: 00002000:00010000:2.0:1746155642.437086:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009045f100 00000100:00100000:2.0:1746155642.437096:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1409 00000100:00100000:2.0:1746155642.437100:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976125997696:12345-192.168.202.51@tcp:4:cat.0 00010000:00010000:0.0:1746155642.437102:0:9235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.437350:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125375872:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.437365:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125376256:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.437373:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125376384:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.437386:0:29728:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.437589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.437612:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.437647:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125998080 00000100:00100000:2.0:1746155642.437650:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125998080 00010000:00010000:2.0:1746155642.437661:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8e00/0x844e5faceb5f7cfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181e6 expref: 19 pid: 9235 timeout: 871 lvb_type: 1 00000100:00100000:0.0:1746155642.437662:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125997824 00000100:00100000:0.0:1746155642.437665:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125997824 00010000:00010000:0.0:1746155642.437679:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d592000/0x844e5faceb5f7c37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1815a expref: 17 pid: 20796 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.437686:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8740 00000100:00100000:2.0:1746155642.437695:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1960:x1830976125998080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.437701:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155642.437711:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8e00/0x844e5faceb5f7cfb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181e6 expref: 19 pid: 9235 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746155642.437716:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8e00/0x844e5faceb5f7cfb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181e6 expref: 19 pid: 9235 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746155642.437725:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8e00/0x844e5faceb5f7cfb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181e6 expref: 19 pid: 9235 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746155642.437732:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.437748:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1960:x1830976125998080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.437828:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8740 00000100:00100000:2.0:1746155642.437839:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8741 00000100:00100000:0.0:1746155642.438189:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.438225:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125998336 00000100:00100000:1.0:1746155642.438229:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125998336 00010000:00010000:1.0:1746155642.438242:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f0dfc00/0x844e5faceb5f7c0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1813e expref: 30 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.438263:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8742 00000100:00100000:1.0:1746155642.438269:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976125998336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.438275:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155642.438655:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125997824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.438665:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155642.438675:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d592000/0x844e5faceb5f7c37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1815a expref: 17 pid: 20796 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746155642.438683:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d592000/0x844e5faceb5f7c37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1815a expref: 17 pid: 20796 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746155642.438695:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d592000/0x844e5faceb5f7c37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1815a expref: 17 pid: 20796 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746155642.438703:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.438704:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.438708:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.438714:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.438728:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.438749:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125997824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 904us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.438754:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8741 00010000:00010000:1.0:1746155642.438780:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f0dfc00/0x844e5faceb5f7c0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1813e expref: 30 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.438788:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f0dfc00/0x844e5faceb5f7c0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1813e expref: 30 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.438791:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155642.438798:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f0dfc00/0x844e5faceb5f7c0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1813e expref: 30 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.438805:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125998464 00010000:00010000:1.0:1746155642.438806:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.438808:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125998464 00010000:00010000:2.0:1746155642.438818:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d592200/0x844e5faceb5f7c3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1816f expref: 35 pid: 20796 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.438821:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976125998336:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 553us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.438826:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8742 00000100:00100000:1.0:1746155642.438837:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8743 00000100:00100000:1.0:1746155642.438841:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1961:x1830976125998464:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.438846:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.438857:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d592200/0x844e5faceb5f7c3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1816f expref: 35 pid: 20796 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.438864:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d592200/0x844e5faceb5f7c3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1816f expref: 35 pid: 20796 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.438872:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d592200/0x844e5faceb5f7c3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1816f expref: 35 pid: 20796 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.438877:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.438879:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.438881:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.438886:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.438888:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.438897:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.438899:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155642.438920:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.438922:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1961:x1830976125998464:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 69us (119us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155642.438927:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.438940:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.438946:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d592400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155642.438949:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.438955:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.438968:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.438974:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d592400/0x844e5faceb5f7d64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.439005:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125996672:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 11815us (12019us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.439007:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8743 00000100:00100000:3.0:1746155642.439012:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17027 00010000:00010000:2.0:1746155642.439017:0:29728:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.439024:0:29728:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.439036:0:29728:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.439042:0:29728:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.439048:0:29728:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.439052:0:29728:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c69f600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155642.439054:0:29728:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.439059:0:29728:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.439067:0:29728:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.439073:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c69f600/0x844e5faceb5f7d72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.439104:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1960:x1830976125996928:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 11906us (12091us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.439109:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17028 00000100:00100000:2.0:1746155642.440587:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.440781:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125998592 00000100:00100000:1.0:1746155642.440786:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125998592 00010000:00010000:1.0:1746155642.440802:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 34 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.440822:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8744 00000100:00100000:1.0:1746155642.440827:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1961:x1830976125998592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.440837:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.440848:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 34 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.440857:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 34 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.440870:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c69fa00/0x844e5faceb5f7cae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->1835007) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181ae expref: 34 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.440880:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.440881:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.440884:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.440890:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.440947:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155642.440970:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1961:x1830976125998592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 143us (384us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155642.440973:0:19959:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.440975:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8744 00010000:00010000:2.0:1746155642.440981:0:19959:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.440996:0:19959:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.441002:0:19959:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.441007:0:19959:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.441013:0:19959:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f458e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155642.441016:0:19959:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.441021:0:19959:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.441034:0:19959:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.441039:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f7d5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.441071:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976125996544:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 14679us (14941us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.441077:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17025 00000100:00100000:3.0:1746155642.441942:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976125997696:12345-192.168.202.51@tcp:4:cat.0 Request processed in 4840us (4952us total) trans 21474841597 rc 0/0 00000100:00100000:3.0:1746155642.441950:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1409 00002000:00100000:3.0:1746155642.441957:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1384447) req@ffff88009045f100 x1830976125997696/t21474841597(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/448 e 0 to 0 dl 1746155653 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.441965:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045f100 with x1830976125997696 ext(1048576->1384447) 00010000:00010000:3.0:1746155642.441971:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 29 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.441979:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 29 pid: 18270 timeout: 871 lvb_type: 0 00002000:00010000:3.0:1746155642.441984:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009045f100 00000100:00100000:0.0:1746155642.442092:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1960:x1830976125997440:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10180us (10265us total) trans 17179874276 rc 0/0 00000100:00100000:0.0:1746155642.442098:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1408 00002000:00100000:0.0:1746155642.442102:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e1:0x0] (462848->1048575) req@ffff8800910da300 x1830976125997440/t17179874276(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/448 e 0 to 0 dl 1746155653 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155642.442109:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910da300 with x1830976125997440 ext(462848->1048575) 00010000:00010000:0.0:1746155642.442115:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 44 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.442123:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 44 pid: 18270 timeout: 871 lvb_type: 0 00002000:00010000:0.0:1746155642.442128:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910da300 00000100:00100000:0.0:1746155642.443398:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.443547:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125998720 00000100:00100000:1.0:1746155642.443551:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125998720 00010000:00010000:1.0:1746155642.443565:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 29 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.443588:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8745 00000100:00100000:1.0:1746155642.443592:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976125998720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.443599:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.443608:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 29 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.443614:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 29 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.443625:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e84a00/0x844e5faceb5f7c45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1384447) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18176 expref: 29 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.443633:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.443634:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.443636:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.443641:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.443654:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155642.443678:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976125998720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 85us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.443681:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8745 00000100:00100000:0.0:1746155642.443695:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.443707:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125998848 00000100:00100000:1.0:1746155642.443710:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125998848 00010000:00010000:1.0:1746155642.443719:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 44 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.443738:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8746 00000100:00100000:1.0:1746155642.443744:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1962:x1830976125998848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.443750:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.443758:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 44 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.443764:0:9235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.443766:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 44 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.443773:0:9235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.443776:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f0df400/0x844e5faceb5f7c06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 462848->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18137 expref: 44 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.443783:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.443783:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.443785:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.443787:0:9235:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.443789:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.443793:0:9235:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.443799:0:9235:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.443805:0:9235:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06d2400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155642.443808:0:9235:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.443809:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155642.443815:0:9235:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.443824:0:9235:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.443827:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1962:x1830976125998848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 83us (132us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155642.443829:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06d2400/0x844e5faceb5f7d6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.443831:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8746 00000100:00100000:2.0:1746155642.443873:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976125996416:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 16684us (16912us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.443880:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17026 00010000:00010000:3.0:1746155642.444038:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.444045:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.444057:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.444063:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.444068:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.444073:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f459200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155642.444075:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.444081:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.444095:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.444100:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f459200/0x844e5faceb5f7d4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.444137:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976125996288:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 17889us (18043us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.444144:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17023 00000100:00100000:0.0:1746155642.445082:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.445125:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125999104 00000100:00100000:2.0:1746155642.445130:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125999104 00000100:00100000:2.0:1746155642.445158:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11133 00000100:00100000:2.0:1746155642.445164:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32361:x1830976125999104:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155642.445201:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155642.445215:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e000/0x844e5faceb5f7d1e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f181f4 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.445230:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155642.445233:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155642.445252:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.445262:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18049 expref: 16 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.445269:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.445274:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18065 expref: 292 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.445281:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130887e00/0x844e5faceb5f7b3b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180dc expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.445286:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5f7b6c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180f1 expref: 292 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.445291:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.445310:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5f7b6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180f1 expref: 292 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.445320:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5f7b6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180f1 expref: 292 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.445330:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125376512:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.445402:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130887e00/0x844e5faceb5f7b3b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180dc expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.445410:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130887e00/0x844e5faceb5f7b3b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180dc expref: 16 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.445459:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125376640:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.445490:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18065 expref: 292 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.445496:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18065 expref: 292 pid: 14234 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.445520:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125376768:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.445568:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.445575:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 16 pid: 27374 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.445582:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125376896:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.445604:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18049 expref: 16 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.445610:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18049 expref: 16 pid: 15474 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.445763:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125377024:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.445798:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.446860:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125376512:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.446868:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125376640:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.446875:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125376768:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155642.447141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.447168:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.447193:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.447208:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.447228:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.447249:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125999616 00000100:00100000:2.0:1746155642.447254:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125999616 00010000:00010000:2.0:1746155642.447273:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 17 pid: 27374 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.447278:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125999360 00000100:00100000:3.0:1746155642.447282:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125999360 00000100:00100000:2.0:1746155642.447291:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125999744 00000100:00100000:2.0:1746155642.447293:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125999744 00010000:00010000:3.0:1746155642.447295:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5f7b6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180f1 expref: 293 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.447302:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18049 expref: 18 pid: 15474 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.447305:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125999232 00000100:00100000:3.0:1746155642.447307:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125999232 00000100:00100000:2.0:1746155642.447310:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125999488 00000100:00100000:2.0:1746155642.447312:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125999488 00010000:00010000:3.0:1746155642.447314:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130887e00/0x844e5faceb5f7b3b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180dc expref: 19 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.447319:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18065 expref: 294 pid: 14234 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.447324:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8747 00000100:00100000:3.0:1746155642.447330:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976125999616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155642.447341:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8748 00000100:00100000:2.0:1746155642.447346:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1962:x1830976125999360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.447354:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155642.447358:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5f7b6c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180f1 expref: 294 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.447367:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5f7b6c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180f1 expref: 294 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.447371:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8749 00000100:00100000:1.0:1746155642.447377:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976125999744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.447382:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130886000/0x844e5faceb5f7b6c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180f1 expref: 294 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.447385:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.447390:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18049 expref: 19 pid: 15474 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.447394:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155642.447399:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.447405:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.447442:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1962:x1830976125999360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 96us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.447449:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8748 00000100:00100000:2.0:1746155642.447462:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8750 00000100:00100000:2.0:1746155642.447467:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976125999232:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.447473:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155642.447476:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130887e00/0x844e5faceb5f7b3b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180dc expref: 19 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.447529:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.447558:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18049 expref: 19 pid: 15474 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.447568:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130887e00/0x844e5faceb5f7b3b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180dc expref: 19 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.447582:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 19 pid: 27374 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.447607:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130887e00/0x844e5faceb5f7b3b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f180dc expref: 19 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.447608:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155642.447611:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.447616:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155642.447617:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155642.447620:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.447624:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155642.447671:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 18 pid: 27374 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.447682:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.447685:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.447689:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155642.447742:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976125999744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 365us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.447743:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976125999232:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 275us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.447749:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8750 00000100:00100000:1.0:1746155642.447755:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8749 00000100:00100000:2.0:1746155642.447759:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8751 00000100:00100000:2.0:1746155642.447764:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:1962:x1830976125999488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.447770:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155642.447774:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18065 expref: 292 pid: 14234 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.447781:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18065 expref: 292 pid: 14234 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.447790:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9a00/0x844e5faceb5f7aaf lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18065 expref: 292 pid: 14234 timeout: 871 lvb_type: 0 00010000:00010000:2.0:1746155642.447798:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155642.447801:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.447806:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.447812:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.447824:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.447838:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1962:x1830976125999488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 74us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.447844:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8751 00010000:00010000:2.0:1746155642.447871:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f7aa1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18057 expref: 16 pid: 27374 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.447879:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125376896:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.447891:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6126800/0x844e5faceb5f7a9a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18049 expref: 15 pid: 15474 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.447898:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125377024:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.447930:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.447937:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155642.447940:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976125999616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 609us (799us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155642.447941:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155642.447946:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8747 00000040:00080000:2.0:1746155642.448452:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3599, 88 off303632 00000004:00080000:2.0:1746155642.448464:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771597960478ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.448534:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3602, 88 off304160 00000004:00080000:2.0:1746155642.448543:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771598039664ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.448564:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3603, 88 off304248 00000004:00080000:2.0:1746155642.448568:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771598064634ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.448575:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3600, 88 off303720 00000004:00080000:2.0:1746155642.448577:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771598074204ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.448582:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3601, 88 off303808 00000004:00080000:2.0:1746155642.448585:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771598081663ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.448590:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3604, 88 off304336 00000004:00080000:2.0:1746155642.448592:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771598089474ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.448598:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3605, 88 off304424 00000004:00080000:2.0:1746155642.448600:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771598097227ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.448605:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3606, 88 off304512 00000004:00080000:2.0:1746155642.448608:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771598105098ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.448614:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3602, 88 off303896 00000004:00080000:2.0:1746155642.448616:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771598113134ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.448621:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3607, 88 off304600 00000004:00080000:2.0:1746155642.448624:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771598120807ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.448633:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3603, 88 off303984 00000004:00080000:2.0:1746155642.448636:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771598132719ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.448642:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3608, 88 off304688 00000004:00080000:2.0:1746155642.448644:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771598140957ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.448671:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3604, 88 off304072 00000004:00080000:2.0:1746155642.448674:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771598171417ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.448690:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3605, 88 off304160 00000004:00080000:2.0:1746155642.448693:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771598189744ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.448698:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3606, 88 off304248 00000004:00080000:2.0:1746155642.448701:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771598198018ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.448709:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3607, 88 off304336 00000004:00080000:2.0:1746155642.448711:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771598208077ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.448720:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3609, 88 off304776 00000004:00080000:2.0:1746155642.448722:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771598219236ns, next at 716011101328ns, rc = 0 00000001:00080000:0.0:1746155642.466904:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945292 is committed 00000001:00080000:0.0:1746155642.466924:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945283 is committed 00000001:00080000:0.0:1746155642.466929:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945282 is committed 00000001:00080000:0.0:1746155642.466939:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945294 is committed 00000004:00080000:0.0:1746155642.466942:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2793 committed 00000004:00080000:0.0:1746155642.466950:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2785 committed 00000004:00080000:0.0:1746155642.466963:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2784 committed 00000004:00080000:0.0:1746155642.466965:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2783 committed 00000004:00080000:0.0:1746155642.466966:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2782 committed 00000004:00080000:0.0:1746155642.466967:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2792 committed 00000004:00080000:0.0:1746155642.466969:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2781 committed 00000004:00080000:0.0:1746155642.466970:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2791 committed 00000004:00080000:0.0:1746155642.466972:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2780 committed 00000004:00080000:0.0:1746155642.466974:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2790 committed 00000004:00080000:0.0:1746155642.466975:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2789 committed 00000004:00080000:0.0:1746155642.466977:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2788 committed 00000004:00080000:0.0:1746155642.466978:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2779 committed 00000004:00080000:0.0:1746155642.466979:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2778 committed 00000004:00080000:0.0:1746155642.466980:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2787 committed 00000004:00080000:0.0:1746155642.466982:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2786 committed 00000004:00080000:0.0:1746155642.466983:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2777 committed 00000001:00080000:0.0:1746155642.466990:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945291 is committed 00000001:00080000:0.0:1746155642.466993:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945288 is committed 00000100:00100000:0.0:1746155642.467095:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125377408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.467099:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125377280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155642.467133:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125377664:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746155642.467360:0:20364:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800910db100 reply state ffff88012c7ec000 transno 8589945294 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155642.467369:0:20364:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746155642.467756:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155642.467780:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125377152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.467793:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155642.467802:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125377792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.467813:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155642.467820:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125378304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155642.467831:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155642.467840:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125378816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.467852:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155642.467877:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125377280 00000100:00100000:2.0:1746155642.467883:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125377280 00000100:00100000:0.0:1746155642.467890:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155642.467904:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125377152 00000100:00100000:0.0:1746155642.467905:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125377920:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155642.467906:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125377152 00000100:00100000:2.0:1746155642.467929:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125377792 00000100:00100000:0.0:1746155642.467930:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155642.467931:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125377792 00000100:00100000:2.0:1746155642.467941:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125378304 00000100:00100000:0.0:1746155642.467941:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125378432:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155642.467942:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125378304 00000100:00100000:2.0:1746155642.467950:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125378816 00000100:00100000:2.0:1746155642.467952:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125378816 00000100:00100000:0.0:1746155642.467952:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155642.467958:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125377408 00000100:00100000:2.0:1746155642.467959:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125377408 00000100:00100000:0.0:1746155642.467963:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125378944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.467965:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125377920 00000100:00100000:2.0:1746155642.467966:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125377920 00000100:00100000:2.0:1746155642.467971:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125378432 00000100:00100000:2.0:1746155642.467973:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125378432 00000100:00100000:0.0:1746155642.467974:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155642.467978:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125378944 00000100:00100000:2.0:1746155642.467979:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125378944 00000100:00100000:0.0:1746155642.467981:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746155642.467984:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125377536:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155642.467987:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17029 00000100:00100000:2.0:1746155642.467992:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+80:3296:x1830976125377280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.467995:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155642.468001:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125378048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.468011:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155642.468016:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125378560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.468025:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155642.468031:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125379072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.468040:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155642.468057:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125377536 00000100:00100000:0.0:1746155642.468059:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125377536 00000100:00100000:0.0:1746155642.468069:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125378048 00000100:00100000:0.0:1746155642.468070:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125378048 00000100:00100000:0.0:1746155642.468076:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125378560 00000100:00100000:0.0:1746155642.468078:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125378560 00000100:00100000:0.0:1746155642.468082:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125379072 00000100:00100000:0.0:1746155642.468084:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125379072 00000100:00100000:1.0:1746155642.468090:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155642.468090:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17030 00000100:00100000:0.0:1746155642.468094:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+93:3296:x1830976125377152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155642.468103:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125378176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155642.468117:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155642.468124:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125378688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155642.468137:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155642.468144:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+82:3296:x1830976125377280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 151us (388us total) trans 21474841598 rc 0/0 00000100:00100000:2.0:1746155642.468151:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17029 00000100:00100000:1.0:1746155642.468154:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125377664 00000100:00100000:1.0:1746155642.468156:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125377664 00000100:00100000:2.0:1746155642.468160:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125378176 00000100:00100000:2.0:1746155642.468163:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125378176 00000100:00100000:1.0:1746155642.468168:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125378688 00000100:00100000:1.0:1746155642.468170:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125378688 00000100:00100000:2.0:1746155642.468172:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17031 00000100:00100000:2.0:1746155642.468175:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+94:3296:x1830976125377792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155642.468179:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17032 00000100:00100000:1.0:1746155642.468183:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:3296:x1830976125378304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.468190:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+94:3296:x1830976125377152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (395us total) trans 17179874277 rc 0/0 00000100:00100000:0.0:1746155642.468197:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17030 00000100:00100000:0.0:1746155642.468206:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17033 00000100:00100000:0.0:1746155642.468210:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+93:3296:x1830976125378816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155642.468270:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3296:x1830976125378304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (437us total) trans 21474841599 rc 0/0 00000100:00100000:1.0:1746155642.468275:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17032 00000100:00100000:1.0:1746155642.468284:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17034 00000100:00100000:1.0:1746155642.468288:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+94:3297:x1830976125377408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155642.468300:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17035 00000100:00100000:1.0:1746155642.468303:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+84:3297:x1830976125377920:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155642.468969:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+94:3296:x1830976125377792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 792us (1154us total) trans 17179874278 rc 0/0 00000100:00100000:2.0:1746155642.468975:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17031 00000100:00100000:2.0:1746155642.468984:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17036 00000100:00100000:2.0:1746155642.468989:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+85:3297:x1830976125378432:12345-0@lo:2:osp-syn-0-0.0 00010000:00080000:3.0:1746155642.469596:0:20364:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746155642.469610:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32361:x1830976125999104:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 24443us (24525us total) trans 8589945294 rc 0/0 00000100:00100000:3.0:1746155642.469617:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11133 00000100:00100000:3.0:1746155642.469652:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17037 00000100:00100000:3.0:1746155642.469659:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+93:3297:x1830976125378944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.469810:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+86:3297:x1830976125378432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 819us (1855us total) trans 21474841601 rc 0/0 00000100:00100000:2.0:1746155642.469815:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17036 00000100:00100000:2.0:1746155642.469827:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17038 00000100:00100000:2.0:1746155642.469831:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+85:3297:x1830976125377536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155642.469939:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+86:3297:x1830976125377536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (1942us total) trans 21474841602 rc 0/0 00000100:00100000:2.0:1746155642.469944:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17038 00000100:00100000:2.0:1746155642.469958:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17039 00000100:00100000:2.0:1746155642.469962:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+94:3297:x1830976125378048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.470026:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+96:3297:x1830976125377408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1736us (2135us total) trans 17179874280 rc 0/0 00000100:00100000:0.0:1746155642.470032:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17034 00000100:00100000:2.0:1746155642.470036:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+96:3297:x1830976125378048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (2024us total) trans 17179874281 rc 0/0 00000100:00100000:2.0:1746155642.470040:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17039 00000100:00100000:0.0:1746155642.470043:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17040 00000100:00100000:0.0:1746155642.470049:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+94:3297:x1830976125378560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.470050:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17041 00000100:00100000:2.0:1746155642.470054:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+94:3297:x1830976125379072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.470122:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+96:3296:x1830976125378816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1911us (2268us total) trans 17179874282 rc 0/0 00000100:00100000:0.0:1746155642.470127:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17033 00000100:00100000:0.0:1746155642.470136:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17042 00000100:00100000:0.0:1746155642.470141:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+85:3295:x1830976125377664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155642.470176:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+85:3297:x1830976125377920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1871us (2244us total) trans 21474841600 rc 0/0 00000100:00100000:1.0:1746155642.470182:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17035 00000100:00100000:1.0:1746155642.470193:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17043 00000100:00100000:1.0:1746155642.470198:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+85:3295:x1830976125378176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.470228:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+85:3295:x1830976125377664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (2137us total) trans 21474841603 rc 0/0 00000100:00100000:0.0:1746155642.470232:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17042 00000100:00100000:0.0:1746155642.470241:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17044 00000100:00100000:0.0:1746155642.470246:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+84:3295:x1830976125378688:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155642.470271:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:1.0:1746155642.470274:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155642.470276:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746155642.470278:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155642.470279:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746155642.470299:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+86:3295:x1830976125378176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 102us (2181us total) trans 21474841604 rc 0/0 00000100:00100000:1.0:1746155642.470304:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17043 00000100:00100000:0.0:1746155642.470311:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+85:3295:x1830976125378688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (2172us total) trans 21474841605 rc 0/0 00000100:00100000:0.0:1746155642.470316:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17044 00000004:00080000:1.0:1746155642.470341:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca95880/2, rc 0, transno 21474841603 00000100:00100000:1.0:1746155642.470346:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125377664:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155642.470353:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910c9880/2, rc 0, transno 21474841604 00000100:00100000:1.0:1746155642.470355:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125378176:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155642.470361:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366ce00/2, rc 0, transno 21474841605 00000100:00100000:1.0:1746155642.470364:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125378688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.470378:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+96:3297:x1830976125378560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 330us (2351us total) trans 17179874284 rc 0/0 00000100:00100000:0.0:1746155642.470383:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17040 00000100:00100000:3.0:1746155642.470423:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+95:3297:x1830976125378944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 765us (2448us total) trans 17179874279 rc 0/0 00000100:00100000:3.0:1746155642.470428:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17037 00010000:00010000:3.0:1746155642.470451:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.470458:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155642.470460:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+94:3297:x1830976125379072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 405us (2418us total) trans 17179874283 rc 0/0 00010000:00010000:3.0:1746155642.470464:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155642.470465:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17041 00010000:00010000:3.0:1746155642.470469:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f65400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155642.470473:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.470478:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.470489:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.470492:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155642.470495:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.470499:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f65400/0x844e5faceb5f7d79 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00000004:00080000:2.0:1746155642.470517:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26f480/2, rc 0, transno 21474841598 00000100:00100000:2.0:1746155642.470520:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125377280:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155642.470530:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c213480/2, rc 0, transno 17179874277 00000100:00100000:2.0:1746155642.470537:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125377152:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155642.470543:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c213100/2, rc 0, transno 17179874278 00000100:00100000:2.0:1746155642.470545:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125377792:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155642.470552:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910caa00/2, rc 0, transno 21474841599 00000100:00100000:2.0:1746155642.470554:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125378304:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155642.470559:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c210380/2, rc 0, transno 17179874282 00000100:00100000:2.0:1746155642.470562:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125378816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.470712:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746155642.470721:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125379200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.470902:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155642.470936:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125379200 00000100:00100000:2.0:1746155642.470940:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125379200 00000100:00100000:2.0:1746155642.470957:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17045 00000100:00100000:2.0:1746155642.470961:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+94:3296:x1830976125379200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.471088:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+95:3296:x1830976125379200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 125us (185us total) trans 17179874285 rc 0/0 00000100:00100000:2.0:1746155642.471093:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17045 00000004:00080000:2.0:1746155642.471112:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01d0000/2, rc 0, transno 17179874285 00000100:00100000:2.0:1746155642.471116:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125379200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155642.471165:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26ca80/2, rc 0, transno 21474841602 00000100:00100000:0.0:1746155642.471169:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125377536:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155642.471176:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c211f80/2, rc 0, transno 17179874281 00000100:00100000:0.0:1746155642.471178:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125378048:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155642.471183:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c213800/2, rc 0, transno 17179874284 00000100:00100000:0.0:1746155642.471185:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125378560:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155642.471190:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c211180/2, rc 0, transno 17179874283 00000100:00100000:0.0:1746155642.471192:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c211180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125379072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155642.471196:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c210a80/2, rc 0, transno 17179874279 00000100:00100000:0.0:1746155642.471198:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125378944:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155642.471202:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c212300/2, rc 0, transno 17179874280 00000100:00100000:0.0:1746155642.471204:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125377408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155642.471209:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca96a00/2, rc 0, transno 21474841600 00000100:00100000:0.0:1746155642.471211:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125377920:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155642.471215:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910cb800/2, rc 0, transno 21474841601 00000100:00100000:0.0:1746155642.471217:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125378432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.472946:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.473084:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125999872 00000100:00100000:3.0:1746155642.473089:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125999872 00000100:00100000:3.0:1746155642.473114:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11134 00000100:00100000:3.0:1746155642.473119:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32361:x1830976125999872:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155642.473135:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.473147:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592c00/0x844e5faceb5f7d80 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18217 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.473186:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592c00/0x844e5faceb5f7d80 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18217 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.473195:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592c00/0x844e5faceb5f7d80 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18217 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.473207:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.473210:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155642.473212:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d592c00, rc 0) 00000100:00100000:3.0:1746155642.473444:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32361:x1830976125999872:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 323us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.473449:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11134 00000100:00100000:0.0:1746155642.476176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.476229:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126000000 00000100:00100000:3.0:1746155642.476236:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126000000 00000100:00100000:3.0:1746155642.476275:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11135 00000100:00100000:3.0:1746155642.476281:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32361:x1830976126000000:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155642.476295:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.476307:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592000/0x844e5faceb5f7d87 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1821e expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.476371:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592400/0x844e5faceb5f7d8e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.476380:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592400/0x844e5faceb5f7d8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.476388:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592400/0x844e5faceb5f7d8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155642.476406:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155642.476409:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155642.476418:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592400/0x844e5faceb5f7d8e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.476434:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592000/0x844e5faceb5f7d87 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1821e expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.476445:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592400/0x844e5faceb5f7d8e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1821e expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.476451:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.476454:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155642.476456:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d592400, rc 0) 00000100:00100000:3.0:1746155642.476497:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32361:x1830976126000000:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 216us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.476532:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11135 00000100:00100000:0.0:1746155642.479879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.480153:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126000128 00000100:00100000:2.0:1746155642.480161:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126000128 00000100:00100000:2.0:1746155642.480194:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17046 00000100:00100000:2.0:1746155642.480200:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126000128:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155642.480214:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.480230:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131443e00/0x844e5faceb5f7d95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18225 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155642.480252:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e1:0x0] initial LVB size: 1048576, mtime: 0x6814387a, atime: 0x68143879, ctime: 0x6814387a, blocks: 0x7e9 00010000:00010000:2.0:1746155642.480268:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.480270:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.480276:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131443e00/0x844e5faceb5f7d95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18225 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.480291:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131443e00/0x844e5faceb5f7d95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18225 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.480300:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131443e00, rc 0) 00000100:00100000:2.0:1746155642.480351:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976126000128:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 151us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.480357:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17046 00000100:00100000:0.0:1746155642.482617:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.483861:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.483862:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126000256 00000100:00100000:2.0:1746155642.483870:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126000256 00000100:00100000:2.0:1746155642.483966:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126000512 00000100:00100000:2.0:1746155642.483970:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126000512 00000100:00100000:1.0:1746155642.483975:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.483986:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126000768 00000100:00100000:2.0:1746155642.483988:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126000768 00000100:00100000:1.0:1746155642.483991:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.484830:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126000384 00000100:00100000:2.0:1746155642.484834:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126000384 00000100:00100000:2.0:1746155642.484850:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17047 00000100:00100000:2.0:1746155642.484856:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976126000256:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155642.484868:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155642.484881:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155642.484883:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7d9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1822c expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155642.484907:0:29728:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x6814387a, atime: 0x68143879, ctime: 0x6814387a, blocks: 0x821 00000100:00100000:0.0:1746155642.484945:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126000640 00000100:00100000:0.0:1746155642.484947:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126000640 00000100:00100000:3.0:1746155642.484960:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17048 00000100:00100000:3.0:1746155642.484968:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976126000512:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:0.0:1746155642.484972:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17049 00010000:00010000:3.0:1746155642.484975:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155642.484977:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976126000768:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155642.484982:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.484984:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d593000/0x844e5faceb5f7da3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1823a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.484989:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x844e5faceb5f7daa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18248 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155642.484997:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e3:0x0] initial LVB size: 2097152, mtime: 0x6814387a, atime: 0x6814387a, ctime: 0x6814387a, blocks: 0x821 00002000:00010000:0.0:1746155642.484999:0:4461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e2:0x0] initial LVB size: 4194304, mtime: 0x6814387a, atime: 0x68143879, ctime: 0x6814387a, blocks: 0x1029 00010000:00010000:3.0:1746155642.485009:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.485009:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.485011:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.485011:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.485017:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d593000/0x844e5faceb5f7da3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1823a expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.485017:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x844e5faceb5f7daa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18248 expref: 18 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.485029:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d593000/0x844e5faceb5f7da3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1823a expref: 17 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155642.485029:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x844e5faceb5f7daa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18248 expref: 18 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.485036:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d593000, rc 0) 00010000:00010000:0.0:1746155642.485036:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312e7c00, rc 0) 00000100:00100000:3.0:1746155642.485072:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976126000512:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 105us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.485077:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17048 00000100:00100000:3.0:1746155642.485092:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17050 00000100:00100000:3.0:1746155642.485097:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1961:x1830976126000384:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155642.485103:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.485110:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d592a00/0x844e5faceb5f7db1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18233 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155642.485120:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x6814387a, atime: 0x68143879, ctime: 0x6814387a, blocks: 0x81d 00010000:00010000:3.0:1746155642.485127:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.485129:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.485132:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d592a00/0x844e5faceb5f7db1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18233 expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.485140:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d592a00/0x844e5faceb5f7db1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18233 expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.485145:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d592a00, rc 0) 00000100:00100000:1.0:1746155642.485190:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17051 00000100:00100000:1.0:1746155642.485196:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976126000640:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155642.485202:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155642.485208:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a06d2400/0x844e5faceb5f7db8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18241 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155642.485219:0:20200:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e4:0x0] initial LVB size: 5079552, mtime: 0x6814387a, atime: 0x68143879, ctime: 0x6814387a, blocks: 0x1711 00010000:00010000:1.0:1746155642.485225:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.485226:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.485229:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06d2400/0x844e5faceb5f7db8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18241 expref: 17 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.485236:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a06d2400/0x844e5faceb5f7db8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18241 expref: 17 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155642.485242:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a06d2400, rc 0) 00010000:00010000:2.0:1746155642.485639:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.485641:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.485646:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7d9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1822c expref: 20 pid: 29728 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155642.485807:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1961:x1830976126000768:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 829us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.485814:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17049 00000100:00100000:3.0:1746155642.485815:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1961:x1830976126000384:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 716us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.485820:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17050 00010000:00010000:2.0:1746155642.485872:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7d9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1822c expref: 18 pid: 29728 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155642.485874:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976126000640:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 678us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.485879:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17051 00010000:00010000:2.0:1746155642.485880:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a608800, rc 0) 00000100:00100000:2.0:1746155642.485898:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1961:x1830976126000256:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1043us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.485902:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17047 00000100:00100000:0.0:1746155642.495840:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.496134:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126001024 00000100:00100000:2.0:1746155642.496144:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126001024 00000100:00100000:2.0:1746155642.496206:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8089 00000100:00100000:2.0:1746155642.496219:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976126001024:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155642.496255:0:31252:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7dbf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.496271:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.496272:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.496280:0:31252:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7dbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.496294:0:31252:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7dbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.497649:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.497685:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.497703:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126001408 00000100:00100000:3.0:1746155642.497708:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126001408 00000100:00100000:3.0:1746155642.497774:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126001280 00000100:00100000:3.0:1746155642.497776:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126001280 00000100:00100000:3.0:1746155642.497864:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8090 00000100:00100000:3.0:1746155642.497871:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1961:x1830976126001408:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155642.497901:0:31253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d593c00/0x844e5faceb5f7dc6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.497926:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.497927:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.497930:0:31253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d593c00/0x844e5faceb5f7dc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.497939:0:31253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d593c00/0x844e5faceb5f7dc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.498316:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8091 00000100:00100000:1.0:1746155642.498324:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1960:x1830976126001280:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155642.498338:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7dcd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.498345:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.498347:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.498349:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7dcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.498357:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7dcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.499157:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.499182:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.499891:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126001792 00000100:00100000:3.0:1746155642.499898:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126001792 00000100:00100000:3.0:1746155642.499938:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126002048 00000100:00100000:3.0:1746155642.499941:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126002048 00000100:00100000:3.0:1746155642.499956:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8092 00000100:00100000:3.0:1746155642.499961:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1963:x1830976126001792:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155642.499982:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008d593800/0x844e5faceb5f7dd4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.499991:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.499992:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.499995:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d593800/0x844e5faceb5f7dd4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.500003:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d593800/0x844e5faceb5f7dd4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.500031:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8093 00000100:00100000:2.0:1746155642.500039:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1963:x1830976126002048:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155642.500054:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7ddb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.500062:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.500063:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.500066:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7ddb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.500074:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7ddb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.501730:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.502728:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.503304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.503444:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126002304 00000100:00100000:3.0:1746155642.503451:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126002304 00000100:00100000:3.0:1746155642.503495:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126002560 00000100:00100000:3.0:1746155642.503498:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126002560 00000100:00100000:3.0:1746155642.503523:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126002816 00000100:00100000:3.0:1746155642.503525:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126002816 00000100:00100000:3.0:1746155642.503538:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8094 00000100:00100000:3.0:1746155642.503544:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+23:1962:x1830976126002304:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:1.0:1746155642.503550:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8095 00000100:00100000:1.0:1746155642.503556:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+23:1962:x1830976126002560:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155642.503568:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f7de2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.503577:0:31251:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009bf2a000/0x844e5faceb5f7de9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.503579:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.503580:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.503583:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f7de2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.503585:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.503587:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.503590:0:31251:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf2a000/0x844e5faceb5f7de9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.503593:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f7de2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.503600:0:31251:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf2a000/0x844e5faceb5f7de9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.504465:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8096 00000100:00100000:3.0:1746155642.504469:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+24:1962:x1830976126002816:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155642.504480:0:10888:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7df0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.504485:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.504485:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.504487:0:10888:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7df0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.504492:0:10888:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7df0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.512140:0:31253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d593c00/0x844e5faceb5f7dc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.512153:0:31253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d593c00/0x844e5faceb5f7dc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.512160:0:31253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d593c00/0x844e5faceb5f7dc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.512166:0:31253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d593c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155642.512170:0:31253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d593c00/0x844e5faceb5f7dc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.512177:0:31253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d593c00/0x844e5faceb5f7dc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.512191:0:31253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d593c00/0x844e5faceb5f7dc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.512197:0:31253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d593c00/0x844e5faceb5f7dc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.512257:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+24:1961:x1830976126001408:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 14383us (14607us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155642.512265:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8090 00010000:00010000:3.0:1746155642.515409:0:31252:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7dbf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.515421:0:31252:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7dbf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.515428:0:31252:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.515434:0:31252:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a609200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155642.515438:0:31252:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7dbf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.515444:0:31252:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7dbf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.515458:0:31252:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7dbf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.515463:0:31252:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7dbf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.515937:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+23:1961:x1830976126001024:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 19717us (20100us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155642.515946:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8089 00010000:00010000:1.0:1746155642.519790:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7dcd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.519804:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7dcd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.519811:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7dcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.519818:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a06d3a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155642.519821:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7dcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.519828:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7dcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.519844:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7dcd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.519850:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a06d3a00/0x844e5faceb5f7dcd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.519941:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+22:1960:x1830976126001280:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 21614us (22251us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155642.519950:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8091 00010000:00010000:3.0:1746155642.525837:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008d593800/0x844e5faceb5f7dd4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.525851:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d593800/0x844e5faceb5f7dd4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.525862:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d593800/0x844e5faceb5f7dd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.525868:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d593800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155642.525871:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d593800/0x844e5faceb5f7dd4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.525877:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d593800/0x844e5faceb5f7dd4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.525893:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d593800/0x844e5faceb5f7dd4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.525899:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d593800/0x844e5faceb5f7dd4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.525992:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+21:1963:x1830976126001792:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 26026us (26832us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155642.526000:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8092 00010000:00010000:2.0:1746155642.528586:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7ddb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.528598:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7ddb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.528605:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7ddb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.528611:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a608600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155642.528614:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7ddb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.528621:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7ddb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.528635:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7ddb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.528641:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7ddb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.528707:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1963:x1830976126002048:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 28666us (29521us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155642.529655:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8093 00010000:00010000:3.0:1746155642.534801:0:25394:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f7de2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.534819:0:25394:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f7de2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.534826:0:25394:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f7de2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.534837:0:25394:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb0000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155642.534841:0:25394:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f7de2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.534847:0:25394:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f7de2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.534862:0:25394:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f7de2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.534867:0:25394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0000/0x844e5faceb5f7de2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.536672:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1962:x1830976126002304:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 33122us (34941us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155642.536681:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8094 00010000:00010000:3.0:1746155642.540398:0:10888:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7df0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.540411:0:10888:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7df0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.540418:0:10888:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7df0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.540423:0:10888:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090487400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155642.540427:0:10888:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7df0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.540433:0:10888:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7df0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.540446:0:10888:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7df0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.540450:0:10888:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7df0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.540530:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1962:x1830976126002816:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 36057us (37223us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155642.540538:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8096 00010000:00010000:1.0:1746155642.544944:0:31251:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009bf2a000/0x844e5faceb5f7de9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.544958:0:31251:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf2a000/0x844e5faceb5f7de9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.544970:0:31251:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bf2a000/0x844e5faceb5f7de9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.544976:0:31251:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf2a000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155642.544980:0:31251:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bf2a000/0x844e5faceb5f7de9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.544986:0:31251:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bf2a000/0x844e5faceb5f7de9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.545001:0:31251:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bf2a000/0x844e5faceb5f7de9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.545006:0:31251:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf2a000/0x844e5faceb5f7de9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.545062:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1962:x1830976126002560:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 41502us (42331us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155642.545070:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8095 00000100:00100000:0.0:1746155642.554962:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.555056:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126003072 00000100:00100000:3.0:1746155642.555064:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126003072 00000100:00100000:3.0:1746155642.555765:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11136 00000100:00100000:3.0:1746155642.555773:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32361:x1830976126003072:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:3.0:1746155642.555816:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.555839:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592400/0x844e5faceb5f7d8e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1821e expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.557595:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.557601:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155642.557637:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090487400/0x844e5faceb5f7df7 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.557648:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090487400/0x844e5faceb5f7df7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.557656:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090487400/0x844e5faceb5f7df7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00010000:3.0:1746155642.557805:0:20364:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b883800 reply state ffff880091010000 transno 8589945295 ns: mdt-lustre-MDT0000_UUID lock: ffff880090487400/0x844e5faceb5f7df7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155642.557813:0:20364:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746155642.558366:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32361:x1830976126003072:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 2591us (3408us total) trans 8589945295 rc 0/0 00000100:00100000:3.0:1746155642.558374:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11136 00000100:00100000:0.0:1746155642.564384:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.564445:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126003200 00000100:00100000:2.0:1746155642.564453:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126003200 00010000:00010000:1.0:1746155642.564494:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090487400/0x844e5faceb5f7df7 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155642.564521:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17052 00010000:00010000:1.0:1746155642.564523:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090487400/0x844e5faceb5f7df7 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155642.564529:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:32361:x1830976126003200:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155642.564529:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090487400/0x844e5faceb5f7df7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.564538:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090487400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155642.564542:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090487400/0x844e5faceb5f7df7 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.564543:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155642.564548:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090487400/0x844e5faceb5f7df7 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.564556:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7dfe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1824f expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.564560:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155642.564562:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155642.564566:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090487400/0x844e5faceb5f7df7 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.564570:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090487400/0x844e5faceb5f7df7 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155642.564577:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131443e00/0x844e5faceb5f7d95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18225 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.564583:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.564585:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.564588:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7dfe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1824f expref: 18 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.564980:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131443e00/0x844e5faceb5f7d95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18225 expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.564991:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131443e00/0x844e5faceb5f7d95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18225 expref: 18 pid: 8437 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.565002:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125379328:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.565079:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.566711:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.566760:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126003328 00000100:00100000:3.0:1746155642.566765:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126003328 00010000:00010000:3.0:1746155642.566789:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131443e00/0x844e5faceb5f7d95 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18225 expref: 19 pid: 8437 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.566797:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125379328:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.566814:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7dfe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1824f expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.566823:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8752 00010000:00010000:2.0:1746155642.566825:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a608600, rc 0) 00000100:00100000:3.0:1746155642.566829:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1961:x1830976126003328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.566837:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.566855:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131443e00/0x844e5faceb5f7d95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18225 expref: 19 pid: 8437 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.566861:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:32361:x1830976126003200:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2334us (2486us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155642.566864:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131443e00/0x844e5faceb5f7d95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18225 expref: 19 pid: 8437 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.566867:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17052 00010000:00010000:3.0:1746155642.566879:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131443e00/0x844e5faceb5f7d95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18225 expref: 18 pid: 8437 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.567146:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.567149:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.567155:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7dfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1824f expref: 17 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.567163:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7dfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1824f expref: 17 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.567183:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7dfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1824f expref: 17 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.567191:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125379456:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155642.567236:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.569581:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125379456:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155642.569595:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.569637:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976126003328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2807us (2927us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.569644:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8752 00000100:00100000:0.0:1746155642.569728:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.569763:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126003456 00000100:00100000:2.0:1746155642.569767:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126003456 00000100:00100000:2.0:1746155642.569802:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17053 00000100:00100000:2.0:1746155642.569808:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:32361:x1830976126003456:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155642.569821:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.569832:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7e05 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18256 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.569853:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7d9c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1822c expref: 19 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.569864:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.569865:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.569868:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7e05 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18256 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.569888:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7d9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1822c expref: 19 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.569898:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7d9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1822c expref: 19 pid: 29728 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.569919:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125379584:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.569975:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.571100:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125379584:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155642.571100:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155642.571115:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7e05 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18256 expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.571126:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a608200, rc 0) 00000100:00100000:2.0:1746155642.571162:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:32361:x1830976126003456:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1354us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.571168:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17053 00000100:00100000:3.0:1746155642.571171:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126003584 00000100:00100000:3.0:1746155642.571175:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126003584 00010000:00010000:3.0:1746155642.571189:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7d9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1822c expref: 19 pid: 29728 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746155642.571204:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8753 00000100:00100000:3.0:1746155642.571208:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1960:x1830976126003584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.571218:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.571234:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7d9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1822c expref: 19 pid: 29728 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.571245:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7d9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1822c expref: 19 pid: 29728 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.571260:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a608800/0x844e5faceb5f7d9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1822c expref: 19 pid: 29728 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.571269:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.571271:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.571276:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18256 expref: 18 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.571282:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7e05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18256 expref: 18 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.571300:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7e05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18256 expref: 18 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.571309:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125379712:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155642.571583:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.573541:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125379712:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155642.573558:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.573597:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1960:x1830976126003584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2386us (2497us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.573605:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8753 00000100:00100000:0.0:1746155642.573969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.574033:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126003712 00000100:00100000:2.0:1746155642.574120:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126003712 00000100:00100000:2.0:1746155642.574161:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17054 00000100:00100000:2.0:1746155642.574167:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:32361:x1830976126003712:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155642.574180:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.574192:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7e0c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1825d expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.574214:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d592a00/0x844e5faceb5f7db1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18233 expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.574221:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.574222:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.574225:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7e0c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1825d expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.574245:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d592a00/0x844e5faceb5f7db1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18233 expref: 19 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.574254:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d592a00/0x844e5faceb5f7db1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18233 expref: 19 pid: 8437 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.574263:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125379840:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.574319:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.576358:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.576437:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125379840:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.576455:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7e0c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1825d expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.576467:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a609400, rc 0) 00000100:00100000:3.0:1746155642.576666:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126003840 00000100:00100000:3.0:1746155642.576671:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126003840 00010000:00010000:3.0:1746155642.576688:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d592a00/0x844e5faceb5f7db1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18233 expref: 20 pid: 8437 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746155642.576714:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8754 00000100:00100000:3.0:1746155642.576720:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1963:x1830976126003840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.576727:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.576742:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d592a00/0x844e5faceb5f7db1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18233 expref: 20 pid: 8437 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.576752:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d592a00/0x844e5faceb5f7db1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18233 expref: 20 pid: 8437 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.576767:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d592a00/0x844e5faceb5f7db1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18233 expref: 20 pid: 8437 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.576777:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.576778:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.576784:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7e0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1825d expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.576790:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7e0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1825d expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.576810:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7e0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1825d expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.576820:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125379968:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155642.576876:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:32361:x1830976126003712:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2709us (2908us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.576883:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17054 00000100:00100000:3.0:1746155642.577431:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.581347:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125379968:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155642.581349:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.581409:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126003968 00000100:00100000:2.0:1746155642.581415:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126003968 00000100:00100000:2.0:1746155642.581444:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17055 00000100:00100000:2.0:1746155642.581450:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:32361:x1830976126003968:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155642.581463:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.581477:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a609000/0x844e5faceb5f7e13 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18264 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.581498:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d593000/0x844e5faceb5f7da3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1823a expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.581524:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.581525:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.581528:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a609000/0x844e5faceb5f7e13 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18264 expref: 18 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.581551:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d593000/0x844e5faceb5f7da3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1823a expref: 18 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.581560:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d593000/0x844e5faceb5f7da3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1823a expref: 18 pid: 8437 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.581570:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125380096:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155642.581610:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.581790:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1963:x1830976126003840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5069us (5435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.581798:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8754 00000100:00100000:2.0:1746155642.581966:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.584901:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125380096:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.584935:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a609000/0x844e5faceb5f7e13 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18264 expref: 18 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.584949:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a609000, rc 0) 00000100:00100000:2.0:1746155642.584984:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a15ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:32361:x1830976126003968:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3533us (3635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.584991:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17055 00000100:00100000:0.0:1746155642.589554:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.589617:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126004096 00000100:00100000:3.0:1746155642.589625:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126004096 00010000:00010000:3.0:1746155642.589655:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d593000/0x844e5faceb5f7da3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1823a expref: 18 pid: 8437 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746155642.589692:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8755 00000100:00100000:3.0:1746155642.589699:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1960:x1830976126004096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.589712:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.589731:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d593000/0x844e5faceb5f7da3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1823a expref: 18 pid: 8437 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.589741:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d593000/0x844e5faceb5f7da3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1823a expref: 18 pid: 8437 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.589760:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d593000/0x844e5faceb5f7da3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1823a expref: 18 pid: 8437 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.589790:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.589793:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.589798:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a609000/0x844e5faceb5f7e13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18264 expref: 17 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.589805:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a609000/0x844e5faceb5f7e13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18264 expref: 17 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.589832:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a609000/0x844e5faceb5f7e13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18264 expref: 17 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.589842:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125380224:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155642.589928:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.593144:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125380224:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155642.593144:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155642.593160:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.593165:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126004224 00000100:00100000:2.0:1746155642.593169:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126004224 00000100:00100000:3.0:1746155642.593192:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1960:x1830976126004096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3492us (3645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.593199:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17056 00000100:00100000:3.0:1746155642.593200:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8755 00000100:00100000:2.0:1746155642.593205:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:32361:x1830976126004224:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155642.593215:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.593227:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7e1a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1826b expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.593252:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a06d2400/0x844e5faceb5f7db8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18241 expref: 18 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.593259:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.593261:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.593264:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7e1a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1826b expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.593282:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a06d2400/0x844e5faceb5f7db8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18241 expref: 18 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.593295:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a06d2400/0x844e5faceb5f7db8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18241 expref: 18 pid: 20200 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.593304:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125380352:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.593334:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.596283:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.596330:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126004352 00000100:00100000:3.0:1746155642.596336:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126004352 00000100:00100000:2.0:1746155642.596353:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125380352:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155642.596359:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a06d2400/0x844e5faceb5f7db8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18241 expref: 19 pid: 20200 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746155642.596371:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7e1a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1826b expref: 19 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.596379:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8756 00010000:00010000:2.0:1746155642.596384:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a609200, rc 0) 00000100:00100000:3.0:1746155642.596385:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1961:x1830976126004352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.596395:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.596412:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a06d2400/0x844e5faceb5f7db8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18241 expref: 19 pid: 20200 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.596412:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:32361:x1830976126004224:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3208us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.596418:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17056 00010000:00010000:3.0:1746155642.596421:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a06d2400/0x844e5faceb5f7db8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18241 expref: 19 pid: 20200 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.596438:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a06d2400/0x844e5faceb5f7db8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18241 expref: 18 pid: 20200 timeout: 871 lvb_type: 1 00010000:00010000:3.0:1746155642.596447:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.596448:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.596454:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7e1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1826b expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.596461:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7e1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1826b expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.596481:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7e1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1826b expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.596490:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125380480:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155642.596561:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.599630:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125380480:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155642.599645:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.599674:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976126004352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3289us (3394us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.599683:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8756 00000100:00100000:1.0:1746155642.600092:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.600190:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126004480 00000100:00100000:3.0:1746155642.600195:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126004480 00000100:00100000:3.0:1746155642.600217:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17057 00000100:00100000:3.0:1746155642.600222:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:32361:x1830976126004480:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155642.600235:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.600246:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18272 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.600267:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x844e5faceb5f7daa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18248 expref: 19 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.600274:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.600275:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.600278:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18272 expref: 19 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.600300:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x844e5faceb5f7daa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18248 expref: 19 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.600309:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x844e5faceb5f7daa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18248 expref: 19 pid: 4461 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746155642.600319:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125380608:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155642.600788:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.603745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.603807:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126004608 00000100:00100000:2.0:1746155642.603816:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126004608 00010000:00010000:2.0:1746155642.603846:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x844e5faceb5f7daa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18248 expref: 20 pid: 4461 timeout: 871 lvb_type: 1 00000100:00100000:2.0:1746155642.603870:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8757 00000100:00100000:2.0:1746155642.603876:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1962:x1830976126004608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155642.603886:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155642.603904:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x844e5faceb5f7daa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18248 expref: 20 pid: 4461 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746155642.603933:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x844e5faceb5f7daa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18248 expref: 20 pid: 4461 timeout: 871 lvb_type: 1 00010000:00010000:2.0:1746155642.603953:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.603954:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.603960:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18272 expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.603967:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18272 expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.603993:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18272 expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.604002:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125380736:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155642.604075:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4540 going to sleep for 11 seconds 00010000:00010000:3.0:1746155642.604182:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801312e7c00/0x844e5faceb5f7daa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18248 expref: 20 pid: 4461 timeout: 871 lvb_type: 1 00000100:00100000:3.0:1746155642.604208:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125380608:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155642.604234:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18272 expref: 19 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.604246:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0df400, rc 0) 00000100:00100000:3.0:1746155642.604295:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:32361:x1830976126004480:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4072us (4204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.604303:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17057 00000100:00100000:0.0:1746155642.606036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.606065:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.606086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.606373:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125380736:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155642.606390:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.606419:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1962:x1830976126004608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2543us (2684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.606428:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8757 00000100:00100000:0.0:1746155642.606599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.606946:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.606960:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126004736 00000100:00100000:1.0:1746155642.606965:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126004736 00000100:00100000:1.0:1746155642.606994:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126004864 00000100:00100000:1.0:1746155642.606996:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126004864 00000100:00100000:1.0:1746155642.607013:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126004992 00000100:00100000:1.0:1746155642.607014:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126004992 00000100:00100000:1.0:1746155642.607025:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126005120 00000100:00100000:1.0:1746155642.607027:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126005120 00000100:00100000:1.0:1746155642.607040:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17058 00000100:00100000:1.0:1746155642.607045:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1962:x1830976126004736:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155642.607234:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155642.607238:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:1.0:1746155642.607240:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155641 -> 1746155642 00002000:00010000:1.0:1746155642.607241:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155642 -> 1746155643 00002000:00010000:1.0:1746155642.607244:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:1.0:1746155642.607269:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1962:x1830976126004736:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 223us (1236us total) trans 17179874286 rc 0/0 00000100:00100000:1.0:1746155642.607274:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17058 00000100:00100000:1.0:1746155642.607286:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17059 00000100:00100000:1.0:1746155642.607291:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1963:x1830976126004864:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155642.607377:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155642.607379:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:1.0:1746155642.607381:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155641 -> 1746155642 00002000:00010000:1.0:1746155642.607383:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155642 -> 1746155643 00002000:00010000:1.0:1746155642.607385:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155642.607398:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1963:x1830976126004864:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 107us (1332us total) trans 21474841606 rc 0/0 00000100:00100000:1.0:1746155642.607402:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17059 00000100:00100000:1.0:1746155642.607409:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17060 00000100:00100000:1.0:1746155642.607413:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1962:x1830976126004992:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155642.607457:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155642.607459:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:1.0:1746155642.607460:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155641 -> 1746155642 00002000:00010000:1.0:1746155642.607462:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155642 -> 1746155643 00002000:00010000:1.0:1746155642.607464:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000100:00100000:1.0:1746155642.607475:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1962:x1830976126004992:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 61us (1388us total) trans 21474841607 rc 0/0 00000100:00100000:1.0:1746155642.607479:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17060 00000100:00100000:1.0:1746155642.607486:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17061 00000100:00100000:1.0:1746155642.607489:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1963:x1830976126005120:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155642.607552:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155642.607554:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:1.0:1746155642.607556:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155642 -> 1746155642 00002000:00010000:1.0:1746155642.607557:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155642 -> 1746155643 00002000:00010000:1.0:1746155642.607559:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155642.607571:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1963:x1830976126005120:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 82us (973us total) trans 17179874287 rc 0/0 00000100:00100000:1.0:1746155642.607575:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17061 00000100:00100000:3.0:1746155642.608352:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126005248 00000100:00100000:3.0:1746155642.608358:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126005248 00000100:00100000:3.0:1746155642.608381:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17062 00000100:00100000:3.0:1746155642.608387:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1962:x1830976126005248:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155642.608479:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:3.0:1746155642.608482:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:3.0:1746155642.608484:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155641 -> 1746155642 00002000:00010000:3.0:1746155642.608486:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155642 -> 1746155643 00002000:00010000:3.0:1746155642.608488:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:3.0:1746155642.608534:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1962:x1830976126005248:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 147us (1587us total) trans 17179874288 rc 0/0 00000100:00100000:3.0:1746155642.608540:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17062 00000100:00100000:2.0:1746155642.608621:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.608679:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126005376 00000100:00100000:3.0:1746155642.608785:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126005376 00000100:00100000:3.0:1746155642.608804:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17063 00000100:00100000:3.0:1746155642.608809:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1962:x1830976126005376:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155642.608884:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746155642.608887:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:3.0:1746155642.608889:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155641 -> 1746155642 00002000:00010000:3.0:1746155642.608890:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155642 -> 1746155643 00002000:00010000:3.0:1746155642.608892:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746155642.609183:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+21:1962:x1830976126005376:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 373us (562us total) trans 21474841608 rc 0/0 00000100:00100000:3.0:1746155642.609189:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17063 00000100:00100000:0.0:1746155642.610684:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.610737:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126005632 00000100:00100000:2.0:1746155642.610743:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126005632 00000100:00100000:2.0:1746155642.610788:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4727 00000100:00100000:2.0:1746155642.610795:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32361:x1830976126005632:12345-192.168.202.51@tcp:35:lfs.0 00000004:00010000:2.0:1746155642.610850:0:16336:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x35e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e400/0x844e5faceb5f7d41 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18210 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.610896:0:16336:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155642.610907:0:16336:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592c00/0x844e5faceb5f7d80 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18217 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.610927:0:16336:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155642.610960:0:16336:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592c00/0x844e5faceb5f7d80 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18217 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.610972:0:16336:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592c00/0x844e5faceb5f7d80 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18217 expref: 9 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.610984:0:16336:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16336:1830976125380864:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.611069:0:16336:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b0b4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.614774:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.614943:0:16336:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16336:1830976125380864:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.614968:0:16336:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:3.0:1746155642.615492:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126005760 00000100:00100000:3.0:1746155642.615499:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126005760 00010000:00010000:3.0:1746155642.615547:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592c00/0x844e5faceb5f7d80 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18217 expref: 10 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.615870:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8758 00000100:00100000:3.0:1746155642.615878:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976126005760:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.615891:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.615897:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592c00/0x844e5faceb5f7d80 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18217 expref: 10 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.615907:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592c00/0x844e5faceb5f7d80 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18217 expref: 10 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.615936:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592c00/0x844e5faceb5f7d80 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18217 expref: 10 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.616037:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.616043:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155642.616053:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155642.616059:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16336 initiator: MDT0 00010000:00010000:3.0:1746155642.616082:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155642.616143:0:16336:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155642.616149:0:16336:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:3.0:1746155642.616581:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976126005760:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 702us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.616588:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8758 00000040:00080000:2.0:1746155642.617314:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3608, 88 off304424 00000004:00080000:2.0:1746155642.617320:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771766816786ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.618489:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3610, 88 off304864 00000004:00080000:2.0:1746155642.618495:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771767991872ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.618858:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3611, 88 off304952 00000004:00080000:2.0:1746155642.618862:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771768359454ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.618878:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3609, 88 off304512 00000004:00080000:2.0:1746155642.618880:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771768377598ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.618887:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3610, 88 off304600 00000004:00080000:2.0:1746155642.618889:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771768386330ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.618896:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3612, 88 off305040 00000004:00080000:2.0:1746155642.618898:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771768395018ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.618904:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3613, 88 off305128 00000004:00080000:2.0:1746155642.618906:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771768403578ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.618923:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3614, 88 off305216 00000004:00080000:2.0:1746155642.618925:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771768422559ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.618933:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3611, 88 off304688 00000004:00080000:2.0:1746155642.618935:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771768431865ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.618941:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3615, 88 off305304 00000004:00080000:2.0:1746155642.618944:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771768440724ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.618950:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3612, 88 off304776 00000004:00080000:2.0:1746155642.618953:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771768449597ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.618958:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3616, 88 off305392 00000004:00080000:2.0:1746155642.618960:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771768457519ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155642.618966:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3613, 88 off304864 00000004:00080000:2.0:1746155642.618968:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771768465478ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.618974:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3614, 88 off304952 00000004:00080000:2.0:1746155642.618976:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771768473670ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.618982:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3615, 88 off305040 00000004:00080000:2.0:1746155642.618984:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771768481308ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.618990:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3616, 88 off305128 00000004:00080000:2.0:1746155642.618992:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771768489622ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155642.618998:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3617, 88 off305480 00000004:00080000:2.0:1746155642.619000:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771768497312ns, next at 716011101328ns, rc = 0 00000001:00080000:0.0:1746155642.644028:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945296 is committed 00000004:00080000:0.0:1746155642.644039:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2801 committed 00000004:00080000:0.0:1746155642.644045:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2794 committed 00000004:00080000:0.0:1746155642.644055:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2793 committed 00000004:00080000:0.0:1746155642.644056:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2792 committed 00000004:00080000:0.0:1746155642.644058:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2791 committed 00000004:00080000:0.0:1746155642.644059:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2800 committed 00000004:00080000:0.0:1746155642.644061:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2790 committed 00000004:00080000:0.0:1746155642.644062:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2799 committed 00000004:00080000:0.0:1746155642.644064:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2789 committed 00000004:00080000:0.0:1746155642.644065:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2798 committed 00000004:00080000:0.0:1746155642.644067:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2797 committed 00000004:00080000:0.0:1746155642.644068:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2796 committed 00000004:00080000:0.0:1746155642.644069:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2788 committed 00000004:00080000:0.0:1746155642.644070:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2787 committed 00000004:00080000:0.0:1746155642.644072:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2795 committed 00000004:00080000:0.0:1746155642.644073:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2794 committed 00000004:00080000:0.0:1746155642.644075:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2786 committed 00000100:00100000:3.0:1746155642.644185:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125380992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.644185:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125381120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.644791:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125381248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.644793:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125381376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.644905:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.644938:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125381248 00000100:00100000:3.0:1746155642.644947:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125381248 00000100:00100000:0.0:1746155642.644958:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125381760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.644973:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.644981:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125381760 00000100:00100000:3.0:1746155642.644983:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125381760 00000100:00100000:0.0:1746155642.644986:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125382272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.644998:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17064 00000100:00100000:0.0:1746155642.644998:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.645004:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+96:3298:x1830976125381248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.645010:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125382784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.645023:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155642.645041:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125382272 00000100:00100000:1.0:1746155642.645046:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125382272 00000100:00100000:0.0:1746155642.645054:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155642.645064:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125381632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.645076:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:2.0:1746155642.645214:0:16336:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a3fc4380 reply state ffff8800903cbc00 transno 8589945296 ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:2.0:1746155642.645225:0:16336:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746155642.645234:0:16336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155642.645237:0:16336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155642.645244:0:16336:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c69e400/0x844e5faceb5f7d41 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18210 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155642.645245:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155642.645248:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:3.0:1746155642.645250:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155642 -> 1746155642 00002000:00010000:3.0:1746155642.645252:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155643 -> 1746155643 00002000:00010000:3.0:1746155642.645254:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155642.645287:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+98:3298:x1830976125381248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 282us (381us total) trans 17179874289 rc 0/0 00000100:00100000:3.0:1746155642.645293:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17064 00000100:00100000:3.0:1746155642.645413:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125381120 00000100:00100000:1.0:1746155642.645413:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125382784 00000100:00100000:3.0:1746155642.645415:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125381120 00000100:00100000:1.0:1746155642.645416:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125382784 00000100:00100000:0.0:1746155642.645417:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125382144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155642.645427:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125381632 00000100:00100000:3.0:1746155642.645429:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125381632 00000100:00100000:0.0:1746155642.645431:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.645440:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125382144 00000100:00100000:0.0:1746155642.645440:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125382656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155642.645442:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125382144 00000100:00100000:3.0:1746155642.645449:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17065 00000100:00100000:0.0:1746155642.645451:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.645454:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+98:3298:x1830976125381760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155642.645462:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125382656 00000100:00100000:1.0:1746155642.645465:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125382656 00000100:00100000:0.0:1746155642.645470:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17066 00000100:00100000:0.0:1746155642.645476:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+98:3298:x1830976125382272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155642.645479:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17067 00000100:00100000:1.0:1746155642.645483:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+88:3297:x1830976125381120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.645521:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17068 00000100:00100000:0.0:1746155642.645526:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+88:3297:x1830976125381632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.645595:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17069 00000100:00100000:0.0:1746155642.645600:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+88:3297:x1830976125382144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155642.645635:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17070 00000100:00100000:1.0:1746155642.645641:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+89:3297:x1830976125382656:12345-0@lo:2:osp-syn-0-0.0 00010000:00080000:2.0:1746155642.646420:0:16336:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746155642.646432:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155642.646434:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32361:x1830976126005632:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 35638us (35754us total) trans 8589945296 rc 0/0 00000100:00100000:2.0:1746155642.646442:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4727 00000100:00100000:3.0:1746155642.646459:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125381888:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155642.646464:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125381376 00000100:00100000:2.0:1746155642.646466:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125381376 00000100:00100000:2.0:1746155642.646481:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17071 00000100:00100000:3.0:1746155642.646482:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155642.646486:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+90:3295:x1830976125381376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155642.646492:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125382400:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746155642.646518:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16336 initiator: MDT0 00000100:00100000:3.0:1746155642.646519:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1746155642.646525:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16336 initiator: MDT0 00000004:00080000:0.0:1746155642.646526:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910d9880/2, rc 0, transno 17179874289 00010000:00010000:2.0:1746155642.646531:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16336 initiator: MDT0 00000100:00100000:0.0:1746155642.646535:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125381248:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746155642.646536:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131443e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155642.646540:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155642.646545:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155642.646559:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155642.646560:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155642.646563:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155642.646567:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131443e00/0x844e5faceb5f7e28 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16336 initiator: MDT0 00000100:00100000:2.0:1746155642.646584:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125381888 00000100:00100000:2.0:1746155642.646587:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125381888 00000100:00100000:2.0:1746155642.646597:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125382400 00000100:00100000:2.0:1746155642.646598:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125382400 00000100:00100000:2.0:1746155642.646607:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17072 00000100:00100000:2.0:1746155642.646611:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+93:3295:x1830976125381888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155642.647025:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155642.647028:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:1.0:1746155642.647030:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155642 -> 1746155642 00002000:00010000:1.0:1746155642.647032:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155643 -> 1746155643 00002000:00010000:1.0:1746155642.647033:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155642.647058:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+93:3297:x1830976125381120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1574us (2003us total) trans 21474841609 rc 0/0 00000100:00100000:1.0:1746155642.647064:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17067 00000100:00100000:1.0:1746155642.647076:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17073 00000100:00100000:1.0:1746155642.647081:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+92:3295:x1830976125382400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155642.647170:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+93:3295:x1830976125382400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (650us total) trans 21474841611 rc 0/0 00000100:00100000:1.0:1746155642.647176:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17073 00000100:00100000:1.0:1746155642.647200:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17074 00000100:00100000:1.0:1746155642.647205:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+98:3298:x1830976125382784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.647270:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125382912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155642.647294:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155642.647298:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+93:3297:x1830976125382656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1657us (1846us total) trans 21474841612 rc 0/0 00000100:00100000:1.0:1746155642.647303:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17070 00000100:00100000:1.0:1746155642.647310:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125382912 00000100:00100000:1.0:1746155642.647313:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125382912 00000004:00080000:3.0:1746155642.647316:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b880e00/2, rc 0, transno 21474841611 00000100:00100000:1.0:1746155642.647320:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17075 00000100:00100000:3.0:1746155642.647321:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125382400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155642.647324:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+93:3295:x1830976125382912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155642.647325:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746155642.647330:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125383040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.647344:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.647361:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125383040 00000100:00100000:3.0:1746155642.647363:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125383040 00000100:00100000:3.0:1746155642.647376:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17076 00000100:00100000:3.0:1746155642.647381:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+99:3295:x1830976125383040:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155642.647387:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+94:3295:x1830976125382912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (93us total) trans 21474841613 rc 0/0 00000100:00100000:1.0:1746155642.647392:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17075 00000100:00100000:3.0:1746155642.647409:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746155642.647410:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c4700/2, rc 0, transno 21474841613 00000100:00100000:1.0:1746155642.647413:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125382912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155642.647422:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125381504:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.647437:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.647445:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125382016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.647457:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.647465:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125382528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.647478:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.647493:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125380992 00000100:00100000:3.0:1746155642.647495:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125380992 00000100:00100000:3.0:1746155642.647520:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125381504 00000100:00100000:3.0:1746155642.647522:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125381504 00000100:00100000:3.0:1746155642.647528:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125382016 00000100:00100000:3.0:1746155642.647530:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125382016 00000100:00100000:3.0:1746155642.647535:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125382528 00000100:00100000:3.0:1746155642.647537:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125382528 00000100:00100000:3.0:1746155642.647543:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17077 00000100:00100000:3.0:1746155642.647548:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+103:3296:x1830976125380992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155642.647627:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155642.647630:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:0.0:1746155642.647632:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155642 -> 1746155642 00002000:00010000:0.0:1746155642.647634:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155643 -> 1746155643 00002000:00010000:0.0:1746155642.647636:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00002000:00010000:3.0:1746155642.647639:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746155642.647641:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:3.0:1746155642.647643:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155642 -> 1746155642 00002000:00010000:3.0:1746155642.647645:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155643 -> 1746155643 00002000:00010000:3.0:1746155642.647647:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:0.0:1746155642.647655:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+93:3297:x1830976125381632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2128us (2577us total) trans 21474841610 rc 0/0 00000100:00100000:0.0:1746155642.647659:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17068 00000100:00100000:3.0:1746155642.647668:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+104:3296:x1830976125380992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (259us total) trans 17179874290 rc 0/0 00000100:00100000:0.0:1746155642.647669:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17078 00000100:00100000:3.0:1746155642.647673:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17077 00000100:00100000:0.0:1746155642.647674:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+104:3296:x1830976125381504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.647683:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17079 00000100:00100000:3.0:1746155642.647687:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+103:3296:x1830976125382016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.647709:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17080 00000100:00100000:3.0:1746155642.647712:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+103:3296:x1830976125382528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155642.647765:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155642.647767:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:0.0:1746155642.647769:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155642 -> 1746155642 00002000:00010000:0.0:1746155642.647771:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155643 -> 1746155643 00002000:00010000:0.0:1746155642.647772:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2077 00000004:00080000:3.0:1746155642.647777:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01d0e00/2, rc 0, transno 17179874290 00000100:00100000:3.0:1746155642.647782:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125380992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.647791:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+93:3295:x1830976125381376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1306us (1360us total) trans 21474841614 rc 0/0 00000100:00100000:0.0:1746155642.647795:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17071 00000100:00100000:3.0:1746155642.647859:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+105:3298:x1830976125381760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2405us (2884us total) trans 17179874291 rc 0/0 00000100:00100000:3.0:1746155642.647864:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17065 00000100:00100000:0.0:1746155642.647877:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+104:3298:x1830976125382272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2401us (2877us total) trans 17179874292 rc 0/0 00000100:00100000:0.0:1746155642.647882:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17066 00000100:00100000:0.0:1746155642.647983:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+93:3295:x1830976125381888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1372us (1501us total) trans 21474841615 rc 0/0 00000100:00100000:0.0:1746155642.647991:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17072 00000100:00100000:0.0:1746155642.648071:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+104:3298:x1830976125382784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 865us (3046us total) trans 17179874293 rc 0/0 00000100:00100000:0.0:1746155642.648076:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17074 00000004:00080000:0.0:1746155642.648103:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fb69880/2, rc 0, transno 17179874291 00000100:00100000:0.0:1746155642.648107:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fb69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125381760:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155642.648114:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c28ea00/2, rc 0, transno 17179874292 00000100:00100000:0.0:1746155642.648117:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125382272:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155642.648123:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c28c700/2, rc 0, transno 17179874293 00000100:00100000:0.0:1746155642.648125:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125382784:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155642.648138:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094e34700/2, rc 0, transno 21474841614 00000100:00100000:0.0:1746155642.648141:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125381376:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155642.648147:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac7800/2, rc 0, transno 21474841615 00000100:00100000:0.0:1746155642.648149:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125381888:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155642.648216:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:0.0:1746155642.648218:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155642.648220:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155642.648221:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155642.648223:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155642.648242:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+93:3297:x1830976125382144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2642us (2810us total) trans 21474841616 rc 0/0 00000100:00100000:0.0:1746155642.648246:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17069 00000004:00080000:0.0:1746155642.648267:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a5f80/2, rc 0, transno 21474841609 00000100:00100000:0.0:1746155642.648270:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125381120:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155642.648277:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac7480/2, rc 0, transno 21474841610 00000100:00100000:0.0:1746155642.648279:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125381632:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155642.648283:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac7b80/2, rc 0, transno 21474841616 00000100:00100000:0.0:1746155642.648286:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125382144:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155642.648291:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c4e00/2, rc 0, transno 21474841612 00000100:00100000:0.0:1746155642.648293:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125382656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155642.649013:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+104:3295:x1830976125383040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1630us (1666us total) trans 17179874294 rc 0/0 00000100:00100000:3.0:1746155642.649019:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17076 00002000:00010000:3.0:1746155642.649090:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:3.0:1746155642.649092:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:3.0:1746155642.649094:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155642 -> 1746155642 00002000:00010000:3.0:1746155642.649449:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155643 -> 1746155643 00002000:00010000:3.0:1746155642.649451:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:3.0:1746155642.649478:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+104:3296:x1830976125381504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1804us (2039us total) trans 17179874295 rc 0/0 00000100:00100000:3.0:1746155642.649483:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17078 00000100:00100000:3.0:1746155642.649572:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+104:3296:x1830976125382016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1884us (2113us total) trans 17179874296 rc 0/0 00000100:00100000:3.0:1746155642.649577:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17079 00000100:00100000:3.0:1746155642.649650:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+104:3296:x1830976125382528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1936us (2170us total) trans 17179874297 rc 0/0 00000100:00100000:3.0:1746155642.649654:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17080 00000004:00080000:3.0:1746155642.649719:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f3ef480/2, rc 0, transno 17179874294 00000100:00100000:3.0:1746155642.649723:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125383040:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155642.649735:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800910da680/2, rc 0, transno 17179874295 00000100:00100000:3.0:1746155642.649738:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125381504:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155642.649744:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c28d880/2, rc 0, transno 17179874296 00000100:00100000:3.0:1746155642.649747:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125382016:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155642.649753:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c28dc00/2, rc 0, transno 17179874297 00000100:00100000:3.0:1746155642.649755:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125382528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.652176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.652197:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126005888 00000100:00100000:0.0:1746155642.652205:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126005888 00000100:00100000:0.0:1746155642.652239:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11137 00000100:00100000:0.0:1746155642.652245:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32361:x1830976126005888:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155642.652266:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.652283:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc000/0x844e5faceb5f7e2f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18279 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.652337:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc000/0x844e5faceb5f7e2f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18279 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.652350:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc000/0x844e5faceb5f7e2f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18279 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.652368:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155642.652371:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155642.652374:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373dc000, rc 0) 00000100:00100000:0.0:1746155642.652411:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32361:x1830976126005888:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 166us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.652419:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11137 00000100:00100000:0.0:1746155642.657084:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.658393:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126006144 00000100:00100000:2.0:1746155642.658403:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126006144 00000100:00100000:2.0:1746155642.658449:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4728 00000100:00100000:2.0:1746155642.658456:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32361:x1830976126006144:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:2.0:1746155642.658716:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32361:x1830976126006144:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 260us (1641us total) trans 8589945297 rc 0/0 00000100:00100000:2.0:1746155642.658727:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4728 00000100:00100000:0.0:1746155642.683794:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.683835:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126006400 00000100:00100000:0.0:1746155642.683845:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126006400 00000100:00100000:0.0:1746155642.683887:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11138 00000100:00100000:0.0:1746155642.683894:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32368:x1830976126006400:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155642.683933:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.683952:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd200/0x844e5faceb5f7e36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18280 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.684057:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7e3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684071:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7e3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684082:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7e3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684093:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc400/0x844e5faceb5f7e44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684099:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc400/0x844e5faceb5f7e44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684104:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc400/0x844e5faceb5f7e44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684205:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd400/0x844e5faceb5f7e4b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684216:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd400/0x844e5faceb5f7e4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684222:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd400/0x844e5faceb5f7e4b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:0.0:1746155642.684231:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155642.684305:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7e3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684311:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7e3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684317:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7e3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684321:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801373dcc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155642.684325:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7e3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684331:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7e3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684342:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155642.684345:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155642.684348:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7e3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684353:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7e3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684364:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc400/0x844e5faceb5f7e44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684372:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc400/0x844e5faceb5f7e44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684376:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc400/0x844e5faceb5f7e44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684380:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801373dc400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155642.684382:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc400/0x844e5faceb5f7e44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684386:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc400/0x844e5faceb5f7e44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684391:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51f00) 00010000:00010000:0.0:1746155642.684392:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155642.684394:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc400/0x844e5faceb5f7e44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684398:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc400/0x844e5faceb5f7e44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.684430:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd200/0x844e5faceb5f7e36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18280 expref: 9 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.684440:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd400/0x844e5faceb5f7e4b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18280 expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.684445:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155642.684447:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155642.684449:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373dd400, rc 0) 00000100:00100000:0.0:1746155642.684518:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32368:x1830976126006400:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 607us (719us total) trans 8589945298 rc 0/0 00000100:00100000:0.0:1746155642.684524:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11138 00000100:00100000:0.0:1746155642.690438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.690475:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126006656 00000100:00100000:0.0:1746155642.690485:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126006656 00000100:00100000:0.0:1746155642.690545:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11139 00000100:00100000:0.0:1746155642.690554:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32372:x1830976126006656:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155642.690582:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.690602:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd000/0x844e5faceb5f7e59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18287 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.690705:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7e60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.690717:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7e60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.690728:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7e60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.690740:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7e67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.690746:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7e67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.690750:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7e67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.690850:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dca00/0x844e5faceb5f7e6e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.690857:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dca00/0x844e5faceb5f7e6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.690863:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dca00/0x844e5faceb5f7e6e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155642.690871:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155642.690966:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7e60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.690972:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7e60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.690978:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7e60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.690982:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801373dc200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155642.690987:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7e60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.690993:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7e60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.691003:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155642.691006:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155642.691009:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7e60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.691015:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7e60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.691024:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7e67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.691028:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7e67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.691037:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7e67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.691041:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801373dd800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155642.691043:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7e67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.691047:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7e67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.691051:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51b00) 00010000:00010000:0.0:1746155642.691053:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155642.691055:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7e67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.691059:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7e67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.691091:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd000/0x844e5faceb5f7e59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18287 expref: 289 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.691100:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dca00/0x844e5faceb5f7e6e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18287 expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.691105:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155642.691107:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155642.691109:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373dca00, rc 0) 00000100:00100000:0.0:1746155642.691154:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32372:x1830976126006656:12345-192.168.202.51@tcp:101:cat.0 Request processed in 601us (726us total) trans 8589945299 rc 0/0 00000100:00100000:0.0:1746155642.691160:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11139 00000100:00100000:0.0:1746155642.695097:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.695144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.695172:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126007168 00000100:00100000:0.0:1746155642.695181:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126007168 00000100:00100000:0.0:1746155642.695223:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11140 00000100:00100000:0.0:1746155642.695231:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32373:x1830976126007168:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155642.695273:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.695292:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373ddc00/0x844e5faceb5f7e7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1828e expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.695389:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f7e83 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.695402:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f7e83 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.695413:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f7e83 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:0.0:1746155642.695424:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155642.695550:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373ddc00/0x844e5faceb5f7e7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1828e expref: 11 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.695567:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f7e83 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1828e expref: 10 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.695575:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155642.695577:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746155642.695581:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373dde00, rc 0) 00000100:00100000:0.0:1746155642.695620:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32373:x1830976126007168:12345-192.168.202.51@tcp:101:cat.0 Request processed in 390us (476us total) trans 8589945300 rc 0/0 00000100:00100000:0.0:1746155642.695628:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11140 00000100:00100000:2.0:1746155642.696009:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126006912 00000100:00100000:2.0:1746155642.696013:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126006912 00000100:00100000:2.0:1746155642.696039:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4729 00000100:00100000:2.0:1746155642.696044:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32372:x1830976126006912:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155642.696137:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32372:x1830976126006912:12345-192.168.202.51@tcp:35:cat.0 Request processed in 93us (1049us total) trans 8589945301 rc 0/0 00000100:00100000:2.0:1746155642.696143:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4729 00000100:00100000:0.0:1746155642.698155:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.698331:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126007296 00000100:00100000:3.0:1746155642.698339:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126007296 00000100:00100000:3.0:1746155642.698380:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17081 00000100:00100000:3.0:1746155642.698387:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32373:x1830976126007296:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155642.698401:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.698419:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f7e91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18295 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.698457:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7dfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1824f expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.698465:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155642.698467:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155642.698470:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f7e91 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18295 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.698500:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7dfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1824f expref: 19 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.698535:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7dfe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1824f expref: 19 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.698552:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125383168:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155642.698647:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.700926:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.700953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.701020:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126007552 00000100:00100000:1.0:1746155642.701027:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126007552 00000100:00100000:1.0:1746155642.701068:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11141 00000100:00100000:1.0:1746155642.701075:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32367:x1830976126007552:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155642.701095:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155642.701112:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7e98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1829c expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.701210:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.701228:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd400/0x844e5faceb5f7e4b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18280 expref: 9 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.701235:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dca00/0x844e5faceb5f7e6e lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18287 expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.701244:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155642.701276:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dca00/0x844e5faceb5f7e6e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18287 expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.701286:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dca00/0x844e5faceb5f7e6e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18287 expref: 290 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.701297:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f57f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125383296:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155642.701370:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd400/0x844e5faceb5f7e4b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18280 expref: 9 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.701378:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd400/0x844e5faceb5f7e4b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18280 expref: 9 pid: 19870 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.701395:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f57e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125383424:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.701411:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024240 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.701926:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126007680 00000100:00100000:3.0:1746155642.701931:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126007680 00000100:00100000:3.0:1746155642.701960:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17082 00000100:00100000:3.0:1746155642.701965:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:32372:x1830976126007680:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155642.702405:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.702419:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fed9800/0x844e5faceb5f7ea6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182a3 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.702438:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155642.702555:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fed9800/0x844e5faceb5f7ea6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182a3 expref: 44 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.702567:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fed9800/0x844e5faceb5f7ea6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182a3 expref: 44 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.702577:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fed9800, rc 0) 00000100:00100000:3.0:1746155642.702623:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125383168:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155642.702702:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f7e91 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18295 expref: 20 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.702710:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fed9000, rc 0) 00000100:00100000:3.0:1746155642.702737:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32373:x1830976126007296:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4351us (4587us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.702742:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17081 00000100:00100000:3.0:1746155642.702769:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:32372:x1830976126007680:12345-192.168.202.51@tcp:101:cat.0 Request processed in 804us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.702774:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17082 00000100:00100000:0.0:1746155642.705686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.709689:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126007808 00000100:00100000:3.0:1746155642.709704:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126007808 00010000:00010000:3.0:1746155642.709755:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dca00/0x844e5faceb5f7e6e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18287 expref: 291 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.709791:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8759 00000100:00100000:3.0:1746155642.709799:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1960:x1830976126007808:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.709813:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.709819:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dca00/0x844e5faceb5f7e6e lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18287 expref: 291 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.709830:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dca00/0x844e5faceb5f7e6e lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18287 expref: 291 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.709853:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.709857:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.709865:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.709871:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.709930:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1960:x1830976126007808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 132us (4253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.709937:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8759 00000100:00100000:3.0:1746155642.710854:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155642.711082:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dca00/0x844e5faceb5f7e6e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18287 expref: 290 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.711097:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f57f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125383296:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155642.711107:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f57e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125383424:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155642.711127:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155642.711149:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126007936 00000100:00100000:3.0:1746155642.711154:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126007936 00000100:00100000:0.0:1746155642.711161:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155642.711168:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd400/0x844e5faceb5f7e4b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18280 expref: 10 pid: 19870 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.711176:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126008064 00000100:00100000:0.0:1746155642.711179:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126008064 00000100:00100000:3.0:1746155642.711190:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8760 00010000:00010000:0.0:1746155642.711195:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7dfe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1824f expref: 20 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.711196:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126007936:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.711203:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.711206:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd400/0x844e5faceb5f7e4b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18280 expref: 10 pid: 19870 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.711213:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8761 00010000:00010000:3.0:1746155642.711214:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd400/0x844e5faceb5f7e4b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18280 expref: 10 pid: 19870 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.711219:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1961:x1830976126008064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.711226:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd400/0x844e5faceb5f7e4b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18280 expref: 10 pid: 19870 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.711226:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.711239:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155642.711243:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.711248:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7dfe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1824f expref: 20 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.711250:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155642.711256:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.711256:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7dfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1824f expref: 20 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:3.0:1746155642.711270:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155642.711274:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a608600/0x844e5faceb5f7dfe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1824f expref: 20 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.711283:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.711285:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155642.711288:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976126007936:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 92us (434us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155642.711291:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f7e91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18295 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.711293:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8760 00010000:00010000:0.0:1746155642.711298:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f7e91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18295 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.711304:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.711305:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.711308:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fed9800/0x844e5faceb5f7ea6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182a3 expref: 43 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.711313:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fed9800/0x844e5faceb5f7ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182a3 expref: 43 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.711335:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fed9800/0x844e5faceb5f7ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182a3 expref: 43 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.714357:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125383552:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155642.714539:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155642.714548:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155642.714571:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155642.714707:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad800/0x844e5faceb5f7e98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1829c expref: 291 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.714724:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1829c expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.714733:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155642.714736:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155642.714739:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b180200, rc 0) 00000100:00100000:0.0:1746155642.714786:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32367:x1830976126007552:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 13710us (13866us total) trans 8589945302 rc 0/0 00000100:00100000:0.0:1746155642.714794:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11141 00010000:00010000:0.0:1746155642.714926:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f7e91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18295 expref: 19 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.714938:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125383680:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155642.714955:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012bf20300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.719256:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125383552:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155642.719271:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125383680:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155642.719292:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155642.719337:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1961:x1830976126008064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8117us (8174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.719349:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8761 00000100:00100000:0.0:1746155642.725811:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.725850:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.725884:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126008192 00000100:00100000:0.0:1746155642.725893:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126008192 00000100:00100000:0.0:1746155642.725949:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11142 00000100:00100000:0.0:1746155642.725957:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32372:x1830976126008192:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155642.725982:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.726001:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7eb4 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182aa expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.726064:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182aa expref: 291 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.726077:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182aa expref: 291 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.726097:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155642.726099:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155642.726103:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373dcc00, rc 0) 00000100:00100000:0.0:1746155642.726149:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32372:x1830976126008192:12345-192.168.202.51@tcp:101:cat.0 Request processed in 192us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.726155:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11142 00000100:00100000:1.0:1746155642.726464:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126008448 00000100:00100000:1.0:1746155642.726468:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126008448 00002000:00100000:1.0:1746155642.726500:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880095269500 x1830976126008448/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.726526:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269500 with x1830976126008448 ext(0->1048575) 00002000:00010000:1.0:1746155642.726530:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095269500 00000100:00100000:1.0:1746155642.726864:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8097 00000100:00100000:1.0:1746155642.726881:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1962:x1830976126008448:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155642.731395:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.732443:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126008704 00000100:00100000:3.0:1746155642.732453:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126008704 00002000:00100000:3.0:1746155642.732496:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f57f100 x1830976126008704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.732522:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57f100 with x1830976126008704 ext(0->1048575) 00002000:00010000:3.0:1746155642.732527:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f57f100 00000100:00100000:3.0:1746155642.732552:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8098 00000100:00100000:3.0:1746155642.732561:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1963:x1830976126008704:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155642.745810:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1962:x1830976126008448:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18926us (19944us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155642.745822:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8097 00002000:00100000:1.0:1746155642.745833:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880095269500 x1830976126008448/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.745843:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269500 with x1830976126008448 ext(0->1048575) 00002000:00010000:1.0:1746155642.745849:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880095269500 00000100:00100000:3.0:1746155642.751780:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1963:x1830976126008704:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19212us (20383us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155642.751794:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8098 00002000:00100000:3.0:1746155642.751807:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f57f100 x1830976126008704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.751816:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57f100 with x1830976126008704 ext(0->1048575) 00002000:00010000:3.0:1746155642.751821:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f57f100 00000100:00100000:1.0:1746155642.765929:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.765983:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126008832 00000100:00100000:3.0:1746155642.765993:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126008832 00000100:00100000:3.0:1746155642.766049:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17083 00000100:00100000:3.0:1746155642.766058:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:32372:x1830976126008832:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155642.766569:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.766587:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0611600/0x844e5faceb5f7ebb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182b1 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.766617:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7e05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18256 expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.766625:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155642.766628:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155642.766631:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0611600/0x844e5faceb5f7ebb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b1 expref: 29 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.767787:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7e05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18256 expref: 20 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.767801:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7e05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18256 expref: 20 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:3.0:1746155642.767815:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125383808:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155642.767904:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8801309496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.769861:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.769888:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126008960 00000100:00100000:0.0:1746155642.769895:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126008960 00000100:00100000:0.0:1746155642.769941:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17084 00000100:00100000:0.0:1746155642.769968:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:32373:x1830976126008960:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155642.770056:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.770072:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7ec2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182b8 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.770103:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155642.770109:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7ec2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b8 expref: 34 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.770119:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7ec2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b8 expref: 34 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.770130:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373dd800, rc 0) 00000100:00100000:0.0:1746155642.770170:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:32373:x1830976126008960:12345-192.168.202.51@tcp:101:cat.0 Request processed in 222us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.770177:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17084 00000100:00100000:2.0:1746155642.770648:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125383808:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.770670:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0611600/0x844e5faceb5f7ebb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b1 expref: 29 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.770679:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0611600, rc 0) 00000100:00100000:2.0:1746155642.770711:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:32372:x1830976126008832:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4654us (4800us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.770717:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17083 00000100:00100000:0.0:1746155642.771653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.771674:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126009088 00000100:00100000:0.0:1746155642.771678:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126009088 00010000:00010000:0.0:1746155642.771696:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7e05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18256 expref: 21 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.771717:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8762 00000100:00100000:0.0:1746155642.771723:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+21:1962:x1830976126009088:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155642.771733:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155642.771756:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7e05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18256 expref: 21 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.771767:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7e05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18256 expref: 21 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.771793:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a608200/0x844e5faceb5f7e05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18256 expref: 21 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.771801:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.771803:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.771808:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0611600/0x844e5faceb5f7ebb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b1 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.771816:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0611600/0x844e5faceb5f7ebb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b1 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.771823:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.771824:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.771827:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7ec2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b8 expref: 33 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.771834:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7ec2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b8 expref: 33 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.771859:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7ec2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b8 expref: 33 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.771871:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125383936:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155642.771949:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0611600/0x844e5faceb5f7ebb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b1 expref: 28 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.771962:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125384064:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155642.773607:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.775222:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125383936:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155642.783770:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.792154:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126009344 00000100:00100000:3.0:1746155642.792168:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126009344 00002000:00100000:3.0:1746155642.792223:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009526ad80 x1830976126009344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.792233:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526ad80 with x1830976126009344 ext(1048576->2097151) 00002000:00010000:3.0:1746155642.792239:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009526ad80 00000100:00100000:3.0:1746155642.792264:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8099 00000100:00100000:3.0:1746155642.792271:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976126009344:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155642.792388:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.792440:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:15879:1830976125384064:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155642.792463:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155642.792526:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+20:1962:x1830976126009088:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 20801us (20873us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.792528:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126009600 00000100:00100000:3.0:1746155642.792532:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126009600 00000100:00100000:0.0:1746155642.792535:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8762 00002000:00100000:3.0:1746155642.792547:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009526aa00 x1830976126009600/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.792554:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526aa00 with x1830976126009600 ext(1048576->2097151) 00002000:00010000:3.0:1746155642.792559:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009526aa00 00000100:00100000:3.0:1746155642.792571:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8100 00000100:00100000:3.0:1746155642.792576:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1963:x1830976126009600:12345-192.168.202.51@tcp:3:cat.0 00000001:00080000:1.0:1746155642.798804:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841605 is committed 00000001:00080000:1.0:1746155642.798845:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841538 is committed 00000001:00080000:1.0:1746155642.798872:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841607 is committed 00000001:00080000:1.0:1746155642.798884:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841595 is committed 00000001:00080000:1.0:1746155642.798893:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841594 is committed 00000001:00080000:1.0:1746155642.798969:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841596 is committed 00000001:00080000:1.0:1746155642.799074:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841608 is committed 00000001:00080000:1.0:1746155642.799078:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841597 is committed 00000100:00100000:0.0:1746155642.809765:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.809796:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126009856 00000100:00100000:0.0:1746155642.809805:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126009856 00000100:00100000:0.0:1746155642.809857:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11143 00000100:00100000:0.0:1746155642.809866:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32368:x1830976126009856:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155642.810785:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.810791:0:19870:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746155642.810821:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f7e83 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1828e expref: 9 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.810838:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155642.810842:0:19870:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155642.811079:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd400/0x844e5faceb5f7ec9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182bf expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.811143:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.811155:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc000/0x844e5faceb5f7e2f lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18279 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.811162:0:19870:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7eb4 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182aa expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.811169:0:19870:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.811200:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7eb4 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182aa expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.811213:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7eb4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182aa expref: 290 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.811225:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125384192:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155642.811303:0:19870:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc000/0x844e5faceb5f7e2f lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18279 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.811312:0:19870:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc000/0x844e5faceb5f7e2f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18279 expref: 7 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.811321:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125384320:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155642.811341:0:19870:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155642.811652:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1963:x1830976126009600:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19073us (19262us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155642.811662:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8100 00002000:00100000:3.0:1746155642.811671:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009526aa00 x1830976126009600/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.811680:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526aa00 with x1830976126009600 ext(1048576->2097151) 00002000:00010000:3.0:1746155642.811684:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009526aa00 00000100:00100000:1.0:1746155642.816856:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.816900:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.816933:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126009984 00000100:00100000:1.0:1746155642.816941:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126009984 00010000:00010000:1.0:1746155642.816980:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc000/0x844e5faceb5f7e2f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18279 expref: 8 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.817004:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126010112 00000100:00100000:1.0:1746155642.817006:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126010112 00010000:00010000:1.0:1746155642.817016:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7eb4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182aa expref: 291 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:1.0:1746155642.817030:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8763 00000100:00100000:1.0:1746155642.817037:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126009984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.817049:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.817055:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc000/0x844e5faceb5f7e2f lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18279 expref: 8 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.817065:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc000/0x844e5faceb5f7e2f lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18279 expref: 8 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.817087:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155642.817092:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155642.817099:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155642.817105:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155642.817143:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126009984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 107us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.817149:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8763 00000100:00100000:1.0:1746155642.817163:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8764 00000100:00100000:1.0:1746155642.817168:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1961:x1830976126010112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.817174:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.817177:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7eb4 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182aa expref: 291 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.817185:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7eb4 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182aa expref: 291 pid: 20364 timeout: 871 lvb_type: 0 00010000:00010000:1.0:1746155642.817194:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155642.817197:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155642.817203:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155642.817210:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 19870 initiator: MDT0 00010000:00010000:1.0:1746155642.817226:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155642.817237:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1961:x1830976126010112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 69us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.817242:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8764 00010000:00010000:0.0:1746155642.817390:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dcc00/0x844e5faceb5f7eb4 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182aa expref: 290 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.817409:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526b800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125384192:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155642.817425:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc000/0x844e5faceb5f7e2f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18279 expref: 7 pid: 20364 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.817434:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125384320:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155642.817455:0:19870:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.817464:0:19870:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.817469:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000040:00080000:0.0:1746155642.818280:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3617, 88 off305216 00000004:00080000:0.0:1746155642.818288:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771967784015ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155642.818372:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3618, 88 off305568 00000004:00080000:0.0:1746155642.818377:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771967874378ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155642.818397:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3619, 88 off305656 00000004:00080000:0.0:1746155642.818401:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771967897837ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155642.818411:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3618, 88 off305304 00000004:00080000:0.0:1746155642.818415:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771967912255ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155642.818424:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3619, 88 off305392 00000004:00080000:0.0:1746155642.818428:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771967924715ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155642.818436:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3620, 88 off305744 00000004:00080000:0.0:1746155642.818439:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771967935725ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155642.818447:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3621, 88 off305832 00000004:00080000:0.0:1746155642.818450:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771967947173ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155642.818458:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3622, 88 off305920 00000004:00080000:0.0:1746155642.818462:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771967959027ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155642.818471:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3620, 88 off305480 00000004:00080000:0.0:1746155642.818474:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771967970565ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155642.818482:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3623, 88 off306008 00000004:00080000:0.0:1746155642.818485:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771967981603ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155642.818493:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3621, 88 off305568 00000004:00080000:0.0:1746155642.818497:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771967993585ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155642.818579:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3624, 88 off306096 00000004:00080000:0.0:1746155642.818586:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771968082585ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155642.818599:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3622, 88 off305656 00000004:00080000:0.0:1746155642.818603:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771968100018ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155642.818612:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3623, 88 off305744 00000004:00080000:0.0:1746155642.818615:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771968112013ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155642.818623:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3624, 88 off305832 00000004:00080000:0.0:1746155642.818626:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771968122955ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155642.818633:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3625, 88 off305920 00000004:00080000:0.0:1746155642.818636:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 771968133388ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155642.818697:0:19870:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3625, 88 off306184 00000004:00080000:0.0:1746155642.818702:0:19870:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 771968199430ns, next at 716011101328ns, rc = 0 00000100:00100000:0.0:1746155642.827237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.831584:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126010240 00000100:00100000:2.0:1746155642.831599:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126010240 00000100:00100000:2.0:1746155642.831666:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17085 00000100:00100000:2.0:1746155642.831677:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32373:x1830976126010240:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155642.831698:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.831719:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0x844e5faceb5f7ed7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182c6 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.831754:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7e0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1825d expref: 7 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.831763:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155642.831765:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155642.831769:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0x844e5faceb5f7ed7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182c6 expref: 7 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.831806:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7e0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1825d expref: 7 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.831820:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7e0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1825d expref: 7 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:2.0:1746155642.831834:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125384448:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.831948:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.834355:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+11:1960:x1830976126009344:12345-192.168.202.51@tcp:3:cat.0 Request processed in 42077us (50586us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155642.834372:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8099 00002000:00100000:2.0:1746155642.834385:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009526ad80 x1830976126009344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.834395:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526ad80 with x1830976126009344 ext(1048576->2097151) 00002000:00010000:2.0:1746155642.834401:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009526ad80 00000100:00100000:0.0:1746155642.843083:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.843087:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125384448:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155642.843110:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126010368 00010000:00010000:2.0:1746155642.843116:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0x844e5faceb5f7ed7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182c6 expref: 7 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.843116:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126010368 00010000:00010000:2.0:1746155642.843140:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090486a00, rc 0) 00010000:00010000:0.0:1746155642.843144:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7e0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1825d expref: 8 pid: 18270 timeout: 871 lvb_type: 0 00000100:00100000:0.0:1746155642.843175:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8765 00000100:00100000:2.0:1746155642.843183:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32373:x1830976126010240:12345-192.168.202.51@tcp:101:cat.0 Request processed in 11509us (15957us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.843183:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976126010368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155642.843190:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17085 00010000:00010000:0.0:1746155642.843196:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746155642.843215:0:9789:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2077 -> 2081 00010000:00010000:0.0:1746155642.843221:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7e0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1825d expref: 8 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.843232:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7e0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1825d expref: 8 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.843255:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a609400/0x844e5faceb5f7e0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1825d expref: 8 pid: 18270 timeout: 871 lvb_type: 0 00010000:00010000:0.0:1746155642.843265:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.843267:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.843274:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0x844e5faceb5f7ed7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182c6 expref: 6 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.843282:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0x844e5faceb5f7ed7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182c6 expref: 6 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.843310:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0x844e5faceb5f7ed7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182c6 expref: 6 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.843322:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125384576:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155642.843368:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.849320:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.849356:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126010496 00000100:00100000:2.0:1746155642.849365:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126010496 00000100:00100000:2.0:1746155642.849407:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17086 00000100:00100000:2.0:1746155642.849415:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+11:32372:x1830976126010496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155642.849432:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.849449:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7ede lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182cd expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.849474:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.849475:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155642.849482:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7ede lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182cd expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.849498:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7ede lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182cd expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.849606:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090487400, rc 0) 00000100:00100000:2.0:1746155642.849653:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:32372:x1830976126010496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 238us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.849659:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17086 00000100:00100000:0.0:1746155642.853736:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.853781:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125384576:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155642.853799:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155642.853838:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126010368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10654us (10764us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.853848:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8765 00000100:00100000:0.0:1746155642.853884:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126010624 00000100:00100000:0.0:1746155642.853889:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126010624 00000100:00100000:0.0:1746155642.853927:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11144 00000100:00100000:0.0:1746155642.853934:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32373:x1830976126010624:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155642.853951:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.853969:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182d4 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.854034:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.854043:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.854060:0:20364:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19870 initiator: MDT0 00010000:00010000:0.0:1746155642.854069:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.854086:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155642.854089:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155642.854093:0:20364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.854099:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f458a00, rc 0) 00000100:00100000:0.0:1746155642.854114:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32373:x1830976126010624:12345-192.168.202.51@tcp:101:cat.0 Request processed in 181us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.854119:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11144 00000100:00100000:0.0:1746155642.857855:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.857885:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126010752 00000100:00100000:0.0:1746155642.857892:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126010752 00000100:00100000:0.0:1746155642.857957:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11145 00000100:00100000:0.0:1746155642.857965:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32372:x1830976126010752:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155642.857983:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.858003:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182db expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.858058:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182db expref: 291 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.858069:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182db expref: 291 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.858081:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155642.858084:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155642.858089:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.858096:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f459a00, rc 0) 00000100:00100000:0.0:1746155642.858133:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32372:x1830976126010752:12345-192.168.202.51@tcp:101:cat.0 Request processed in 170us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.858139:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11145 00010000:00010000:0.0:1746155642.875094:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182bf expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.875107:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155642.875110:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746155642.875114:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.875289:0:19870:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.875297:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.875305:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182db expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.875311:0:19870:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182db expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.875316:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182db expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.875347:0:19870:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182db expref: 290 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.875358:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125384704:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155642.875439:0:19870:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.875447:0:19870:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125384832:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155642.875464:0:19870:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024f00 going to sleep for 11 seconds 00000001:00080000:0.0:1746155642.875480:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945303 is committed 00000004:00080000:0.0:1746155642.875485:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2809 committed 00000004:00080000:0.0:1746155642.875491:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2803 committed 00000004:00080000:0.0:1746155642.875496:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2802 committed 00000004:00080000:0.0:1746155642.875497:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2801 committed 00000004:00080000:0.0:1746155642.875498:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2800 committed 00000004:00080000:0.0:1746155642.875500:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2808 committed 00000004:00080000:0.0:1746155642.875523:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2799 committed 00000004:00080000:0.0:1746155642.875526:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2807 committed 00000004:00080000:0.0:1746155642.875528:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2798 committed 00000004:00080000:0.0:1746155642.875530:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2806 committed 00000004:00080000:0.0:1746155642.875531:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2805 committed 00000004:00080000:0.0:1746155642.875532:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2804 committed 00000004:00080000:0.0:1746155642.875534:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2797 committed 00000004:00080000:0.0:1746155642.875535:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2796 committed 00000004:00080000:0.0:1746155642.875537:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2803 committed 00000004:00080000:0.0:1746155642.875539:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2802 committed 00000004:00080000:0.0:1746155642.875541:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2795 committed 00000001:00080000:0.0:1746155642.875547:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945302 is committed 00000001:00080000:0.0:1746155642.875560:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945297 is committed 00000100:00100000:0.0:1746155642.877200:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125384960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.877239:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155642.877258:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125385472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.877271:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155642.877284:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125385984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.877298:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155642.877299:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125384960 00000100:00100000:0.0:1746155642.877309:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125386496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155642.877310:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125384960 00000100:00100000:0.0:1746155642.877320:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155642.877334:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746155642.877338:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125385088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.877349:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155642.877359:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125385600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155642.877362:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125385472 00000100:00100000:1.0:1746155642.877364:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125385472 00000100:00100000:0.0:1746155642.877375:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155642.877380:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125385984 00000100:00100000:1.0:1746155642.877383:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125385984 00000100:00100000:0.0:1746155642.877384:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125386112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155642.877397:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125386496 00000100:00100000:1.0:1746155642.877399:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125386496 00000100:00100000:0.0:1746155642.877402:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155642.877414:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125385088 00000100:00100000:1.0:1746155642.877416:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125385088 00000100:00100000:0.0:1746155642.877416:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125386624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155642.877428:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125385600 00000100:00100000:0.0:1746155642.877429:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155642.877430:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125385600 00000100:00100000:1.0:1746155642.877438:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125386112 00000100:00100000:1.0:1746155642.877440:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125386112 00000100:00100000:1.0:1746155642.877449:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125386624 00000100:00100000:1.0:1746155642.877451:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125386624 00000100:00100000:0.0:1746155642.877457:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17087 00000100:00100000:1.0:1746155642.877467:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17088 00000100:00100000:0.0:1746155642.877468:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+16:3297:x1830976125384960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155642.877474:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3297:x1830976125385472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155642.877643:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17089 00000100:00100000:2.0:1746155642.877651:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+107:3297:x1830976125385984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155642.877829:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155642.877832:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:2.0:1746155642.877834:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155642 -> 1746155642 00002000:00010000:2.0:1746155642.877836:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155643 -> 1746155643 00002000:00010000:2.0:1746155642.877838:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:2.0:1746155642.877887:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+108:3297:x1830976125385984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 237us (588us total) trans 17179874298 rc 0/0 00002000:00010000:0.0:1746155642.877891:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746155642.877894:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17089 00002000:00010000:0.0:1746155642.877895:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:0.0:1746155642.877897:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155642 -> 1746155642 00002000:00010000:0.0:1746155642.877899:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155643 -> 1746155643 00002000:00010000:0.0:1746155642.877901:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2081 -> 2079 00000100:00100000:2.0:1746155642.877920:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17090 00000100:00100000:2.0:1746155642.877925:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+107:3297:x1830976125386496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.877937:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3297:x1830976125384960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 473us (698us total) trans 21474841617 rc 0/0 00000100:00100000:0.0:1746155642.877944:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17087 00000100:00100000:2.0:1746155642.878008:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+108:3297:x1830976125386496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (686us total) trans 17179874299 rc 0/0 00000100:00100000:2.0:1746155642.878013:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17090 00000100:00100000:2.0:1746155642.878022:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17091 00000100:00100000:2.0:1746155642.878026:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3297:x1830976125385088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155642.878098:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155642.878101:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:2.0:1746155642.878103:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155642 -> 1746155642 00002000:00010000:2.0:1746155642.878104:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155643 -> 1746155643 00002000:00010000:2.0:1746155642.878106:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155642.878123:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3297:x1830976125385088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (773us total) trans 21474841618 rc 0/0 00000100:00100000:0.0:1746155642.878125:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17092 00000100:00100000:2.0:1746155642.878129:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17091 00000100:00100000:0.0:1746155642.878132:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3297:x1830976125385600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155642.878140:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17093 00000100:00100000:2.0:1746155642.878145:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+107:3297:x1830976125386112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.878218:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+17:3297:x1830976125385600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (841us total) trans 21474841619 rc 0/0 00002000:00010000:2.0:1746155642.878222:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155642.878224:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00000100:00100000:0.0:1746155642.878224:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17092 00002000:00010000:2.0:1746155642.878226:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155642 -> 1746155642 00002000:00010000:2.0:1746155642.878228:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155643 -> 1746155643 00002000:00010000:2.0:1746155642.878229:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155642.878236:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17094 00000100:00100000:0.0:1746155642.878241:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+108:3297:x1830976125386624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.878249:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+108:3297:x1830976125386112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (845us total) trans 17179874300 rc 0/0 00000100:00100000:2.0:1746155642.878255:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17093 00000100:00100000:0.0:1746155642.878342:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+108:3297:x1830976125386624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (911us total) trans 17179874301 rc 0/0 00000100:00100000:0.0:1746155642.878347:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17094 00000100:00100000:0.0:1746155642.878413:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.878469:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.878486:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126010880 00000100:00100000:0.0:1746155642.878491:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126010880 00002000:00010000:1.0:1746155642.878550:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:1.0:1746155642.878555:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155642.878557:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746155642.878559:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155642.878561:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155642.878563:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126011008 00000100:00100000:0.0:1746155642.878566:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126011008 00000100:00100000:0.0:1746155642.878583:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4730 00000100:00100000:0.0:1746155642.878588:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32373:x1830976126010880:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:0.0:1746155642.878652:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32373:x1830976126010880:12345-192.168.202.51@tcp:49:cat.0 Request processed in 63us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.878658:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4730 00000100:00100000:0.0:1746155642.878668:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4731 00000100:00100000:0.0:1746155642.878674:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094619850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32372:x1830976126011008:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:1.0:1746155642.878676:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3297:x1830976125385472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1203us (1403us total) trans 21474841620 rc 0/0 00000100:00100000:1.0:1746155642.878683:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17088 00000100:00100000:0.0:1746155642.878729:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094619850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32372:x1830976126011008:12345-192.168.202.51@tcp:49:cat.0 Request processed in 54us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.878734:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4731 00000100:00100000:0.0:1746155642.879102:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841605 gen 2 00000004:00080000:0.0:1746155642.879107:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c2bdc00, transno 21474841498 00000004:00080000:0.0:1746155642.879113:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c2bd880, transno 21474841499 00000004:00080000:0.0:1746155642.879115:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c2be680, transno 21474841500 00000004:00080000:0.0:1746155642.879117:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c2bed80, transno 21474841501 00000004:00080000:0.0:1746155642.879119:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c2bdf80, transno 21474841502 00000004:00080000:0.0:1746155642.879121:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c2bc380, transno 21474841503 00000004:00080000:0.0:1746155642.879123:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c2bc700, transno 21474841504 00000004:00080000:0.0:1746155642.879124:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c2bd500, transno 21474841505 00000004:00080000:0.0:1746155642.879126:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a1180, transno 21474841509 00000004:00080000:0.0:1746155642.879128:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fc700, transno 21474841510 00000004:00080000:0.0:1746155642.879130:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a1500, transno 21474841511 00000004:00080000:0.0:1746155642.879132:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a0380, transno 21474841512 00000004:00080000:0.0:1746155642.879134:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fce00, transno 21474841513 00000004:00080000:0.0:1746155642.879136:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fd180, transno 21474841514 00000004:00080000:0.0:1746155642.879138:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a1880, transno 21474841515 00000004:00080000:0.0:1746155642.879140:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a62a3100, transno 21474841516 00000004:00080000:0.0:1746155642.879141:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e36300, transno 21474841517 00000004:00080000:0.0:1746155642.879144:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009045fb80, transno 21474841518 00000004:00080000:0.0:1746155642.879145:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e34000, transno 21474841519 00000004:00080000:0.0:1746155642.879147:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009045c700, transno 21474841520 00000004:00080000:0.0:1746155642.879149:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e37480, transno 21474841521 00000004:00080000:0.0:1746155642.879151:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009045c000, transno 21474841522 00000004:00080000:0.0:1746155642.879153:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e37100, transno 21474841523 00000004:00080000:0.0:1746155642.879155:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009045e300, transno 21474841524 00000004:00080000:0.0:1746155642.879157:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366c380, transno 21474841529 00000004:00080000:0.0:1746155642.879159:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366f480, transno 21474841530 00000004:00080000:0.0:1746155642.879161:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366ca80, transno 21474841531 00000004:00080000:0.0:1746155642.879163:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366f100, transno 21474841532 00000004:00080000:0.0:1746155642.879164:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366c000, transno 21474841533 00000004:00080000:0.0:1746155642.879166:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366ed80, transno 21474841534 00000004:00080000:0.0:1746155642.879168:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366e680, transno 21474841535 00000004:00080000:0.0:1746155642.879169:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366ea00, transno 21474841536 00000004:00080000:0.0:1746155642.879171:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a5180, transno 21474841540 00000004:00080000:0.0:1746155642.879173:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a4700, transno 21474841541 00000004:00080000:0.0:1746155642.879175:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc52680, transno 21474841542 00000004:00080000:0.0:1746155642.879177:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc50a80, transno 21474841543 00000004:00080000:0.0:1746155642.879179:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a5500, transno 21474841544 00000004:00080000:0.0:1746155642.879181:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc53800, transno 21474841545 00000004:00080000:0.0:1746155642.879183:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a6300, transno 21474841546 00000004:00080000:0.0:1746155642.879184:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc53b80, transno 21474841547 00000004:00080000:0.0:1746155642.879186:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26c380, transno 21474841548 00000004:00080000:0.0:1746155642.879188:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26f100, transno 21474841549 00000004:00080000:0.0:1746155642.879190:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26e300, transno 21474841550 00000004:00080000:0.0:1746155642.879192:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26e680, transno 21474841551 00000004:00080000:0.0:1746155642.879194:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26ea00, transno 21474841552 00000004:00080000:0.0:1746155642.879196:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26d180, transno 21474841553 00000004:00080000:0.0:1746155642.879198:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26d500, transno 21474841554 00000004:00080000:0.0:1746155642.879200:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26df80, transno 21474841555 00000004:00080000:0.0:1746155642.879202:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf4a80, transno 21474841567 00000004:00080000:0.0:1746155642.879203:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf5880, transno 21474841568 00000004:00080000:0.0:1746155642.879205:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf4e00, transno 21474841569 00000004:00080000:0.0:1746155642.879207:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f703480, transno 21474841570 00000004:00080000:0.0:1746155642.879209:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f701c00, transno 21474841571 00000004:00080000:0.0:1746155642.879212:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf6a00, transno 21474841572 00000004:00080000:0.0:1746155642.879214:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf7b80, transno 21474841573 00000004:00080000:0.0:1746155642.879215:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f700000, transno 21474841574 00000004:00080000:0.0:1746155642.879217:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f881500, transno 21474841578 00000004:00080000:0.0:1746155642.879219:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f883800, transno 21474841579 00000004:00080000:0.0:1746155642.879221:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f881c00, transno 21474841580 00000004:00080000:0.0:1746155642.879222:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f880000, transno 21474841581 00000004:00080000:0.0:1746155642.879224:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f880700, transno 21474841582 00000004:00080000:0.0:1746155642.879225:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f881880, transno 21474841583 00000004:00080000:0.0:1746155642.879227:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f882680, transno 21474841584 00000004:00080000:0.0:1746155642.879229:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f880380, transno 21474841585 00000004:00080000:0.0:1746155642.879231:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac6300, transno 21474841586 00000004:00080000:0.0:1746155642.879233:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac5500, transno 21474841587 00000004:00080000:0.0:1746155642.879234:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac6680, transno 21474841588 00000004:00080000:0.0:1746155642.879236:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b883480, transno 21474841589 00000004:00080000:0.0:1746155642.879238:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac4a80, transno 21474841590 00000004:00080000:0.0:1746155642.879240:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac7100, transno 21474841591 00000004:00080000:0.0:1746155642.879242:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac4380, transno 21474841592 00000004:00080000:0.0:1746155642.879244:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac6a00, transno 21474841593 00000004:00080000:0.0:1746155642.879246:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26f480, transno 21474841598 00000004:00080000:0.0:1746155642.879248:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910caa00, transno 21474841599 00000004:00080000:0.0:1746155642.879249:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca96a00, transno 21474841600 00000004:00080000:0.0:1746155642.879251:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910cb800, transno 21474841601 00000004:00080000:0.0:1746155642.879253:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26ca80, transno 21474841602 00000004:00080000:0.0:1746155642.879255:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca95880, transno 21474841603 00000004:00080000:0.0:1746155642.879257:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910c9880, transno 21474841604 00000004:00080000:0.0:1746155642.879259:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366ce00, transno 21474841605 00000100:00100000:0.0:1746155642.879264:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800a06a5f80 x1830976125381120/t21474841609(21474841609) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746155658 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746155642.879272:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6061180/2, rc 0, transno 21474841618 00000100:00100000:0.0:1746155642.879276:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125385088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155642.879278:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125385216:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155642.879286:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa34700/2, rc 0, transno 21474841619 00000100:00100000:0.0:1746155642.879288:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125385600:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155642.879297:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa35500/2, rc 0, transno 17179874300 00000100:00100000:0.0:1746155642.879302:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125386112:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155642.879307:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa36300/2, rc 0, transno 17179874301 00000100:00100000:0.0:1746155642.879310:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125386624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.879313:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155642.879316:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc50380/2, rc 0, transno 21474841617 00000100:00100000:0.0:1746155642.879318:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125384960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155642.879325:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa34380/2, rc 0, transno 21474841620 00000100:00100000:0.0:1746155642.879327:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125385472:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155642.879333:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa35180/2, rc 0, transno 17179874298 00000100:00100000:0.0:1746155642.879335:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125385984:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155642.879341:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa35f80/2, rc 0, transno 17179874299 00000100:00100000:0.0:1746155642.879343:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125386496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.879377:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746155642.879385:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125387008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.879414:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125384704:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155642.879421:0:19870:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19870:1830976125384832:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155642.879444:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd400/0x844e5faceb5f7ec9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182bf expref: 9 pid: 19870 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746155642.879458:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182bf expref: 8 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.879474:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373dc200, rc 0) 00000100:00100000:0.0:1746155642.879493:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32368:x1830976126009856:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 69629us (69738us total) trans 8589945303 rc 0/0 00000100:00100000:0.0:1746155642.879499:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11143 00000004:00080000:0.0:1746155642.879837:0:14274:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 16 in progress, 4 in flight, 80 done 00000100:00100000:3.0:1746155642.879942:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125385728:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155642.879960:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.879983:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125386240:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.880000:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.880010:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125386752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.880024:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.880037:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1746155642.880043:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125385344:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155642.880057:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.880067:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125385856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155642.880078:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.880087:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125386368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.880100:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155642.880108:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125386880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155642.880120:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155642.880175:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125385216 00000100:00100000:1.0:1746155642.880179:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125385216 00000100:00100000:1.0:1746155642.880197:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125385728 00000100:00100000:1.0:1746155642.880199:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125385728 00000100:00100000:1.0:1746155642.880207:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125386240 00000100:00100000:1.0:1746155642.880209:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125386240 00000100:00100000:1.0:1746155642.880218:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125386752 00000100:00100000:1.0:1746155642.880220:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125386752 00000100:00100000:2.0:1746155642.880419:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125385344 00000100:00100000:2.0:1746155642.880423:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125385344 00000100:00100000:2.0:1746155642.880436:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125385856 00000100:00100000:2.0:1746155642.880437:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125385856 00000100:00100000:2.0:1746155642.880443:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125386368 00000100:00100000:2.0:1746155642.880444:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125386368 00000100:00100000:2.0:1746155642.880450:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125386880 00000100:00100000:2.0:1746155642.880451:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125386880 00000100:00100000:2.0:1746155642.880459:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17095 00000100:00100000:2.0:1746155642.880464:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976125385216:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155642.880523:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17096 00000100:00100000:2.0:1746155642.880528:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976125385728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155642.880679:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17097 00000100:00100000:0.0:1746155642.880704:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17098 00000100:00100000:0.0:1746155642.880713:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+111:3295:x1830976125386752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.881156:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976125385728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 627us (1194us total) trans 21474841621 rc 0/0 00000100:00100000:0.0:1746155642.881158:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+112:3295:x1830976125386752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 445us (1131us total) trans 17179874302 rc 0/0 00000100:00100000:2.0:1746155642.881164:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17096 00000100:00100000:0.0:1746155642.881168:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17098 00000100:00100000:2.0:1746155642.881178:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17099 00000100:00100000:0.0:1746155642.881183:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17100 00000100:00100000:2.0:1746155642.881185:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976125385344:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.881190:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976125385856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155642.881283:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976125385856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (1203us total) trans 21474841622 rc 0/0 00000100:00100000:0.0:1746155642.881288:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17100 00000100:00100000:0.0:1746155642.881298:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17101 00000100:00100000:0.0:1746155642.881302:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+111:3295:x1830976125386368:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155642.881303:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746155642.881307:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:2.0:1746155642.881309:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155642 -> 1746155642 00002000:00010000:2.0:1746155642.881311:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155643 -> 1746155643 00002000:00010000:2.0:1746155642.881313:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746155642.881334:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976125385216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 870us (2021us total) trans 21474841624 rc 0/0 00000100:00100000:2.0:1746155642.881340:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17095 00000100:00100000:2.0:1746155642.881351:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17102 00000100:00100000:2.0:1746155642.881355:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+112:3295:x1830976125386880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.881373:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+112:3295:x1830976125386368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1272us total) trans 17179874303 rc 0/0 00000100:00100000:0.0:1746155642.881378:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17101 00000100:00100000:0.0:1746155642.881400:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155642.881422:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125387008 00000100:00100000:0.0:1746155642.881426:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125387008 00000100:00100000:0.0:1746155642.881441:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17103 00000100:00100000:0.0:1746155642.881445:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+113:3298:x1830976125387008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.881454:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+113:3295:x1830976125386880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (1331us total) trans 17179874304 rc 0/0 00000100:00100000:2.0:1746155642.881460:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17102 00000100:00100000:0.0:1746155642.881541:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+113:3298:x1830976125387008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (139us total) trans 17179874305 rc 0/0 00000100:00100000:0.0:1746155642.881546:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17103 00000004:00080000:0.0:1746155642.881569:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094440700/2, rc 0, transno 17179874305 00000100:00100000:0.0:1746155642.881572:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125387008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155642.881608:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.881653:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976125385344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 469us (1595us total) trans 21474841623 rc 0/0 00000100:00100000:0.0:1746155642.881658:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17099 00000004:00080000:3.0:1746155642.881776:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa34000/2, rc 0, transno 21474841623 00000100:00100000:3.0:1746155642.881782:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125385344:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155642.881790:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa34e00/2, rc 0, transno 21474841622 00000100:00100000:3.0:1746155642.881793:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125385856:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155642.881802:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa35c00/2, rc 0, transno 17179874303 00000100:00100000:3.0:1746155642.881805:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125386368:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155642.881811:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa36a00/2, rc 0, transno 17179874304 00000100:00100000:3.0:1746155642.881813:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125386880:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155642.881818:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a6060700/2, rc 0, transno 21474841624 00000100:00100000:3.0:1746155642.881821:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125385216:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155642.881826:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa34a80/2, rc 0, transno 21474841621 00000100:00100000:3.0:1746155642.881828:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125385728:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155642.881835:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa36680/2, rc 0, transno 17179874302 00000100:00100000:3.0:1746155642.881838:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125386752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155642.882028:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+112:3295:x1830976125386240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155642.882127:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:1.0:1746155642.882130:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155642 -> 1746155642 00002000:00010000:1.0:1746155642.882132:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155642 -> 1746155642 00002000:00010000:1.0:1746155642.882134:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155643 -> 1746155643 00002000:00010000:1.0:1746155642.882136:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:1.0:1746155642.882162:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+113:3295:x1830976125386240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1477us (2161us total) trans 17179874306 rc 0/0 00000100:00100000:1.0:1746155642.882167:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17097 00000100:00100000:2.0:1746155642.882310:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126011136 00000100:00100000:2.0:1746155642.882314:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126011136 00000100:00100000:2.0:1746155642.882337:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4732 00000100:00100000:2.0:1746155642.882342:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32368:x1830976126011136:12345-192.168.202.51@tcp:49:multiop.0 00000004:00080000:3.0:1746155642.882395:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa35880/2, rc 0, transno 17179874306 00000100:00100000:3.0:1746155642.882399:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125386240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155642.883774:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32368:x1830976126011136:12345-192.168.202.51@tcp:49:multiop.0 Request processed in 1427us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.883782:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4732 00000100:00100000:0.0:1746155642.886615:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.886727:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126011392 00000100:00100000:3.0:1746155642.886736:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126011392 00002000:00100000:3.0:1746155642.886783:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880094441180 x1830976126011392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.886800:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094441180 with x1830976126011392 ext(1048576->2097151) 00002000:00010000:3.0:1746155642.886806:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094441180 00000100:00100000:3.0:1746155642.887026:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8101 00000100:00100000:3.0:1746155642.887035:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1960:x1830976126011392:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155642.889831:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.889961:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126011520 00000100:00100000:1.0:1746155642.889969:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126011520 00000100:00100000:1.0:1746155642.890006:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17104 00000100:00100000:1.0:1746155642.890014:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32368:x1830976126011520:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155642.890030:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155642.890047:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182e2 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.890074:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7e1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1826b expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.890080:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155642.890082:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155642.890085:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2215936->3002367] (req 2215936->3002367) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 21 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.890118:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7e1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1826b expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.890129:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7e1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1826b expref: 18 pid: 9235 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155642.890139:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f57ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125387136:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.890216:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.891679:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.891806:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126011776 00000100:00100000:2.0:1746155642.891811:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126011776 00002000:00100000:2.0:1746155642.891843:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009f57d500 x1830976126011776/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.891852:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57d500 with x1830976126011776 ext(1048576->2097151) 00002000:00010000:2.0:1746155642.891858:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f57d500 00000100:00100000:2.0:1746155642.891874:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8102 00000100:00100000:2.0:1746155642.891881:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1963:x1830976126011776:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155642.893184:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.894377:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f57ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125387136:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155642.894406:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2215936->3002367] (req 2215936->3002367) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 21 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.894423:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53e0a00, rc 0) 00000100:00100000:0.0:1746155642.894450:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:32368:x1830976126011520:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4436us (4623us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.894458:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17104 00000100:00100000:0.0:1746155642.895341:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126011904 00000100:00100000:0.0:1746155642.895347:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126011904 00010000:00010000:0.0:1746155642.895375:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7e1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1826b expref: 19 pid: 9235 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746155642.895399:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8766 00000100:00100000:0.0:1746155642.895406:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+19:1962:x1830976126011904:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155642.895416:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155642.895437:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7e1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1826b expref: 19 pid: 9235 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746155642.895482:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7e1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1826b expref: 19 pid: 9235 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746155642.895525:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a609200/0x844e5faceb5f7e1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1826b expref: 19 pid: 9235 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746155642.895538:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.895539:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.895547:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.895554:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.895611:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 20 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155642.895623:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125387264:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155642.895677:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024e40 going to sleep for 11 seconds 00000001:00080000:3.0:1746155642.896191:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874293 is committed 00000001:00080000:3.0:1746155642.896212:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874276 is committed 00000001:00080000:3.0:1746155642.896243:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874242 is committed 00000001:00080000:3.0:1746155642.896270:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874287 is committed 00000001:00080000:3.0:1746155642.896336:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874273 is committed 00000001:00080000:3.0:1746155642.896421:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874297 is committed 00000001:00080000:3.0:1746155642.896437:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874288 is committed 00000001:00080000:3.0:1746155642.896442:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874275 is committed 00000100:00100000:0.0:1746155642.907694:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.907765:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126012160 00000100:00100000:3.0:1746155642.907778:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126012160 00002000:00100000:3.0:1746155642.907829:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (2215936->2220031) req@ffff880094441c00 x1830976126012160/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.907839:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094441c00 with x1830976126012160 ext(2215936->2220031) 00002000:00010000:3.0:1746155642.907846:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094441c00 00000100:00100000:3.0:1746155642.907867:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8103 00000100:00100000:3.0:1746155642.907874:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1963:x1830976126012160:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155642.908132:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1963:x1830976126012160:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 257us (444us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155642.908139:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8103 00002000:00100000:3.0:1746155642.908150:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (2215936->2220031) req@ffff880094441c00 x1830976126012160/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/4536 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.908157:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094441c00 with x1830976126012160 ext(2215936->2220031) 00002000:00010000:3.0:1746155642.908160:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094441c00 00000100:00100000:2.0:1746155642.908201:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125387264:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155642.908216:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155642.908254:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1962:x1830976126011904:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 12847us (15071us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.908263:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8766 00000100:00100000:3.0:1746155642.909196:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1960:x1830976126011392:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22161us (22586us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155642.909202:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8101 00002000:00100000:3.0:1746155642.909208:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880094441180 x1830976126011392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.909216:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094441180 with x1830976126011392 ext(1048576->2097151) 00002000:00010000:3.0:1746155642.909220:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094441180 00000100:00100000:2.0:1746155642.912046:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1963:x1830976126011776:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 20156us (20360us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155642.912057:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8102 00002000:00100000:2.0:1746155642.912067:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009f57d500 x1830976126011776/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.912075:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57d500 with x1830976126011776 ext(1048576->2097151) 00002000:00010000:2.0:1746155642.912080:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f57d500 00000100:00100000:0.0:1746155642.914036:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.914096:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126012288 00000100:00100000:2.0:1746155642.914103:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126012288 00000100:00100000:0.0:1746155642.914106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.914133:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126012416 00000100:00100000:2.0:1746155642.914135:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126012416 00000100:00100000:0.0:1746155642.914143:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17105 00000100:00100000:0.0:1746155642.914151:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:32367:x1830976126012288:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155642.914164:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155642.914177:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182e9 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.914199:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0611600/0x844e5faceb5f7ebb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b1 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.914207:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7ec2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b8 expref: 6 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.914212:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.914214:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155642.914217:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1060864->2015231] (req 1060864->2015231) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 13 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.914367:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17106 00000100:00100000:2.0:1746155642.914374:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:32372:x1830976126012416:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155642.914380:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.914389:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f0df600/0x844e5faceb5f7f01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182f0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.914403:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a609000/0x844e5faceb5f7e13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18264 expref: 5 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.914413:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155642.914414:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155642.914416:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0df600/0x844e5faceb5f7f01 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f0 expref: 19 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.914438:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a609000/0x844e5faceb5f7e13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18264 expref: 5 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.914447:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a609000/0x844e5faceb5f7e13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18264 expref: 5 pid: 18270 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155642.914456:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125387392:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.914526:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff840 going to sleep for 11 seconds 00010000:00010000:0.0:1746155642.915524:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7ec2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b8 expref: 6 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.915535:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7ec2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b8 expref: 6 pid: 1625 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746155642.915545:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125387520:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155642.915597:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0611600/0x844e5faceb5f7ebb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b1 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.915608:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0611600/0x844e5faceb5f7ebb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b1 expref: 13 pid: 10591 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746155642.915615:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125387648:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155642.915630:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.919948:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.920070:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c213b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125387392:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155642.920079:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126012672 00000100:00100000:1.0:1746155642.920087:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126012672 00010000:00010000:2.0:1746155642.920114:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f0df600/0x844e5faceb5f7f01 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f0 expref: 19 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.920130:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17107 00010000:00010000:2.0:1746155642.920133:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0df600, rc 0) 00000100:00100000:1.0:1746155642.920137:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32373:x1830976126012672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155642.920153:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155642.920168:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136b73e00/0x844e5faceb5f7f08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182f7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.920192:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155642.920197:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b73e00/0x844e5faceb5f7f08 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f7 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.920205:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136b73e00/0x844e5faceb5f7f08 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f7 expref: 8 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.920212:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136b73e00, rc 0) 00000100:00100000:0.0:1746155642.920462:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125387520:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155642.920472:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125387648:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.920482:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32372:x1830976126012416:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6107us (6374us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.920489:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17106 00010000:00010000:0.0:1746155642.920497:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1060864->2015231] (req 1060864->2015231) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 13 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.920543:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc8600, rc 0) 00000100:00100000:0.0:1746155642.920574:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:32367:x1830976126012288:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6424us (6542us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155642.920581:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17105 00000100:00100000:1.0:1746155642.920850:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32373:x1830976126012672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 713us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.920857:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17107 00000100:00100000:0.0:1746155642.920933:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.920961:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126012800 00000100:00100000:2.0:1746155642.920964:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126012800 00000100:00100000:0.0:1746155642.920977:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155642.920981:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a609000/0x844e5faceb5f7e13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18264 expref: 6 pid: 18270 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746155642.921314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.921542:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126013056 00000100:00100000:2.0:1746155642.921546:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126013056 00010000:00010000:2.0:1746155642.921559:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0611600/0x844e5faceb5f7ebb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b1 expref: 13 pid: 10591 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155642.921606:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126012928 00000100:00100000:1.0:1746155642.921609:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126012928 00000100:00100000:3.0:1746155642.921616:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8767 00010000:00010000:1.0:1746155642.921622:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7ec2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b8 expref: 7 pid: 1625 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155642.921628:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976126012800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.921640:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155642.921640:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8768 00000100:00100000:1.0:1746155642.921646:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976126013056:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.921655:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155642.921660:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a609000/0x844e5faceb5f7e13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18264 expref: 6 pid: 18270 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155642.921671:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a609000/0x844e5faceb5f7e13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18264 expref: 6 pid: 18270 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155642.921671:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0611600/0x844e5faceb5f7ebb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b1 expref: 13 pid: 10591 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155642.921680:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0611600/0x844e5faceb5f7ebb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b1 expref: 13 pid: 10591 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155642.921688:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a609000/0x844e5faceb5f7e13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18264 expref: 6 pid: 18270 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155642.921698:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0611600/0x844e5faceb5f7ebb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b1 expref: 13 pid: 10591 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155642.921702:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.921704:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.921710:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f0df600/0x844e5faceb5f7f01 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f0 expref: 18 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.921712:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155642.921717:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0df600/0x844e5faceb5f7f01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f0 expref: 18 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.921724:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.921725:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.921728:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b73e00/0x844e5faceb5f7f08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f7 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.921732:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1961:x1830976126013056:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (755us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155642.921734:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136b73e00/0x844e5faceb5f7f08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f7 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.921738:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8768 00000100:00100000:1.0:1746155642.921749:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8769 00000100:00100000:1.0:1746155642.921754:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094443100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976126012928:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155642.921756:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136b73e00/0x844e5faceb5f7f08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f7 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.921762:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155642.921767:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125387776:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155642.921769:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7ec2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b8 expref: 7 pid: 1625 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155642.921777:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7ec2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b8 expref: 7 pid: 1625 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155642.921787:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801373dd800/0x844e5faceb5f7ec2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182b8 expref: 7 pid: 1625 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155642.921795:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.921797:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.921801:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 11 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.921808:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 11 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.921815:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f0df600/0x844e5faceb5f7f01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f0 expref: 18 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.921822:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125387904:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155642.921831:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 11 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155642.921838:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.921841:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f57d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125388032:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155642.921873:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.922062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.922114:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126013184 00000100:00100000:2.0:1746155642.922118:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126013184 00002000:00100000:2.0:1746155642.922147:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2998272->3002367) req@ffff880094443480 x1830976126013184/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.922156:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094443480 with x1830976126013184 ext(2998272->3002367) 00002000:00010000:2.0:1746155642.922161:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094443480 00000100:00100000:2.0:1746155642.922177:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8104 00000100:00100000:2.0:1746155642.922182:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976126013184:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155642.922335:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976126013184:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 152us (272us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155642.922341:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8104 00002000:00100000:2.0:1746155642.922346:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2998272->3002367) req@ffff880094443480 x1830976126013184/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/4536 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.922354:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094443480 with x1830976126013184 ext(2998272->3002367) 00002000:00010000:2.0:1746155642.922357:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094443480 00000100:00100000:3.0:1746155642.925680:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125387776:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155642.925690:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125387904:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155642.925707:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.925746:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+5:1961:x1830976126012800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4122us (4812us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.925755:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8767 00000100:00100000:2.0:1746155642.926093:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.926125:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126013440 00000100:00100000:0.0:1746155642.926131:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126013440 00002000:00100000:0.0:1746155642.926164:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009c213b80 x1830976126013440/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155642.926174:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213b80 with x1830976126013440 ext(1048576->2097151) 00002000:00010000:0.0:1746155642.926178:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c213b80 00000100:00100000:0.0:1746155642.926192:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8105 00000100:00100000:0.0:1746155642.926198:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976126013440:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155642.926902:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.926960:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126013696 00000100:00100000:3.0:1746155642.926965:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126013696 00000100:00100000:2.0:1746155642.926993:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.926997:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4733 00000100:00100000:3.0:1746155642.927003:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32368:x1830976126013696:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155642.927020:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126013952 00000100:00100000:2.0:1746155642.927026:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126013952 00002000:00100000:2.0:1746155642.927058:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e0:0x0] (1060864->1064959) req@ffff88009c211880 x1830976126013952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.927068:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211880 with x1830976126013952 ext(1060864->1064959) 00002000:00010000:2.0:1746155642.927073:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c211880 00000100:00100000:2.0:1746155642.927097:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8106 00000100:00100000:2.0:1746155642.927104:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1960:x1830976126013952:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155642.927156:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32368:x1830976126013696:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 153us (254us total) trans 8589945304 rc 0/0 00000100:00100000:3.0:1746155642.927162:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4733 00000100:00100000:2.0:1746155642.927248:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1960:x1830976126013952:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 144us (254us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155642.927256:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8106 00002000:00100000:2.0:1746155642.927261:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e0:0x0] (1060864->1064959) req@ffff88009c211880 x1830976126013952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/4536 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.927268:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211880 with x1830976126013952 ext(1060864->1064959) 00002000:00010000:2.0:1746155642.927271:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c211880 00000100:00100000:1.0:1746155642.927362:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f57d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125388032:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155642.927378:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155642.927415:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094443100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1961:x1830976126012928:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5660us (6100us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.927424:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8769 00000100:00100000:0.0:1746155642.928614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.928666:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126014208 00000100:00100000:2.0:1746155642.928671:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126014208 00002000:00100000:2.0:1746155642.928691:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880094443800 x1830976126014208/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.928700:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094443800 with x1830976126014208 ext(1048576->2097151) 00002000:00010000:2.0:1746155642.928704:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094443800 00000100:00100000:2.0:1746155642.928799:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8107 00000100:00100000:2.0:1746155642.928806:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126014208:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155642.936641:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094443800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126014208:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7826us (8018us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155642.936655:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8107 00002000:00100000:2.0:1746155642.936666:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880094443800 x1830976126014208/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.936674:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094443800 with x1830976126014208 ext(1048576->2097151) 00002000:00010000:2.0:1746155642.936680:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094443800 00000100:00100000:2.0:1746155642.939648:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976126013440:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13441us (13551us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155642.939659:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8105 00002000:00100000:2.0:1746155642.939668:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009c213b80 x1830976126013440/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.939677:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213b80 with x1830976126013440 ext(1048576->2097151) 00002000:00010000:2.0:1746155642.939682:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c213b80 00000100:00100000:0.0:1746155642.945133:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.945172:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.945202:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.945308:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126014720 00000100:00100000:1.0:1746155642.945320:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126014720 00000100:00100000:2.0:1746155642.945465:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126014464 00000100:00100000:2.0:1746155642.945473:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126014464 00002000:00100000:2.0:1746155642.945531:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (2011136->2015231) req@ffff880094443b80 x1830976126014464/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.945539:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094443b80 with x1830976126014464 ext(2011136->2015231) 00002000:00010000:2.0:1746155642.945544:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094443b80 00000100:00100000:2.0:1746155642.945992:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8108 00000100:00100000:2.0:1746155642.945999:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976126014464:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155642.946014:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126014592 00000100:00100000:1.0:1746155642.946017:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126014592 00000100:00100000:0.0:1746155642.946083:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17108 00000100:00100000:0.0:1746155642.946093:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1962:x1830976126014720:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155642.946095:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17109 00000100:00100000:2.0:1746155642.946102:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976126014592:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155642.946109:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.946113:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.946127:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009460b600/0x844e5faceb5f7f16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f182fe expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155642.946127:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9800/0x844e5faceb5f7f0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18305 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.946167:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125388160:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155642.946170:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012c2bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125388288:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155642.946224:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.946279:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.946333:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976126014464:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 333us (1205us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155642.946340:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8108 00002000:00100000:2.0:1746155642.946345:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (2011136->2015231) req@ffff880094443b80 x1830976126014464/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/4536 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.946351:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094443b80 with x1830976126014464 ext(2011136->2015231) 00002000:00010000:2.0:1746155642.946354:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094443b80 00000100:00100000:0.0:1746155642.947357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.947456:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126014976 00000100:00100000:2.0:1746155642.947463:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126014976 00002000:00100000:2.0:1746155642.947487:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012c2be680 x1830976126014976/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 504/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.947496:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2be680 with x1830976126014976 ext(2097152->3145727) 00002000:00010000:2.0:1746155642.947515:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c2be680 00000100:00100000:2.0:1746155642.948077:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8109 00000100:00100000:2.0:1746155642.948084:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976126014976:12345-192.168.202.51@tcp:3:cat.0 00002000:00010000:3.0:1746155642.949825:0:20200:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155642 -> 1746155643 00002000:00010000:3.0:1746155642.949830:0:20200:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155642 -> 1746155643 00000100:00100000:3.0:1746155642.949846:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125388160:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155642.949878:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009460b600/0x844e5faceb5f7f16 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182fe expref: 20 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.949892:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009460b600/0x844e5faceb5f7f16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182fe expref: 20 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155642.949919:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009460b600, rc 0) 00000100:00100000:3.0:1746155642.949954:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976126014592:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3852us (4750us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155642.949961:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17109 00010000:00010000:2.0:1746155642.949976:0:29728:0:(ldlm_lockd.c:785:ldlm_cb_interpret()) ### lost race - client has a lock but no inode ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18272 expref: 6 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155642.950001:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012c2bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125388288:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155642.950019:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9800/0x844e5faceb5f7f0f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18305 expref: 13 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.950028:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc9800/0x844e5faceb5f7f0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18305 expref: 13 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155642.950049:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdc9800, rc 0) 00000100:00100000:2.0:1746155642.950068:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1962:x1830976126014720:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3977us (4895us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155642.950074:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17108 00000100:00100000:2.0:1746155642.951661:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976126014976:12345-192.168.202.51@tcp:3:cat.0 Request processed in 3572us (4299us total) trans 0 rc 262144/262144 00000100:00100000:2.0:1746155642.951669:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8109 00002000:00100000:2.0:1746155642.951678:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012c2be680 x1830976126014976/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 504/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 262144/262144 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.951687:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2be680 with x1830976126014976 ext(2097152->3145727) 00002000:00010000:2.0:1746155642.951693:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012c2be680 00000100:00100000:0.0:1746155642.952838:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.952877:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126015104 00000100:00100000:2.0:1746155642.952886:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126015104 00000100:00100000:2.0:1746155642.952939:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17110 00000100:00100000:2.0:1746155642.952945:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32372:x1830976126015104:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155642.952961:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155642.952979:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f0dee00/0x844e5faceb5f7f1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1830c expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.953007:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 7 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.953015:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155642.953017:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155642.953021:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0dee00/0x844e5faceb5f7f1d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1830c expref: 20 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.953051:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 7 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.953062:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 7 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155642.953073:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125388416:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155642.953145:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.954491:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.954564:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126015232 00000100:00100000:3.0:1746155642.954572:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126015232 00000100:00100000:3.0:1746155642.954642:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17111 00000100:00100000:3.0:1746155642.954650:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32373:x1830976126015232:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155642.954664:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.954678:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b1ffea00/0x844e5faceb5f7f24 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18313 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.954703:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18272 expref: 6 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.954711:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155642.954712:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155642.954715:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1ffea00/0x844e5faceb5f7f24 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18313 expref: 7 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.954737:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18272 expref: 6 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.954747:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18272 expref: 6 pid: 9235 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155642.954756:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125388544:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155642.954832:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155642.957651:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.957804:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:29728:1830976125388416:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155642.957834:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f0dee00/0x844e5faceb5f7f1d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1830c expref: 20 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155642.957850:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0dee00, rc 0) 00000100:00100000:2.0:1746155642.957901:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:32372:x1830976126015104:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4955us (5068us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155642.957918:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17110 00000100:00100000:3.0:1746155642.957998:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126015360 00000100:00100000:3.0:1746155642.958004:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126015360 00002000:00100000:3.0:1746155642.958033:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2215936->3002367) req@ffff88012c2bc380 x1830976126015360/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.958040:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bc380 with x1830976126015360 ext(2215936->3002367) 00010000:00010000:3.0:1746155642.958046:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 8 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155642.958056:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 8 pid: 20200 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746155642.958063:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c2bc380 00000100:00100000:3.0:1746155642.958089:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1410 00000100:00100000:3.0:1746155642.958095:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976126015360:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155642.959010:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125388544:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155642.959028:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b1ffea00/0x844e5faceb5f7f24 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18313 expref: 7 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.959039:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b1ffea00, rc 0) 00000100:00100000:3.0:1746155642.959071:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32373:x1830976126015232:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4421us (4582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.959077:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17111 00000100:00100000:0.0:1746155642.961496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.961558:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126015488 00000100:00100000:1.0:1746155642.961566:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126015488 00010000:00010000:1.0:1746155642.961600:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18272 expref: 7 pid: 9235 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155642.961643:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8770 00000100:00100000:1.0:1746155642.961651:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126015488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.961665:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.961690:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18272 expref: 7 pid: 9235 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155642.961701:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18272 expref: 7 pid: 9235 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155642.961726:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7e21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18272 expref: 7 pid: 9235 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155642.962241:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.962245:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.962254:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1ffea00/0x844e5faceb5f7f24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18313 expref: 6 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.962268:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1ffea00/0x844e5faceb5f7f24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18313 expref: 6 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.962300:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1ffea00/0x844e5faceb5f7f24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18313 expref: 6 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.962313:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f57d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125388672:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155642.962387:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155642.965688:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f57d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125388672:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155642.965709:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155642.965745:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976126015488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4094us (4255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.965922:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8770 00000100:00100000:0.0:1746155642.967274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.967457:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126015744 00000100:00100000:2.0:1746155642.967464:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126015744 00002000:00100000:2.0:1746155642.967494:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012c2bd500 x1830976126015744/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.967517:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bd500 with x1830976126015744 ext(2097152->3145727) 00002000:00010000:2.0:1746155642.967522:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c2bd500 00000100:00100000:2.0:1746155642.967550:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8110 00000100:00100000:2.0:1746155642.967555:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976126015744:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155642.969040:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976126015360:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10943us (11393us total) trans 17179874307 rc 0/0 00000100:00100000:3.0:1746155642.969048:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1410 00002000:00100000:3.0:1746155642.969055:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2215936->3002367) req@ffff88012c2bc380 x1830976126015360/t17179874307(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/448 e 0 to 0 dl 1746155653 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.969063:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bc380 with x1830976126015360 ext(2215936->3002367) 00010000:00010000:3.0:1746155642.969069:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 10 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155642.969086:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 10 pid: 20200 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746155642.969092:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012c2bc380 00000100:00100000:0.0:1746155642.975491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.975554:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126015872 00000100:00100000:1.0:1746155642.975562:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126015872 00010000:00010000:1.0:1746155642.975593:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 10 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155642.975630:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8771 00000100:00100000:1.0:1746155642.975637:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1963:x1830976126015872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155642.975648:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155642.975666:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 10 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155642.975682:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 10 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155642.975701:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b53e0a00/0x844e5faceb5f7ef3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2215936->3002367) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e2 expref: 10 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155642.975726:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.975728:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155642.975734:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f0dee00/0x844e5faceb5f7f1d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1830c expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.975741:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0dee00/0x844e5faceb5f7f1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1830c expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155642.975768:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f0dee00/0x844e5faceb5f7f1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1830c expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155642.975778:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f57d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125388800:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155642.975836:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155642.976241:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976126015744:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8683us (8968us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155642.976250:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8110 00002000:00100000:2.0:1746155642.976258:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012c2bd500 x1830976126015744/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.976267:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bd500 with x1830976126015744 ext(2097152->3145727) 00002000:00010000:2.0:1746155642.976271:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c2bd500 00000100:00100000:1.0:1746155642.979228:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155642.979273:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f57d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125388800:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155642.979283:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126016128 00010000:00010000:1.0:1746155642.979286:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155642.979288:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126016128 00000100:00100000:1.0:1746155642.979320:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1963:x1830976126015872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3683us (3837us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155642.979328:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8771 00002000:00100000:3.0:1746155642.980076:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f57ed80 x1830976126016128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.980084:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57ed80 with x1830976126016128 ext(2097152->3145727) 00002000:00010000:3.0:1746155642.980088:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f57ed80 00000100:00100000:3.0:1746155642.980115:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8111 00000100:00100000:3.0:1746155642.980122:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126016128:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155642.983381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155642.983431:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126016256 00000100:00100000:3.0:1746155642.983438:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126016256 00000100:00100000:3.0:1746155642.983480:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17112 00000100:00100000:3.0:1746155642.983486:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32373:x1830976126016256:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155642.983498:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155642.983527:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948e5600/0x844e5faceb5f7f2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1831a expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.984578:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.984581:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155642.984592:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e5600/0x844e5faceb5f7f2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1831a expref: 10 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.984615:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948e5600/0x844e5faceb5f7f2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1831a expref: 10 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155642.984629:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e5600, rc 0) 00000100:00100000:3.0:1746155642.984673:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32373:x1830976126016256:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1187us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155642.984680:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17112 00000100:00100000:0.0:1746155642.991538:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155642.991580:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155642.991605:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126016640 00000100:00100000:1.0:1746155642.991612:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126016768 00000100:00100000:2.0:1746155642.991613:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126016640 00000100:00100000:1.0:1746155642.991616:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126016768 00002000:00100000:2.0:1746155642.991647:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88012c2bd880 x1830976126016640/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155642.991647:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880094e36300 x1830976126016768/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/0 e 0 to 0 dl 1746155653 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155642.991655:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bd880 with x1830976126016640 ext(3145728->4194303) 00002000:00100000:1.0:1746155642.991655:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36300 with x1830976126016768 ext(3145728->4194303) 00002000:00010000:2.0:1746155642.991660:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c2bd880 00002000:00010000:1.0:1746155642.991660:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36300 00000100:00100000:2.0:1746155642.991690:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8112 00000100:00100000:2.0:1746155642.991697:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976126016640:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155642.992280:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8113 00000100:00100000:3.0:1746155642.992288:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126016768:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155642.995943:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126016128:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15811us (16709us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155642.995954:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8111 00002000:00100000:3.0:1746155642.995965:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f57ed80 x1830976126016128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155642.995973:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57ed80 with x1830976126016128 ext(2097152->3145727) 00002000:00010000:3.0:1746155642.995979:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f57ed80 00000100:00100000:3.0:1746155643.000499:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126016768:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8204us (8908us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155643.000530:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8113 00002000:00100000:3.0:1746155643.000539:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880094e36300 x1830976126016768/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.000548:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36300 with x1830976126016768 ext(3145728->4194303) 00002000:00010000:3.0:1746155643.000553:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36300 00000100:00100000:0.0:1746155643.002445:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.003435:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c2bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976126016640:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11736us (11938us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155643.003445:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8112 00002000:00100000:2.0:1746155643.003453:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88012c2bd880 x1830976126016640/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:713/0 lens 488/440 e 0 to 0 dl 1746155653 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.003461:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012c2bd880 with x1830976126016640 ext(3145728->4194303) 00002000:00010000:2.0:1746155643.003465:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012c2bd880 00000100:00100000:3.0:1746155643.004549:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126016896 00000100:00100000:3.0:1746155643.004556:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126016896 00000100:00100000:3.0:1746155643.004585:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17113 00000100:00100000:3.0:1746155643.004590:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:32372:x1830976126016896:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155643.004602:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.004620:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948e5400/0x844e5faceb5f7f32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18321 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.004639:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.004640:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.004646:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948e5400/0x844e5faceb5f7f32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18321 expref: 13 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.004657:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948e5400/0x844e5faceb5f7f32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18321 expref: 13 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.004665:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e5400, rc 0) 00000100:00100000:3.0:1746155643.004691:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:32372:x1830976126016896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 100us (2250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.004695:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17113 00000100:00100000:0.0:1746155643.008080:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.008168:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126017024 00000100:00100000:2.0:1746155643.008175:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126017024 00000100:00100000:2.0:1746155643.008253:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17114 00000100:00100000:2.0:1746155643.008261:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976126017024:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.008275:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.008289:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009460ba00/0x844e5faceb5f7f39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18328 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.008332:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125388928:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.009047:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff840 going to sleep for 11 seconds 00002000:00010000:2.0:1746155643.015973:0:29728:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime: 1746155642 -> 1746155643 00002000:00010000:2.0:1746155643.015979:0:29728:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime: 1746155642 -> 1746155643 00000100:00100000:2.0:1746155643.016000:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125388928:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.016029:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009460ba00/0x844e5faceb5f7f39 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18328 expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.016041:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009460ba00/0x844e5faceb5f7f39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18328 expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.016072:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009460ba00, rc 0) 00000100:00100000:2.0:1746155643.016116:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976126017024:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7855us (8041us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.016122:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17114 00000100:00100000:0.0:1746155643.018047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.018079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.018111:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.018143:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126017280 00000100:00100000:0.0:1746155643.018149:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126017280 00000100:00100000:3.0:1746155643.018183:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126017536 00002000:00100000:0.0:1746155643.018185:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880094e37100 x1830976126017280/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155643.018187:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126017536 00002000:00100000:0.0:1746155643.018193:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37100 with x1830976126017280 ext(2097152->3145727) 00002000:00010000:0.0:1746155643.018198:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e37100 00002000:00100000:3.0:1746155643.018205:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009fc52680 x1830976126017536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.018213:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc52680 with x1830976126017536 ext(3145728->4194303) 00002000:00010000:3.0:1746155643.018216:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc52680 00000100:00100000:0.0:1746155643.018841:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126017792 00000100:00100000:0.0:1746155643.018844:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126017792 00000100:00100000:3.0:1746155643.018850:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8114 00000100:00100000:3.0:1746155643.018857:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976126017280:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:0.0:1746155643.018859:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009fc50a80 x1830976126017792/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155643.018866:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc50a80 with x1830976126017792 ext(3145728->4194303) 00002000:00010000:0.0:1746155643.018870:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc50a80 00000100:00100000:0.0:1746155643.019087:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8115 00000100:00100000:0.0:1746155643.019093:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976126017536:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155643.019836:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8116 00000100:00100000:2.0:1746155643.019853:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976126017792:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155643.023921:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.024991:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126018048 00000100:00100000:2.0:1746155643.024999:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126018048 00002000:00100000:2.0:1746155643.025031:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009fc53800 x1830976126018048/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.025040:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc53800 with x1830976126018048 ext(4194304->5083135) 00002000:00010000:2.0:1746155643.025044:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc53800 00000100:00100000:2.0:1746155643.025070:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8117 00000100:00100000:2.0:1746155643.025077:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126018048:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155643.031370:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976126017280:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12504us (13318us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155643.031381:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8114 00002000:00100000:2.0:1746155643.031390:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880094e37100 x1830976126017280/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.031399:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37100 with x1830976126017280 ext(2097152->3145727) 00002000:00010000:2.0:1746155643.031405:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e37100 00000100:00100000:2.0:1746155643.035171:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976126017792:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15318us (17050us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155643.035181:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8116 00002000:00100000:2.0:1746155643.035191:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009fc50a80 x1830976126017792/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.035199:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc50a80 with x1830976126017792 ext(3145728->4194303) 00002000:00010000:2.0:1746155643.035204:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc50a80 00000100:00100000:1.0:1746155643.039599:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976126017536:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20497us (21510us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155643.039610:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8115 00002000:00100000:1.0:1746155643.039620:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009fc52680 x1830976126017536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.039628:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc52680 with x1830976126017536 ext(3145728->4194303) 00002000:00010000:1.0:1746155643.039633:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fc52680 00000100:00100000:3.0:1746155643.040541:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126018048:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15463us (16636us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155643.040548:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8117 00002000:00100000:3.0:1746155643.040554:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009fc53800 x1830976126018048/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.040562:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc53800 with x1830976126018048 ext(4194304->5083135) 00002000:00010000:3.0:1746155643.040565:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc53800 00000100:00100000:0.0:1746155643.045880:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.046364:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126018176 00000100:00100000:2.0:1746155643.046372:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126018176 00000100:00100000:0.0:1746155643.046977:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.047101:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17115 00000100:00100000:2.0:1746155643.047110:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976126018176:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155643.047118:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126018432 00000100:00100000:3.0:1746155643.047122:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126018432 00010000:00010000:2.0:1746155643.047124:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.047137:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009460b600/0x844e5faceb5f7f40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1832f expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746155643.047148:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012bdf4a80 x1830976126018432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.047156:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4a80 with x1830976126018432 ext(4194304->5083135) 00002000:00010000:3.0:1746155643.047160:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf4a80 00000100:00100000:2.0:1746155643.047178:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125389056:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155643.047183:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8118 00000100:00100000:3.0:1746155643.047189:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126018432:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155643.047244:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.051033:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125389056:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.051060:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009460b600/0x844e5faceb5f7f40 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1832f expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.051072:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009460b600/0x844e5faceb5f7f40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1832f expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.051095:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009460b600, rc 0) 00000100:00100000:2.0:1746155643.051141:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976126018176:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4032us (5268us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.051150:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17115 00000100:00100000:3.0:1746155643.055574:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126018432:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8378us (8590us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155643.055584:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8118 00002000:00100000:3.0:1746155643.055593:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012bdf4a80 x1830976126018432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.055602:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4a80 with x1830976126018432 ext(4194304->5083135) 00002000:00010000:3.0:1746155643.055607:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012bdf4a80 00000100:00100000:0.0:1746155643.056586:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.056661:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126018560 00000100:00100000:2.0:1746155643.056669:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126018560 00000100:00100000:2.0:1746155643.056758:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17116 00000100:00100000:2.0:1746155643.056766:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976126018560:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.056780:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.056794:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009460a800/0x844e5faceb5f7f47 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18336 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.056840:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125389184:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.057265:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.060956:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125389184:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.060984:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009460a800/0x844e5faceb5f7f47 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18336 expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.060996:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009460a800/0x844e5faceb5f7f47 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18336 expref: 8 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.061025:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009460a800, rc 0) 00000100:00100000:2.0:1746155643.061074:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976126018560:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4307us (4488us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.061081:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17116 00000100:00100000:0.0:1746155643.067544:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.067630:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126018816 00000100:00100000:3.0:1746155643.067638:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126018816 00000100:00100000:3.0:1746155643.067687:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4734 00000100:00100000:3.0:1746155643.067695:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32373:x1830976126018816:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155643.067870:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32373:x1830976126018816:12345-192.168.202.51@tcp:35:cat.0 Request processed in 176us (373us total) trans 8589945305 rc 0/0 00000100:00100000:3.0:1746155643.067877:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4734 00000100:00100000:0.0:1746155643.070167:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.070275:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126019072 00000100:00100000:2.0:1746155643.070282:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126019072 00000100:00100000:2.0:1746155643.070322:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11146 00000100:00100000:2.0:1746155643.070329:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32377:x1830976126019072:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155643.070342:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.070355:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009460b000/0x844e5faceb5f7f4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1833d expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.070487:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009460a800/0x844e5faceb5f7f55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070498:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009460a800/0x844e5faceb5f7f55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070545:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009460a800/0x844e5faceb5f7f55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070558:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7f5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070564:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7f5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070568:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7f5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070731:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f7f63 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070739:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f7f63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070745:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f7f63 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:2.0:1746155643.070752:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155643.070808:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009460a800/0x844e5faceb5f7f55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070814:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009460a800/0x844e5faceb5f7f55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070819:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009460a800/0x844e5faceb5f7f55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070823:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009460a800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.070826:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009460a800/0x844e5faceb5f7f55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070831:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009460a800/0x844e5faceb5f7f55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070839:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155643.070841:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.070844:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009460a800/0x844e5faceb5f7f55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070849:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009460a800/0x844e5faceb5f7f55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070870:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7f5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070874:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7f5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070879:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7f5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070883:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f0df400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.070885:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7f5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070893:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7f5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070898:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800942dc200) 00010000:00010000:2.0:1746155643.070900:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.070902:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7f5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070915:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0df400/0x844e5faceb5f7f5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.070944:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009460b000/0x844e5faceb5f7f4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1833d expref: 291 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.070954:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f7f63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1833d expref: 290 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.070959:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.070961:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155643.070962:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef0c00, rc 0) 00000100:00100000:2.0:1746155643.071001:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32377:x1830976126019072:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 671us (839us total) trans 8589945306 rc 0/0 00000100:00100000:2.0:1746155643.071006:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11146 00000100:00100000:0.0:1746155643.073220:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.073414:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126019328 00000100:00100000:2.0:1746155643.073420:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126019328 00000100:00100000:2.0:1746155643.073466:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4735 00000100:00100000:2.0:1746155643.073472:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32377:x1830976126019328:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155643.073790:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32377:x1830976126019328:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 317us (574us total) trans 8589945307 rc 0/0 00000100:00100000:2.0:1746155643.073797:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4735 00000100:00100000:0.0:1746155643.123080:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.123138:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126019456 00000100:00100000:2.0:1746155643.123146:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126019456 00000100:00100000:3.0:1746155643.124616:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17117 00000100:00100000:3.0:1746155643.124627:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:32377:x1830976126019456:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155643.124643:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.124656:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18344 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.124679:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f7e91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18295 expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.124687:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fed9800/0x844e5faceb5f7ea6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182a3 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.124693:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.124694:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.124698:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [978944->1048575] (req 978944->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 21 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.124721:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fed9800/0x844e5faceb5f7ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182a3 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.124735:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fed9800/0x844e5faceb5f7ea6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182a3 expref: 21 pid: 10591 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.124745:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125389312:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.124849:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f7e91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18295 expref: 9 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.124857:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f7e91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18295 expref: 9 pid: 1625 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.124864:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125389440:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.124882:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.126519:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.126553:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.126726:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125389312:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.126735:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125389440:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.126757:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [978944->1048575] (req 978944->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 21 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.126769:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e5800, rc 0) 00000100:00100000:3.0:1746155643.126796:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:32377:x1830976126019456:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2172us (3722us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.126802:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17117 00000100:00100000:2.0:1746155643.126843:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126019584 00000100:00100000:2.0:1746155643.126848:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126019584 00000100:00100000:1.0:1746155643.126862:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126019712 00000100:00100000:1.0:1746155643.126866:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126019712 00010000:00010000:2.0:1746155643.126868:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fed9800/0x844e5faceb5f7ea6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182a3 expref: 21 pid: 10591 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.126880:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f7e91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18295 expref: 10 pid: 1625 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.126896:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8772 00000100:00100000:1.0:1746155643.126901:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8773 00000100:00100000:2.0:1746155643.126902:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976126019584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155643.126918:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976126019712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.126920:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.126925:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155643.126938:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fed9800/0x844e5faceb5f7ea6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182a3 expref: 21 pid: 10591 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.126938:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f7e91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18295 expref: 10 pid: 1625 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.126946:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fed9800/0x844e5faceb5f7ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182a3 expref: 21 pid: 10591 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.126957:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f7e91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18295 expref: 10 pid: 1625 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.127356:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fed9800/0x844e5faceb5f7ea6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182a3 expref: 21 pid: 10591 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.127379:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.127399:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976126019584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 497us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.127405:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8772 00010000:00010000:1.0:1746155643.127474:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f7e91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18295 expref: 10 pid: 1625 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.127486:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.127487:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.127492:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 19 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.127499:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 19 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.127535:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 19 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.127545:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f57d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125389568:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155643.127601:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a403c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.129451:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f57d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125389568:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155643.129464:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.129520:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976126019712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2594us (2947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.129527:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8773 00000100:00100000:0.0:1746155643.133040:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.133128:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126019968 00000100:00100000:3.0:1746155643.133135:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126019968 00002000:00100000:3.0:1746155643.133169:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (978944->983039) req@ffff88009fac6680 x1830976126019968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.133178:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6680 with x1830976126019968 ext(978944->983039) 00002000:00010000:3.0:1746155643.133182:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac6680 00000100:00100000:3.0:1746155643.133209:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8119 00000100:00100000:3.0:1746155643.133216:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126019968:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155643.133541:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126019968:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 324us (506us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155643.133548:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8119 00002000:00100000:3.0:1746155643.133553:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (978944->983039) req@ffff88009fac6680 x1830976126019968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.133561:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6680 with x1830976126019968 ext(978944->983039) 00002000:00010000:3.0:1746155643.133563:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac6680 00000100:00100000:0.0:1746155643.156028:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.156277:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126020224 00000100:00100000:2.0:1746155643.156285:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126020224 00000100:00100000:2.0:1746155643.156321:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11147 00000100:00100000:2.0:1746155643.156328:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32382:x1830976126020224:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155643.156348:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.156364:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f7f78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1834b expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.156443:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0600/0x844e5faceb5f7f7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156454:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0600/0x844e5faceb5f7f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156463:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0600/0x844e5faceb5f7f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156473:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f7f86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156478:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f7f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156483:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f7f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156582:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1400/0x844e5faceb5f7f8d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156589:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1400/0x844e5faceb5f7f8d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156594:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1400/0x844e5faceb5f7f8d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:2.0:1746155643.156601:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155643.156656:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0600/0x844e5faceb5f7f7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156662:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0600/0x844e5faceb5f7f7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156667:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0600/0x844e5faceb5f7f7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156672:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6ef0600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.156675:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0600/0x844e5faceb5f7f7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156680:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0600/0x844e5faceb5f7f7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156688:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155643.156690:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.156693:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0600/0x844e5faceb5f7f7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156698:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0600/0x844e5faceb5f7f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156724:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f7f86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156728:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f7f86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156732:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f7f86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156736:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6ef1e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.156738:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f7f86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156746:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f7f86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156751:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800942dc400) 00010000:00010000:2.0:1746155643.156753:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.156755:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f7f86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156759:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f7f86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.156785:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f7f78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1834b expref: 13 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.156796:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1400/0x844e5faceb5f7f8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1834b expref: 12 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.156801:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.156802:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155643.156804:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef1400, rc 0) 00000100:00100000:2.0:1746155643.156841:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32382:x1830976126020224:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 512us (820us total) trans 8589945308 rc 0/0 00000100:00100000:2.0:1746155643.157381:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11147 00000100:00100000:0.0:1746155643.160132:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.160173:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126020352 00000100:00100000:3.0:1746155643.160179:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126020352 00000100:00100000:3.0:1746155643.160299:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17118 00000100:00100000:3.0:1746155643.160307:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32382:x1830976126020352:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155643.160452:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.160466:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18352 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.160487:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f0dee00/0x844e5faceb5f7f1d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1830c expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.160494:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5600/0x844e5faceb5f7f2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1831a expref: 10 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.160500:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.160572:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.160576:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3969024->3989503] (req 3969024->3989503) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 10 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.160600:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948e5600/0x844e5faceb5f7f2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1831a expref: 10 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.160609:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948e5600/0x844e5faceb5f7f2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1831a expref: 10 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.160620:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125389696:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.160855:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f0dee00/0x844e5faceb5f7f1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1830c expref: 19 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.160864:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f0dee00/0x844e5faceb5f7f1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1830c expref: 19 pid: 29728 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.160871:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125389824:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.160891:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155643.162491:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125389696:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.163447:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125389824:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.163470:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3969024->3989503] (req 3969024->3989503) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 10 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.163487:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e5a00, rc 0) 00000100:00100000:3.0:1746155643.163741:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32382:x1830976126020352:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3433us (3610us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.163748:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17118 00000100:00100000:0.0:1746155643.164669:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.164826:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126020480 00000100:00100000:1.0:1746155643.164832:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126020480 00010000:00010000:1.0:1746155643.164854:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e5600/0x844e5faceb5f7f2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1831a expref: 10 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155643.164935:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8774 00000100:00100000:1.0:1746155643.164942:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126020480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.164951:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.164968:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948e5600/0x844e5faceb5f7f2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1831a expref: 10 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.164976:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948e5600/0x844e5faceb5f7f2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1831a expref: 10 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.164994:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5600/0x844e5faceb5f7f2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1831a expref: 10 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.165019:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.165202:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976126020480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 260us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.165208:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8774 00000100:00100000:0.0:1746155643.167398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.167488:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126020608 00000100:00100000:1.0:1746155643.167493:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126020608 00010000:00010000:1.0:1746155643.167538:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0dee00/0x844e5faceb5f7f1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1830c expref: 20 pid: 29728 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155643.167566:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8775 00000100:00100000:1.0:1746155643.167572:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126020608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.167580:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.167593:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f0dee00/0x844e5faceb5f7f1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1830c expref: 20 pid: 29728 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.167603:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f0dee00/0x844e5faceb5f7f1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1830c expref: 20 pid: 29728 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.167641:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f0dee00/0x844e5faceb5f7f1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1830c expref: 20 pid: 29728 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.167651:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.167653:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.167658:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 8 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.167665:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 8 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.167687:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 8 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.167697:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f57d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125389952:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155643.167827:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a403c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.171641:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f57d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125389952:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155643.171657:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.171688:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976126020608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4116us (4292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.171697:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8775 00000100:00100000:2.0:1746155643.171817:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.172224:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126020864 00000100:00100000:3.0:1746155643.172229:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126020864 00002000:00100000:3.0:1746155643.172259:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3969024->3973119) req@ffff88009c210000 x1830976126020864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.172268:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210000 with x1830976126020864 ext(3969024->3973119) 00002000:00010000:3.0:1746155643.172272:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c210000 00000100:00100000:3.0:1746155643.172298:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8120 00000100:00100000:3.0:1746155643.172305:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976126020864:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155643.173055:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976126020864:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 749us (1237us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155643.173061:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8120 00002000:00100000:3.0:1746155643.173067:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3969024->3973119) req@ffff88009c210000 x1830976126020864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.173074:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210000 with x1830976126020864 ext(3969024->3973119) 00002000:00010000:3.0:1746155643.173077:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c210000 00000100:00100000:0.0:1746155643.175084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.175154:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126021120 00000100:00100000:3.0:1746155643.175158:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126021120 00002000:00100000:3.0:1746155643.175179:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3985408->3989503) req@ffff88009ca96a00 x1830976126021120/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.175193:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96a00 with x1830976126021120 ext(3985408->3989503) 00002000:00010000:3.0:1746155643.175197:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca96a00 00000100:00100000:3.0:1746155643.175224:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8121 00000100:00100000:3.0:1746155643.175230:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1963:x1830976126021120:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155643.175981:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1963:x1830976126021120:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 749us (900us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155643.175986:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8121 00002000:00100000:3.0:1746155643.175992:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3985408->3989503) req@ffff88009ca96a00 x1830976126021120/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.175998:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96a00 with x1830976126021120 ext(3985408->3989503) 00002000:00010000:3.0:1746155643.176001:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca96a00 00000100:00100000:0.0:1746155643.177973:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.178296:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126021376 00000100:00100000:2.0:1746155643.178302:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126021376 00000100:00100000:2.0:1746155643.178674:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4736 00000100:00100000:2.0:1746155643.178682:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32382:x1830976126021376:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155643.179102:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32382:x1830976126021376:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 420us (1132us total) trans 8589945309 rc 0/0 00000100:00100000:2.0:1746155643.179108:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4736 00010000:00010000:3.0:1746155643.284607:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155643.284610:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.284712:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126021632 00000100:00100000:2.0:1746155643.284719:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126021632 00000100:00100000:2.0:1746155643.284754:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11148 00000100:00100000:2.0:1746155643.284761:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32389:x1830976126021632:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.284777:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.284789:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0a00/0x844e5faceb5f7fa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18359 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.284870:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1a00/0x844e5faceb5f7fa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.284881:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1a00/0x844e5faceb5f7fa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.284890:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1a00/0x844e5faceb5f7fa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.284915:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f7fb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.284921:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f7fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.284926:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f7fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.285010:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f7fb7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.285022:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f7fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.285028:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f7fb7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:2.0:1746155643.285035:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155643.285101:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1a00/0x844e5faceb5f7fa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.285107:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1a00/0x844e5faceb5f7fa9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.285112:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1a00/0x844e5faceb5f7fa9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.285117:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6ef1a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.285120:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1a00/0x844e5faceb5f7fa9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.285126:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1a00/0x844e5faceb5f7fa9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.285135:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155643.285137:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.285140:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1a00/0x844e5faceb5f7fa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.285144:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1a00/0x844e5faceb5f7fa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00000100:00100000:0.0:1746155643.286090:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.286103:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126021888 00000100:00100000:0.0:1746155643.286106:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126021888 00000100:00100000:0.0:1746155643.286125:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11149 00000100:00100000:0.0:1746155643.286130:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32390:x1830976126021888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155643.286138:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155643.286145:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124000/0x844e5faceb5f7fc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18360 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.286183:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f7fcc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286190:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f7fcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286196:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f7fcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286204:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f7fd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286213:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f7fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286217:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f7fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286262:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125a00/0x844e5faceb5f7fda lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286269:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125a00/0x844e5faceb5f7fda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286274:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125a00/0x844e5faceb5f7fda lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155643.286279:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155643.286311:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f7fcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286316:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f7fcc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286321:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f7fcc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286325:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a125200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155643.286328:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f7fcc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286332:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f7fcc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286339:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155643.286341:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155643.286344:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f7fcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286348:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125200/0x844e5faceb5f7fcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286374:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f7fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286379:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f7fd3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286383:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f7fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286387:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a124200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155643.286389:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f7fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286394:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f7fd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286401:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800942dc800) 00010000:00010000:0.0:1746155643.286402:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155643.286405:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f7fd3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286409:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124200/0x844e5faceb5f7fd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155643.286434:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a124000/0x844e5faceb5f7fc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18360 expref: 294 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.286447:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125a00/0x844e5faceb5f7fda lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18360 expref: 293 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.286453:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155643.286455:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155643.286456:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a125a00, rc 0) 00000100:00100000:0.0:1746155643.286490:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32390:x1830976126021888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 360us (402us total) trans 8589945311 rc 0/0 00000100:00100000:0.0:1746155643.286496:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11149 00010000:00010000:2.0:1746155643.286571:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f7fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.286581:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f7fb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.286586:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f7fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.286589:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6ef1000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.286591:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f7fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.286843:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f7fb0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.286852:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800942dc800) 00010000:00010000:2.0:1746155643.286854:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.286856:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f7fb0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.286861:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1000/0x844e5faceb5f7fb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.286887:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0a00/0x844e5faceb5f7fa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18359 expref: 16 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.286896:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f7fb7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18359 expref: 15 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.286911:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.286913:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155643.286915:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef0e00, rc 0) 00000100:00100000:2.0:1746155643.286937:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32389:x1830976126021632:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2176us (2333us total) trans 8589945310 rc 0/0 00000100:00100000:2.0:1746155643.286942:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11148 00000100:00100000:0.0:1746155643.291362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.291439:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126022144 00000100:00100000:1.0:1746155643.291446:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126022144 00000100:00100000:1.0:1746155643.291495:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 756 00000100:00100000:1.0:1746155643.291526:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976126022144:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.291538:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.291555:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f7fb7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18359 expref: 15 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.291574:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155643.291578:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.291609:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976126022144:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 108us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.291615:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 756 00000100:00100000:0.0:1746155643.296653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.297697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.297730:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.297748:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.297753:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126022656 00000100:00100000:2.0:1746155643.297761:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126022656 00000100:00100000:0.0:1746155643.297775:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.297806:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126022016 00000100:00100000:0.0:1746155643.297809:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126022016 00000100:00100000:0.0:1746155643.297843:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 757 00000100:00100000:0.0:1746155643.297850:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1960:x1830976126022016:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155643.297910:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155643.297930:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a125a00/0x844e5faceb5f7fda lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18360 expref: 294 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.297973:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4737 00000100:00100000:2.0:1746155643.297980:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32390:x1830976126022656:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155643.298002:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126022272 00000100:00100000:3.0:1746155643.298006:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126022272 00000100:00100000:3.0:1746155643.298024:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126022400 00000100:00100000:3.0:1746155643.298026:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126022400 00000100:00100000:3.0:1746155643.298042:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17119 00000100:00100000:3.0:1746155643.298047:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976126022272:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155643.298056:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.298067:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948e4200/0x844e5faceb5f7fe8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18367 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155643.298106:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125390080:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.298138:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32390:x1830976126022656:12345-192.168.202.51@tcp:35:cat.0 Request processed in 158us (406us total) trans 8589945312 rc 0/0 00000100:00100000:2.0:1746155643.298144:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4737 00000100:00100000:3.0:1746155643.298157:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfda80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155643.298170:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17120 00000100:00100000:3.0:1746155643.298175:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976126022400:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155643.298181:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.298188:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948e5600/0x844e5faceb5f7fef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1836e expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155643.298208:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125390208:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155643.298224:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155643.298241:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126022784 00000100:00100000:3.0:1746155643.298243:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126022784 00000100:00100000:3.0:1746155643.298266:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11150 00000100:00100000:3.0:1746155643.298271:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32391:x1830976126022784:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155643.298279:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.298287:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5f7ff6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18375 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.298321:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7ffd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.298331:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7ffd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.298338:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7ffd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.298348:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f8004 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.298353:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f8004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.298362:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f8004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.298442:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.298450:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1829c expref: 293 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.298456:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.298472:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1829c expref: 293 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.298481:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1829c expref: 293 pid: 20364 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.298489:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125390336:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.298535:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfdcc0 going to sleep for 11 seconds 00010000:00010000:0.0:1746155643.298675:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155643.298679:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155643.298685:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155643.298690:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155643.298694:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.299258:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1960:x1830976126022016:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1407us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.299265:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 757 00002000:00010000:3.0:1746155643.304556:0:9235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime: 1746155642 -> 1746155643 00002000:00010000:3.0:1746155643.304561:0:9235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime: 1746155642 -> 1746155643 00000100:00100000:3.0:1746155643.304579:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125390080:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155643.304606:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948e4200/0x844e5faceb5f7fe8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18367 expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.304618:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948e4200/0x844e5faceb5f7fe8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18367 expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.307239:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e4200, rc 0) 00000100:00100000:3.0:1746155643.307300:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976126022272:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9248us (10651us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155643.307308:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17119 00000100:00100000:0.0:1746155643.308985:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.310215:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.310272:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126023424 00000100:00100000:2.0:1746155643.310279:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126023424 00000100:00100000:2.0:1746155643.310317:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11151 00000100:00100000:2.0:1746155643.310324:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32393:x1830976126023424:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155643.310341:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.310355:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0200/0x844e5faceb5f8012 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18383 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.310441:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f8019 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310453:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f8019 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310461:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f8019 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310469:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8020 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310475:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310481:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310580:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f8027 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310588:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f8027 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310593:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f8027 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:2.0:1746155643.310600:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000100:00100000:3.0:1746155643.310605:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126022912 00000100:00100000:3.0:1746155643.310609:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126022912 00010000:00010000:2.0:1746155643.310663:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f8019 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310670:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f8019 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310675:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f8019 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310680:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6ef1e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.310683:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f8019 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310688:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f8019 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310696:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155643.310698:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.310701:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f8019 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310708:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1e00/0x844e5faceb5f8019 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310721:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8020 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310725:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8020 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310729:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8020 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310733:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6ef1200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.310734:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8020 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310738:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8020 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310744:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0c00) 00010000:00010000:2.0:1746155643.310746:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.310748:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8020 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310752:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8020 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.310778:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0200/0x844e5faceb5f8012 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18383 expref: 17 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.310786:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f8027 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18383 expref: 16 pid: 19870 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155643.310787:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17121 00000100:00100000:3.0:1746155643.310793:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126022912:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.310795:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.310797:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155643.310799:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.310801:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.310804:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.310807:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef0e00, rc 0) 00010000:00010000:3.0:1746155643.310809:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f8035 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1837c expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.310837:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32393:x1830976126023424:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 514us (624us total) trans 8589945313 rc 0/0 00000100:00100000:3.0:1746155643.310842:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125390464:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.310843:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11151 00000100:00100000:2.0:1746155643.310893:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125390208:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.310923:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948e5600/0x844e5faceb5f7fef lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1836e expref: 8 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.310932:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948e5600/0x844e5faceb5f7fef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1836e expref: 8 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.310938:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e5600, rc 0) 00000100:00100000:3.0:1746155643.311087:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfda80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.312250:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976126022400:12345-192.168.202.51@tcp:101:cat.0 Request processed in 14072us (14552us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.312256:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17120 00000100:00100000:2.0:1746155643.312291:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125390336:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.312301:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155643.312534:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.312621:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126023168 00000100:00100000:2.0:1746155643.312625:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126023168 00000100:00100000:2.0:1746155643.312644:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4738 00000100:00100000:2.0:1746155643.312648:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:7660:x1830976126023168:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746155643.312739:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:7660:x1830976126023168:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 89us (205us total) trans 8589945314 rc 0/0 00000100:00100000:2.0:1746155643.312744:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4738 00000100:00100000:0.0:1746155643.314435:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.315050:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.315325:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126023552 00000100:00100000:1.0:1746155643.315330:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126023552 00000100:00100000:1.0:1746155643.315364:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126023680 00000100:00100000:1.0:1746155643.315367:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126023680 00010000:00010000:1.0:1746155643.315377:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1829c expref: 294 pid: 20364 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155643.315392:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8776 00000100:00100000:1.0:1746155643.315397:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1963:x1830976126023680:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.315405:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.315409:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1829c expref: 294 pid: 20364 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.315419:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1829c expref: 294 pid: 20364 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.315434:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b180200/0x844e5faceb5f7e9f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1829c expref: 294 pid: 20364 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.315448:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155643.315452:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155643.315460:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155643.315465:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155643.315479:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.315517:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1963:x1830976126023680:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 104us (451us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155643.315522:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155643.315523:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8776 00010000:00010000:2.0:1746155643.315530:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155643.315534:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 758 00000100:00100000:1.0:1746155643.315539:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126023552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.315544:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.315553:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0e00/0x844e5faceb5f8027 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18383 expref: 16 pid: 19870 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1746155643.315556:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155643.315560:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1746155643.315561:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155643.315564:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00010000:2.0:1746155643.315572:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155643.315575:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126023552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 37us (1142us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155643.315579:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155643.315580:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 758 00010000:00010000:2.0:1746155643.315586:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7ffd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315591:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7ffd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315595:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7ffd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315599:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb1800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.315602:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7ffd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315607:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7ffd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315613:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155643.315616:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.315618:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7ffd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315621:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb1800/0x844e5faceb5f7ffd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315630:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f8004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315634:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f8004 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315637:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f8004 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315641:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fcb0800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.315643:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f8004 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315647:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f8004 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315652:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0c00) 00010000:00010000:2.0:1746155643.315654:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.315656:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f8004 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315664:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0800/0x844e5faceb5f8004 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.315688:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0400/0x844e5faceb5f7ff6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18375 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.315698:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18375 expref: 7 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.315703:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.315704:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155643.315706:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0e00, rc 0) 00000100:00100000:2.0:1746155643.315730:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32391:x1830976126022784:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 17458us (17953us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155643.315731:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125390464:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.315736:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11150 00010000:00010000:0.0:1746155643.315748:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f8035 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1837c expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155643.315756:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb1e00/0x844e5faceb5f8035 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1837c expref: 20 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155643.315767:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1e00, rc 0) 00000100:00100000:0.0:1746155643.315781:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126022912:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4989us (6798us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155643.316221:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17121 00000100:00100000:0.0:1746155643.316831:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.316865:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126023808 00000100:00100000:2.0:1746155643.316869:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126023808 00000100:00100000:2.0:1746155643.316898:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17122 00000100:00100000:2.0:1746155643.316911:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32389:x1830976126023808:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.316919:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.316928:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef1600/0x844e5faceb5f803c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1838a expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.316942:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 18 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.316948:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.316950:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.316952:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef1600/0x844e5faceb5f803c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1838a expref: 10 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.316969:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 18 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.316977:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 18 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.316987:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125390592:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.317020:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.320667:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.321318:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125390592:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.321338:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef1600/0x844e5faceb5f803c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1838a expref: 10 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.321351:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef1600, rc 0) 00000100:00100000:2.0:1746155643.321379:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32389:x1830976126023808:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4476us (4549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.321386:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17122 00000100:00100000:2.0:1746155643.321403:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126023936 00000100:00100000:2.0:1746155643.321407:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126023936 00000100:00080000:1.0:1746155643.322401:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155643.322628:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17123 00000100:00100000:2.0:1746155643.322636:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+5:1960:x1830976126023936:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155643.322648:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.322659:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef0a00/0x844e5faceb5f8043 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18391 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.322693:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125390720:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.322737:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.323411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.323435:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.324343:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.324696:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.324795:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126024192 00000100:00100000:3.0:1746155643.324801:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126024192 00000100:00100000:3.0:1746155643.324833:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126024448 00000100:00100000:3.0:1746155643.324835:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126024448 00000100:00100000:3.0:1746155643.324846:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126024064 00000100:00100000:3.0:1746155643.324847:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126024064 00000100:00100000:3.0:1746155643.324864:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17124 00000100:00100000:3.0:1746155643.324870:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126024192:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155643.324879:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.324889:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0600/0x844e5faceb5f804a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1839f expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.324916:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.324918:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.324925:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0600/0x844e5faceb5f804a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1839f expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.324937:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0600/0x844e5faceb5f804a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1839f expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.324945:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0600, rc 0) 00000100:00100000:3.0:1746155643.324970:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126024192:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 101us (1560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.324975:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17124 00000100:00100000:3.0:1746155643.324988:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17125 00000100:00100000:3.0:1746155643.324992:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126024448:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155643.324998:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.325005:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0a00/0x844e5faceb5f8051 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f183ad expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155643.325027:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125390848:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155643.325061:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfda80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155643.325074:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17126 00000100:00100000:3.0:1746155643.325079:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126024064:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155643.325084:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.325090:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0200/0x844e5faceb5f8058 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18398 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155643.325109:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125390976:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155643.325124:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfde40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.325328:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.325352:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.325408:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126024320 00000100:00100000:1.0:1746155643.325411:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126024320 00000100:00100000:1.0:1746155643.325424:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126024576 00000100:00100000:1.0:1746155643.325426:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126024576 00000100:00100000:1.0:1746155643.325436:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17127 00000100:00100000:1.0:1746155643.325440:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126024320:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155643.325446:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155643.325452:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b407ca00/0x844e5faceb5f805f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f183a6 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.325462:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.325463:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.325467:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b407ca00/0x844e5faceb5f805f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183a6 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.325477:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b407ca00/0x844e5faceb5f805f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183a6 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.325483:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b407ca00, rc 0) 00000100:00100000:1.0:1746155643.325500:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126024320:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 60us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.325523:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17127 00000100:00100000:1.0:1746155643.325533:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17128 00000100:00100000:1.0:1746155643.325538:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126024576:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155643.325543:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155643.325549:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b407c400/0x844e5faceb5f8066 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f183b4 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.325557:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.325558:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.325562:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b407c400/0x844e5faceb5f8066 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183b4 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.325571:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b407c400/0x844e5faceb5f8066 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183b4 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.325577:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b407c400, rc 0) 00000100:00100000:1.0:1746155643.325589:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126024576:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 51us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.325594:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17128 00000100:00100000:2.0:1746155643.325673:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126024704 00000100:00100000:2.0:1746155643.325676:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126024704 00002000:00100000:2.0:1746155643.325696:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (978944->1048575) req@ffff8800a3fc5880 x1830976126024704/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.325704:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5880 with x1830976126024704 ext(978944->1048575) 00010000:00010000:2.0:1746155643.325709:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 19 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.325719:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 19 pid: 20200 timeout: 872 lvb_type: 0 00002000:00010000:2.0:1746155643.325725:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a3fc5880 00000100:00100000:2.0:1746155643.325735:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1411 00000100:00100000:2.0:1746155643.325740:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126024704:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155643.328170:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.328299:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126024832 00000100:00100000:3.0:1746155643.328304:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126024832 00000100:00100000:3.0:1746155643.328483:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17129 00000100:00100000:3.0:1746155643.328664:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:32390:x1830976126024832:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155643.328674:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.328684:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800948e5200/0x844e5faceb5f806d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f183bb expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.328701:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155643.328706:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e5200/0x844e5faceb5f806d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183bb expref: 22 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.328715:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800948e5200/0x844e5faceb5f806d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183bb expref: 22 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.328723:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e5200, rc 0) 00000100:00100000:3.0:1746155643.329323:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32390:x1830976126024832:12345-192.168.202.51@tcp:101:cat.0 Request processed in 661us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.329329:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17129 00000100:00100000:3.0:1746155643.329824:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125390976:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155643.329845:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0200/0x844e5faceb5f8058 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18398 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.329860:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0200/0x844e5faceb5f8058 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18398 expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.329878:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0200, rc 0) 00000100:00100000:2.0:1746155643.330283:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125390720:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.330300:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef0a00/0x844e5faceb5f8043 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18391 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.330308:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef0a00/0x844e5faceb5f8043 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18391 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.330315:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef0a00, rc 0) 00000100:00100000:3.0:1746155643.330973:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126024064:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5892us (6629us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155643.330979:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17126 00000100:00100000:3.0:1746155643.331013:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125390848:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155643.331026:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0a00/0x844e5faceb5f8051 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183ad expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.331035:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fcb0a00/0x844e5faceb5f8051 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183ad expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.331042:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb0a00, rc 0) 00000100:00100000:2.0:1746155643.331310:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126023936:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 8674us (10647us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.331316:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17123 00000100:00100000:2.0:1746155643.331823:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976126024704:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 6082us (6469us total) trans 17179874308 rc 0/0 00000100:00100000:2.0:1746155643.331831:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1411 00002000:00100000:2.0:1746155643.331838:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (978944->1048575) req@ffff8800a3fc5880 x1830976126024704/t17179874308(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/448 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.331847:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5880 with x1830976126024704 ext(978944->1048575) 00010000:00010000:2.0:1746155643.331853:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 22 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.331864:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 22 pid: 20200 timeout: 872 lvb_type: 0 00002000:00010000:2.0:1746155643.331870:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a3fc5880 00000100:00100000:3.0:1746155643.332281:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1960:x1830976126024448:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 7287us (8843us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155643.332287:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17125 00000100:00100000:1.0:1746155643.334193:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.334272:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126024960 00000100:00100000:2.0:1746155643.334278:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126024960 00010000:00010000:2.0:1746155643.334300:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 22 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.334319:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8777 00000100:00100000:2.0:1746155643.334325:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976126024960:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.334334:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155643.334348:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 22 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.334362:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 22 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.334379:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5800/0x844e5faceb5f7f71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 978944->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18344 expref: 22 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.334548:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.334550:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.334556:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef1600/0x844e5faceb5f803c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1838a expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.334564:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef1600/0x844e5faceb5f803c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1838a expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.334572:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.334573:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.334576:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5200/0x844e5faceb5f806d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183bb expref: 21 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.334582:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e5200/0x844e5faceb5f806d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183bb expref: 21 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.334605:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800948e5200/0x844e5faceb5f806d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183bb expref: 21 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.334616:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125391104:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155643.335089:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef1600/0x844e5faceb5f803c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1838a expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.335097:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125391232:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155643.335871:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.336599:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125391104:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155643.336606:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125391232:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155643.336617:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.336646:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976126024960:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2320us (2455us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.336653:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8777 00000100:00100000:0.0:1746155643.338634:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.338893:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126025216 00000100:00100000:2.0:1746155643.338899:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126025216 00002000:00100000:2.0:1746155643.338939:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f582680 x1830976126025216/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.338948:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f582680 with x1830976126025216 ext(0->1048575) 00002000:00010000:2.0:1746155643.338952:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f582680 00000100:00100000:2.0:1746155643.338968:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8122 00000100:00100000:2.0:1746155643.338974:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126025216:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155643.339373:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.342146:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126025728 00000100:00100000:3.0:1746155643.342153:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126025728 00000100:00100000:3.0:1746155643.342184:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11152 00000100:00100000:3.0:1746155643.342190:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32391:x1830976126025728:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155643.342203:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.342216:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5c00/0x844e5faceb5f8074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f183c2 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.342283:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.342295:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18375 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.342301:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.342325:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18375 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.342335:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18375 expref: 8 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.342346:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125391360:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.342385:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.345695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.345716:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126025856 00000100:00100000:0.0:1746155643.345722:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126025856 00002000:00100000:0.0:1746155643.345752:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e0:0x0] (2015232->2097151) req@ffff88009fed8000 x1830976126025856/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155643.345761:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed8000 with x1830976126025856 ext(2015232->2097151) 00002000:00010000:0.0:1746155643.345765:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fed8000 00000100:00100000:0.0:1746155643.345796:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8123 00000100:00100000:0.0:1746155643.345803:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976126025856:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155643.346077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.346233:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126025984 00000100:00100000:3.0:1746155643.346236:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126025984 00002000:00100000:3.0:1746155643.346253:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fed8380 x1830976126025984/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.346260:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed8380 with x1830976126025984 ext(0->1048575) 00002000:00010000:3.0:1746155643.346263:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed8380 00000100:00100000:3.0:1746155643.346274:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8124 00000100:00100000:3.0:1746155643.346279:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976126025984:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155643.355152:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.355371:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976126025856:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9567us (9681us total) trans 0 rc 81920/81920 00000100:00100000:1.0:1746155643.355381:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8123 00002000:00100000:1.0:1746155643.355390:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e0:0x0] (2015232->2097151) req@ffff88009fed8000 x1830976126025856/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 81920/81920 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.355398:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed8000 with x1830976126025856 ext(2015232->2097151) 00002000:00010000:1.0:1746155643.355403:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fed8000 00000100:00100000:3.0:1746155643.355485:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125391360:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.355528:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:3.0:1746155643.355724:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976126025984:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9444us (9646us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155643.355730:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8124 00002000:00100000:3.0:1746155643.355735:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fed8380 x1830976126025984/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.355742:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed8380 with x1830976126025984 ext(0->1048575) 00002000:00010000:3.0:1746155643.355745:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed8380 00000100:00100000:2.0:1746155643.355808:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126026112 00000100:00100000:2.0:1746155643.355814:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126026112 00010000:00010000:2.0:1746155643.355836:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18375 expref: 9 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.355854:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8778 00000100:00100000:2.0:1746155643.355860:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126026112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.355870:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155643.355875:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18375 expref: 9 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.355885:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18375 expref: 9 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.355914:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fcb0e00/0x844e5faceb5f800b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18375 expref: 9 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.355929:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.355932:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.355940:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.355946:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.355958:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.355973:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126026112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 113us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.355979:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8778 00000100:00100000:2.0:1746155643.356329:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126025216:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17353us (17702us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155643.356334:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8122 00002000:00100000:2.0:1746155643.356340:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f582680 x1830976126025216/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.356347:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f582680 with x1830976126025216 ext(0->1048575) 00002000:00010000:2.0:1746155643.356350:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f582680 00010000:00010000:3.0:1746155643.356556:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.356562:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:3.0:1746155643.356577:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155643.356672:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5c00/0x844e5faceb5f8074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c2 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.356687:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c2 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.356693:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155643.356695:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155643.356697:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e4600, rc 0) 00000100:00100000:3.0:1746155643.356802:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32391:x1830976126025728:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 14611us (17428us total) trans 8589945315 rc 0/0 00000100:00100000:3.0:1746155643.356811:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11152 00000100:00100000:0.0:1746155643.363316:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.364034:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126026240 00000100:00100000:3.0:1746155643.364042:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126026240 00000100:00100000:3.0:1746155643.364090:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17130 00000100:00100000:3.0:1746155643.364098:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32389:x1830976126026240:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155643.364114:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.364128:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f8089 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f183c9 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.364150:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 12 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.364158:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155643.364159:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155643.364162:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f8089 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c9 expref: 8 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.364187:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 12 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.364197:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 12 pid: 29728 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.364208:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125391488:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.364279:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.364559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.364785:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126026368 00000100:00100000:3.0:1746155643.364790:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126026368 00000100:00100000:3.0:1746155643.364813:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11153 00000100:00100000:3.0:1746155643.364818:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32391:x1830976126026368:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155643.364830:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.364840:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5800/0x844e5faceb5f8090 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f183d0 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.364900:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.364920:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c2 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.364926:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.364943:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c2 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.364950:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c2 expref: 9 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.364958:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125391616:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.364990:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.368007:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.371161:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126026496 00000100:00100000:2.0:1746155643.371171:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126026496 00000100:00100000:2.0:1746155643.371224:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17131 00000100:00100000:2.0:1746155643.371232:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:32390:x1830976126026496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.371245:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.371259:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009374c200/0x844e5faceb5f809e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f183d7 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.371282:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 9 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.371289:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.371291:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.371294:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374c200/0x844e5faceb5f809e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d7 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.371319:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 9 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.371328:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 9 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.371339:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125391744:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.371413:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.372811:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.372893:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126026624 00000100:00100000:3.0:1746155643.372897:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126026624 00000100:00100000:3.0:1746155643.372931:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17132 00000100:00100000:3.0:1746155643.372937:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32393:x1830976126026624:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155643.372947:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.372957:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f183de expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.372976:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0x844e5faceb5f7ed7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182c6 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.372984:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0600/0x844e5faceb5f804a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1839f expref: 7 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.372990:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7ede lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182cd expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.372995:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.372997:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.372999:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1884160->2097151] (req 1884160->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 10 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.373016:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7ede lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182cd expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.373024:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7ede lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182cd expref: 12 pid: 10591 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.373033:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125391872:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.373071:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0600/0x844e5faceb5f804a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1839f expref: 7 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.373079:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0600/0x844e5faceb5f804a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1839f expref: 7 pid: 19959 timeout: 872 lvb_type: 1 00000100:00100000:3.0:1746155643.373088:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125392000:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.373107:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0x844e5faceb5f7ed7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182c6 expref: 10 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.373114:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0x844e5faceb5f7ed7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182c6 expref: 10 pid: 10591 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.373121:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125392128:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.373133:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.374317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.374743:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125391616:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.374760:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155643.374821:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125391488:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.374838:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f8089 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c9 expref: 10 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.374849:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e4800, rc 0) 00000100:00100000:2.0:1746155643.374872:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32389:x1830976126026240:12345-192.168.202.51@tcp:101:cat.0 Request processed in 10775us (11562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.374879:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17130 00000100:00100000:2.0:1746155643.374916:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126026752 00000100:00100000:2.0:1746155643.374920:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126026752 00002000:00100000:2.0:1746155643.374943:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2015231) req@ffff88009fac6300 x1830976126026752/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.374951:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6300 with x1830976126026752 ext(1048576->2015231) 00010000:00010000:2.0:1746155643.374956:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 13 pid: 29728 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.374965:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 13 pid: 29728 timeout: 872 lvb_type: 0 00002000:00010000:2.0:1746155643.374971:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fac6300 00000100:00100000:2.0:1746155643.374983:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1412 00000100:00100000:2.0:1746155643.374988:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1962:x1830976126026752:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155643.376199:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.376255:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126026880 00000100:00100000:1.0:1746155643.376259:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126026880 00010000:00010000:1.0:1746155643.376276:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c2 expref: 10 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155643.376292:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8779 00000100:00100000:1.0:1746155643.376297:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976126026880:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.376305:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.376310:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c2 expref: 10 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.376319:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c2 expref: 10 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.376335:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e4600/0x844e5faceb5f807b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c2 expref: 10 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.376348:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155643.376352:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155643.376359:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155643.376365:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155643.376615:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.376636:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976126026880:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 338us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.376641:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8779 00010000:00010000:3.0:1746155643.376840:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.376846:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:3.0:1746155643.376877:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155643.376881:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155643.376892:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.376926:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5800/0x844e5faceb5f8090 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d0 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.376944:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d0 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.376950:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155643.376952:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155643.376954:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e5600, rc 0) 00000100:00100000:3.0:1746155643.376974:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32391:x1830976126026368:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 12156us (12415us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.376980:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11153 00000100:00100000:3.0:1746155643.380537:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125391872:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.380549:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125392000:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.380555:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125392128:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.380581:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1884160->2097151] (req 1884160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.380597:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fcb1400, rc 0) 00000100:00100000:3.0:1746155643.380675:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32393:x1830976126026624:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7737us (7865us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.380683:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17132 00000100:00100000:3.0:1746155643.380718:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125391744:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.380731:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009374c200/0x844e5faceb5f809e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d7 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.380744:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374c200, rc 0) 00000100:00100000:3.0:1746155643.380758:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32390:x1830976126026496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 9528us (12759us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.380763:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17131 00000100:00100000:1.0:1746155643.386142:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.388021:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.388072:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126027136 00000100:00100000:2.0:1746155643.388080:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126027136 00010000:00010000:2.0:1746155643.388112:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7ede lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182cd expref: 15 pid: 10591 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.388144:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8780 00000100:00100000:2.0:1746155643.388150:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976126027136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.388161:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155643.388178:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7ede lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182cd expref: 15 pid: 10591 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.388188:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7ede lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182cd expref: 15 pid: 10591 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.388205:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090487400/0x844e5faceb5f7ede lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182cd expref: 15 pid: 10591 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.388221:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.388268:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976126027136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 117us (2133us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.388274:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8780 00000100:00100000:1.0:1746155643.388593:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126027392 00000100:00100000:1.0:1746155643.388597:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126027392 00010000:00010000:1.0:1746155643.388609:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0x844e5faceb5f7ed7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182c6 expref: 9 pid: 10591 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155643.388623:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8781 00000100:00100000:1.0:1746155643.388628:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976126027392:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.388634:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.388642:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0x844e5faceb5f7ed7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182c6 expref: 9 pid: 10591 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.388649:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0x844e5faceb5f7ed7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182c6 expref: 9 pid: 10591 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.388660:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090486a00/0x844e5faceb5f7ed7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182c6 expref: 9 pid: 10591 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.388671:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.388687:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976126027392:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 58us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.388692:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8781 00000100:00100000:1.0:1746155643.388719:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.389060:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126027008 00000100:00100000:1.0:1746155643.389064:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126027008 00002000:00100000:1.0:1746155643.389086:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3969024->3989503) req@ffff88009fac6a00 x1830976126027008/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.389094:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6a00 with x1830976126027008 ext(3969024->3989503) 00010000:00010000:1.0:1746155643.389101:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 10 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.389111:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 10 pid: 20200 timeout: 872 lvb_type: 0 00002000:00010000:1.0:1746155643.389116:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac6a00 00000100:00100000:1.0:1746155643.389132:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1413 00000100:00100000:1.0:1746155643.389137:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126027008:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155643.389296:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.389347:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126027264 00000100:00100000:2.0:1746155643.389350:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126027264 00010000:00010000:2.0:1746155643.389361:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0600/0x844e5faceb5f804a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1839f expref: 8 pid: 19959 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746155643.389374:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8782 00000100:00100000:2.0:1746155643.389379:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126027264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.389384:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155643.389392:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0600/0x844e5faceb5f804a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1839f expref: 8 pid: 19959 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746155643.389400:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0600/0x844e5faceb5f804a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1839f expref: 8 pid: 19959 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746155643.389411:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb0600/0x844e5faceb5f804a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1839f expref: 8 pid: 19959 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746155643.389419:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.389420:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.389426:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 7 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.389433:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 7 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.389456:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 7 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.389466:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125392256:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155643.389521:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.391700:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.391731:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.392126:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.392202:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.392229:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126027520 00000100:00100000:2.0:1746155643.392234:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126027520 00000100:00100000:2.0:1746155643.392262:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126027776 00000100:00100000:2.0:1746155643.392263:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126027776 00000100:00100000:2.0:1746155643.392280:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17133 00000100:00100000:2.0:1746155643.392286:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1962:x1830976126027520:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155643.392301:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.392313:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5f80ac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f183e5 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.392329:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.392331:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.392337:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5f80ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183e5 expref: 7 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.392349:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5f80ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183e5 expref: 7 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.392358:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374de00, rc 0) 00000100:00100000:2.0:1746155643.392387:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126027520:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 101us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.392393:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17133 00000100:00100000:2.0:1746155643.392402:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126027648 00000100:00100000:2.0:1746155643.392404:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126027648 00000100:00100000:2.0:1746155643.392415:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17134 00000100:00100000:2.0:1746155643.392419:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976126027776:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155643.392425:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.392433:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948e5800/0x844e5faceb5f80b3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f183f3 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.392461:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125392384:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.392491:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.392520:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17135 00000100:00100000:2.0:1746155643.392526:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126027648:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155643.392531:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.392536:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800948e4200/0x844e5faceb5f80ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f183ec expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.392555:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125392512:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.392571:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6161cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.393163:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126027904 00000100:00100000:1.0:1746155643.393167:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126027904 00000100:00100000:1.0:1746155643.393187:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17136 00000100:00100000:1.0:1746155643.393192:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126027904:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155643.393198:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155643.393204:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a626f600/0x844e5faceb5f80c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f183fa expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.393222:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125392640:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155643.393242:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a406c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.394339:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125392256:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155643.394350:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.395512:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126027264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6122us (6204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.395521:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8782 00000100:00100000:0.0:1746155643.395743:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.395917:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126028160 00000100:00100000:1.0:1746155643.395922:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126028160 00002000:00100000:1.0:1746155643.395946:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1884160->1888255) req@ffff88009fed9500 x1830976126028160/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.395954:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9500 with x1830976126028160 ext(1884160->1888255) 00002000:00010000:1.0:1746155643.395958:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fed9500 00000100:00100000:1.0:1746155643.395971:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8125 00000100:00100000:1.0:1746155643.395976:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976126028160:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155643.396091:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976126028160:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 115us (349us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155643.396097:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8125 00002000:00100000:1.0:1746155643.396102:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1884160->1888255) req@ffff88009fed9500 x1830976126028160/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.396108:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9500 with x1830976126028160 ext(1884160->1888255) 00002000:00010000:1.0:1746155643.396111:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fed9500 00000100:00100000:0.0:1746155643.396320:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.396427:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126028416 00000100:00100000:3.0:1746155643.396431:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126028416 00000100:00100000:3.0:1746155643.396451:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11154 00000100:00100000:3.0:1746155643.396456:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32395:x1830976126028416:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155643.396467:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.396477:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de400/0x844e5faceb5f80c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18401 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.396558:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de000/0x844e5faceb5f80cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396568:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de000/0x844e5faceb5f80cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396576:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de000/0x844e5faceb5f80cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396586:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfa00/0x844e5faceb5f80d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396591:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfa00/0x844e5faceb5f80d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396596:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfa00/0x844e5faceb5f80d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396673:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfc00/0x844e5faceb5f80dd lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396680:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfc00/0x844e5faceb5f80dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396685:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfc00/0x844e5faceb5f80dd lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:3.0:1746155643.396692:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155643.396752:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de000/0x844e5faceb5f80cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396758:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de000/0x844e5faceb5f80cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396763:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de000/0x844e5faceb5f80cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396768:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0de000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155643.396771:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de000/0x844e5faceb5f80cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396776:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de000/0x844e5faceb5f80cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396784:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155643.396787:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155643.396790:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de000/0x844e5faceb5f80cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396794:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de000/0x844e5faceb5f80cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396809:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfa00/0x844e5faceb5f80d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396813:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfa00/0x844e5faceb5f80d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396817:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfa00/0x844e5faceb5f80d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396821:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f0dfa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155643.396823:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfa00/0x844e5faceb5f80d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396827:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfa00/0x844e5faceb5f80d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396832:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0f00) 00010000:00010000:3.0:1746155643.396835:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155643.396836:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfa00/0x844e5faceb5f80d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396841:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfa00/0x844e5faceb5f80d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.396866:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0de400/0x844e5faceb5f80c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18401 expref: 296 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.396875:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfc00/0x844e5faceb5f80dd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18401 expref: 295 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.396881:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155643.396883:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155643.396885:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f0dfc00, rc 0) 00000100:00100000:3.0:1746155643.396916:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:32395:x1830976126028416:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 447us (584us total) trans 8589945316 rc 0/0 00000100:00100000:3.0:1746155643.396921:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11154 00000100:00100000:3.0:1746155643.399780:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1962:x1830976126026752:12345-192.168.202.51@tcp:4:cat.0 Request processed in 24786us (25459us total) trans 21474841625 rc 0/0 00000100:00100000:3.0:1746155643.399789:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1412 00002000:00100000:3.0:1746155643.399798:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2015231) req@ffff88009fac6300 x1830976126026752/t21474841625(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/448 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.399806:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6300 with x1830976126026752 ext(1048576->2015231) 00010000:00010000:3.0:1746155643.399812:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 14 pid: 29728 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.399824:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 14 pid: 29728 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746155643.399830:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fac6300 00000100:00100000:1.0:1746155643.400189:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126027008:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 11051us (11468us total) trans 17179874309 rc 0/0 00000100:00100000:1.0:1746155643.400194:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1413 00002000:00100000:1.0:1746155643.400197:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (3969024->3989503) req@ffff88009fac6a00 x1830976126027008/t17179874309(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/448 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.400202:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6a00 with x1830976126027008 ext(3969024->3989503) 00010000:00010000:1.0:1746155643.400207:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 12 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.400216:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 12 pid: 20200 timeout: 872 lvb_type: 0 00002000:00010000:1.0:1746155643.400220:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac6a00 00000100:00100000:2.0:1746155643.400919:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125392512:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.400942:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948e4200/0x844e5faceb5f80ba lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183ec expref: 10 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.400953:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948e4200/0x844e5faceb5f80ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183ec expref: 10 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.400964:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e4200, rc 0) 00000100:00100000:2.0:1746155643.400984:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976126027648:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 8458us (8858us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.400990:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17135 00002000:00010000:2.0:1746155643.401014:0:9235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime: 1746155642 -> 1746155643 00002000:00010000:2.0:1746155643.401016:0:9235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime: 1746155642 -> 1746155643 00000100:00100000:2.0:1746155643.401024:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125392384:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.401036:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800948e5800/0x844e5faceb5f80b3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183f3 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.401044:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948e5800/0x844e5faceb5f80b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183f3 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.401050:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800948e5800, rc 0) 00000100:00100000:2.0:1746155643.401064:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126027776:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 8644us (9333us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.401069:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17134 00000100:00100000:0.0:1746155643.402252:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.402305:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125392640:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155643.402323:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155643.402324:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a626f600/0x844e5faceb5f80c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183fa expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.402333:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a626f600/0x844e5faceb5f80c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183fa expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.402344:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a626f600, rc 0) 00000100:00100000:1.0:1746155643.402366:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a15a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126027904:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 9172us (10163us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155643.402371:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17136 00000100:00100000:2.0:1746155643.402474:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126028544 00000100:00100000:2.0:1746155643.402480:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126028544 00000100:00100000:1.0:1746155643.402481:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126028672 00000100:00100000:1.0:1746155643.402484:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126028672 00010000:00010000:2.0:1746155643.402498:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 14 pid: 29728 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155643.402524:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17137 00000100:00100000:1.0:1746155643.402531:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32395:x1830976126028672:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:2.0:1746155643.402537:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8783 00010000:00010000:1.0:1746155643.402541:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155643.402542:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1963:x1830976126028544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.402551:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.402551:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18408 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.402559:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 14 pid: 29728 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.402567:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 14 pid: 29728 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.402568:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef1600/0x844e5faceb5f803c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1838a expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.402580:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdc8600/0x844e5faceb5f7efa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1060864->2015231) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182e9 expref: 14 pid: 29728 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.402580:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5f80ac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183e5 expref: 6 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.402586:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5200/0x844e5faceb5f806d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183bb expref: 23 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.402589:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.402590:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.402591:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.402592:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.402594:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [712704->753663] (req 712704->753663) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 23 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.402597:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f8089 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c9 expref: 7 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.402604:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f8089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c9 expref: 7 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.402612:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800948e5200/0x844e5faceb5f806d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183bb expref: 23 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.402620:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f8089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c9 expref: 7 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.402621:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800948e5200/0x844e5faceb5f806d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183bb expref: 23 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155643.402629:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125392768:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.402630:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125392896:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155643.402667:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5f80ac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183e5 expref: 6 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.402675:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5f80ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183e5 expref: 6 pid: 9235 timeout: 872 lvb_type: 1 00000100:00100000:1.0:1746155643.402682:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125393024:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.402814:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6161cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746155643.402826:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef1600/0x844e5faceb5f803c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1838a expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.402834:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef1600/0x844e5faceb5f803c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1838a expref: 11 pid: 9235 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155643.402841:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125393152:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155643.402856:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a406c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.407070:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.407144:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126028800 00000100:00100000:2.0:1746155643.407151:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126028800 00000100:00100000:2.0:1746155643.407183:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17138 00000100:00100000:2.0:1746155643.407190:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32393:x1830976126028800:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155643.407202:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.407216:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1840f expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.407239:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f0df600/0x844e5faceb5f7f01 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f0 expref: 23 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.407247:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b407ca00/0x844e5faceb5f805f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183a6 expref: 6 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.407255:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136b73e00/0x844e5faceb5f7f08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f7 expref: 13 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.407260:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.407261:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.407264:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1048576->1343487] (req 1048576->1343487) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 13 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.407286:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136b73e00/0x844e5faceb5f7f08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f7 expref: 13 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.407295:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136b73e00/0x844e5faceb5f7f08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f7 expref: 13 pid: 8438 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.407306:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125393280:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.407383:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b407ca00/0x844e5faceb5f805f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183a6 expref: 6 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.407391:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b407ca00/0x844e5faceb5f805f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183a6 expref: 6 pid: 1625 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746155643.407399:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125393408:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.407419:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f0df600/0x844e5faceb5f7f01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f0 expref: 23 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.407430:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f0df600/0x844e5faceb5f7f01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f0 expref: 23 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.407437:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125393536:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.407449:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.414710:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.414855:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125392896:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155643.414857:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125392768:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.414873:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155643.414918:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1963:x1830976126028544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 12375us (12668us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.414924:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126028928 00000100:00100000:3.0:1746155643.414926:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8783 00000100:00100000:1.0:1746155643.414929:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126028928 00010000:00010000:1.0:1746155643.414953:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 14 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155643.414986:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8784 00000100:00100000:1.0:1746155643.414992:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126028928:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.415001:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.415025:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 14 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.415034:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 14 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.415053:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5a00/0x844e5faceb5f7f9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3969024->3989503) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18352 expref: 14 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.415075:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.415078:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.415084:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009374c200/0x844e5faceb5f809e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d7 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.415092:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374c200/0x844e5faceb5f809e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d7 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.415123:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009374c200/0x844e5faceb5f809e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d7 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.415135:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125393664:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155643.415180:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a40000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.416874:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.416952:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126029440 00000100:00100000:2.0:1746155643.416957:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126029440 00000100:00100000:2.0:1746155643.416997:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11155 00000100:00100000:2.0:1746155643.417003:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32391:x1830976126029440:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155643.417015:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.417028:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0a00/0x844e5faceb5f80f9 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18416 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.417091:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8100 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.417102:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8100 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.417110:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8100 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.417118:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8100 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.417123:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8100 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.417129:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8100 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.417134:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6ef1200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.417137:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8100 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.417142:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8100 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.417149:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.417151:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155643.417153:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8100 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.417157:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1200/0x844e5faceb5f8100 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:2.0:1746155643.417193:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0a00/0x844e5faceb5f80f9 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18416 expref: 9 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.417199:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0a00/0x844e5faceb5f80f9 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18416 expref: 9 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.417207:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef0a00, rc 0) 00000100:00100000:2.0:1746155643.417230:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32391:x1830976126029440:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 227us (358us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.417235:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11155 00000100:00100000:0.0:1746155643.420025:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.420050:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.420073:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126029184 00000100:00100000:3.0:1746155643.420079:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126029184 00000100:00100000:0.0:1746155643.420081:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155643.420102:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5f80ac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183e5 expref: 7 pid: 9235 timeout: 872 lvb_type: 1 00000100:00100000:0.0:1746155643.420104:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.420115:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.420134:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126030080 00000100:00100000:3.0:1746155643.420137:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126030080 00010000:00010000:3.0:1746155643.420147:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136b73e00/0x844e5faceb5f7f08 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f7 expref: 14 pid: 8438 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.420160:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126030208 00000100:00100000:3.0:1746155643.420161:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126030208 00010000:00010000:3.0:1746155643.420169:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef1600/0x844e5faceb5f803c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1838a expref: 15 pid: 9235 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.420179:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8785 00000100:00100000:3.0:1746155643.420186:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126029184:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155643.420197:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155643.420217:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5f80ac lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183e5 expref: 7 pid: 9235 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746155643.420226:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5f80ac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183e5 expref: 7 pid: 9235 timeout: 872 lvb_type: 1 00010000:00010000:3.0:1746155643.420244:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155643.420287:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126029184:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 101us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.420294:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8785 00000100:00100000:3.0:1746155643.420308:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8786 00000100:00100000:3.0:1746155643.420313:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976126030080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155643.420323:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155643.420332:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136b73e00/0x844e5faceb5f7f08 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f7 expref: 15 pid: 8438 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.420340:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136b73e00/0x844e5faceb5f7f08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f7 expref: 15 pid: 8438 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.420350:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155643.420364:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976126030080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.420369:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8786 00000100:00100000:3.0:1746155643.420383:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8787 00000100:00100000:3.0:1746155643.420388:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126030208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155643.420393:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155643.420399:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef1600/0x844e5faceb5f803c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1838a expref: 14 pid: 9235 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.420406:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef1600/0x844e5faceb5f803c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1838a expref: 14 pid: 9235 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.420416:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155643.420428:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126030208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 40us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.420432:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8787 00000100:00100000:3.0:1746155643.420450:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126029696 00000100:00100000:3.0:1746155643.420453:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126029696 00002000:00100000:3.0:1746155643.420474:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1884159) req@ffff88009fedb100 x1830976126029696/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.420482:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fedb100 with x1830976126029696 ext(1048576->1884159) 00002000:00010000:3.0:1746155643.420485:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fedb100 00000100:00100000:3.0:1746155643.420522:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126029568 00000100:00100000:3.0:1746155643.420525:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126029568 00002000:00100000:3.0:1746155643.420538:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009fedb480 x1830976126029568/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.420544:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fedb480 with x1830976126029568 ext(1048576->2097151) 00002000:00010000:3.0:1746155643.420547:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fedb480 00000100:00100000:3.0:1746155643.420558:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8126 00000100:00100000:3.0:1746155643.420562:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976126029696:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155643.420805:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8127 00000100:00100000:1.0:1746155643.420813:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976126029568:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155643.421584:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125393664:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155643.421598:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155643.421620:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126028928:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6628us (6917us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155643.421625:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8784 00010000:00010000:2.0:1746155643.422135:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009374de00/0x844e5faceb5f80ac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183e5 expref: 6 pid: 9235 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746155643.422152:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125393024:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.422163:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6ef1600/0x844e5faceb5f803c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1838a expref: 12 pid: 9235 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.422172:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125393152:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.422189:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [712704->753663] (req 712704->753663) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 23 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.422199:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17ba00, rc 0) 00000100:00100000:2.0:1746155643.422223:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32395:x1830976126028672:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 19693us (19901us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.422229:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17137 00010000:00010000:2.0:1746155643.422260:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136b73e00/0x844e5faceb5f7f08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f7 expref: 11 pid: 8438 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.422268:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125393280:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.422276:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c212d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125393408:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.422283:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125393536:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.422297:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->1343487] (req 1048576->1343487) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 10 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.422304:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090487400, rc 0) 00000100:00100000:2.0:1746155643.422320:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32393:x1830976126028800:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 15131us (15257us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.422325:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17138 00000100:00100000:1.0:1746155643.423975:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.424126:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.424144:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126029952 00000100:00100000:1.0:1746155643.424149:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126029952 00010000:00010000:1.0:1746155643.424171:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b407ca00/0x844e5faceb5f805f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183a6 expref: 6 pid: 1625 timeout: 872 lvb_type: 1 00000100:00100000:1.0:1746155643.424190:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126030464 00000100:00100000:1.0:1746155643.424191:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126030464 00010000:00010000:1.0:1746155643.424199:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f0df600/0x844e5faceb5f7f01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f0 expref: 23 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155643.424212:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8788 00000100:00100000:1.0:1746155643.424218:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1963:x1830976126029952:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.424227:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.424243:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b407ca00/0x844e5faceb5f805f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183a6 expref: 6 pid: 1625 timeout: 872 lvb_type: 1 00010000:00010000:1.0:1746155643.424252:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b407ca00/0x844e5faceb5f805f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183a6 expref: 6 pid: 1625 timeout: 872 lvb_type: 1 00010000:00010000:1.0:1746155643.424268:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b407ca00/0x844e5faceb5f805f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183a6 expref: 6 pid: 1625 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746155643.424314:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8789 00000100:00100000:2.0:1746155643.424321:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976126030464:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.424327:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155643.424336:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f0df600/0x844e5faceb5f7f01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f0 expref: 23 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.424343:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f0df600/0x844e5faceb5f7f01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f0 expref: 23 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.424354:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f0df600/0x844e5faceb5f7f01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182f0 expref: 23 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.424363:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.424365:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.424372:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.424379:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.424403:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.424414:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c210700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125393792:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155643.424458:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00010000:00010000:1.0:1746155643.424528:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.424546:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+5:1963:x1830976126029952:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 328us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.424553:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8788 00000100:00100000:1.0:1746155643.424598:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.424608:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126030336 00000100:00100000:1.0:1746155643.424611:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126030336 00010000:00010000:1.0:1746155643.424621:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800948e5200/0x844e5faceb5f806d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183bb expref: 23 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155643.424633:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8790 00000100:00100000:1.0:1746155643.424638:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976126030336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.424644:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155643.424646:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155643.424654:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800948e5200/0x844e5faceb5f806d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183bb expref: 23 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.424961:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126030720 00000100:00100000:2.0:1746155643.424964:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126030720 00000100:00100000:2.0:1746155643.424986:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4739 00000100:00100000:2.0:1746155643.424991:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32391:x1830976126030720:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:2.0:1746155643.425128:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32391:x1830976126030720:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 137us (482us total) trans 8589945317 rc 0/0 00000100:00100000:2.0:1746155643.425134:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4739 00010000:00010000:1.0:1746155643.425181:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800948e5200/0x844e5faceb5f806d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183bb expref: 23 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.425193:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800948e5200/0x844e5faceb5f806d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183bb expref: 23 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.425200:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.425202:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.425205:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 22 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.425212:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 22 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.425230:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 22 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.425239:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125393920:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155643.425279:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea910c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.434431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.434463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.434464:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c210700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125393792:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155643.434482:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155643.434538:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976126030464:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10217us (10411us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.434547:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8789 00000100:00100000:3.0:1746155643.434598:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126030976 00000100:00100000:3.0:1746155643.434602:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126030976 00002000:00100000:3.0:1746155643.434630:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009c212d80 x1830976126030976/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.434638:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212d80 with x1830976126030976 ext(2097152->3145727) 00002000:00010000:3.0:1746155643.434642:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c212d80 00000100:00100000:2.0:1746155643.434648:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126031104 00000100:00100000:2.0:1746155643.434651:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126031104 00000100:00100000:3.0:1746155643.434659:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8128 00002000:00100000:2.0:1746155643.434663:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009c212680 x1830976126031104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746155643.434664:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976126030976:12345-192.168.202.51@tcp:3:multiop.0 00002000:00100000:2.0:1746155643.434669:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212680 with x1830976126031104 ext(3145728->4194303) 00002000:00010000:2.0:1746155643.434671:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c212680 00000100:00100000:2.0:1746155643.434681:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8129 00000100:00100000:2.0:1746155643.434684:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126031104:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155643.434751:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.434767:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.434827:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126029568:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 14014us (14744us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155643.434835:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8127 00002000:00100000:0.0:1746155643.434840:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009fedb480 x1830976126029568/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155643.434847:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fedb480 with x1830976126029568 ext(1048576->2097151) 00002000:00010000:0.0:1746155643.434851:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fedb480 00000100:00100000:0.0:1746155643.434864:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126031616 00000100:00100000:0.0:1746155643.434867:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126031616 00002000:00100000:0.0:1746155643.434879:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e1:0x0] (712704->716799) req@ffff88009c210700 x1830976126031616/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155643.434886:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210700 with x1830976126031616 ext(712704->716799) 00002000:00010000:0.0:1746155643.434888:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c210700 00000100:00100000:0.0:1746155643.434913:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126031744 00000100:00100000:0.0:1746155643.434915:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126031744 00000100:00100000:2.0:1746155643.434923:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8130 00002000:00100000:0.0:1746155643.434925:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e3:0x0] (1339392->1343487) req@ffff88009c210e00 x1830976126031744/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746155643.434928:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976126031616:12345-192.168.202.51@tcp:3:multiop.0 00002000:00100000:0.0:1746155643.434933:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210e00 with x1830976126031744 ext(1339392->1343487) 00002000:00010000:0.0:1746155643.434935:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c210e00 00000100:00100000:0.0:1746155643.434945:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8131 00000100:00100000:0.0:1746155643.434950:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126031744:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155643.435003:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976126031616:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 75us (251us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155643.435010:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126031744:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 59us (241us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155643.435011:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8130 00002000:00100000:2.0:1746155643.435014:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (712704->716799) req@ffff88009c210700 x1830976126031616/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746155643.435016:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8131 00002000:00100000:2.0:1746155643.435020:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210700 with x1830976126031616 ext(712704->716799) 00002000:00100000:0.0:1746155643.435020:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e3:0x0] (1339392->1343487) req@ffff88009c210e00 x1830976126031744/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00010000:2.0:1746155643.435023:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c210700 00002000:00100000:0.0:1746155643.435026:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210e00 with x1830976126031744 ext(1339392->1343487) 00002000:00010000:0.0:1746155643.435029:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c210e00 00000100:00100000:1.0:1746155643.435158:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125393920:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155643.435169:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.435185:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976126030336:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10547us (10587us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.435190:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8790 00000100:00100000:0.0:1746155643.435876:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976126029696:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 15312us (15823us total) trans 0 rc 835584/835584 00000100:00100000:0.0:1746155643.435882:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8126 00002000:00100000:0.0:1746155643.435887:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1884159) req@ffff88009fedb100 x1830976126029696/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 835584/835584 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155643.435893:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fedb100 with x1830976126029696 ext(1048576->1884159) 00002000:00010000:0.0:1746155643.435897:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fedb100 00000100:00100000:0.0:1746155643.442253:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.443454:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.443532:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126032256 00000100:00100000:3.0:1746155643.443540:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126032256 00000100:00100000:2.0:1746155643.443570:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126032000 00000100:00100000:2.0:1746155643.443573:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126032000 00000100:00100000:3.0:1746155643.443581:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4740 00000100:00100000:3.0:1746155643.443588:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32393:x1830976126032256:12345-192.168.202.51@tcp:35:multiop.0 00002000:00100000:2.0:1746155643.443597:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e1:0x0] (749568->753663) req@ffff88009fed9180 x1830976126032000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.443606:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9180 with x1830976126032000 ext(749568->753663) 00002000:00010000:2.0:1746155643.443610:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed9180 00000100:00100000:2.0:1746155643.443622:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8132 00000100:00100000:2.0:1746155643.443626:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126032000:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155643.443747:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126032000:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 120us (1502us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155643.443748:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32393:x1830976126032256:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 162us (296us total) trans 8589945318 rc 0/0 00000100:00100000:3.0:1746155643.443753:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4740 00000100:00100000:2.0:1746155643.443753:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8132 00002000:00100000:2.0:1746155643.443758:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e1:0x0] (749568->753663) req@ffff88009fed9180 x1830976126032000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.443765:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9180 with x1830976126032000 ext(749568->753663) 00002000:00010000:2.0:1746155643.443767:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed9180 00000100:00100000:3.0:1746155643.446875:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976126030976:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12202us (12443us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155643.446885:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8128 00002000:00100000:3.0:1746155643.446895:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009c212d80 x1830976126030976/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.446911:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212d80 with x1830976126030976 ext(2097152->3145727) 00002000:00010000:3.0:1746155643.446916:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c212d80 00000100:00100000:2.0:1746155643.451492:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126031104:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 16797us (17019us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155643.451533:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8129 00002000:00100000:2.0:1746155643.451544:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009c212680 x1830976126031104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.451553:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212680 with x1830976126031104 ext(3145728->4194303) 00002000:00010000:2.0:1746155643.451558:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c212680 00000100:00100000:0.0:1746155643.456596:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.456693:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126032512 00000100:00100000:2.0:1746155643.456701:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126032512 00002000:00100000:2.0:1746155643.456737:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1343488->2097151) req@ffff88009fed9c00 x1830976126032512/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.456746:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9c00 with x1830976126032512 ext(1343488->2097151) 00002000:00010000:2.0:1746155643.456751:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed9c00 00000100:00100000:2.0:1746155643.456780:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8133 00000100:00100000:2.0:1746155643.456786:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126032512:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155643.458686:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.461551:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126032768 00000100:00100000:2.0:1746155643.461560:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126032768 00000100:00100000:2.0:1746155643.461611:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4741 00000100:00100000:2.0:1746155643.461618:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:32395:x1830976126032768:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155643.461809:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32395:x1830976126032768:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 190us (3126us total) trans 8589945319 rc 0/0 00000100:00100000:2.0:1746155643.461815:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4741 00000100:00100000:0.0:1746155643.465953:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.466011:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.466069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.466283:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126032896 00000100:00100000:2.0:1746155643.466290:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126032896 00000100:00100000:2.0:1746155643.466319:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126033024 00000100:00100000:2.0:1746155643.466321:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126033024 00000100:00100000:2.0:1746155643.466337:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126033152 00000100:00100000:2.0:1746155643.466340:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126033152 00000100:00100000:3.0:1746155643.466348:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17139 00000100:00100000:3.0:1746155643.466361:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1962:x1830976126032896:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155643.466375:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.466392:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f8107 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1841d expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.466411:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.466413:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.466420:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f8107 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1841d expref: 15 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.466437:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f8107 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1841d expref: 15 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.466447:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4a800, rc 0) 00000100:00100000:3.0:1746155643.466474:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976126032896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 115us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.466814:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17140 00000100:00100000:2.0:1746155643.466821:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1963:x1830976126033024:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.466827:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.466834:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009374da00/0x844e5faceb5f810e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18424 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.466865:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125394048:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.466918:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.466935:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17141 00000100:00100000:2.0:1746155643.466940:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976126033152:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.466946:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.466954:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f088400/0x844e5faceb5f8115 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1842b expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.466973:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125394176:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.466989:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155643.467135:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17139 00000100:00100000:3.0:1746155643.467168:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126032512:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10382us (10579us total) trans 0 rc 753664/753664 00000100:00100000:3.0:1746155643.467176:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8133 00002000:00100000:3.0:1746155643.467182:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1343488->2097151) req@ffff88009fed9c00 x1830976126032512/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 753664/753664 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.467190:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9c00 with x1830976126032512 ext(1343488->2097151) 00002000:00010000:3.0:1746155643.467193:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed9c00 00000100:00100000:2.0:1746155643.471098:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125394048:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.471125:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009374da00/0x844e5faceb5f810e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18424 expref: 15 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.471137:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009374da00/0x844e5faceb5f810e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18424 expref: 15 pid: 8438 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746155643.471243:0:9235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime: 1746155642 -> 1746155643 00002000:00010000:3.0:1746155643.471246:0:9235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime: 1746155642 -> 1746155643 00000100:00100000:3.0:1746155643.471258:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125394176:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155643.471274:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f088400/0x844e5faceb5f8115 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1842b expref: 22 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.471282:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f088400/0x844e5faceb5f8115 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1842b expref: 22 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.471309:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f088400, rc 0) 00010000:00010000:2.0:1746155643.471409:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374da00, rc 0) 00000100:00100000:3.0:1746155643.471441:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976126033152:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4497us (5369us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155643.471447:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17141 00000100:00100000:2.0:1746155643.471447:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1963:x1830976126033024:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4625us (5435us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.471455:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17140 00000100:00100000:0.0:1746155643.473293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.473390:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126033280 00000100:00100000:2.0:1746155643.473396:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126033280 00000100:00100000:2.0:1746155643.473438:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17142 00000100:00100000:2.0:1746155643.473444:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32389:x1830976126033280:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.473456:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.473469:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5f811c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18432 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.473486:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.473488:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.473494:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5f811c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18432 expref: 11 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.473532:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5f811c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18432 expref: 11 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.473541:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f089600, rc 0) 00000100:00100000:2.0:1746155643.473576:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32389:x1830976126033280:12345-192.168.202.51@tcp:101:cat.0 Request processed in 132us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.473582:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17142 00000100:00100000:0.0:1746155643.476355:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.476428:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126033536 00000100:00100000:3.0:1746155643.476434:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126033536 00002000:00100000:3.0:1746155643.476467:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880094e37480 x1830976126033536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.476476:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37480 with x1830976126033536 ext(4194304->5083135) 00002000:00010000:3.0:1746155643.476481:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e37480 00000100:00100000:3.0:1746155643.476496:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8134 00000100:00100000:3.0:1746155643.476523:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126033536:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155643.481254:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.481336:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.481392:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126033792 00000100:00100000:3.0:1746155643.481399:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126033792 00002000:00100000:3.0:1746155643.481435:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a3fc4000 x1830976126033792/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.481444:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc4000 with x1830976126033792 ext(2097152->3145727) 00002000:00010000:3.0:1746155643.481449:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc4000 00000100:00100000:3.0:1746155643.481462:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126033920 00000100:00100000:3.0:1746155643.481464:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126033920 00002000:00100000:3.0:1746155643.481471:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a3fc7b80 x1830976126033920/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.481477:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc7b80 with x1830976126033920 ext(3145728->4194303) 00002000:00010000:3.0:1746155643.481480:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc7b80 00000100:00100000:3.0:1746155643.481526:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8135 00000100:00100000:3.0:1746155643.481533:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976126033792:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155643.481607:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8136 00000100:00100000:0.0:1746155643.481615:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976126033920:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155643.488050:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126033536:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11538us (11691us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155643.488059:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8134 00002000:00100000:3.0:1746155643.488069:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880094e37480 x1830976126033536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.488078:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37480 with x1830976126033536 ext(4194304->5083135) 00002000:00010000:3.0:1746155643.488083:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e37480 00000100:00100000:3.0:1746155643.494588:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976126033792:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13044us (13329us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155643.494600:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8135 00002000:00100000:3.0:1746155643.494611:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a3fc4000 x1830976126033792/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.494619:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc4000 with x1830976126033792 ext(2097152->3145727) 00002000:00010000:3.0:1746155643.494625:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc4000 00000100:00100000:0.0:1746155643.501113:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.507637:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126034176 00000100:00100000:2.0:1746155643.507647:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126034176 00000100:00100000:2.0:1746155643.507687:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17143 00000100:00100000:2.0:1746155643.507695:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976126034176:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.507709:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.507723:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5daee00/0x844e5faceb5f8123 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18439 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.507762:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125394304:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155643.507928:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126033920:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26313us (26590us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155643.507937:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8136 00002000:00100000:1.0:1746155643.507945:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a3fc7b80 x1830976126033920/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.507952:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc7b80 with x1830976126033920 ext(3145728->4194303) 00002000:00010000:1.0:1746155643.507956:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc7b80 00000100:00100000:0.0:1746155643.508184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.508214:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126034304 00000100:00100000:0.0:1746155643.508217:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126034304 00000100:00100000:0.0:1746155643.508235:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17144 00000100:00100000:0.0:1746155643.508240:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126034304:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155643.508247:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155643.508255:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f17b000/0x844e5faceb5f812a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18440 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155643.508276:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125394432:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.516496:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.516556:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.516560:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125394304:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.516583:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5daee00/0x844e5faceb5f8123 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18439 expref: 15 pid: 8438 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155643.516584:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125394432:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.516596:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5daee00/0x844e5faceb5f8123 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18439 expref: 15 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155643.516601:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f17b000/0x844e5faceb5f812a lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18440 expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155643.516610:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f17b000/0x844e5faceb5f812a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18440 expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.516622:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5daee00, rc 0) 00010000:00010000:0.0:1746155643.516628:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17b000, rc 0) 00000100:00100000:2.0:1746155643.516669:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976126034176:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8975us (15563us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.516676:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17143 00000100:00100000:0.0:1746155643.516706:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126034304:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8465us (8522us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155643.516712:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17144 00000100:00100000:0.0:1746155643.518383:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.518434:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126034432 00000100:00100000:2.0:1746155643.518440:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126034432 00000100:00100000:2.0:1746155643.518477:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17145 00000100:00100000:2.0:1746155643.518483:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976126034432:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.518495:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.518531:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5dae800/0x844e5faceb5f8131 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18447 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155643.518603:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125394560:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155643.518674:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155643.519808:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125394560:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155643.519830:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5dae800/0x844e5faceb5f8131 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18447 expref: 12 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.519839:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dae800/0x844e5faceb5f8131 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18447 expref: 12 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.519862:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dae800, rc 0) 00000100:00100000:3.0:1746155643.519896:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976126034432:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1413us (1515us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155643.519916:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17145 00000100:00100000:0.0:1746155643.522807:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.522846:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.522868:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126034688 00000100:00100000:0.0:1746155643.522873:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126034688 00000100:00100000:3.0:1746155643.522921:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126034560 00000100:00100000:3.0:1746155643.523186:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126034560 00000100:00100000:3.0:1746155643.523226:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17146 00000100:00100000:3.0:1746155643.523233:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976126034560:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155643.523245:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.523365:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fe4ba00/0x844e5faceb5f8138 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1844e expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155643.523405:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125394688:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155643.528140:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.530684:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17147 00000100:00100000:1.0:1746155643.530696:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126034688:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155643.530711:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155643.530726:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cbac800/0x844e5faceb5f813f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18455 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.530769:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125394816:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155643.530832:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.531162:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.531250:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126034944 00000100:00100000:1.0:1746155643.531256:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126034944 00002000:00100000:1.0:1746155643.531279:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800910c9880 x1830976126034944/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.531286:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c9880 with x1830976126034944 ext(4194304->5083135) 00002000:00010000:1.0:1746155643.531290:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910c9880 00000100:00100000:1.0:1746155643.531312:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8137 00000100:00100000:1.0:1746155643.531318:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976126034944:12345-192.168.202.51@tcp:3:cat.0 00002000:00010000:3.0:1746155643.532362:0:19959:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime: 1746155643 -> 1746155644 00000100:00100000:3.0:1746155643.532378:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125394688:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155643.532402:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4ba00/0x844e5faceb5f8138 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1844e expref: 15 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.532413:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4ba00/0x844e5faceb5f8138 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1844e expref: 15 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.532422:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4ba00, rc 0) 00000100:00100000:3.0:1746155643.535043:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976126034560:12345-192.168.202.51@tcp:101:cat.0 Request processed in 11804us (12189us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155643.535052:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17146 00002000:00010000:0.0:1746155643.536273:0:8438:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime: 1746155643 -> 1746155644 00000100:00100000:0.0:1746155643.536291:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125394816:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155643.536316:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cbac800/0x844e5faceb5f813f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18455 expref: 22 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155643.536327:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cbac800/0x844e5faceb5f813f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18455 expref: 22 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155643.536355:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbac800, rc 0) 00000100:00100000:0.0:1746155643.536385:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126034688:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5693us (13582us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155643.536390:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17147 00000100:00100000:1.0:1746155643.544136:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976126034944:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12803us (12960us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155643.544150:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8137 00002000:00100000:1.0:1746155643.544161:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800910c9880 x1830976126034944/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.544170:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c9880 with x1830976126034944 ext(4194304->5083135) 00002000:00010000:1.0:1746155643.544175:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910c9880 00000100:00100000:0.0:1746155643.547776:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.547880:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126035072 00000100:00100000:2.0:1746155643.547887:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126035072 00000100:00100000:2.0:1746155643.547943:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17148 00000100:00100000:2.0:1746155643.547950:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126035072:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.547964:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.547979:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5dae800/0x844e5faceb5f8146 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1845c expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.548018:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125394944:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.548083:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.553210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.553416:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126035200 00000100:00100000:3.0:1746155643.553423:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126035200 00000100:00100000:3.0:1746155643.553473:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11156 00000100:00100000:3.0:1746155643.553481:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32400:x1830976126035200:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155643.553539:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.553560:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c000/0x844e5faceb5f814d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18463 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.553609:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f8154 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553619:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f8154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553628:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f8154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553639:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374de00/0x844e5faceb5f815b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553645:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009374de00/0x844e5faceb5f815b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553650:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009374de00/0x844e5faceb5f815b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553735:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c400/0x844e5faceb5f8162 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553742:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c400/0x844e5faceb5f8162 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553748:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c400/0x844e5faceb5f8162 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:3.0:1746155643.553773:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155643.553777:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155643.553788:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c400/0x844e5faceb5f8162 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553797:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c400/0x844e5faceb5f8162 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553802:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f8154 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553808:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f8154 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553812:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f8154 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553818:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009374cc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155643.553826:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f8154 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553832:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f8154 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00002000:00010000:2.0:1746155643.553839:0:8438:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime: 1746155643 -> 1746155644 00010000:00010000:3.0:1746155643.553840:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155643.553842:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155643.553845:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f8154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553849:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f8154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155643.553853:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125394944:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155643.553861:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374de00/0x844e5faceb5f815b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553865:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009374de00/0x844e5faceb5f815b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553869:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009374de00/0x844e5faceb5f815b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553873:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009374de00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155643.553875:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009374de00/0x844e5faceb5f815b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.553875:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5dae800/0x844e5faceb5f8146 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1845c expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.553879:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009374de00/0x844e5faceb5f815b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553884:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0700) 00010000:00010000:2.0:1746155643.553884:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5dae800/0x844e5faceb5f8146 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1845c expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.553885:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155643.553887:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009374de00/0x844e5faceb5f815b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.553890:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374de00/0x844e5faceb5f815b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.553913:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5dae800, rc 0) 00010000:00010000:3.0:1746155643.553925:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c000/0x844e5faceb5f814d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18463 expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.553934:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c400/0x844e5faceb5f8162 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18463 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.553939:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155643.553941:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155643.553943:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374c400, rc 0) 00000100:00100000:2.0:1746155643.553946:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126035072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5997us (6176us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.553952:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17148 00000100:00100000:3.0:1746155643.553969:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32400:x1830976126035200:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 490us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.553974:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11156 00000100:00100000:0.0:1746155643.556402:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.556438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.556531:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.556756:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126035584 00000100:00100000:2.0:1746155643.556762:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126035584 00000100:00100000:2.0:1746155643.556786:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126035712 00000100:00100000:2.0:1746155643.556788:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126035712 00000100:00100000:2.0:1746155643.556804:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17149 00000100:00100000:2.0:1746155643.556809:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+5:1963:x1830976126035584:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155643.556820:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155643.556826:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17150 00010000:00010000:2.0:1746155643.556832:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132b0ec00/0x844e5faceb5f8169 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18471 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155643.556834:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1963:x1830976126035712:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155643.556842:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.556851:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009374da00/0x844e5faceb5f8170 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18478 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.556863:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.556865:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746155643.556867:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125395072:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155643.556870:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009374da00/0x844e5faceb5f8170 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18478 expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.556886:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009374da00/0x844e5faceb5f8170 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18478 expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.556894:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374da00, rc 0) 00000100:00100000:3.0:1746155643.556925:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976126035712:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 92us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.556926:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155643.556931:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17150 00000100:00100000:1.0:1746155643.556998:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126035456 00000100:00100000:1.0:1746155643.557002:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126035456 00000100:00100000:1.0:1746155643.557026:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 759 00000100:00100000:1.0:1746155643.557031:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976126035456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.557039:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.557052:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c400/0x844e5faceb5f8162 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18463 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.557064:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155643.557068:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.557084:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976126035456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 53us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.557090:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 759 00000100:00100000:1.0:1746155643.557348:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.557392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.557408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.557523:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126035840 00000100:00100000:2.0:1746155643.557526:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126035840 00000100:00100000:2.0:1746155643.557547:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126035968 00000100:00100000:2.0:1746155643.557548:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126035968 00000100:00100000:2.0:1746155643.557567:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126036096 00000100:00100000:2.0:1746155643.557569:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126036096 00000100:00100000:2.0:1746155643.557584:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17151 00000100:00100000:2.0:1746155643.557589:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976126035840:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155643.557595:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.557601:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132b0e000/0x844e5faceb5f8177 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1847f expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.557621:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125395200:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.557653:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.557808:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17152 00000100:00100000:0.0:1746155643.557814:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976126035968:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155643.557820:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155643.557827:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f17a600/0x844e5faceb5f817e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18486 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155643.557847:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125395328:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155643.557868:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.557949:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17153 00000100:00100000:1.0:1746155643.557954:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976126036096:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155643.558034:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155643.558041:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cbacc00/0x844e5faceb5f8185 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1848d expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.558050:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.558052:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.558057:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbacc00/0x844e5faceb5f8185 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1848d expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.558066:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cbacc00/0x844e5faceb5f8185 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1848d expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.558074:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbacc00, rc 0) 00000100:00100000:1.0:1746155643.558089:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976126036096:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 135us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.558094:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17153 00000100:00100000:0.0:1746155643.558362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.558392:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126035328 00000100:00100000:3.0:1746155643.558396:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126035328 00000100:00100000:3.0:1746155643.558413:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17154 00000100:00100000:3.0:1746155643.558418:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126035328:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155643.558428:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.558435:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009374ca00/0x844e5faceb5f818c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1846a expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155643.558456:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125395456:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155643.558489:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfde40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.560941:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125395072:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.560962:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880132b0ec00/0x844e5faceb5f8169 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18471 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.560972:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132b0ec00/0x844e5faceb5f8169 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18471 expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.560992:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132b0ec00, rc 0) 00000100:00100000:2.0:1746155643.561022:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976126035584:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4212us (4583us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.561029:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17149 00000100:00100000:3.0:1746155643.561331:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125395456:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155643.561340:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125395328:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155643.561347:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009374ca00/0x844e5faceb5f818c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1846a expref: 12 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.561355:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f17a600/0x844e5faceb5f817e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18486 expref: 7 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.561356:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009374ca00/0x844e5faceb5f818c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1846a expref: 12 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.561363:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f17a600/0x844e5faceb5f817e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18486 expref: 7 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.561366:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374ca00, rc 0) 00010000:00010000:1.0:1746155643.561370:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17a600, rc 0) 00000100:00100000:3.0:1746155643.561384:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126035328:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2965us (3021us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155643.561386:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1963:x1830976126035968:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3572us (3993us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155643.561389:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17154 00000100:00100000:1.0:1746155643.561392:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17152 00000100:00100000:2.0:1746155643.561453:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125395200:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.561466:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132b0e000/0x844e5faceb5f8177 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1847f expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.561474:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132b0e000/0x844e5faceb5f8177 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1847f expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.561481:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132b0e000, rc 0) 00000100:00100000:2.0:1746155643.561500:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976126035840:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3910us (4152us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.561520:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17151 00000100:00100000:0.0:1746155643.564746:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.564787:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.564847:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126036608 00000100:00100000:2.0:1746155643.564853:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126036608 00000100:00100000:2.0:1746155643.564882:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4742 00000100:00100000:2.0:1746155643.564888:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32389:x1830976126036608:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155643.565048:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32389:x1830976126036608:12345-192.168.202.51@tcp:35:cat.0 Request processed in 158us (260us total) trans 8589945320 rc 0/0 00000100:00100000:2.0:1746155643.565054:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4742 00000100:00100000:3.0:1746155643.565300:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126036352 00000100:00100000:3.0:1746155643.565304:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126036352 00000100:00100000:3.0:1746155643.565325:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11157 00000100:00100000:3.0:1746155643.565330:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32400:x1830976126036352:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155643.565338:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.565351:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2400/0x844e5faceb5f8193 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18494 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.565401:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.565413:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d0 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.565420:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfc00/0x844e5faceb5f80dd lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18401 expref: 295 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.565425:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.565446:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfc00/0x844e5faceb5f80dd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18401 expref: 295 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.565456:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfc00/0x844e5faceb5f80dd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18401 expref: 295 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.565466:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125395584:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.567224:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d0 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.567233:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d0 expref: 10 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.567411:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125395712:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.567801:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfde40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155643.568490:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125395584:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.568759:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125395712:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.568779:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155643.569197:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.569254:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.569370:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126036736 00000100:00100000:3.0:1746155643.569374:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126036736 00010000:00010000:3.0:1746155643.569393:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d0 expref: 11 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.569418:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126036864 00000100:00100000:3.0:1746155643.569420:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126036864 00010000:00010000:3.0:1746155643.569428:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfc00/0x844e5faceb5f80dd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18401 expref: 296 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.569442:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8791 00000100:00100000:3.0:1746155643.569448:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126036736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155643.569457:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155643.569462:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d0 expref: 11 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.569469:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d0 expref: 11 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.569485:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800948e5600/0x844e5faceb5f8097 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d0 expref: 11 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.569496:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155643.569499:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.569524:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.569529:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155643.569551:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126036736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 103us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.569557:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8791 00000100:00100000:3.0:1746155643.569569:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8792 00000100:00100000:3.0:1746155643.569574:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:1961:x1830976126036864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155643.569579:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155643.569583:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfc00/0x844e5faceb5f80dd lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18401 expref: 296 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.569591:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfc00/0x844e5faceb5f80dd lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18401 expref: 296 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.569601:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f0dfc00/0x844e5faceb5f80dd lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18401 expref: 296 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.569608:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155643.569610:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.569617:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.569622:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.570311:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155643.570341:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1961:x1830976126036864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 765us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.570347:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8792 00010000:00010000:2.0:1746155643.570560:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.570567:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155643.570580:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155643.570679:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2400/0x844e5faceb5f8193 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18494 expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.570691:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18494 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.570696:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.570698:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155643.570700:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b2000, rc 0) 00000100:00100000:2.0:1746155643.570720:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32400:x1830976126036352:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5390us (5981us total) trans 8589945321 rc 0/0 00000100:00100000:2.0:1746155643.570726:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11157 00000100:00100000:0.0:1746155643.572088:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.572144:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126036992 00000100:00100000:2.0:1746155643.572149:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126036992 00000100:00100000:2.0:1746155643.572180:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11158 00000100:00100000:2.0:1746155643.572185:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32400:x1830976126036992:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155643.572197:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.572207:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093603e00/0x844e5faceb5f81a8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1849b expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.572250:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.572259:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18494 expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.572265:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.572282:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18494 expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.572292:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18494 expref: 11 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.572302:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125395840:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.572837:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.573699:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.573755:0:19870:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126037248 00000100:00100000:3.0:1746155643.573759:0:19870:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126037248 00000100:00100000:3.0:1746155643.573789:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11159 00000100:00100000:3.0:1746155643.573794:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32402:x1830976126037248:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155643.573805:0:19870:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.573813:0:19870:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad200/0x844e5faceb5f81b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184a2 expref: -99 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.573886:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac600/0x844e5faceb5f81bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.573894:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac600/0x844e5faceb5f81bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.573912:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac600/0x844e5faceb5f81bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.573923:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac800/0x844e5faceb5f81c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.573929:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac800/0x844e5faceb5f81c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.573934:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac800/0x844e5faceb5f81c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574003:0:19870:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac400/0x844e5faceb5f81cb lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574011:0:19870:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac400/0x844e5faceb5f81cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574016:0:19870:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac400/0x844e5faceb5f81cb lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 19870 initiator: MDT0 00000004:00200000:3.0:1746155643.574023:0:19870:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155643.574075:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac600/0x844e5faceb5f81bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574081:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac600/0x844e5faceb5f81bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574087:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac600/0x844e5faceb5f81bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574091:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fdac600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155643.574094:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac600/0x844e5faceb5f81bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574100:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac600/0x844e5faceb5f81bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574109:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155643.574111:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155643.574114:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac600/0x844e5faceb5f81bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574118:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac600/0x844e5faceb5f81bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574126:0:19870:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac800/0x844e5faceb5f81c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574130:0:19870:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac800/0x844e5faceb5f81c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574138:0:19870:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac800/0x844e5faceb5f81c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574142:0:19870:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008fdac800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155643.574144:0:19870:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac800/0x844e5faceb5f81c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574148:0:19870:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac800/0x844e5faceb5f81c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574153:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0200) 00010000:00010000:3.0:1746155643.574155:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155643.574156:0:19870:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac800/0x844e5faceb5f81c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574161:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac800/0x844e5faceb5f81c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19870 initiator: MDT0 00010000:00010000:3.0:1746155643.574187:0:19870:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad200/0x844e5faceb5f81b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184a2 expref: 20 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.574195:0:19870:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac400/0x844e5faceb5f81cb lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184a2 expref: 19 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.574201:0:19870:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155643.574203:0:19870:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155643.574205:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.574211:0:19870:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.574219:0:19870:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdac400, rc 0) 00000100:00100000:3.0:1746155643.574243:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32402:x1830976126037248:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 448us (544us total) trans 8589945322 rc 0/0 00000100:00100000:3.0:1746155643.574249:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11159 00000100:00100000:0.0:1746155643.574599:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.574774:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126037376 00000100:00100000:2.0:1746155643.574778:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126037376 00010000:00010000:2.0:1746155643.574793:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18494 expref: 12 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.574891:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8793 00000100:00100000:2.0:1746155643.574898:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976126037376:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.574914:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155643.574918:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18494 expref: 12 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.574925:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18494 expref: 12 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.574936:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.574939:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.574945:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.574950:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.574960:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.575219:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976126037376:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 321us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.575225:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8793 00010000:00010000:3.0:1746155643.575439:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c7b2000/0x844e5faceb5f819a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18494 expref: 11 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.575449:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125395840:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.575459:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.575465:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.575469:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:3.0:1746155643.575487:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155643.575490:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155643.575498:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.575688:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093603e00/0x844e5faceb5f81a8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1849b expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.575697:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1849b expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.575703:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155643.575705:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155643.575708:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093602200, rc 0) 00000100:00100000:3.0:1746155643.575737:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32400:x1830976126036992:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3551us (3649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.575742:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11158 00000100:00100000:2.0:1746155643.580404:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.580679:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.580697:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126037760 00000100:00100000:2.0:1746155643.580703:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126037760 00000100:00100000:2.0:1746155643.580735:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17155 00000100:00100000:2.0:1746155643.580741:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126037760:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155643.580755:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.580767:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f81d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184b0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.580809:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125395968:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.580859:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff600 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.580940:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.580953:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126037632 00000100:00100000:2.0:1746155643.580956:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126037632 00000100:00100000:3.0:1746155643.581128:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126037504 00000100:00100000:3.0:1746155643.581132:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126037504 00000100:00100000:3.0:1746155643.581160:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 760 00000100:00100000:3.0:1746155643.581165:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976126037504:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155643.581173:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155643.581188:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdac400/0x844e5faceb5f81cb lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184a2 expref: 19 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.581199:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155643.581203:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155643.581222:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976126037504:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 57us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.581228:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 760 00000100:00100000:2.0:1746155643.581519:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17156 00000100:00100000:2.0:1746155643.581525:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1960:x1830976126037632:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155643.581532:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.581541:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093603c00/0x844e5faceb5f81e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184a9 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.581563:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125396096:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155643.581582:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.582407:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.582524:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126038144 00000100:00100000:3.0:1746155643.582528:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126038144 00000100:00100000:3.0:1746155643.582830:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11160 00000100:00100000:3.0:1746155643.582837:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:32405:x1830976126038144:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155643.582849:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.582857:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad000/0x844e5faceb5f81e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184be expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.582936:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.582947:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1849b expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.582954:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.582971:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1849b expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.582980:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1849b expref: 9 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.582988:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125396224:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.583340:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.584278:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.585627:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126037888 00000100:00100000:3.0:1746155643.585634:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126037888 00000100:00100000:3.0:1746155643.585676:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17157 00000100:00100000:3.0:1746155643.585683:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126037888:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155643.585694:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.585705:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008fdad800/0x844e5faceb5f81f5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184b7 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155643.585800:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125396352:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155643.585890:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.586866:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125395968:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.586885:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f81d9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184b0 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.586896:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f81d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184b0 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.586926:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093602000, rc 0) 00000100:00100000:3.0:1746155643.586998:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125396096:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155643.587013:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093603c00/0x844e5faceb5f81e0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184a9 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.587023:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093603c00/0x844e5faceb5f81e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184a9 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155643.587030:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093603c00, rc 0) 00000100:00100000:3.0:1746155643.587050:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126037632:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5525us (6109us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155643.587055:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17156 00000100:00100000:3.0:1746155643.587081:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125396224:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155643.587094:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155643.587105:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126037760:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 6242us (6304us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.587111:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17155 00000100:00100000:2.0:1746155643.587348:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.587409:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125396352:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155643.587423:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008fdad800/0x844e5faceb5f81f5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184b7 expref: 7 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155643.587432:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008fdad800/0x844e5faceb5f81f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184b7 expref: 7 pid: 19959 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155643.587443:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126038272 00010000:00010000:0.0:1746155643.587445:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdad800, rc 0) 00000100:00100000:3.0:1746155643.587447:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126038272 00010000:00010000:3.0:1746155643.587462:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1849b expref: 10 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746155643.587476:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1960:x1830976126037888:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1793us (3198us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155643.587479:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8794 00000100:00100000:3.0:1746155643.587484:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126038272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155643.587484:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17157 00010000:00010000:3.0:1746155643.587491:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155643.587495:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1849b expref: 10 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.587524:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1849b expref: 10 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.587537:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f81af lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1849b expref: 10 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.587546:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155643.587550:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.587557:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.587563:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155643.587581:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155643.587595:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c9ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126038272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 112us (247us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155643.587599:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:3.0:1746155643.587600:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8794 00010000:00010000:2.0:1746155643.587605:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155643.587624:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155643.587723:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdad000/0x844e5faceb5f81e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184be expref: 298 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.587734:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184be expref: 297 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.587740:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.587742:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155643.587744:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008fdade00, rc 0) 00000100:00100000:2.0:1746155643.587763:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:32405:x1830976126038144:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4927us (5357us total) trans 8589945323 rc 0/0 00000100:00100000:2.0:1746155643.587769:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11160 00000100:00100000:0.0:1746155643.591916:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.592340:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126038400 00000100:00100000:2.0:1746155643.592346:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126038400 00000100:00100000:2.0:1746155643.592386:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11161 00000100:00100000:2.0:1746155643.592392:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32400:x1830976126038400:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155643.592406:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.592420:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093602c00/0x844e5faceb5f8203 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184c5 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.592463:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093602c00/0x844e5faceb5f8203 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184c5 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.592474:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093602c00/0x844e5faceb5f8203 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184c5 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.592488:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.592490:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155643.592493:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093602c00, rc 0) 00000100:00100000:2.0:1746155643.592552:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32400:x1830976126038400:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 160us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.592558:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11161 00000100:00100000:0.0:1746155643.596070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.597977:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126038656 00000100:00100000:1.0:1746155643.597985:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126038656 00000100:00100000:1.0:1746155643.598673:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11162 00000100:00100000:1.0:1746155643.598682:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32400:x1830976126038656:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155643.598697:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155643.598710:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad200/0x844e5faceb5f820a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184cc expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.598780:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.598792:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184be expref: 296 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.598799:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.598824:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184be expref: 296 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.598834:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184be expref: 296 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155643.598844:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125396480:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155643.599726:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.602497:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.602571:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126038784 00000100:00100000:2.0:1746155643.602578:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126038784 00010000:00010000:2.0:1746155643.602605:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184be expref: 297 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.603845:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8795 00000100:00100000:2.0:1746155643.603854:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1962:x1830976126038784:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.603865:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155643.603872:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 5/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184be expref: 297 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.603883:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184be expref: 297 pid: 14234 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.603913:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.603917:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155643.603929:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155643.603935:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155643.603948:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.603982:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1962:x1830976126038784:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 130us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.603987:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8795 00010000:00010000:1.0:1746155643.604268:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008fdade00/0x844e5faceb5f81ee lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184be expref: 296 pid: 14234 timeout: 872 lvb_type: 0 00000100:00100000:1.0:1746155643.604295:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125396480:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155643.604312:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.604320:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.604324:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.604337:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.604343:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.604348:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.604353:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cbace00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155643.604356:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.604361:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.604367:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155643.604370:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155643.604373:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.604377:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbace00/0x844e5faceb5f8211 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.604403:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad200/0x844e5faceb5f820a lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184cc expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.604414:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbad200/0x844e5faceb5f820a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184cc expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.604420:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbad200, rc 0) 00000100:00100000:1.0:1746155643.604452:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32400:x1830976126038656:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5772us (8387us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155643.604458:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11162 00000100:00100000:0.0:1746155643.609298:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.613107:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126039040 00000100:00100000:2.0:1746155643.613115:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126039040 00000100:00100000:2.0:1746155643.613152:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4743 00000100:00100000:2.0:1746155643.613158:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea57850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32400:x1830976126039040:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:2.0:1746155643.613324:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea57850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:32400:x1830976126039040:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 166us (4033us total) trans 8589945324 rc 0/0 00000100:00100000:2.0:1746155643.613329:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4743 00000100:00100000:0.0:1746155643.622222:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.622287:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126039168 00000100:00100000:2.0:1746155643.622295:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126039168 00000100:00100000:2.0:1746155643.622341:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17158 00000100:00100000:2.0:1746155643.622348:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:32405:x1830976126039168:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155643.622362:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.622376:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184d3 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.622399:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009374c200/0x844e5faceb5f809e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d7 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.622406:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cbacc00/0x844e5faceb5f8185 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1848d expref: 5 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.622414:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5f811c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18432 expref: 10 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.622419:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.622421:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.622424:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3887104->4194303] (req 3887104->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 22 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.622447:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5f811c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18432 expref: 10 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.622462:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5f811c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18432 expref: 10 pid: 8438 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.622472:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125396608:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.622578:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cbacc00/0x844e5faceb5f8185 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1848d expref: 5 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.622586:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cbacc00/0x844e5faceb5f8185 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1848d expref: 5 pid: 4461 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746155643.622594:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125396736:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.622615:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009374c200/0x844e5faceb5f809e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d7 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.622623:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009374c200/0x844e5faceb5f809e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d7 expref: 22 pid: 9235 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.622630:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125396864:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.622646:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.629228:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.629256:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.629295:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126039296 00000100:00100000:3.0:1746155643.629302:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126039296 00000100:00100000:0.0:1746155643.629316:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155643.629333:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbacc00/0x844e5faceb5f8185 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1848d expref: 6 pid: 4461 timeout: 872 lvb_type: 1 00000100:00100000:3.0:1746155643.629367:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126039424 00000100:00100000:3.0:1746155643.629370:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126039424 00010000:00010000:3.0:1746155643.629382:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5f811c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18432 expref: 11 pid: 8438 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.629544:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125396608:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.629552:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125396736:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.629559:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125396864:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.629582:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3887104->4194303] (req 3887104->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 22 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.629596:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093602a00, rc 0) 00000100:00100000:2.0:1746155643.629631:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32405:x1830976126039168:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7283us (7415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.629638:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17158 00000100:00100000:0.0:1746155643.629801:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126039552 00000100:00100000:0.0:1746155643.629804:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126039552 00000100:00100000:0.0:1746155643.629816:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8796 00000100:00100000:0.0:1746155643.629822:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976126039296:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155643.629831:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155643.629847:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cbacc00/0x844e5faceb5f8185 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1848d expref: 6 pid: 4461 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746155643.629856:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cbacc00/0x844e5faceb5f8185 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1848d expref: 6 pid: 4461 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746155643.629874:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cbacc00/0x844e5faceb5f8185 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1848d expref: 6 pid: 4461 timeout: 872 lvb_type: 1 00010000:00010000:0.0:1746155643.629898:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155643.629924:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+5:1961:x1830976126039296:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 102us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155643.629929:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8796 00000100:00100000:0.0:1746155643.629941:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8797 00000100:00100000:0.0:1746155643.629946:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126039424:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155643.629952:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155643.629958:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5f811c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18432 expref: 11 pid: 8438 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746155643.629966:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5f811c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18432 expref: 11 pid: 8438 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746155643.629976:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f089600/0x844e5faceb5f811c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18432 expref: 11 pid: 8438 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746155643.629984:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155643.629995:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976126039424:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155643.629999:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8797 00010000:00010000:0.0:1746155643.630016:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009374c200/0x844e5faceb5f809e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d7 expref: 22 pid: 9235 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746155643.630028:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8798 00000100:00100000:0.0:1746155643.630033:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126039552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155643.630038:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155643.630044:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009374c200/0x844e5faceb5f809e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d7 expref: 22 pid: 9235 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746155643.630052:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009374c200/0x844e5faceb5f809e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d7 expref: 22 pid: 9235 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746155643.630062:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009374c200/0x844e5faceb5f809e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183d7 expref: 22 pid: 9235 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746155643.630069:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155643.630071:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155643.630076:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 21 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.630083:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 21 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.630105:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 21 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155643.630115:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa37100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125396992:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155643.630166:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.632656:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.632710:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126039808 00000100:00100000:1.0:1746155643.632715:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126039808 00000100:00100000:2.0:1746155643.632736:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa37100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125396992:192.168.202.51@tcp:105: 00002000:00100000:1.0:1746155643.632740:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3887104->3891199) req@ffff8800a06a5180 x1830976126039808/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.632748:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a5180 with x1830976126039808 ext(3887104->3891199) 00010000:00010000:2.0:1746155643.632752:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1746155643.632752:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a06a5180 00000100:00100000:2.0:1746155643.632776:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126039552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2742us (3459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.632780:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8138 00000100:00100000:2.0:1746155643.632784:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8798 00000100:00100000:1.0:1746155643.632786:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126039808:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155643.632923:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126039808:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 137us (271us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155643.632929:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8138 00002000:00100000:1.0:1746155643.632934:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3887104->3891199) req@ffff8800a06a5180 x1830976126039808/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.632941:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a5180 with x1830976126039808 ext(3887104->3891199) 00002000:00010000:1.0:1746155643.632944:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a06a5180 00000100:00100000:0.0:1746155643.636182:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.636316:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126039936 00000100:00100000:2.0:1746155643.636323:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126039936 00000100:00100000:2.0:1746155643.636353:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17159 00000100:00100000:2.0:1746155643.636360:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:32405:x1830976126039936:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155643.636374:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.636388:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184da expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.636410:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b1ffea00/0x844e5faceb5f7f24 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18313 expref: 7 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.636418:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b407c400/0x844e5faceb5f8066 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183b4 expref: 7 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.636428:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948e5400/0x844e5faceb5f7f32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18321 expref: 15 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.636434:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.636435:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.636438:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3145728->3284991] (req 3145728->3284991) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 15 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.636461:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800948e5400/0x844e5faceb5f7f32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18321 expref: 15 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.636471:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800948e5400/0x844e5faceb5f7f32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18321 expref: 15 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.636482:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125397120:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.637105:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b407c400/0x844e5faceb5f8066 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183b4 expref: 7 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.637115:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b407c400/0x844e5faceb5f8066 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183b4 expref: 7 pid: 1625 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746155643.637123:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125397248:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.637147:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b1ffea00/0x844e5faceb5f7f24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18313 expref: 7 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.637160:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b1ffea00/0x844e5faceb5f7f24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18313 expref: 7 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.637168:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125397376:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.637184:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e480 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.642515:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125397120:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.642527:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125397248:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.642533:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125397376:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.642557:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3145728->3284991] (req 3145728->3284991) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 15 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.642571:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093602000, rc 0) 00000100:00100000:2.0:1746155643.642621:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:32405:x1830976126039936:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6260us (6443us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.642628:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17159 00000100:00100000:0.0:1746155643.643749:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.643996:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.644076:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126040192 00000100:00100000:2.0:1746155643.644081:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126040192 00010000:00010000:2.0:1746155643.644103:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948e5400/0x844e5faceb5f7f32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18321 expref: 15 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.644119:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126040064 00000100:00100000:2.0:1746155643.644120:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126040064 00010000:00010000:2.0:1746155643.644128:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b407c400/0x844e5faceb5f8066 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183b4 expref: 8 pid: 1625 timeout: 872 lvb_type: 1 00000100:00100000:2.0:1746155643.644392:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8799 00000100:00100000:2.0:1746155643.644399:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976126040192:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.644410:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155643.644428:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948e5400/0x844e5faceb5f7f32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18321 expref: 15 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.644437:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948e5400/0x844e5faceb5f7f32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18321 expref: 15 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.644454:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948e5400/0x844e5faceb5f7f32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18321 expref: 15 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.644470:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.644494:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976126040192:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 96us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.644499:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8799 00000100:00100000:2.0:1746155643.644528:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8800 00000100:00100000:2.0:1746155643.644537:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126040064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.644544:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155643.644550:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b407c400/0x844e5faceb5f8066 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183b4 expref: 8 pid: 1625 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746155643.644558:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b407c400/0x844e5faceb5f8066 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183b4 expref: 8 pid: 1625 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746155643.644572:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b407c400/0x844e5faceb5f8066 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183b4 expref: 8 pid: 1625 timeout: 872 lvb_type: 1 00010000:00010000:2.0:1746155643.644580:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.644591:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126040064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 59us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.644596:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8800 00000100:00100000:0.0:1746155643.644978:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.644990:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126040320 00000100:00100000:0.0:1746155643.644993:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126040320 00010000:00010000:0.0:1746155643.645007:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b1ffea00/0x844e5faceb5f7f24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18313 expref: 8 pid: 20200 timeout: 872 lvb_type: 0 00000100:00100000:0.0:1746155643.645028:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8801 00000100:00100000:0.0:1746155643.645033:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976126040320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155643.645039:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155643.645046:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b1ffea00/0x844e5faceb5f7f24 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18313 expref: 8 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746155643.645054:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b1ffea00/0x844e5faceb5f7f24 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18313 expref: 8 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746155643.645065:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b1ffea00/0x844e5faceb5f7f24 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18313 expref: 8 pid: 20200 timeout: 872 lvb_type: 0 00010000:00010000:0.0:1746155643.645083:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155643.645088:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155643.645094:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 13 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.645101:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 13 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.645124:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 13 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155643.645241:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125397504:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155643.645672:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.650135:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.650235:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125397504:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155643.650253:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.650302:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976126040320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5267us (5323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.650312:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8801 00000100:00100000:3.0:1746155643.650376:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126040576 00000100:00100000:3.0:1746155643.650381:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126040576 00002000:00100000:3.0:1746155643.650412:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3280896->3284991) req@ffff88009c28e680 x1830976126040576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.650421:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28e680 with x1830976126040576 ext(3280896->3284991) 00002000:00010000:3.0:1746155643.650426:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28e680 00000100:00100000:3.0:1746155643.650480:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8139 00000100:00100000:3.0:1746155643.650487:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976126040576:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155643.650921:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976126040576:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 433us (792us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155643.650927:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8139 00002000:00100000:3.0:1746155643.650932:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3280896->3284991) req@ffff88009c28e680 x1830976126040576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.650939:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28e680 with x1830976126040576 ext(3280896->3284991) 00002000:00010000:3.0:1746155643.650942:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28e680 00000100:00100000:0.0:1746155643.652831:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.652884:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126040832 00000100:00100000:2.0:1746155643.652891:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126040832 00000100:00100000:2.0:1746155643.652956:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4744 00000100:00100000:2.0:1746155643.652964:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32405:x1830976126040832:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155643.653326:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:32405:x1830976126040832:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 361us (495us total) trans 8589945325 rc 0/0 00000100:00100000:2.0:1746155643.653332:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4744 00000100:00100000:0.0:1746155643.711357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.711450:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126040960 00000100:00100000:2.0:1746155643.711458:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126040960 00000100:00100000:2.0:1746155643.711491:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17160 00000100:00100000:2.0:1746155643.711497:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32402:x1830976126040960:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155643.711534:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.711548:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184e1 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.711570:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 13 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.711576:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.711577:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.711580:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3973120->4194303] (req 3973120->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 8 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.711600:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 13 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.711608:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 13 pid: 19959 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.711618:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125397632:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.711701:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.713187:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.713258:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125397632:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.713277:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3973120->4194303] (req 3973120->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 8 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.713287:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093603800, rc 0) 00000100:00100000:3.0:1746155643.713291:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126041088 00000100:00100000:3.0:1746155643.713296:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126041088 00000100:00100000:2.0:1746155643.713313:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32402:x1830976126040960:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1816us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.713319:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17160 00002000:00100000:3.0:1746155643.713321:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3284991) req@ffff88009c28f480 x1830976126041088/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.713330:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28f480 with x1830976126041088 ext(3145728->3284991) 00010000:00010000:3.0:1746155643.713335:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 14 pid: 19959 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.713345:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 14 pid: 19959 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746155643.713352:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c28f480 00000100:00100000:3.0:1746155643.713377:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1414 00000100:00100000:3.0:1746155643.713383:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976126041088:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155643.715889:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976126041088:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 2501us (2698us total) trans 21474841626 rc 0/0 00000100:00100000:3.0:1746155643.715897:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1414 00002000:00100000:3.0:1746155643.715914:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3284991) req@ffff88009c28f480 x1830976126041088/t21474841626(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/448 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.715921:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28f480 with x1830976126041088 ext(3145728->3284991) 00010000:00010000:3.0:1746155643.715929:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 16 pid: 19959 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.715940:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 16 pid: 19959 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746155643.715946:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c28f480 00000100:00100000:0.0:1746155643.719167:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.720027:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126041216 00000100:00100000:2.0:1746155643.720036:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126041216 00010000:00010000:2.0:1746155643.720071:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 16 pid: 19959 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.720106:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8802 00000100:00100000:2.0:1746155643.720112:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1962:x1830976126041216:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.720125:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746155643.720140:0:7062:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155642 -> 1746155644 00002000:00010000:2.0:1746155643.720142:0:7062:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155643 -> 1746155644 00010000:00010000:2.0:1746155643.720147:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 16 pid: 19959 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.720158:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 16 pid: 19959 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.720178:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093602000/0x844e5faceb5f821f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3284991) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184da expref: 16 pid: 19959 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.720206:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.720208:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.720214:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 7 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.720221:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 7 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.720248:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 7 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.720259:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125397760:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155643.720325:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.721700:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125397760:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155643.721714:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.721750:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976126041216:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1637us (2590us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.721757:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8802 00000100:00100000:0.0:1746155643.722133:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.722264:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126041472 00000100:00100000:3.0:1746155643.722269:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126041472 00002000:00100000:3.0:1746155643.722294:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3973120->3977215) req@ffff88009c28ca80 x1830976126041472/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.722303:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28ca80 with x1830976126041472 ext(3973120->3977215) 00002000:00010000:3.0:1746155643.722306:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28ca80 00000100:00100000:3.0:1746155643.722469:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8140 00000100:00100000:3.0:1746155643.722476:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976126041472:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155643.722621:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976126041472:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 145us (488us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155643.722626:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8140 00002000:00100000:3.0:1746155643.722632:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3973120->3977215) req@ffff88009c28ca80 x1830976126041472/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.722638:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28ca80 with x1830976126041472 ext(3973120->3977215) 00002000:00010000:3.0:1746155643.722640:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28ca80 00000100:00100000:0.0:1746155643.726070:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.726642:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126041600 00000100:00100000:2.0:1746155643.726650:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126041600 00000100:00100000:2.0:1746155643.726682:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17161 00000100:00100000:2.0:1746155643.726688:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32402:x1830976126041600:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155643.727068:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.727085:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184e8 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.727108:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 20 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.727115:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.727117:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.727119:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [4194304->4878335] (req 4194304->4878335) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.727142:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 20 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.727155:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 20 pid: 19959 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.727165:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125397888:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.727839:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.729023:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125397888:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.729042:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [4194304->4878335] (req 4194304->4878335) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.729054:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093603600, rc 0) 00000100:00100000:2.0:1746155643.729081:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32402:x1830976126041600:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2392us (3017us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.729087:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17161 00000100:00100000:0.0:1746155643.730069:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.730328:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126041728 00000100:00100000:1.0:1746155643.730334:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126041728 00002000:00100000:1.0:1746155643.730362:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3887104->4194303) req@ffff88009c28ed80 x1830976126041728/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.730370:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28ed80 with x1830976126041728 ext(3887104->4194303) 00010000:00010000:1.0:1746155643.730375:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 21 pid: 19959 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.730386:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 21 pid: 19959 timeout: 872 lvb_type: 0 00002000:00010000:1.0:1746155643.730392:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c28ed80 00000100:00100000:1.0:1746155643.730417:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1415 00000100:00100000:1.0:1746155643.730423:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126041728:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155643.734645:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126041728:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 4213us (4568us total) trans 17179874310 rc 0/0 00000100:00100000:1.0:1746155643.734655:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1415 00002000:00100000:1.0:1746155643.734664:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3887104->4194303) req@ffff88009c28ed80 x1830976126041728/t17179874310(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/448 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.734673:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28ed80 with x1830976126041728 ext(3887104->4194303) 00010000:00010000:1.0:1746155643.734681:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 23 pid: 19959 timeout: 872 lvb_type: 0 00010000:00010000:1.0:1746155643.734694:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 23 pid: 19959 timeout: 872 lvb_type: 0 00002000:00010000:1.0:1746155643.734705:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c28ed80 00000100:00100000:0.0:1746155643.737599:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.737699:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126041856 00000100:00100000:2.0:1746155643.737707:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126041856 00010000:00010000:2.0:1746155643.737735:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 23 pid: 19959 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.738010:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8803 00000100:00100000:2.0:1746155643.738017:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126041856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.738030:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746155643.738044:0:7062:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155643 -> 1746155644 00002000:00010000:2.0:1746155643.738046:0:7062:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155643 -> 1746155644 00010000:00010000:2.0:1746155643.738050:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 23 pid: 19959 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.738061:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 23 pid: 19959 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.738078:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f8218 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184d3 expref: 23 pid: 19959 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.738228:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.738230:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.738235:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 10 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.738242:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 10 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.738266:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 10 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.738274:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125398016:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155643.738340:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.740255:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125398016:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155643.740271:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.740297:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126041856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2281us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.740305:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8803 00000100:00100000:0.0:1746155643.745315:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.745406:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126042112 00000100:00100000:1.0:1746155643.745414:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126042112 00002000:00100000:1.0:1746155643.745452:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4874240->4878335) req@ffff88009c28fb80 x1830976126042112/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.745461:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28fb80 with x1830976126042112 ext(4874240->4878335) 00002000:00010000:1.0:1746155643.745466:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28fb80 00000100:00100000:1.0:1746155643.745767:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8141 00000100:00100000:1.0:1746155643.745775:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126042112:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155643.745928:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126042112:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 153us (620us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155643.745934:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8141 00002000:00100000:1.0:1746155643.745940:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4874240->4878335) req@ffff88009c28fb80 x1830976126042112/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.745946:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28fb80 with x1830976126042112 ext(4874240->4878335) 00002000:00010000:1.0:1746155643.745949:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28fb80 00000100:00100000:0.0:1746155643.750120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.750231:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126042368 00000100:00100000:2.0:1746155643.750239:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126042368 00000100:00100000:2.0:1746155643.750272:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4745 00000100:00100000:2.0:1746155643.750278:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32402:x1830976126042368:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155643.750439:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32402:x1830976126042368:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 161us (325us total) trans 8589945326 rc 0/0 00000100:00100000:2.0:1746155643.750445:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4745 00000100:00100000:0.0:1746155643.760889:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.760928:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.760954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.760990:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.761023:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126042496 00000100:00100000:0.0:1746155643.761030:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126042496 00000100:00100000:0.0:1746155643.761062:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126042752 00000100:00100000:0.0:1746155643.761064:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126042752 00000100:00100000:0.0:1746155643.761075:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126042624 00000100:00100000:0.0:1746155643.761077:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126042624 00000100:00100000:0.0:1746155643.761086:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126042880 00000100:00100000:0.0:1746155643.761087:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126042880 00000100:00100000:0.0:1746155643.761099:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17162 00000100:00100000:0.0:1746155643.761105:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976126042496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155643.761120:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155643.761133:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f17a400/0x844e5faceb5f8234 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184ef expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155643.761176:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125398144:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155643.761239:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40243c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.761254:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17163 00000100:00100000:0.0:1746155643.761260:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976126042752:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155643.761267:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155643.761275:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f17ae00/0x844e5faceb5f823b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184fd expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155643.761295:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125398272:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155643.761313:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.761433:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17164 00000100:00100000:1.0:1746155643.761439:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976126042624:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155643.761445:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155643.761451:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f081600/0x844e5faceb5f8242 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f184f6 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.761470:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125398400:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155643.761487:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.761499:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17165 00000100:00100000:1.0:1746155643.761525:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976126042880:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155643.761530:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155643.761535:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f081e00/0x844e5faceb5f8249 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18504 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.761550:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094443100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125398528:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155643.761573:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00002000:00010000:0.0:1746155643.763999:0:20200:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime: 1746155643 -> 1746155644 00002000:00010000:0.0:1746155643.764005:0:20200:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime: 1746155643 -> 1746155644 00000100:00100000:0.0:1746155643.764024:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125398400:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155643.764052:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f081600/0x844e5faceb5f8242 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184f6 expref: 25 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155643.764063:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f081600/0x844e5faceb5f8242 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184f6 expref: 25 pid: 20200 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746155643.764145:0:20796:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155643 -> 1746155644 00000100:00100000:1.0:1746155643.764156:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125398272:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155643.764170:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f17ae00/0x844e5faceb5f823b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184fd expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.764178:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f17ae00/0x844e5faceb5f823b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184fd expref: 24 pid: 20796 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1746155643.764606:0:8438:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime: 1746155643 -> 1746155644 00002000:00010000:2.0:1746155643.764609:0:8438:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime: 1746155643 -> 1746155644 00000100:00100000:2.0:1746155643.764621:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125398144:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.764635:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f17a400/0x844e5faceb5f8234 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184ef expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.764643:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f17a400/0x844e5faceb5f8234 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184ef expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.764661:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17a400, rc 0) 00010000:00010000:0.0:1746155643.764679:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f081600, rc 0) 00000100:00100000:2.0:1746155643.764697:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976126042496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3591us (3816us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155643.764699:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976126042624:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3260us (3744us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.764704:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17162 00000100:00100000:0.0:1746155643.764715:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17164 00010000:00010000:1.0:1746155643.764738:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17ae00, rc 0) 00000100:00100000:1.0:1746155643.764755:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976126042752:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3495us (3826us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155643.764759:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17163 00002000:00010000:1.0:1746155643.764784:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime: 1746155642 -> 1746155644 00000100:00100000:1.0:1746155643.764794:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094443100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125398528:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155643.764979:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f081e00/0x844e5faceb5f8249 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18504 expref: 16 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.764992:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f081e00/0x844e5faceb5f8249 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18504 expref: 16 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.764999:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f081e00, rc 0) 00000100:00100000:1.0:1746155643.765139:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1963:x1830976126042880:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3612us (4146us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155643.765144:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17165 00000100:00100000:2.0:1746155643.768204:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.768234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.768540:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126043136 00000100:00100000:1.0:1746155643.768548:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126043136 00000100:00100000:1.0:1746155643.768588:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126043392 00000100:00100000:1.0:1746155643.768591:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126043392 00000100:00100000:1.0:1746155643.768605:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17166 00000100:00100000:1.0:1746155643.768613:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126043136:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155643.768627:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155643.768641:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f080a00/0x844e5faceb5f8250 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18512 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.768684:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094443100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125398656:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155643.768752:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.768849:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17167 00000100:00100000:1.0:1746155643.768855:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976126043392:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155643.768863:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155643.768872:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f17a400/0x844e5faceb5f8257 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18520 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.768908:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125398784:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155643.768930:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea910c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.769291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.769312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.771103:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126043008 00000100:00100000:0.0:1746155643.771110:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126043008 00000100:00100000:0.0:1746155643.771133:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126043264 00000100:00100000:0.0:1746155643.771134:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126043264 00000100:00100000:0.0:1746155643.771148:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17168 00000100:00100000:0.0:1746155643.771154:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976126043008:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155643.771164:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155643.771175:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009374d800/0x844e5faceb5f825e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1850b expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155643.771208:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125398912:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155643.771255:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.771274:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17169 00000100:00100000:0.0:1746155643.771279:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126043264:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155643.771286:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155643.771293:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009374cc00/0x844e5faceb5f8265 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18519 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155643.771312:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125399040:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155643.771329:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b40243c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.771479:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094443100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125398656:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155643.771495:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f080a00/0x844e5faceb5f8250 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18512 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155643.771525:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f080a00/0x844e5faceb5f8250 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18512 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155643.771534:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f080a00, rc 0) 00000100:00100000:0.0:1746155643.771555:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126043136:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2943us (3357us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155643.771560:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17166 00000100:00100000:1.0:1746155643.771948:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125398784:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155643.771966:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f17a400/0x844e5faceb5f8257 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18520 expref: 18 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.771973:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f17a400/0x844e5faceb5f8257 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18520 expref: 18 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.771980:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17a400, rc 0) 00000100:00100000:1.0:1746155643.771998:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976126043392:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3144us (3763us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155643.772003:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17167 00000100:00100000:1.0:1746155643.773282:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125399040:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155643.773301:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009374cc00/0x844e5faceb5f8265 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18519 expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.773309:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009374cc00/0x844e5faceb5f8265 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18519 expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155643.773317:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374cc00, rc 0) 00000100:00100000:1.0:1746155643.773339:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126043264:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2060us (4026us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155643.773354:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17169 00000100:00100000:2.0:1746155643.773576:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125398912:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.773590:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009374d800/0x844e5faceb5f825e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1850b expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.773603:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009374d800/0x844e5faceb5f825e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1850b expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.774037:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374d800, rc 0) 00000100:00100000:2.0:1746155643.774059:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976126043008:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2904us (4769us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.774064:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17168 00000100:00100000:0.0:1746155643.774714:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.774755:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126043648 00000100:00100000:1.0:1746155643.774760:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126043648 00000100:00100000:1.0:1746155643.774794:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11163 00000100:00100000:1.0:1746155643.774799:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:32413:x1830976126043648:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155643.774813:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155643.775027:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b200/0x844e5faceb5f826c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18527 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.775109:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17be00/0x844e5faceb5f8273 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.775120:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17be00/0x844e5faceb5f8273 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155643.775128:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17be00/0x844e5faceb5f8273 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155643.775136:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155643.775224:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17b200/0x844e5faceb5f826c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18527 expref: 300 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.775235:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17be00/0x844e5faceb5f8273 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18527 expref: 299 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.775240:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155643.775243:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155643.775245:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f17be00, rc 0) 00000100:00100000:1.0:1746155643.775280:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:32413:x1830976126043648:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 480us (566us total) trans 8589945327 rc 0/0 00000100:00100000:1.0:1746155643.775285:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11163 00000100:00100000:0.0:1746155643.778127:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.778172:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.778198:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126044032 00000100:00100000:3.0:1746155643.778206:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126044032 00002000:00100000:3.0:1746155643.778240:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f882680 x1830976126044032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 504/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.778248:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882680 with x1830976126044032 ext(0->1048575) 00002000:00010000:3.0:1746155643.778253:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f882680 00000100:00100000:3.0:1746155643.778281:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126044160 00000100:00100000:3.0:1746155643.778284:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126044160 00002000:00100000:3.0:1746155643.778297:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f703480 x1830976126044160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.778304:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f703480 with x1830976126044160 ext(1048576->2097151) 00002000:00010000:3.0:1746155643.778307:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f703480 00000100:00100000:3.0:1746155643.778319:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8142 00000100:00100000:3.0:1746155643.778326:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976126044032:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155643.778345:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8143 00000100:00100000:1.0:1746155643.778353:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1963:x1830976126044160:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155643.782293:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.782403:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126044416 00000100:00100000:2.0:1746155643.782411:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126044416 00000100:00100000:2.0:1746155643.783594:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11164 00000100:00100000:2.0:1746155643.783603:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32416:x1830976126044416:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.783623:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.783637:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093603400/0x844e5faceb5f8281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1852e expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.783749:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093602000/0x844e5faceb5f8288 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.783761:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093602000/0x844e5faceb5f8288 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.783771:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093602000/0x844e5faceb5f8288 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.783785:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f828f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.783790:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f828f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.783795:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f828f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.783894:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093603c00/0x844e5faceb5f8296 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.783911:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093603c00/0x844e5faceb5f8296 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.783917:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093603c00/0x844e5faceb5f8296 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155643.783925:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155643.784004:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093602000/0x844e5faceb5f8288 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784010:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093602000/0x844e5faceb5f8288 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784015:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093602000/0x844e5faceb5f8288 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784020:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093602000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.784023:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093602000/0x844e5faceb5f8288 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784030:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093602000/0x844e5faceb5f8288 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784043:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155643.784045:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.784048:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093602000/0x844e5faceb5f8288 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784056:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093602000/0x844e5faceb5f8288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784065:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f828f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784069:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f828f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784073:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f828f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784077:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093602200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.784079:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f828f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784083:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f828f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784089:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800942dc200) 00010000:00010000:2.0:1746155643.784091:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.784093:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f828f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784098:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093602200/0x844e5faceb5f828f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.784126:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093603400/0x844e5faceb5f8281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1852e expref: 22 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.784137:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093603c00/0x844e5faceb5f8296 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1852e expref: 21 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.784147:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.784149:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155643.784151:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093603c00, rc 0) 00000100:00100000:2.0:1746155643.784195:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:32416:x1830976126044416:12345-192.168.202.51@tcp:101:cat.0 Request processed in 594us (1908us total) trans 8589945328 rc 0/0 00000100:00100000:2.0:1746155643.784201:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11164 00000100:00100000:0.0:1746155643.784648:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1963:x1830976126044160:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6294us (6473us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155643.784656:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8143 00002000:00100000:0.0:1746155643.784664:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f703480 x1830976126044160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155643.784672:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f703480 with x1830976126044160 ext(1048576->2097151) 00002000:00010000:0.0:1746155643.784676:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f703480 00000100:00100000:3.0:1746155643.786076:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976126044032:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7748us (7954us total) trans 0 rc 1007616/1007616 00000100:00100000:3.0:1746155643.786084:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8142 00002000:00100000:3.0:1746155643.786089:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f882680 x1830976126044032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 504/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1007616/1007616 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.786095:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f882680 with x1830976126044032 ext(0->1048575) 00002000:00010000:3.0:1746155643.786099:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f882680 00000100:00100000:0.0:1746155643.786440:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.786476:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126044544 00000100:00100000:2.0:1746155643.786482:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126044544 00000100:00100000:2.0:1746155643.786525:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17170 00000100:00100000:2.0:1746155643.786530:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126044544:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.786539:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.786549:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093603000/0x844e5faceb5f82a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18535 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155643.786568:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.786579:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125399168:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155643.786713:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126044672 00000100:00100000:3.0:1746155643.786716:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126044672 00000100:00100000:2.0:1746155643.786734:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155643.786738:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 761 00000100:00100000:3.0:1746155643.786743:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1961:x1830976126044672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155643.786750:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155643.786764:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093603c00/0x844e5faceb5f8296 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1852e expref: 21 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.786788:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155643.786791:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155643.786818:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976126044672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 74us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.786823:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 761 00002000:00010000:2.0:1746155643.788032:0:20796:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime: 1746155643 -> 1746155644 00002000:00010000:2.0:1746155643.788038:0:20796:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime: 1746155643 -> 1746155644 00000100:00100000:2.0:1746155643.788052:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125399168:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.788077:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093603000/0x844e5faceb5f82a4 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18535 expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.788088:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093603000/0x844e5faceb5f82a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18535 expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.788101:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093603000, rc 0) 00000100:00100000:2.0:1746155643.788233:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126044544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1699us (1790us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.788240:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17170 00000100:00100000:0.0:1746155643.790321:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.790363:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126044800 00000100:00100000:2.0:1746155643.790368:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126044800 00000100:00100000:2.0:1746155643.790408:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17171 00000100:00100000:2.0:1746155643.790415:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32416:x1830976126044800:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.790428:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.790441:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f82ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1853c expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.790463:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 21 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.790470:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.790472:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.790475:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f82ab lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1853c expref: 12 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.790499:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 21 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.790535:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 21 pid: 8438 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.790551:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125399296:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.790610:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.794914:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125399296:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.794945:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f82ab lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1853c expref: 12 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.794962:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093602a00, rc 0) 00000100:00100000:2.0:1746155643.795008:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32416:x1830976126044800:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4593us (4692us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.795016:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17171 00000100:00100000:0.0:1746155643.796020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.796450:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126044928 00000100:00100000:3.0:1746155643.796457:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126044928 00002000:00100000:3.0:1746155643.796488:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e1:0x0] (712704->753663) req@ffff88009f700700 x1830976126044928/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.796496:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700700 with x1830976126044928 ext(712704->753663) 00010000:00010000:3.0:1746155643.796520:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 22 pid: 8438 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.796646:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 22 pid: 8438 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746155643.796654:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f700700 00000100:00100000:3.0:1746155643.796671:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1416 00000100:00100000:3.0:1746155643.796678:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976126044928:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155643.799786:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976126044928:12345-192.168.202.51@tcp:4:cat.0 Request processed in 3100us (3760us total) trans 17179874311 rc 0/0 00000100:00100000:3.0:1746155643.799796:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1416 00002000:00100000:3.0:1746155643.799806:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e1:0x0] (712704->753663) req@ffff88009f700700 x1830976126044928/t17179874311(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/448 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.799815:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f700700 with x1830976126044928 ext(712704->753663) 00010000:00010000:3.0:1746155643.799823:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 24 pid: 8438 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.799835:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 24 pid: 8438 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746155643.799842:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f700700 00000100:00100000:0.0:1746155643.800602:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.800689:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126045056 00000100:00100000:2.0:1746155643.800695:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126045056 00000100:00100000:2.0:1746155643.800733:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17172 00000100:00100000:2.0:1746155643.800739:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:32411:x1830976126045056:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.800756:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.800768:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5f82b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18543 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.800792:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 7 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.800798:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.800800:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.800803:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5f82b2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18543 expref: 16 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.800836:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 7 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.800845:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 7 pid: 20796 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.800855:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125399424:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.800922:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.802455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.802668:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126045184 00000100:00100000:3.0:1746155643.802675:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126045184 00000100:00100000:2.0:1746155643.802695:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125399424:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.802717:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5f82b2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18543 expref: 16 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.802728:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e78c00, rc 0) 00000100:00100000:2.0:1746155643.802750:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32411:x1830976126045056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2011us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.802756:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17172 00002000:00100000:3.0:1746155643.802923:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1884160->2097151) req@ffff8800a62a1500 x1830976126045184/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.802939:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a1500 with x1830976126045184 ext(1884160->2097151) 00010000:00010000:3.0:1746155643.802946:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 8 pid: 20796 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.802956:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 8 pid: 20796 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746155643.802962:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a62a1500 00000100:00100000:3.0:1746155643.803005:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1417 00000100:00100000:3.0:1746155643.803014:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1963:x1830976126045184:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155643.805575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.806074:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126045312 00000100:00100000:3.0:1746155643.806082:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126045312 00010000:00010000:3.0:1746155643.806111:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 24 pid: 8438 timeout: 872 lvb_type: 0 00000100:00100000:3.0:1746155643.806146:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8804 00000100:00100000:3.0:1746155643.806153:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976126045312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155643.806161:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155643.806177:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 24 pid: 8438 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.806186:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 24 pid: 8438 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.806202:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f17ba00/0x844e5faceb5f80eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 712704->753663) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18408 expref: 24 pid: 8438 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.806235:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.806238:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.806246:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f82ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1853c expref: 11 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.806254:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f82ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1853c expref: 11 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.806301:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f82ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1853c expref: 11 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155643.806313:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125399552:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155643.806662:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfd900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155643.809788:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1963:x1830976126045184:12345-192.168.202.51@tcp:4:cat.0 Request processed in 6767us (7327us total) trans 21474841627 rc 0/0 00000100:00100000:3.0:1746155643.809799:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1417 00002000:00100000:3.0:1746155643.809810:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1884160->2097151) req@ffff8800a62a1500 x1830976126045184/t21474841627(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/448 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.809818:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a1500 with x1830976126045184 ext(1884160->2097151) 00010000:00010000:3.0:1746155643.809826:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 10 pid: 20796 timeout: 872 lvb_type: 0 00010000:00010000:3.0:1746155643.809840:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 10 pid: 20796 timeout: 872 lvb_type: 0 00002000:00010000:3.0:1746155643.809846:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a62a1500 00000100:00100000:2.0:1746155643.809972:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125399552:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155643.809992:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.810017:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976126045312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3864us (4446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.810025:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8804 00000100:00100000:1.0:1746155643.814054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.814148:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126045568 00000100:00100000:3.0:1746155643.814156:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126045568 00002000:00100000:3.0:1746155643.814192:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880094442a00 x1830976126045568/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.814199:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094442a00 with x1830976126045568 ext(0->1048575) 00002000:00010000:3.0:1746155643.814204:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094442a00 00000100:00100000:0.0:1746155643.814436:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.814525:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126045696 00000100:00100000:2.0:1746155643.814529:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126045696 00010000:00010000:2.0:1746155643.814546:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 10 pid: 20796 timeout: 872 lvb_type: 0 00000100:00100000:2.0:1746155643.814567:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8805 00000100:00100000:2.0:1746155643.814573:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126045696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.814584:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155643.814603:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 10 pid: 20796 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.814614:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 10 pid: 20796 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.814631:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fcb1400/0x844e5faceb5f80a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1884160->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183de expref: 10 pid: 20796 timeout: 872 lvb_type: 0 00010000:00010000:2.0:1746155643.814646:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.814648:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.814658:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5f82b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18543 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.814665:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5f82b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18543 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.814694:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5f82b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18543 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.814708:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125399680:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155643.814769:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.815327:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8144 00000100:00100000:1.0:1746155643.815334:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126045568:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155643.825936:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125399680:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155643.825956:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.826003:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976126045696:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 11429us (11566us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.826013:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8805 00000100:00100000:1.0:1746155643.829050:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126045568:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13709us (14994us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155643.829060:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8144 00002000:00100000:1.0:1746155643.829071:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880094442a00 x1830976126045568/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.829080:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094442a00 with x1830976126045568 ext(0->1048575) 00002000:00010000:1.0:1746155643.829085:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094442a00 00000100:00100000:0.0:1746155643.829296:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.829543:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126045952 00000100:00100000:1.0:1746155643.829549:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126045952 00002000:00100000:1.0:1746155643.829574:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a62a3100 x1830976126045952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.829581:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a3100 with x1830976126045952 ext(1048576->2097151) 00002000:00010000:1.0:1746155643.829584:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a3100 00000100:00100000:1.0:1746155643.830158:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8145 00000100:00100000:1.0:1746155643.830164:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976126045952:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155643.843846:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976126045952:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13672us (14540us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155643.843857:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8145 00002000:00100000:1.0:1746155643.843868:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a62a3100 x1830976126045952/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.843876:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a3100 with x1830976126045952 ext(1048576->2097151) 00002000:00010000:1.0:1746155643.843881:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a3100 00000100:00100000:1.0:1746155643.845910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.846059:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126046080 00000100:00100000:3.0:1746155643.846067:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126046080 00000100:00100000:3.0:1746155643.846108:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17173 00000100:00100000:3.0:1746155643.846114:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32416:x1830976126046080:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155643.846125:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.846139:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f82b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1854a expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.846158:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.846159:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155643.846165:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f82b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1854a expref: 10 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.846178:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f82b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1854a expref: 10 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.846188:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fabc00, rc 0) 00000100:00100000:3.0:1746155643.846747:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32416:x1830976126046080:12345-192.168.202.51@tcp:101:cat.0 Request processed in 632us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.846754:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17173 00000100:00100000:0.0:1746155643.852423:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.852449:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126046336 00000100:00100000:0.0:1746155643.852455:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126046336 00002000:00100000:0.0:1746155643.852488:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a62a1c00 x1830976126046336/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155643.852497:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a1c00 with x1830976126046336 ext(1048576->2097151) 00002000:00010000:0.0:1746155643.852564:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a1c00 00000100:00100000:0.0:1746155643.852592:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8146 00000100:00100000:0.0:1746155643.852599:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126046336:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155643.855311:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.855359:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126046464 00000100:00100000:3.0:1746155643.855367:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126046464 00000100:00100000:3.0:1746155643.855407:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17174 00000100:00100000:3.0:1746155643.855414:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32411:x1830976126046464:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155643.855428:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.855443:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fbca400/0x844e5faceb5f82c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18551 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.855469:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.855476:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155643.855478:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155643.855481:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbca400/0x844e5faceb5f82c0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18551 expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.855574:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.855584:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 11 pid: 9235 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155643.855594:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125399808:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155643.855658:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfde40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155643.867840:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126046336:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15234us (15417us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155643.867850:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8146 00002000:00100000:3.0:1746155643.867860:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a62a1c00 x1830976126046336/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.867869:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a62a1c00 with x1830976126046336 ext(1048576->2097151) 00002000:00010000:3.0:1746155643.867873:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a62a1c00 00000100:00100000:0.0:1746155643.867936:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.868234:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125399808:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.868259:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fbca400/0x844e5faceb5f82c0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18551 expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.868280:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbca400, rc 0) 00000100:00100000:2.0:1746155643.868307:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32411:x1830976126046464:12345-192.168.202.51@tcp:101:cat.0 Request processed in 12893us (13002us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.868313:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17174 00000100:00100000:3.0:1746155643.868762:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126046592 00000100:00100000:3.0:1746155643.868768:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126046592 00002000:00100000:3.0:1746155643.868796:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1343487) req@ffff88009fed8a80 x1830976126046592/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.868804:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed8a80 with x1830976126046592 ext(1048576->1343487) 00010000:00010000:3.0:1746155643.868810:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 12 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155643.868821:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 12 pid: 9235 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155643.868827:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fed8a80 00000100:00100000:3.0:1746155643.868838:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1418 00000100:00100000:3.0:1746155643.868844:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126046592:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155643.874582:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.874645:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126046720 00000100:00100000:2.0:1746155643.874653:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126046720 00000100:00100000:2.0:1746155643.874688:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17175 00000100:00100000:2.0:1746155643.874693:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32416:x1830976126046720:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.874708:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.874721:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a57a00/0x844e5faceb5f82c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18558 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.874741:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.874746:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a57a00/0x844e5faceb5f82c7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18558 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.874755:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a57a00/0x844e5faceb5f82c7 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18558 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.874769:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a57a00, rc 0) 00000100:00100000:2.0:1746155643.874811:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32416:x1830976126046720:12345-192.168.202.51@tcp:101:cat.0 Request processed in 118us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.874817:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17175 00000100:00100000:3.0:1746155643.877412:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126046592:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8562us (9470us total) trans 17179874312 rc 0/0 00000100:00100000:3.0:1746155643.877422:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1418 00002000:00100000:3.0:1746155643.877430:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1343487) req@ffff88009fed8a80 x1830976126046592/t17179874312(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/448 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.877438:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed8a80 with x1830976126046592 ext(1048576->1343487) 00010000:00010000:3.0:1746155643.877446:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 15 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155643.877458:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 15 pid: 9235 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155643.877464:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fed8a80 00000100:00100000:0.0:1746155643.882994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.883054:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126046976 00000100:00100000:2.0:1746155643.883062:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126046976 00000100:00100000:2.0:1746155643.883120:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11165 00000100:00100000:2.0:1746155643.883127:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32418:x1830976126046976:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155643.883145:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.883160:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a56a00/0x844e5faceb5f82ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1855f expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.883248:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57e00/0x844e5faceb5f82d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883259:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57e00/0x844e5faceb5f82d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883270:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57e00/0x844e5faceb5f82d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883280:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57000/0x844e5faceb5f82dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883285:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57000/0x844e5faceb5f82dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883290:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57000/0x844e5faceb5f82dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883380:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57600/0x844e5faceb5f82e3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883387:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57600/0x844e5faceb5f82e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883393:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57600/0x844e5faceb5f82e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155643.883400:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155643.883467:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57e00/0x844e5faceb5f82d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883473:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57e00/0x844e5faceb5f82d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883478:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57e00/0x844e5faceb5f82d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883483:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a57e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.883485:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57e00/0x844e5faceb5f82d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883491:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57e00/0x844e5faceb5f82d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883500:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155643.883536:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.883540:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57e00/0x844e5faceb5f82d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883545:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57e00/0x844e5faceb5f82d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883571:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57000/0x844e5faceb5f82dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883576:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57000/0x844e5faceb5f82dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883579:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57000/0x844e5faceb5f82dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883583:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a57000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155643.883585:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57000/0x844e5faceb5f82dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883589:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57000/0x844e5faceb5f82dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883595:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800942dc200) 00010000:00010000:2.0:1746155643.883602:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155643.883604:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57000/0x844e5faceb5f82dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883608:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57000/0x844e5faceb5f82dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155643.883641:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a56a00/0x844e5faceb5f82ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1855f expref: 23 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.883651:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57600/0x844e5faceb5f82e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1855f expref: 22 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.883656:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155643.883658:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155643.883660:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a57600, rc 0) 00000100:00100000:2.0:1746155643.883699:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32418:x1830976126046976:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 572us (712us total) trans 8589945329 rc 0/0 00000100:00100000:2.0:1746155643.883705:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11165 00000100:00100000:1.0:1746155643.884322:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.884383:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126047104 00000100:00100000:2.0:1746155643.884387:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126047104 00010000:00010000:2.0:1746155643.884406:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 15 pid: 9235 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155643.884435:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8806 00000100:00100000:2.0:1746155643.884440:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126047104:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155643.884448:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155643.884464:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 15 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155643.884473:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 15 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155643.884489:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090487400/0x844e5faceb5f80f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1343487) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1840f expref: 15 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155643.884499:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.884500:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.884524:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbca400/0x844e5faceb5f82c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18551 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.884531:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbca400/0x844e5faceb5f82c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18551 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.884538:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.884539:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.884542:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a57a00/0x844e5faceb5f82c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18558 expref: 14 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.884547:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a57a00/0x844e5faceb5f82c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18558 expref: 14 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.884567:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136a57a00/0x844e5faceb5f82c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18558 expref: 14 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.884578:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125399936:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155643.885153:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbca400/0x844e5faceb5f82c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18551 expref: 23 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155643.885161:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125400064:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155643.885191:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.891992:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.893379:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.893422:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126047360 00000100:00100000:3.0:1746155643.893430:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126047360 00002000:00100000:3.0:1746155643.893464:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2617344->2621439) req@ffff88009f57d180 x1830976126047360/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.893473:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57d180 with x1830976126047360 ext(2617344->2621439) 00002000:00010000:3.0:1746155643.893478:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f57d180 00000100:00100000:3.0:1746155643.893500:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8147 00000100:00100000:3.0:1746155643.893520:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126047360:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155643.895711:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126047488 00000100:00100000:1.0:1746155643.895720:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126047488 00000100:00100000:1.0:1746155643.895770:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 762 00000100:00100000:1.0:1746155643.895776:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976126047488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.895787:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.895809:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57600/0x844e5faceb5f82e3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1855f expref: 22 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.895826:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155643.895830:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155643.896332:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126047360:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 2811us (4346us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155643.896340:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8147 00002000:00100000:3.0:1746155643.896348:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2617344->2621439) req@ffff88009f57d180 x1830976126047360/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.896356:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57d180 with x1830976126047360 ext(2617344->2621439) 00002000:00010000:3.0:1746155643.896360:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f57d180 00000100:00100000:0.0:1746155643.896740:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.896780:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.896828:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126047744 00000100:00100000:2.0:1746155643.896832:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126047744 00002000:00100000:2.0:1746155643.896853:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009f57f800 x1830976126047744/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.896861:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57f800 with x1830976126047744 ext(1048576->2097151) 00002000:00010000:2.0:1746155643.896863:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f57f800 00000100:00100000:2.0:1746155643.896873:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126048000 00000100:00100000:2.0:1746155643.896875:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126048000 00002000:00100000:2.0:1746155643.896884:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009f57ce00 x1830976126048000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.896890:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57ce00 with x1830976126048000 ext(1048576->2097151) 00002000:00010000:2.0:1746155643.896893:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f57ce00 00000100:00100000:2.0:1746155643.896912:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8148 00000100:00100000:2.0:1746155643.896917:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126047744:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155643.897644:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8149 00000100:00100000:3.0:1746155643.897652:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126048000:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155643.898054:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126047488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2275us (4674us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.898063:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 762 00000100:00100000:1.0:1746155643.898299:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125399936:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155643.898309:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125400064:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155643.898325:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.898354:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126047104:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 13914us (14033us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.898361:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8806 00000100:00100000:0.0:1746155643.913883:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.915030:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126048256 00000100:00100000:1.0:1746155643.915038:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126048256 00000100:00100000:2.0:1746155643.915042:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126047744:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 18121us (18300us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155643.915051:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8148 00002000:00100000:2.0:1746155643.915061:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009f57f800 x1830976126047744/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.915069:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57f800 with x1830976126047744 ext(1048576->2097151) 00002000:00100000:1.0:1746155643.915071:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2772992->2777087) req@ffff8801317c6a00 x1830976126048256/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00010000:2.0:1746155643.915073:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f57f800 00002000:00100000:1.0:1746155643.915079:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6a00 with x1830976126048256 ext(2772992->2777087) 00002000:00010000:1.0:1746155643.915082:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c6a00 00000100:00100000:1.0:1746155643.915099:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8150 00000100:00100000:1.0:1746155643.915105:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126048256:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155643.915232:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126048256:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 126us (1356us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155643.915237:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8150 00002000:00100000:1.0:1746155643.915242:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2772992->2777087) req@ffff8801317c6a00 x1830976126048256/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.915249:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6a00 with x1830976126048256 ext(2772992->2777087) 00002000:00010000:1.0:1746155643.915251:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c6a00 00000100:00100000:3.0:1746155643.916379:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126048000:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18727us (19596us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155643.916385:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8149 00002000:00100000:3.0:1746155643.916390:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009f57ce00 x1830976126048000/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.916396:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f57ce00 with x1830976126048000 ext(1048576->2097151) 00002000:00010000:3.0:1746155643.916399:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f57ce00 00000100:00100000:0.0:1746155643.921695:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.921742:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126048512 00000100:00100000:2.0:1746155643.921750:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126048512 00000100:00100000:2.0:1746155643.921794:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4746 00000100:00100000:2.0:1746155643.921801:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:32418:x1830976126048512:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155643.921998:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32418:x1830976126048512:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 196us (308us total) trans 8589945330 rc 0/0 00000100:00100000:2.0:1746155643.922004:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4746 00000100:00100000:0.0:1746155643.929855:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.929888:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.929923:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.929951:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.929996:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126048640 00000100:00100000:0.0:1746155643.930004:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126048640 00000100:00100000:1.0:1746155643.930029:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126048768 00000100:00100000:1.0:1746155643.930032:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126048768 00000100:00100000:0.0:1746155643.930035:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126048896 00000100:00100000:0.0:1746155643.930036:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126048896 00000100:00100000:1.0:1746155643.930045:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126049024 00000100:00100000:1.0:1746155643.930046:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126049024 00000100:00100000:0.0:1746155643.930051:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17176 00000100:00100000:0.0:1746155643.930057:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976126048640:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155643.930071:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155643.930086:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c283200/0x844e5faceb5f82f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18566 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.930104:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155643.930106:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155643.930165:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c283200/0x844e5faceb5f82f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18566 expref: 27 pid: 8438 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155643.930176:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17177 00010000:00010000:0.0:1746155643.930179:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c283200/0x844e5faceb5f82f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18566 expref: 27 pid: 8438 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155643.930182:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976126048768:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155643.930188:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155643.930188:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c283200, rc 0) 00000100:00100000:2.0:1746155643.930189:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17178 00000100:00100000:2.0:1746155643.930197:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976126048896:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155643.930198:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f4d9400/0x844e5faceb5f82f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1856d expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.930205:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.930214:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136a57600/0x844e5faceb5f82ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18574 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.930229:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125400192:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155643.930229:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976126048640:12345-192.168.202.51@tcp:101:cat.0 Request processed in 172us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155643.930234:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17176 00000100:00100000:2.0:1746155643.930238:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125400320:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155643.930247:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17179 00000100:00100000:0.0:1746155643.930251:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:32413:x1830976126049024:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155643.930256:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155643.930261:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1857b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.930321:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 13 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.930327:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155643.930328:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155643.930331:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [4112384->4194303] (req 4112384->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 28 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.930346:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 13 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.930356:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 13 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746155643.930364:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125400448:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155643.930423:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.930426:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e316a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.930433:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.930475:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.930496:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.930603:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126049280 00000100:00100000:0.0:1746155643.930606:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126049280 00002000:00100000:0.0:1746155643.930628:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009366c000 x1830976126049280/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155643.930636:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366c000 with x1830976126049280 ext(2097152->3145727) 00010000:00010000:0.0:1746155643.930641:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155643.930651:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746155643.930656:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009366c000 00000100:00100000:0.0:1746155643.930666:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126049536 00000100:00100000:0.0:1746155643.930668:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126049536 00002000:00100000:0.0:1746155643.930683:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009366e680 x1830976126049536/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155643.930689:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366e680 with x1830976126049536 ext(3145728->4194303) 00010000:00010000:0.0:1746155643.930692:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 15 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155643.930700:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 15 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746155643.930704:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009366e680 00000100:00100000:0.0:1746155643.930726:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1419 00000100:00100000:0.0:1746155643.930732:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976126049280:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155643.931077:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1420 00000100:00100000:1.0:1746155643.931082:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976126049536:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155643.931548:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.931583:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126049792 00000100:00100000:2.0:1746155643.931585:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.931587:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126049792 00002000:00100000:3.0:1746155643.931604:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3305471) req@ffff880095268380 x1830976126049792/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 504/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.931612:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095268380 with x1830976126049792 ext(2097152->3305471) 00002000:00010000:3.0:1746155643.931615:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095268380 00000100:00100000:3.0:1746155643.931625:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126050048 00000100:00100000:3.0:1746155643.931628:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126050048 00002000:00100000:3.0:1746155643.931637:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3305472->3973119) req@ffff8800a06a5500 x1830976126050048/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.931643:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a5500 with x1830976126050048 ext(3305472->3973119) 00002000:00010000:3.0:1746155643.931646:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a06a5500 00000100:00100000:3.0:1746155643.931662:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8151 00000100:00100000:3.0:1746155643.931668:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126049792:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155643.931881:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8152 00000100:00100000:0.0:1746155643.931890:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126050048:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155643.933404:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125400448:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155643.933427:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [4112384->4194303] (req 4112384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 28 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.933441:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c283e00, rc 0) 00000100:00100000:0.0:1746155643.933462:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:32413:x1830976126049024:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3210us (3510us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155643.933468:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17179 00000100:00100000:0.0:1746155643.933615:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125400320:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155643.933635:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136a57600/0x844e5faceb5f82ff lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18574 expref: 17 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155643.933644:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a57600/0x844e5faceb5f82ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18574 expref: 17 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155643.933656:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a57600, rc 0) 00000100:00100000:0.0:1746155643.933674:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976126048896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3479us (3750us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155643.933679:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17178 00000100:00100000:2.0:1746155643.933840:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125400192:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155643.933857:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f4d9400/0x844e5faceb5f82f8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1856d expref: 27 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.933866:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f4d9400/0x844e5faceb5f82f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1856d expref: 27 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155643.933878:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d9400, rc 0) 00000100:00100000:2.0:1746155643.933915:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976126048768:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3732us (4025us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155643.933921:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17177 00000100:00100000:0.0:1746155643.935075:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.935122:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126050176 00000100:00100000:3.0:1746155643.935128:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126050176 00002000:00100000:3.0:1746155643.935155:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->4878335) req@ffff88012bdf4e00 x1830976126050176/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.935163:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4e00 with x1830976126050176 ext(4194304->4878335) 00010000:00010000:3.0:1746155643.935169:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 18 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155643.935180:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 18 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155643.935190:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bdf4e00 00000100:00100000:3.0:1746155643.935219:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1421 00000100:00100000:3.0:1746155643.935226:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976126050176:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155643.936892:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.936955:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126050304 00000100:00100000:3.0:1746155643.936960:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126050304 00000100:00100000:3.0:1746155643.936988:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17180 00000100:00100000:3.0:1746155643.936995:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:32411:x1830976126050304:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155643.937006:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155643.937020:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d1da600/0x844e5faceb5f830d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18582 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.937040:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155643.937042:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155643.937046:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d1da600/0x844e5faceb5f830d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18582 expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.937056:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d1da600/0x844e5faceb5f830d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18582 expref: 27 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155643.937065:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d1da600, rc 0) 00000100:00100000:3.0:1746155643.937090:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:32411:x1830976126050304:12345-192.168.202.51@tcp:101:cat.0 Request processed in 95us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155643.937095:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17180 00000100:00100000:2.0:1746155643.939017:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976126049536:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7926us (8511us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155643.939027:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1420 00002000:00100000:2.0:1746155643.939037:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009366e680 x1830976126049536/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.939045:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366e680 with x1830976126049536 ext(3145728->4194303) 00010000:00010000:2.0:1746155643.939056:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 18 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155643.939069:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 18 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746155643.939076:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009366e680 00000100:00100000:2.0:1746155643.945044:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126050048:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13148us (13450us total) trans 0 rc 667648/667648 00000100:00100000:2.0:1746155643.945054:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8152 00002000:00100000:2.0:1746155643.945064:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3305472->3973119) req@ffff8800a06a5500 x1830976126050048/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 667648/667648 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.945072:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a06a5500 with x1830976126050048 ext(3305472->3973119) 00002000:00010000:2.0:1746155643.945078:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a06a5500 00000100:00100000:2.0:1746155643.945949:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126049792:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14279us (14399us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155643.945955:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8151 00002000:00100000:2.0:1746155643.945961:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3305471) req@ffff880095268380 x1830976126049792/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 504/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.945967:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095268380 with x1830976126049792 ext(2097152->3305471) 00002000:00010000:2.0:1746155643.945970:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095268380 00000100:00100000:3.0:1746155643.947291:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976126050176:12345-192.168.202.51@tcp:4:cat.0 Request processed in 12063us (12216us total) trans 17179874313 rc 0/0 00000100:00100000:3.0:1746155643.947302:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1421 00002000:00100000:3.0:1746155643.947308:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->4878335) req@ffff88012bdf4e00 x1830976126050176/t17179874313(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/448 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.947316:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf4e00 with x1830976126050176 ext(4194304->4878335) 00010000:00010000:3.0:1746155643.947324:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 18 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155643.947337:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 18 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155643.947343:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bdf4e00 00000100:00100000:0.0:1746155643.947593:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976126049280:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16860us (17117us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155643.947599:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1419 00002000:00100000:0.0:1746155643.947604:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009366c000 x1830976126049280/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155643.947611:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366c000 with x1830976126049280 ext(2097152->3145727) 00010000:00010000:0.0:1746155643.947616:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 16 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155643.947625:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 16 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746155643.947630:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009366c000 00000100:00100000:0.0:1746155643.951784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.951841:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126050432 00000100:00100000:2.0:1746155643.951848:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126050432 00000100:00100000:2.0:1746155643.951882:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17181 00000100:00100000:2.0:1746155643.951888:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32416:x1830976126050432:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.951914:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.951932:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f8314 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18589 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.951956:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.951963:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [4112384->4194303] (req 4112384->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.951969:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746155643.951972:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f8314 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18589 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.952002:0:19959:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [4112384->4194303] (req 4112384->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.952013:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f8314 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18589 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.952022:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a56c00, rc 0) 00000100:00100000:2.0:1746155643.952072:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32416:x1830976126050432:12345-192.168.202.51@tcp:101:cat.0 Request processed in 183us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.952078:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17181 00000100:00100000:0.0:1746155643.954537:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.954695:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126050560 00000100:00100000:1.0:1746155643.954702:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126050560 00010000:00010000:1.0:1746155643.954732:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 17 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155643.954769:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8807 00000100:00100000:1.0:1746155643.954775:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976126050560:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.954785:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.954816:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 17 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155643.954826:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 17 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155643.954844:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093603600/0x844e5faceb5f822d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4878335) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e8 expref: 17 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155643.954874:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.954876:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.954882:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.954889:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.954907:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.954909:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.954912:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d1da600/0x844e5faceb5f830d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18582 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.954917:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d1da600/0x844e5faceb5f830d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18582 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.954945:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d1da600/0x844e5faceb5f830d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18582 expref: 26 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.954955:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125400704:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155643.955250:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.955260:0:7064:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 26 pid: 8438 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155643.955269:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125400832:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155643.955294:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.959934:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.959977:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.960033:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126050816 00000100:00100000:3.0:1746155643.960039:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126050816 00002000:00100000:3.0:1746155643.960069:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4112384->4116479) req@ffff88008e26f100 x1830976126050816/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155643.960075:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125400704:192.168.202.51@tcp:105: 00002000:00100000:3.0:1746155643.960076:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26f100 with x1830976126050816 ext(4112384->4116479) 00010000:00010000:3.0:1746155643.960082:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 27 pid: 8438 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155643.960084:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125400832:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155643.960092:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 27 pid: 8438 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155643.960096:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e26f100 00000100:00100000:2.0:1746155643.960098:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126051072 00010000:00010000:1.0:1746155643.960102:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155643.960103:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126051072 00000100:00100000:3.0:1746155643.960110:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1422 00000100:00100000:3.0:1746155643.960115:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976126050816:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:2.0:1746155643.960119:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88008e26e300 x1830976126051072/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.960127:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26e300 with x1830976126051072 ext(2097152->3145727) 00002000:00010000:2.0:1746155643.960131:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26e300 00000100:00100000:1.0:1746155643.960133:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126050560:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5357us (5638us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.960141:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8807 00000100:00100000:2.0:1746155643.960146:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8153 00000100:00100000:2.0:1746155643.960151:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976126051072:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155643.960582:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976126050816:12345-192.168.202.51@tcp:3:cat.0 Request processed in 461us (651us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155643.960589:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1422 00002000:00100000:3.0:1746155643.960594:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4112384->4116479) req@ffff88008e26f100 x1830976126050816/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.960602:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26f100 with x1830976126050816 ext(4112384->4116479) 00010000:00010000:3.0:1746155643.960606:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 28 pid: 8438 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155643.960616:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 28 pid: 8438 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155643.960621:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e26f100 00000100:00100000:2.0:1746155643.967126:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976126051072:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6966us (7140us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155643.967137:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8153 00002000:00100000:2.0:1746155643.967147:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88008e26e300 x1830976126051072/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.967155:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26e300 with x1830976126051072 ext(2097152->3145727) 00002000:00010000:2.0:1746155643.967162:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26e300 00000100:00100000:0.0:1746155643.967906:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.967937:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.968046:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126051328 00000100:00100000:2.0:1746155643.968052:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126051328 00000100:00100000:3.0:1746155643.968122:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126051456 00000100:00100000:3.0:1746155643.968127:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126051456 00002000:00100000:3.0:1746155643.968151:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4112384->4194303) req@ffff88008e26ea00 x1830976126051456/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.968158:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26ea00 with x1830976126051456 ext(4112384->4194303) 00010000:00010000:3.0:1746155643.968164:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 27 pid: 8438 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155643.968176:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 27 pid: 8438 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155643.968181:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e26ea00 00000100:00100000:3.0:1746155643.968194:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1423 00000100:00100000:3.0:1746155643.968200:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976126051456:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155643.968222:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17182 00000100:00100000:2.0:1746155643.968228:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32413:x1830976126051328:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155643.968237:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.968251:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18590 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.968269:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 9 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.968276:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.968278:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.968281:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->3899391] (req 3145728->3899391) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.968404:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 9 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.968413:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 9 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155643.968423:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125400960:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.968483:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155643.970532:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.970619:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126051584 00000100:00100000:1.0:1746155643.970625:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126051584 00002000:00100000:1.0:1746155643.970653:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2617344->4194303) req@ffff88008e26d180 x1830976126051584/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 504/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155643.970661:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26d180 with x1830976126051584 ext(2617344->4194303) 00010000:00010000:1.0:1746155643.970668:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 10 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155643.970676:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 10 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:1.0:1746155643.970682:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e26d180 00000100:00100000:1.0:1746155643.970698:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1424 00000100:00100000:1.0:1746155643.970703:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976126051584:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155643.970783:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125400960:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155643.970803:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->3899391] (req 3145728->3899391) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.970815:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a57c00, rc 0) 00000100:00100000:0.0:1746155643.970927:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:32413:x1830976126051328:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2698us (3032us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155643.970934:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17182 00000100:00100000:3.0:1746155643.971271:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976126051456:12345-192.168.202.51@tcp:4:cat.0 Request processed in 3069us (3331us total) trans 17179874314 rc 0/0 00000100:00100000:3.0:1746155643.971278:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1423 00002000:00100000:3.0:1746155643.971283:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (4112384->4194303) req@ffff88008e26ea00 x1830976126051456/t17179874314(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/448 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.971290:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26ea00 with x1830976126051456 ext(4112384->4194303) 00010000:00010000:3.0:1746155643.971296:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 29 pid: 8438 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155643.971305:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 29 pid: 8438 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155643.971311:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e26ea00 00000100:00100000:2.0:1746155643.971612:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.971626:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126051712 00000100:00100000:0.0:1746155643.971629:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126051712 00000100:00100000:0.0:1746155643.971650:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17183 00000100:00100000:0.0:1746155643.971655:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:32411:x1830976126051712:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155643.971662:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155643.971672:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5257400/0x844e5faceb5f8322 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18597 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.971685:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155643.971687:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155643.971690:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5257400/0x844e5faceb5f8322 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18597 expref: 18 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.971702:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5257400/0x844e5faceb5f8322 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18597 expref: 18 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155643.971709:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5257400, rc 0) 00000100:00100000:0.0:1746155643.971738:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a15a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:32411:x1830976126051712:12345-192.168.202.51@tcp:101:cat.0 Request processed in 82us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155643.971744:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17183 00000100:00100000:2.0:1746155643.974058:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.974105:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126051840 00000100:00100000:1.0:1746155643.974111:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126051840 00010000:00010000:1.0:1746155643.974132:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 29 pid: 8438 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155643.974160:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8808 00000100:00100000:1.0:1746155643.974164:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976126051840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.974172:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.974186:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 29 pid: 8438 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155643.974197:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 29 pid: 8438 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155643.974211:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c283e00/0x844e5faceb5f8306 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1857b expref: 29 pid: 8438 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155643.974221:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.974222:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.974226:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f8314 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18589 expref: 15 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.974231:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f8314 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18589 expref: 15 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.974250:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f8314 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18589 expref: 15 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.974257:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125401088:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155643.974304:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.975543:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125401088:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155643.975555:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.975580:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976126051840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1415us (1528us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.975587:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8808 00000100:00100000:2.0:1746155643.976024:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976126051584:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5320us (5527us total) trans 21474841628 rc 0/0 00000100:00100000:2.0:1746155643.976030:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1424 00002000:00100000:2.0:1746155643.976036:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2617344->4194303) req@ffff88008e26d180 x1830976126051584/t21474841628(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 504/448 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.976042:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26d180 with x1830976126051584 ext(2617344->4194303) 00010000:00010000:2.0:1746155643.976047:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 12 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155643.976055:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 12 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746155643.976059:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e26d180 00000100:00100000:0.0:1746155643.977813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.977926:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126052096 00000100:00100000:2.0:1746155643.977932:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126052096 00002000:00100000:2.0:1746155643.977962:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88008e26e680 x1830976126052096/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.977969:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26e680 with x1830976126052096 ext(3145728->4194303) 00002000:00010000:2.0:1746155643.977974:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26e680 00000100:00100000:2.0:1746155643.977999:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8154 00000100:00100000:2.0:1746155643.978006:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126052096:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155643.978690:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.978756:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126052224 00000100:00100000:1.0:1746155643.978760:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126052224 00010000:00010000:1.0:1746155643.978777:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 12 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155643.978807:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8809 00000100:00100000:1.0:1746155643.978815:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1963:x1830976126052224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155643.978823:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155643.978836:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 12 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155643.978845:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 12 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155643.978865:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093603800/0x844e5faceb5f8226 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184e1 expref: 12 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155643.978883:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.978885:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.978892:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.978910:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.978918:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.978919:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155643.978922:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5257400/0x844e5faceb5f8322 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18597 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.978932:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5257400/0x844e5faceb5f8322 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18597 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155643.978953:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5257400/0x844e5faceb5f8322 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18597 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.978962:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125401216:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155643.979032:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155643.979038:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125401344:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155643.979051:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155643.981235:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125401216:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155643.981244:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125401344:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155643.981259:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155643.981432:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976126052224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2617us (2740us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155643.981441:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8809 00000100:00100000:2.0:1746155643.982886:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126052096:12345-192.168.202.51@tcp:3:cat.0 Request processed in 4877us (5072us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155643.982908:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8154 00002000:00100000:2.0:1746155643.982918:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88008e26e680 x1830976126052096/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.982927:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26e680 with x1830976126052096 ext(3145728->4194303) 00002000:00010000:2.0:1746155643.982932:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26e680 00000100:00100000:0.0:1746155643.983830:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155643.983864:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.983993:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126052608 00000100:00100000:2.0:1746155643.983999:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126052608 00000100:00100000:3.0:1746155643.984021:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126052480 00002000:00100000:2.0:1746155643.984022:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3895296->3899391) req@ffff88008e26df80 x1830976126052608/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155643.984026:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126052480 00002000:00100000:2.0:1746155643.984029:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26df80 with x1830976126052608 ext(3895296->3899391) 00002000:00010000:2.0:1746155643.984032:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26df80 00002000:00100000:3.0:1746155643.984043:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88008e26f480 x1830976126052480/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.984051:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26f480 with x1830976126052480 ext(2097152->3145727) 00002000:00010000:3.0:1746155643.984054:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26f480 00000100:00100000:2.0:1746155643.984144:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8155 00000100:00100000:2.0:1746155643.984150:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126052608:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155643.984165:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8156 00000100:00100000:3.0:1746155643.984172:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126052480:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155643.984267:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126052608:12345-192.168.202.51@tcp:3:cat.0 Request processed in 116us (437us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155643.984276:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8155 00002000:00100000:2.0:1746155643.984280:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3895296->3899391) req@ffff88008e26df80 x1830976126052608/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/4536 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.984287:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26df80 with x1830976126052608 ext(3895296->3899391) 00002000:00010000:2.0:1746155643.984289:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26df80 00000100:00100000:0.0:1746155643.985129:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155643.985275:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126052864 00000100:00100000:1.0:1746155643.985279:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126052864 00000100:00100000:2.0:1746155643.985372:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17184 00000100:00100000:2.0:1746155643.985378:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32416:x1830976126052864:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.985387:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.985399:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5f8329 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1859e expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.985416:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 19 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.985423:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.985424:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155643.985427:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5f8329 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1859e expref: 12 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.985449:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 19 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.985459:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 19 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155643.985473:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125401472:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155643.986261:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155643.990305:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125401472:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155643.990333:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5f8329 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1859e expref: 12 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.990347:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c85400, rc 0) 00000100:00100000:2.0:1746155643.990436:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32416:x1830976126052864:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5057us (5306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.990444:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17184 00000100:00100000:3.0:1746155643.990983:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976126052480:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6810us (7116us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155643.990991:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8156 00002000:00100000:3.0:1746155643.991000:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88008e26f480 x1830976126052480/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.991008:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26f480 with x1830976126052480 ext(2097152->3145727) 00002000:00010000:3.0:1746155643.991012:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26f480 00000100:00100000:1.0:1746155643.991255:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155643.991320:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126052992 00000100:00100000:3.0:1746155643.991326:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126052992 00002000:00100000:3.0:1746155643.991356:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3899391) req@ffff880094442300 x1830976126052992/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155643.991363:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094442300 with x1830976126052992 ext(3145728->3899391) 00010000:00010000:3.0:1746155643.991368:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 18 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155643.991378:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 18 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155643.991384:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094442300 00000100:00100000:3.0:1746155643.991406:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1425 00000100:00100000:3.0:1746155643.991411:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976126052992:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155643.995349:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.995535:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126053120 00000100:00100000:2.0:1746155643.995543:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126053120 00000100:00100000:2.0:1746155643.995634:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17185 00000100:00100000:2.0:1746155643.995642:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:32411:x1830976126053120:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155643.995657:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155643.995672:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131005400/0x844e5faceb5f8330 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f185a5 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.995691:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.995693:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155643.995699:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131005400/0x844e5faceb5f8330 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185a5 expref: 29 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.995711:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131005400/0x844e5faceb5f8330 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185a5 expref: 29 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155643.995724:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131005400, rc 0) 00000100:00100000:2.0:1746155643.995767:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:32411:x1830976126053120:12345-192.168.202.51@tcp:101:cat.0 Request processed in 126us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155643.995773:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17185 00000100:00100000:0.0:1746155643.999410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155643.999607:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126053376 00000100:00100000:2.0:1746155643.999614:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126053376 00002000:00100000:2.0:1746155643.999645:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88008e26f800 x1830976126053376/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/0 e 0 to 0 dl 1746155654 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155643.999654:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26f800 with x1830976126053376 ext(3145728->4194303) 00002000:00010000:2.0:1746155643.999659:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26f800 00000100:00100000:2.0:1746155643.999685:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8157 00000100:00100000:2.0:1746155643.999692:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976126053376:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155644.000281:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126052992:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8868us (9025us total) trans 21474841629 rc 0/0 00000100:00100000:3.0:1746155644.000287:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1425 00002000:00100000:3.0:1746155644.000291:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3899391) req@ffff880094442300 x1830976126052992/t21474841629(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/448 e 0 to 0 dl 1746155654 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.000300:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094442300 with x1830976126052992 ext(3145728->3899391) 00010000:00010000:3.0:1746155644.000305:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 20 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.000314:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 20 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155644.000318:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880094442300 00000100:00100000:0.0:1746155644.004137:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.004264:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126053504 00000100:00100000:1.0:1746155644.004271:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126053504 00010000:00010000:1.0:1746155644.004319:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 20 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.004356:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8810 00000100:00100000:1.0:1746155644.004364:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976126053504:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155644.004375:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155644.004391:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 20 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.004406:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 20 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.004409:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976126053376:12345-192.168.202.51@tcp:3:cat.0 Request processed in 4717us (5005us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746155644.004425:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136a57c00/0x844e5faceb5f831b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18590 expref: 20 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.004446:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.004448:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.004455:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5f8329 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1859e expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.004462:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5f8329 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1859e expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.004488:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5f8329 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1859e expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.004499:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125401600:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155644.004570:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.004603:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8157 00002000:00100000:2.0:1746155644.004610:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88008e26f800 x1830976126053376/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:714/0 lens 488/440 e 0 to 0 dl 1746155654 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.004618:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26f800 with x1830976126053376 ext(3145728->4194303) 00002000:00010000:2.0:1746155644.004622:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26f800 00000100:00080000:0.0:1746155644.004627:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746155644.005907:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125401600:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155644.005923:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.005955:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126053504:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1592us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.005961:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8810 00000100:00100000:0.0:1746155644.007323:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.007469:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126053760 00000100:00100000:2.0:1746155644.007474:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126053760 00002000:00100000:2.0:1746155644.007537:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a3fc4380 x1830976126053760/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00080000:0.0:1746155644.007537:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1746155644.007552:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc4380 with x1830976126053760 ext(3145728->4194303) 00002000:00010000:2.0:1746155644.007556:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc4380 00000100:00100000:2.0:1746155644.007592:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8158 00000100:00100000:2.0:1746155644.007599:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126053760:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155644.008691:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.008753:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126053888 00000100:00100000:1.0:1746155644.008758:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126053888 00000100:00100000:1.0:1746155644.008790:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17186 00000100:00100000:1.0:1746155644.008796:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32411:x1830976126053888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155644.008806:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.008888:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e33200/0x844e5faceb5f8337 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f185ac expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.008917:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.008919:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.008926:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e33200/0x844e5faceb5f8337 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ac expref: 20 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.008938:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e33200/0x844e5faceb5f8337 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ac expref: 20 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.008951:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e33200, rc 0) 00000100:00100000:1.0:1746155644.008985:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:32411:x1830976126053888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 188us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.008990:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17186 00000100:00100000:0.0:1746155644.014168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.014579:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126054144 00000100:00100000:3.0:1746155644.014587:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126054144 00002000:00100000:3.0:1746155644.014621:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a3fc4700 x1830976126054144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.014629:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc4700 with x1830976126054144 ext(3145728->4194303) 00002000:00010000:3.0:1746155644.014632:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc4700 00000100:00100000:3.0:1746155644.014650:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8159 00000100:00100000:3.0:1746155644.014657:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126054144:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.014869:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126053760:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7269us (7547us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.014877:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8158 00002000:00100000:2.0:1746155644.014883:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a3fc4380 x1830976126053760/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.014889:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc4380 with x1830976126053760 ext(3145728->4194303) 00002000:00010000:2.0:1746155644.014893:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc4380 00000100:00100000:0.0:1746155644.019955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.020025:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126054400 00000100:00100000:2.0:1746155644.020032:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126054400 00002000:00100000:2.0:1746155644.020075:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009fc53b80 x1830976126054400/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00080000:0.0:1746155644.020081:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:2.0:1746155644.020084:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc53b80 with x1830976126054400 ext(4194304->5083135) 00002000:00010000:2.0:1746155644.020088:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc53b80 00000100:00100000:2.0:1746155644.020115:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8160 00000100:00100000:2.0:1746155644.020121:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1962:x1830976126054400:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155644.022084:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126054144:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7421us (7916us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.022092:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8159 00002000:00100000:3.0:1746155644.022100:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a3fc4700 x1830976126054144/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.022108:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc4700 with x1830976126054144 ext(3145728->4194303) 00002000:00010000:3.0:1746155644.022113:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc4700 00000100:00100000:2.0:1746155644.024297:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1962:x1830976126054400:12345-192.168.202.51@tcp:3:cat.0 Request processed in 4169us (4341us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155644.024307:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8160 00002000:00100000:2.0:1746155644.024315:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009fc53b80 x1830976126054400/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.024323:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc53b80 with x1830976126054400 ext(4194304->5083135) 00002000:00010000:2.0:1746155644.024327:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc53b80 00000100:00100000:0.0:1746155644.028867:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.029634:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126054656 00000100:00100000:2.0:1746155644.029641:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126054656 00002000:00100000:2.0:1746155644.029695:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009b883480 x1830976126054656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.029704:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883480 with x1830976126054656 ext(4194304->5083135) 00002000:00010000:2.0:1746155644.029708:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b883480 00000100:00100000:2.0:1746155644.029732:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8161 00000100:00100000:2.0:1746155644.029738:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976126054656:12345-192.168.202.51@tcp:3:cat.0 00000100:00080000:0.0:1746155644.029752:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155644.032887:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.032985:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126054912 00000100:00100000:2.0:1746155644.032992:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126054912 00000100:00100000:2.0:1746155644.033096:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4747 00000100:00080000:0.0:1746155644.033096:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746155644.033104:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32416:x1830976126054912:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155644.033357:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:32416:x1830976126054912:12345-192.168.202.51@tcp:35:cat.0 Request processed in 252us (475us total) trans 8589945331 rc 0/0 00000100:00100000:2.0:1746155644.033364:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4747 00000100:00100000:2.0:1746155644.038529:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976126054656:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8781us (9659us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155644.038540:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8161 00002000:00100000:2.0:1746155644.038550:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009b883480 x1830976126054656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.038565:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883480 with x1830976126054656 ext(4194304->5083135) 00002000:00010000:2.0:1746155644.038570:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b883480 00000100:00100000:0.0:1746155644.044734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.044836:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126055168 00000100:00100000:1.0:1746155644.044845:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126055168 00000100:00100000:1.0:1746155644.044910:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11166 00000100:00100000:1.0:1746155644.044918:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:32423:x1830976126055168:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155644.044936:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.044949:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33800/0x844e5faceb5f833e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f185b3 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.045031:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32a00/0x844e5faceb5f8345 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045041:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32a00/0x844e5faceb5f8345 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045049:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32a00/0x844e5faceb5f8345 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045060:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f834c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045065:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f834c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045070:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f834c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045151:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32600/0x844e5faceb5f8353 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045159:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32600/0x844e5faceb5f8353 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045165:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32600/0x844e5faceb5f8353 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155644.045176:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155644.045242:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32a00/0x844e5faceb5f8345 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045249:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32a00/0x844e5faceb5f8345 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045253:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32a00/0x844e5faceb5f8345 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045258:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e32a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155644.045261:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32a00/0x844e5faceb5f8345 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045267:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32a00/0x844e5faceb5f8345 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045276:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155644.045278:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155644.045281:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32a00/0x844e5faceb5f8345 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045286:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32a00/0x844e5faceb5f8345 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045314:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f834c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045319:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f834c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045324:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f834c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045331:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e32e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155644.045333:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f834c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045338:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f834c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045344:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c600) 00010000:00010000:1.0:1746155644.045346:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155644.045348:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f834c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045352:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f834c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.045386:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33800/0x844e5faceb5f833e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185b3 expref: 26 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.045397:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32600/0x844e5faceb5f8353 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185b3 expref: 25 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.045403:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155644.045404:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155644.045406:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e32600, rc 0) 00000100:00100000:1.0:1746155644.045456:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:32423:x1830976126055168:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 538us (726us total) trans 8589945332 rc 0/0 00000100:00100000:1.0:1746155644.045462:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11166 00000100:00100000:0.0:1746155644.046968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.047036:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126055296 00000100:00100000:1.0:1746155644.047041:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126055296 00000100:00100000:1.0:1746155644.047128:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 763 00000100:00100000:1.0:1746155644.047134:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976126055296:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155644.047143:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155644.047158:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32600/0x844e5faceb5f8353 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185b3 expref: 25 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.047169:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155644.047172:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.047300:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976126055296:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 165us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.047305:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 763 00000100:00100000:0.0:1746155644.119155:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.119250:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126055424 00000100:00100000:1.0:1746155644.119257:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126055424 00000100:00100000:1.0:1746155644.119305:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17187 00000100:00100000:1.0:1746155644.119312:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32423:x1830976126055424:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155644.119327:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.119341:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f185ba expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.119363:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f8089 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c9 expref: 13 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.119371:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009374da00/0x844e5faceb5f8170 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18478 expref: 6 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.119378:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f8107 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1841d expref: 19 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.119389:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.119394:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.119398:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [1859584->2097151] (req 1859584->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 13 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.119423:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f8107 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1841d expref: 19 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.119432:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f8107 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1841d expref: 19 pid: 20200 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746155644.119441:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125401728:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.119557:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009374da00/0x844e5faceb5f8170 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18478 expref: 6 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.119565:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009374da00/0x844e5faceb5f8170 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18478 expref: 6 pid: 19959 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746155644.119573:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125401856:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.119600:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f8089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c9 expref: 13 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.119607:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f8089 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c9 expref: 13 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.119619:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125401984:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.119661:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155644.120438:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125401728:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155644.121858:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.121887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.121919:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126055552 00000100:00100000:2.0:1746155644.121927:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126055552 00000100:00100000:0.0:1746155644.121927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155644.121954:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155644.121962:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126055680 00000100:00100000:0.0:1746155644.121965:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126055680 00010000:00010000:2.0:1746155644.121966:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009374da00/0x844e5faceb5f8170 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18478 expref: 7 pid: 19959 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746155644.121978:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f8107 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1841d expref: 20 pid: 20200 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746155644.121990:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126055808 00000100:00100000:2.0:1746155644.121993:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126055808 00000100:00100000:1.0:1746155644.121993:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125401856:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155644.121996:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8811 00000100:00100000:1.0:1746155644.122001:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125401984:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.122002:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f8089 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c9 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746155644.122002:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126055552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155644.122011:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155644.122015:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8812 00000100:00100000:2.0:1746155644.122020:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126055680:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155644.122020:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [1859584->2097151] (req 1859584->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 14 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.122026:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155644.122029:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009374da00/0x844e5faceb5f8170 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18478 expref: 7 pid: 19959 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746155644.122032:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e32800, rc 0) 00010000:00010000:2.0:1746155644.122035:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f8107 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1841d expref: 20 pid: 20200 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746155644.122038:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009374da00/0x844e5faceb5f8170 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18478 expref: 7 pid: 19959 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746155644.122059:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32423:x1830976126055424:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2747us (2912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.122065:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17187 00010000:00010000:2.0:1746155644.122075:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f8107 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1841d expref: 20 pid: 20200 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746155644.122085:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8813 00010000:00010000:2.0:1746155644.122090:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fe4a800/0x844e5faceb5f8107 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1841d expref: 20 pid: 20200 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746155644.122091:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126055808:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155644.122097:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.122103:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155644.122106:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f8089 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c9 expref: 13 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.122114:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f8089 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c9 expref: 13 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.122121:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976126055680:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 100us (232us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155644.122125:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800948e4800/0x844e5faceb5f8089 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f183c9 expref: 13 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.122127:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8812 00010000:00010000:1.0:1746155644.122137:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.122151:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126055808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 60us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.122156:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8813 00010000:00010000:0.0:1746155644.122264:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009374da00/0x844e5faceb5f8170 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18478 expref: 7 pid: 19959 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746155644.122285:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.122287:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.122293:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.122304:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.122819:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.122830:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125402112:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155644.123458:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155644.125402:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125402112:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155644.125418:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.125456:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976126055552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3453us (3600us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.125465:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8811 00000100:00100000:0.0:1746155644.125716:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.125773:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126056064 00000100:00100000:2.0:1746155644.125781:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126056064 00002000:00100000:2.0:1746155644.125808:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1859584->1863679) req@ffff88009f880e00 x1830976126056064/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.125817:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f880e00 with x1830976126056064 ext(1859584->1863679) 00002000:00010000:2.0:1746155644.125821:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f880e00 00000100:00100000:2.0:1746155644.125843:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8162 00000100:00100000:2.0:1746155644.125849:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976126056064:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155644.126033:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976126056064:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 183us (316us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155644.126039:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8162 00002000:00100000:2.0:1746155644.126043:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1859584->1863679) req@ffff88009f880e00 x1830976126056064/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/4536 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.126049:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f880e00 with x1830976126056064 ext(1859584->1863679) 00002000:00010000:2.0:1746155644.126051:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f880e00 00000100:00100000:0.0:1746155644.130295:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.130393:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126056192 00000100:00100000:1.0:1746155644.130401:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126056192 00000100:00100000:1.0:1746155644.130669:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17188 00000100:00100000:1.0:1746155644.130676:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32423:x1830976126056192:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155644.130689:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.130702:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f185c1 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.130722:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5f82b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18543 expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.130733:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f82b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1854a expref: 13 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.130738:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.130740:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.130743:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 13 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.130764:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f82b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1854a expref: 13 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.130773:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f82b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1854a expref: 13 pid: 20796 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.130782:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125402240:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.130858:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5f82b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18543 expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.130865:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5f82b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18543 expref: 18 pid: 20796 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.130872:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125402368:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.130886:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1109c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155644.133180:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.133239:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126056320 00000100:00100000:2.0:1746155644.133246:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126056320 00010000:00010000:2.0:1746155644.133274:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f82b9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1854a expref: 14 pid: 20796 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.133297:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8814 00000100:00100000:2.0:1746155644.133304:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126056320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.133313:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.133331:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f82b9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1854a expref: 14 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.133341:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f82b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1854a expref: 14 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.133358:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155644.133389:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126056320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 85us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.133394:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8814 00010000:00010000:1.0:1746155644.133602:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f82b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1854a expref: 13 pid: 20796 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.133635:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125402240:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.133645:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125402368:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.133665:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->1605631] (req 1048576->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 12 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155644.133731:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.133765:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126056448 00000100:00100000:2.0:1746155644.133769:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126056448 00010000:00010000:2.0:1746155644.133781:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5f82b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18543 expref: 19 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.133824:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e33000, rc 0) 00000100:00100000:1.0:1746155644.133845:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32423:x1830976126056192:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3170us (3557us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.133855:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17188 00000100:00100000:2.0:1746155644.134099:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8815 00000100:00100000:2.0:1746155644.134106:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126056448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.134114:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.134122:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5f82b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18543 expref: 19 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.134131:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5f82b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18543 expref: 19 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.134142:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e78c00/0x844e5faceb5f82b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18543 expref: 19 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.134158:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.134160:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.134165:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.134172:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.134194:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.134204:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125402496:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155644.134488:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155644.139748:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125402496:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155644.139766:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.139801:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976126056448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5695us (6069us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.139810:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8815 00000100:00100000:0.0:1746155644.140487:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.140590:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126056704 00000100:00100000:3.0:1746155644.140596:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126056704 00002000:00100000:3.0:1746155644.140626:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1601536->1605631) req@ffff88009fed9f80 x1830976126056704/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.140635:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9f80 with x1830976126056704 ext(1601536->1605631) 00002000:00010000:3.0:1746155644.140639:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fed9f80 00000100:00100000:3.0:1746155644.140666:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8163 00000100:00100000:3.0:1746155644.140672:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126056704:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155644.141530:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126056704:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 856us (1042us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155644.141537:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8163 00002000:00100000:3.0:1746155644.141543:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1601536->1605631) req@ffff88009fed9f80 x1830976126056704/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/4536 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.141551:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9f80 with x1830976126056704 ext(1601536->1605631) 00002000:00010000:3.0:1746155644.141554:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fed9f80 00000100:00100000:0.0:1746155644.144522:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.144830:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126056960 00000100:00100000:2.0:1746155644.144837:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126056960 00000100:00100000:2.0:1746155644.145050:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4748 00000100:00100000:2.0:1746155644.145058:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:32423:x1830976126056960:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155644.145282:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:32423:x1830976126056960:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 225us (782us total) trans 8589945333 rc 0/0 00000100:00100000:2.0:1746155644.145288:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4748 00000100:00100000:0.0:1746155644.151965:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.152023:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126057088 00000100:00100000:1.0:1746155644.152030:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126057088 00000100:00100000:1.0:1746155644.152163:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11167 00000100:00100000:1.0:1746155644.152170:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:32427:x1830976126057088:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155644.152190:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.152204:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32400/0x844e5faceb5f836f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f185c8 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.152252:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33400/0x844e5faceb5f8376 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.152263:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33400/0x844e5faceb5f8376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.152272:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33400/0x844e5faceb5f8376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.152285:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32000/0x844e5faceb5f837d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.152290:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32000/0x844e5faceb5f837d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.152294:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32000/0x844e5faceb5f837d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00080000:0.0:1746155644.152340:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746155644.152452:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.152459:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17be00/0x844e5faceb5f8273 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18527 expref: 298 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.152463:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.152483:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17be00/0x844e5faceb5f8273 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18527 expref: 298 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.152491:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17be00/0x844e5faceb5f8273 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18527 expref: 298 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.152499:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125402624:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.152583:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1109c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155644.154664:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125402624:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.154681:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155644.157305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.157422:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126057344 00000100:00100000:1.0:1746155644.157430:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126057344 00000100:00100000:1.0:1746155644.157602:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4749 00000100:00100000:1.0:1746155644.157609:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:7660:x1830976126057344:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00080000:0.0:1746155644.157689:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155644.158329:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:7660:x1830976126057344:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 719us (1028us total) trans 8589945334 rc 0/0 00000100:00100000:1.0:1746155644.158336:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4749 00000100:00100000:0.0:1746155644.160044:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.160121:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126057472 00000100:00100000:3.0:1746155644.160127:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126057472 00010000:00010000:3.0:1746155644.160153:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17be00/0x844e5faceb5f8273 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18527 expref: 300 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.160179:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8816 00000100:00100000:3.0:1746155644.160186:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1960:x1830976126057472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.160200:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.160205:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17be00/0x844e5faceb5f8273 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18527 expref: 300 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.160215:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17be00/0x844e5faceb5f8273 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18527 expref: 300 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.160233:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17be00/0x844e5faceb5f8273 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18527 expref: 300 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.160257:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.160261:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.160269:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.160274:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.160300:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.160327:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1960:x1830976126057472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 142us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.160332:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8816 00010000:00010000:1.0:1746155644.160477:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160484:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155644.160541:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155644.160545:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155644.160558:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160567:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160574:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33400/0x844e5faceb5f8376 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160579:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33400/0x844e5faceb5f8376 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160584:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33400/0x844e5faceb5f8376 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160589:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e33400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155644.160593:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33400/0x844e5faceb5f8376 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160598:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33400/0x844e5faceb5f8376 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160605:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155644.160608:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155644.160610:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33400/0x844e5faceb5f8376 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160615:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33400/0x844e5faceb5f8376 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160624:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32000/0x844e5faceb5f837d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160629:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32000/0x844e5faceb5f837d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160633:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32000/0x844e5faceb5f837d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160637:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e32000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155644.160639:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32000/0x844e5faceb5f837d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160643:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32000/0x844e5faceb5f837d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160649:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c500) 00010000:00010000:1.0:1746155644.160651:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155644.160653:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32000/0x844e5faceb5f837d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160661:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32000/0x844e5faceb5f837d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.160689:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32400/0x844e5faceb5f836f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c8 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.160699:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c8 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.160705:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155644.160707:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155644.160708:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e32200, rc 0) 00000100:00100000:1.0:1746155644.160731:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32427:x1830976126057088:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 8562us (8772us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.160742:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11167 00000100:00100000:0.0:1746155644.164238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.164270:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.164292:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.164310:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126057600 00000100:00100000:1.0:1746155644.164311:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126057728 00000100:00100000:1.0:1746155644.164317:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126057728 00000100:00100000:0.0:1746155644.164317:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126057600 00000100:00100000:0.0:1746155644.164346:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126057856 00000100:00100000:0.0:1746155644.164348:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126057856 00000100:00100000:1.0:1746155644.164448:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17189 00000100:00100000:1.0:1746155644.164455:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+5:1962:x1830976126057600:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155644.164469:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.164484:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e33600/0x844e5faceb5f838b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f185cf expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.164521:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.164523:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.164532:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e33600/0x844e5faceb5f838b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185cf expref: 6 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.164551:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e33600/0x844e5faceb5f838b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185cf expref: 6 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.164560:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e33600, rc 0) 00000100:00100000:0.0:1746155644.164627:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17190 00000100:00100000:2.0:1746155644.164633:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17191 00000100:00100000:0.0:1746155644.164633:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126057728:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:2.0:1746155644.164641:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126057856:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155644.164641:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.164648:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155644.164649:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fa4e00/0x844e5faceb5f8392 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f185d6 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.164654:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131004600/0x844e5faceb5f8399 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f185dd expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.164684:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125402752:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155644.164684:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125402880:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155644.164774:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1962:x1830976126057600:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 319us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.164780:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17189 00000100:00100000:0.0:1746155644.164783:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155644.164794:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.164811:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155644.164853:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126057984 00000100:00100000:1.0:1746155644.164856:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126057984 00000100:00100000:1.0:1746155644.164875:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17192 00000100:00100000:1.0:1746155644.164880:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1962:x1830976126057984:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:3.0:1746155644.164885:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155644.164886:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.164892:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094e32600/0x844e5faceb5f83a0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f185e4 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.164907:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126058112 00000100:00100000:3.0:1746155644.164913:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126058112 00010000:00010000:1.0:1746155644.164916:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.164917:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.164922:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094e32600/0x844e5faceb5f83a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185e4 expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.164931:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094e32600/0x844e5faceb5f83a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185e4 expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155644.164932:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17193 00000100:00100000:3.0:1746155644.164937:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976126058112:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155644.164937:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e32600, rc 0) 00010000:00010000:3.0:1746155644.164943:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.164949:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009470ce00/0x844e5faceb5f83a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f185eb expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.164960:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.164961:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.164966:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009470ce00/0x844e5faceb5f83a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185eb expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155644.164970:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976126057984:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 89us (175us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155644.164976:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009470ce00/0x844e5faceb5f83a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185eb expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155644.164978:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17192 00010000:00010000:3.0:1746155644.164982:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009470ce00, rc 0) 00000100:00100000:3.0:1746155644.164998:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976126058112:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 60us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.165003:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17193 00000100:00100000:3.0:1746155644.165035:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.165046:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126058240 00000100:00100000:3.0:1746155644.165049:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126058240 00000100:00100000:3.0:1746155644.165061:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17194 00000100:00100000:3.0:1746155644.165065:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126058240:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155644.165070:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.165076:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f83ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f185f2 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.165089:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.165090:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.165094:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f83ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f2 expref: 11 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.165104:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f83ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f2 expref: 11 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.165110:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009470d600, rc 0) 00000100:00100000:3.0:1746155644.165123:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126058240:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 58us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.165129:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17194 00000100:00100000:2.0:1746155644.166747:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125402752:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155644.166769:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131004600/0x844e5faceb5f8399 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185dd expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.166778:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131004600/0x844e5faceb5f8399 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185dd expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.166788:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131004600, rc 0) 00000100:00100000:2.0:1746155644.166811:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976126057856:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2171us (2519us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155644.166817:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17191 00002000:00010000:1.0:1746155644.166889:0:8438:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime: 1746155643 -> 1746155644 00002000:00010000:1.0:1746155644.166893:0:8438:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime: 1746155643 -> 1746155644 00002000:00010000:1.0:1746155644.166907:0:8438:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime: 1746155643 -> 1746155644 00000100:00100000:1.0:1746155644.166916:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca95880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125402880:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155644.166937:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094fa4e00/0x844e5faceb5f8392 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185d6 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.166945:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fa4e00/0x844e5faceb5f8392 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185d6 expref: 8 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.166952:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094fa4e00, rc 0) 00000100:00100000:1.0:1746155644.166968:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126057728:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2336us (2698us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155644.166974:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17190 00000100:00100000:0.0:1746155644.168651:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.168842:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126058496 00000100:00100000:1.0:1746155644.168848:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126058496 00000100:00100000:1.0:1746155644.168878:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11168 00000100:00100000:1.0:1746155644.168889:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32427:x1830976126058496:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155644.168912:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.168925:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33800/0x844e5faceb5f83b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f185f9 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.169006:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.169022:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c8 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.169028:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.169050:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c8 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.169060:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c8 expref: 13 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.169075:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125403008:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.169150:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155644.172273:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125403008:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.172294:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155644.172371:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.172415:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126058624 00000100:00100000:3.0:1746155644.172420:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126058624 00010000:00010000:3.0:1746155644.172444:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c8 expref: 14 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.172678:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8817 00000100:00100000:3.0:1746155644.172685:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126058624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.172695:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.172701:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c8 expref: 14 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.172710:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c8 expref: 14 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.172732:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32200/0x844e5faceb5f8384 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c8 expref: 14 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.172830:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.172834:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.172843:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.172849:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.172864:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.172892:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976126058624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 208us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.172908:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8817 00010000:00010000:0.0:1746155644.173172:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155644.173179:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155644.173194:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155644.173537:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e33800/0x844e5faceb5f83b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f9 expref: 14 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.173789:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f9 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.173796:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155644.173799:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155644.173801:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e32e00, rc 0) 00000100:00100000:0.0:1746155644.173832:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:32427:x1830976126058496:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4943us (5184us total) trans 8589945335 rc 0/0 00000100:00100000:0.0:1746155644.173838:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11168 00000100:00100000:0.0:1746155644.176186:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.176229:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126058752 00000100:00100000:2.0:1746155644.176235:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126058752 00000100:00100000:2.0:1746155644.176280:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11169 00000100:00100000:2.0:1746155644.176287:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:32427:x1830976126058752:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155644.176306:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.176320:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131004200/0x844e5faceb5f83ca lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18600 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.176385:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f83d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.176398:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f9 expref: 14 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.176405:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f83d1 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.176430:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f9 expref: 14 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.176451:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f9 expref: 14 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.176464:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125403136:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.176556:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.178119:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125403136:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.178139:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f83d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155644.178450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.178951:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126058880 00000100:00100000:3.0:1746155644.178957:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126058880 00010000:00010000:3.0:1746155644.178980:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f9 expref: 15 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.178998:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8818 00000100:00100000:3.0:1746155644.179004:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976126058880:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.179013:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.179018:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f9 expref: 15 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.179031:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f9 expref: 15 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.179048:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094e32e00/0x844e5faceb5f83bc lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f9 expref: 15 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.179059:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.179062:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f83d1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.179070:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f83d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.179164:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f83d1 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.179188:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.179221:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976126058880:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 217us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.179227:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8818 00010000:00010000:2.0:1746155644.179285:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f83d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.179291:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f83d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155644.179323:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155644.179327:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155644.179340:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f83d1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.179364:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131004200/0x844e5faceb5f83ca lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18600 expref: 14 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.179391:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f83d1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18600 expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.179397:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.179399:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155644.179401:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131004400, rc 0) 00000100:00100000:2.0:1746155644.179424:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:32427:x1830976126058752:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3137us (3243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.179429:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11169 00000100:00100000:0.0:1746155644.181305:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.181389:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.181443:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126059008 00000100:00100000:2.0:1746155644.181450:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126059008 00000100:00100000:1.0:1746155644.181454:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126059136 00000100:00100000:1.0:1746155644.181458:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126059136 00000100:00100000:2.0:1746155644.181480:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17195 00000100:00100000:2.0:1746155644.181486:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126059008:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155644.181499:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.181548:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131004c00/0x844e5faceb5f83d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18607 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.181587:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125403264:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155644.181636:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155644.181721:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17196 00000100:00100000:1.0:1746155644.181728:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126059136:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155644.181733:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.181740:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e32a00/0x844e5faceb5f83df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1860e expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.181760:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125403392:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155644.181782:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.183329:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125403264:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155644.183329:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125403392:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155644.183347:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131004c00/0x844e5faceb5f83d8 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18607 expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.183347:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094e32a00/0x844e5faceb5f83df lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1860e expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.183357:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131004c00/0x844e5faceb5f83d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18607 expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.183357:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e32a00/0x844e5faceb5f83df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1860e expref: 10 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.183369:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131004c00, rc 0) 00010000:00010000:1.0:1746155644.183379:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094e32a00, rc 0) 00000100:00100000:2.0:1746155644.183846:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126059008:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2358us (2545us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155644.183846:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126059136:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2117us (2455us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155644.183852:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17196 00000100:00100000:2.0:1746155644.183855:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17195 00000100:00100000:0.0:1746155644.185470:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.185530:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126059392 00000100:00100000:2.0:1746155644.185536:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126059392 00000100:00100000:2.0:1746155644.185602:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11170 00000100:00100000:2.0:1746155644.185609:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:32427:x1830976126059392:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155644.185622:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.185637:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f83e6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18615 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.185707:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131004200/0x844e5faceb5f83ed lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.185720:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131004200/0x844e5faceb5f83ed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.185733:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131004200/0x844e5faceb5f83ed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155644.185751:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155644.185839:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f83e6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18615 expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.185853:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131004200/0x844e5faceb5f83ed lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18615 expref: 15 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.185864:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.185866:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155644.185869:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131004200, rc 0) 00000100:00100000:2.0:1746155644.185923:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:32427:x1830976126059392:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 314us (455us total) trans 8589945336 rc 0/0 00000100:00100000:2.0:1746155644.185929:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11170 00000100:00100000:0.0:1746155644.187188:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.187219:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.187254:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.187378:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126059520 00000100:00100000:3.0:1746155644.187383:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126059520 00000100:00100000:2.0:1746155644.187384:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126059648 00000100:00100000:2.0:1746155644.187389:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126059648 00000100:00100000:3.0:1746155644.187406:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126059776 00000100:00100000:3.0:1746155644.187408:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126059776 00000100:00100000:2.0:1746155644.187419:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17197 00000100:00100000:3.0:1746155644.187425:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17198 00000100:00100000:2.0:1746155644.187425:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976126059520:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:3.0:1746155644.187430:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976126059648:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:0.0:1746155644.187446:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17199 00010000:00010000:3.0:1746155644.187448:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.187448:0:20796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155644.187451:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976126059776:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155644.187461:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f82ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1853c expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.187463:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.187463:0:29728:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.187468:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e33600/0x844e5faceb5f838b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185cf expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.187470:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155644.187472:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155644.187472:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.187474:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.187474:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c283200/0x844e5faceb5f82f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18566 expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.187477:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155644.187478:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155644.187479:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.187480:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.187480:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.187482:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.187496:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.187496:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 11 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.187499:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c283200/0x844e5faceb5f82f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18566 expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.187525:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 11 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155644.187525:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 11 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.187527:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c283200/0x844e5faceb5f82f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18566 expref: 28 pid: 8438 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746155644.187535:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125403520:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155644.187535:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125403648:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.187536:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125403776:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.187589:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfda80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155644.187590:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4024240 going to sleep for 11 seconds 00010000:00010000:2.0:1746155644.187602:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094e33600/0x844e5faceb5f838b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185cf expref: 8 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.187609:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094e33600/0x844e5faceb5f838b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185cf expref: 8 pid: 19959 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746155644.187615:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125403904:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.187635:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f82ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1853c expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.187642:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f82ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1853c expref: 15 pid: 20796 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.187648:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125404032:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.187661:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155644.188008:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.188037:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.188056:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.188138:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126059904 00000100:00100000:3.0:1746155644.188141:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126059904 00000100:00100000:3.0:1746155644.188164:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126060032 00000100:00100000:3.0:1746155644.188166:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126060032 00000100:00100000:1.0:1746155644.188173:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126060160 00000100:00100000:1.0:1746155644.188177:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126060160 00000100:00100000:3.0:1746155644.188178:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17200 00000100:00100000:3.0:1746155644.188183:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126059904:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:2.0:1746155644.188193:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17201 00010000:00010000:3.0:1746155644.188199:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.188199:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976126060032:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:1.0:1746155644.188208:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17202 00010000:00010000:3.0:1746155644.188209:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fbca400/0x844e5faceb5f82c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18551 expref: 28 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.188214:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976126060160:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155644.188215:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.188216:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094e32600/0x844e5faceb5f83a0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185e4 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.188223:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a57a00/0x844e5faceb5f82c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18558 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.188225:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f8314 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18589 expref: 15 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.188228:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.188229:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.188230:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.188231:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.188232:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009470ce00/0x844e5faceb5f83a7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185eb expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.188238:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131005400/0x844e5faceb5f8330 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185a5 expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.188240:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5f8329 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1859e expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.188245:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d1da600/0x844e5faceb5f830d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18582 expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.188248:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f83ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f2 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.188249:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155644.188250:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136a57a00/0x844e5faceb5f82c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18558 expref: 15 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.188250:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155644.188252:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 7/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.188255:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e33200/0x844e5faceb5f8337 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ac expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.188258:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136a57a00/0x844e5faceb5f82c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18558 expref: 15 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.188262:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5257400/0x844e5faceb5f8322 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18597 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.188266:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125404160:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.188266:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d1da600/0x844e5faceb5f830d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18582 expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.188267:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155644.188268:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155644.188270:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 7/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.188274:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d1da600/0x844e5faceb5f830d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18582 expref: 28 pid: 20200 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.188280:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125404288:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.188285:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5257400/0x844e5faceb5f8322 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18597 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.188292:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5257400/0x844e5faceb5f8322 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18597 expref: 17 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.188295:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094e32600/0x844e5faceb5f83a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185e4 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155644.188300:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125404416:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.188302:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094e32600/0x844e5faceb5f83a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185e4 expref: 10 pid: 1625 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.188307:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131005400/0x844e5faceb5f8330 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185a5 expref: 28 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.188309:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125404544:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.188314:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131005400/0x844e5faceb5f8330 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185a5 expref: 28 pid: 20200 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.188321:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125404672:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.188326:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094e33200/0x844e5faceb5f8337 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ac expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.188332:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fbca400/0x844e5faceb5f82c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18551 expref: 28 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.188334:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094e33200/0x844e5faceb5f8337 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ac expref: 17 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.188339:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fbca400/0x844e5faceb5f82c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18551 expref: 28 pid: 20796 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.188341:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125404800:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.188342:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009470ce00/0x844e5faceb5f83a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185eb expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155644.188347:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f3ef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125404928:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.188350:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009470ce00/0x844e5faceb5f83a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185eb expref: 10 pid: 20200 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746155644.188357:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa37800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125405056:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.188360:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f83ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f2 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155644.188361:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ebfdb40 going to sleep for 11 seconds 00010000:00010000:1.0:1746155644.188371:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f83ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f2 expref: 9 pid: 20200 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.188378:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f8314 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18589 expref: 15 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.188378:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125405184:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.188386:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f8314 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18589 expref: 15 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.188393:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125405312:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.188405:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5f8329 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1859e expref: 11 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.188406:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00010000:00010000:1.0:1746155644.188412:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5f8329 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1859e expref: 11 pid: 20200 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.188418:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125405440:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.188433:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155644.189016:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125403520:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.189036:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.189046:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125403648:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.189060:0:29728:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.189119:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125403776:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155644.190817:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.190889:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125403904:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.190907:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125404032:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.190923:0:20796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.190961:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126060288 00000100:00100000:2.0:1746155644.190965:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126060288 00000100:00100000:0.0:1746155644.190972:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:2.0:1746155644.190991:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e0:0x0] (1859584->2097151) req@ffff880131496a00 x1830976126060288/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.191000:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496a00 with x1830976126060288 ext(1859584->2097151) 00010000:00010000:2.0:1746155644.191007:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 12 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.191016:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 12 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746155644.191021:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131496a00 00000100:00100000:2.0:1746155644.191047:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa37480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125404288:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.191062:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1426 00000100:00100000:2.0:1746155644.191068:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976126060288:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155644.191710:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125404672:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.191835:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125404160:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.191843:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125404544:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.191854:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126060416 00000100:00100000:3.0:1746155644.191857:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126060416 00010000:00010000:3.0:1746155644.191874:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c283200/0x844e5faceb5f82f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18566 expref: 29 pid: 8438 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746155644.191907:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8819 00000100:00100000:3.0:1746155644.191912:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f823050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976126060416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.191919:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.191934:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c283200/0x844e5faceb5f82f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18566 expref: 29 pid: 8438 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.191942:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c283200/0x844e5faceb5f82f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18566 expref: 29 pid: 8438 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.191964:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c283200/0x844e5faceb5f82f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18566 expref: 29 pid: 8438 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746155644.192066:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.192076:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126060800 00000100:00100000:0.0:1746155644.192078:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126060800 00010000:00010000:0.0:1746155644.192091:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d1da600/0x844e5faceb5f830d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18582 expref: 29 pid: 20200 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.192155:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.192175:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125404416:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.192182:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f823050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976126060416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 270us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.192188:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8819 00000100:00100000:0.0:1746155644.192210:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8820 00000100:00100000:0.0:1746155644.192216:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1963:x1830976126060800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155644.192222:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155644.192231:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d1da600/0x844e5faceb5f830d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18582 expref: 28 pid: 20200 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.192237:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:0.0:1746155644.192239:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d1da600/0x844e5faceb5f830d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18582 expref: 28 pid: 20200 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155644.192249:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d1da600/0x844e5faceb5f830d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18582 expref: 28 pid: 20200 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155644.192266:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.192287:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126061056 00000100:00100000:0.0:1746155644.192288:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976126060800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 72us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.192290:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126061056 00000100:00100000:0.0:1746155644.192293:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8820 00010000:00010000:3.0:1746155644.192301:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094e32600/0x844e5faceb5f83a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185e4 expref: 11 pid: 1625 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746155644.192320:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8821 00000100:00100000:3.0:1746155644.192325:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976126061056:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155644.192330:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155644.192331:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.192339:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094e32600/0x844e5faceb5f83a0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185e4 expref: 11 pid: 1625 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746155644.192339:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126060928 00000100:00100000:0.0:1746155644.192342:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126060928 00010000:00010000:3.0:1746155644.192346:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094e32600/0x844e5faceb5f83a0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185e4 expref: 11 pid: 1625 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746155644.192351:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5257400/0x844e5faceb5f8322 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18597 expref: 18 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.192356:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e32600/0x844e5faceb5f83a0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185e4 expref: 11 pid: 1625 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.192363:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155644.192372:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8822 00000100:00100000:0.0:1746155644.192377:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976126060928:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155644.192383:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155644.192387:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976126061056:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 62us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.192392:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8821 00000100:00100000:3.0:1746155644.192431:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f3ef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125404928:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.192447:0:20200:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.192609:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125404800:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.192662:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa37800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125405056:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.192696:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125405184:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.192704:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125405440:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.192724:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.193031:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125405312:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.193046:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.193690:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b5257400/0x844e5faceb5f8322 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18597 expref: 18 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155644.193699:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5257400/0x844e5faceb5f8322 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18597 expref: 18 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155644.193713:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5257400/0x844e5faceb5f8322 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18597 expref: 18 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155644.193723:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155644.193758:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1963:x1830976126060928:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1380us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155644.193764:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8822 00000100:00100000:2.0:1746155644.195358:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976126060288:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 4286us (4538us total) trans 21474841630 rc 0/0 00000100:00100000:2.0:1746155644.195367:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1426 00002000:00100000:2.0:1746155644.195375:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1859584->2097151) req@ffff880131496a00 x1830976126060288/t21474841630(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/448 e 0 to 0 dl 1746155655 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.195384:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496a00 with x1830976126060288 ext(1859584->2097151) 00010000:00010000:2.0:1746155644.195391:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.195401:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746155644.195407:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131496a00 00000100:00100000:0.0:1746155644.199052:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.199086:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.199106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.199117:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.199139:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.199187:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126061696 00000100:00100000:3.0:1746155644.199194:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126061696 00010000:00010000:3.0:1746155644.199221:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131005400/0x844e5faceb5f8330 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185a5 expref: 27 pid: 20200 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.199247:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126061184 00000100:00100000:3.0:1746155644.199249:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126061184 00010000:00010000:3.0:1746155644.199258:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f82ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1853c expref: 16 pid: 20796 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.199275:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126061440 00000100:00100000:3.0:1746155644.199278:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126061440 00010000:00010000:3.0:1746155644.199285:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009470ce00/0x844e5faceb5f83a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185eb expref: 10 pid: 20200 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746155644.199292:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126061824 00000100:00100000:3.0:1746155644.199293:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126061824 00010000:00010000:3.0:1746155644.199299:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fbca400/0x844e5faceb5f82c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18551 expref: 28 pid: 20796 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.199307:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8823 00000100:00100000:3.0:1746155644.199312:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976126061696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.199324:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.199341:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131005400/0x844e5faceb5f8330 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185a5 expref: 28 pid: 20200 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.199350:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131005400/0x844e5faceb5f8330 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185a5 expref: 28 pid: 20200 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.199366:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131005400/0x844e5faceb5f8330 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185a5 expref: 28 pid: 20200 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.199379:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.199421:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976126061696:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 108us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.199426:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8823 00000100:00100000:3.0:1746155644.199441:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8824 00000100:00100000:3.0:1746155644.199446:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976126061184:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.199454:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.199462:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f82ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1853c expref: 16 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.199469:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f82ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1853c expref: 16 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.199484:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093602a00/0x844e5faceb5f82ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1853c expref: 16 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.199491:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.199521:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976126061184:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 74us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.199525:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8824 00000100:00100000:3.0:1746155644.199535:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8825 00000100:00100000:3.0:1746155644.199540:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126061440:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.199545:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.199555:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009470ce00/0x844e5faceb5f83a7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185eb expref: 10 pid: 20200 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.199565:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009470ce00/0x844e5faceb5f83a7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185eb expref: 10 pid: 20200 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.199576:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009470ce00/0x844e5faceb5f83a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185eb expref: 10 pid: 20200 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.199588:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.199611:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126061440:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 71us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.199615:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8825 00000100:00100000:3.0:1746155644.199623:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8826 00000100:00100000:3.0:1746155644.199626:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976126061824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.199631:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.199638:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fbca400/0x844e5faceb5f82c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18551 expref: 26 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.199644:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fbca400/0x844e5faceb5f82c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18551 expref: 26 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.199652:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fbca400/0x844e5faceb5f82c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18551 expref: 26 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.199659:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.199815:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126061824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 45us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.199821:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8826 00000100:00100000:3.0:1746155644.199857:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126060544 00000100:00100000:3.0:1746155644.199859:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126060544 00002000:00100000:3.0:1746155644.199876:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1605631) req@ffff88009f0daa00 x1830976126060544/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.199884:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0daa00 with x1830976126060544 ext(1048576->1605631) 00010000:00010000:3.0:1746155644.199890:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.199907:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155644.199913:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f0daa00 00000100:00100000:3.0:1746155644.200131:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1427 00000100:00100000:3.0:1746155644.200136:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976126060544:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155644.200907:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.200925:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.200955:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.200997:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126060672 00000100:00100000:2.0:1746155644.201000:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126060672 00010000:00010000:2.0:1746155644.201015:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094e33600/0x844e5faceb5f838b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185cf expref: 9 pid: 19959 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746155644.201029:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126061312 00000100:00100000:2.0:1746155644.201031:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126061312 00010000:00010000:2.0:1746155644.201037:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136a57a00/0x844e5faceb5f82c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18558 expref: 15 pid: 20796 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.201046:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126061568 00000100:00100000:2.0:1746155644.201048:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126061568 00010000:00010000:2.0:1746155644.201057:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f83ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f2 expref: 10 pid: 20200 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746155644.201068:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8827 00000100:00100000:2.0:1746155644.201073:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126060672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.201080:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.201090:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094e33600/0x844e5faceb5f838b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185cf expref: 9 pid: 19959 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.201097:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094e33600/0x844e5faceb5f838b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185cf expref: 9 pid: 19959 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.201108:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094e33600/0x844e5faceb5f838b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185cf expref: 9 pid: 19959 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.201117:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.201118:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.201122:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.201128:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.201143:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155644.201224:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8828 00000100:00100000:0.0:1746155644.201232:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976126061312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155644.201238:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155644.201247:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136a57a00/0x844e5faceb5f82c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18558 expref: 15 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155644.201254:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a57a00/0x844e5faceb5f82c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18558 expref: 15 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155644.201264:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a57a00/0x844e5faceb5f82c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18558 expref: 15 pid: 20796 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155644.201272:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.201273:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.201275:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.201280:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.201293:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155644.201685:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126060672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 611us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.201692:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8827 00000100:00100000:2.0:1746155644.201703:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8829 00000100:00100000:2.0:1746155644.201707:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126061568:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.201714:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.201723:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f83ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f2 expref: 10 pid: 20200 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.201730:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f83ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f2 expref: 10 pid: 20200 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.201741:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f83ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185f2 expref: 10 pid: 20200 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.201748:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155644.202318:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976126061312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1086us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155644.202324:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8828 00010000:00010000:0.0:1746155644.202343:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.202351:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.202373:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.202381:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.202387:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.202391:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009470dc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155644.202395:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.202401:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.202410:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.202416:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009470dc00/0x844e5faceb5f8410 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.202534:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126061568:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 825us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.202540:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8829 00010000:00010000:3.0:1746155644.202612:0:20796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.202618:0:20796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.202632:0:20796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.202637:0:20796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.202643:0:20796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.202647:0:20796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a57c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155644.202649:0:20796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.202658:0:20796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.202665:0:20796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.202670:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a57c00/0x844e5faceb5f8402 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.202696:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126059520:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 15271us (15511us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.202702:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17197 00000100:00100000:1.0:1746155644.202866:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.202881:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126061952 00000100:00100000:1.0:1746155644.202884:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126061952 00010000:00010000:1.0:1746155644.202910:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 16 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.202924:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8830 00000100:00100000:1.0:1746155644.202928:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126061952:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155644.202934:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155644.202943:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 16 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.202949:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 16 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.202959:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e32800/0x844e5faceb5f8361 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1859584->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ba expref: 16 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.202970:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.202971:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.202974:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.202979:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.202991:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.203003:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126061952:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 75us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.203007:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8830 00000100:00100000:0.0:1746155644.203270:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1962:x1830976126059904:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 15086us (15261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155644.203276:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17200 00010000:00010000:2.0:1746155644.203324:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.203330:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.203342:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.203348:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.203353:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.203358:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009470c000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155644.203361:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.203367:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.203375:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.203380:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009470c000/0x844e5faceb5f83fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.203409:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976126059648:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 15979us (16189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.203415:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17198 00000100:00100000:1.0:1746155644.203710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.203724:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126062080 00000100:00100000:1.0:1746155644.203727:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126062080 00010000:00010000:1.0:1746155644.203738:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5f8329 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1859e expref: 15 pid: 20200 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.203751:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8831 00000100:00100000:1.0:1746155644.203756:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1963:x1830976126062080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155644.203762:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155644.203770:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5f8329 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1859e expref: 15 pid: 20200 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.203778:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5f8329 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1859e expref: 15 pid: 20200 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.203788:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c85400/0x844e5faceb5f8329 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1859e expref: 15 pid: 20200 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.203796:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.203809:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1963:x1830976126062080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 53us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.203814:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8831 00000100:00100000:0.0:1746155644.204999:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.205013:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126062208 00000100:00100000:1.0:1746155644.205018:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126062208 00010000:00010000:1.0:1746155644.205032:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f8314 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18589 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.205057:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8832 00000100:00100000:1.0:1746155644.205061:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126062208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155644.205069:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155644.205080:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f8314 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18589 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.205087:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f8314 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18589 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.205100:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136a56c00/0x844e5faceb5f8314 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18589 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.205109:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.205110:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.205113:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.205119:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.205148:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155644.205170:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.205175:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126062208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 113us (178us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155644.205178:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.205180:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8832 00010000:00010000:3.0:1746155644.205192:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.205198:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.205204:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.205216:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc5a800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155644.205219:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.205224:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.205232:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.205238:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc5a800/0x844e5faceb5f8417 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.205272:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+5:1963:x1830976126060032:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 17073us (17234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.205279:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17201 00000100:00100000:2.0:1746155644.205934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.205969:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126062336 00000100:00100000:3.0:1746155644.205973:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126062336 00010000:00010000:3.0:1746155644.205985:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e33200/0x844e5faceb5f8337 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ac expref: 17 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.206006:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8833 00000100:00100000:3.0:1746155644.206015:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976126062336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.206021:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.206030:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e33200/0x844e5faceb5f8337 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ac expref: 17 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.206039:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e33200/0x844e5faceb5f8337 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ac expref: 17 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.206050:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e33200/0x844e5faceb5f8337 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185ac expref: 17 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.206058:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.206059:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.206062:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.206068:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.206080:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155644.206087:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.206094:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.206096:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976126062336:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 81us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.206101:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8833 00010000:00010000:1.0:1746155644.206111:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.206117:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.206122:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.206127:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094e33a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155644.206130:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.206145:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.206154:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.206162:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e33a00/0x844e5faceb5f841e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.206194:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126060160:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 17980us (18137us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.206199:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17202 00000100:00100000:3.0:1746155644.211063:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976126060544:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 10917us (11966us total) trans 21474841631 rc 0/0 00000100:00100000:3.0:1746155644.211073:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1427 00002000:00100000:3.0:1746155644.211083:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1605631) req@ffff88009f0daa00 x1830976126060544/t21474841631(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/448 e 0 to 0 dl 1746155655 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.211091:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0daa00 with x1830976126060544 ext(1048576->1605631) 00010000:00010000:3.0:1746155644.211098:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.211111:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155644.211118:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f0daa00 00000100:00100000:0.0:1746155644.213209:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.213256:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126062464 00000100:00100000:3.0:1746155644.213263:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126062464 00010000:00010000:3.0:1746155644.213293:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.213326:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8834 00000100:00100000:3.0:1746155644.213332:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126062464:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.213342:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.213357:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.213366:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.213383:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094e33000/0x844e5faceb5f8368 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1605631) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f185c1 expref: 14 pid: 19959 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.213395:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.213397:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.213401:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.213411:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.213440:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.213476:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126062464:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 144us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.213482:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8834 00010000:00010000:2.0:1746155644.213645:0:29728:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.213654:0:29728:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.213670:0:29728:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.213676:0:29728:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.213687:0:29728:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.213692:0:29728:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094fa5c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155644.213695:0:29728:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.213701:0:29728:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.213710:0:29728:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.213715:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094fa5c00/0x844e5faceb5f8409 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.213766:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1962:x1830976126059776:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 26313us (26510us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.213773:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17199 00000100:00100000:0.0:1746155644.216663:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.216714:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126062720 00000100:00100000:2.0:1746155644.216722:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126062720 00000100:00100000:2.0:1746155644.216764:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11171 00000100:00100000:2.0:1746155644.216770:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:32427:x1830976126062720:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155644.216813:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746155644.216832:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131004400/0x844e5faceb5f83d1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18600 expref: 15 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.216848:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093602c00/0x844e5faceb5f8203 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f184c5 expref: 14 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.216855:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.216859:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155644.216881:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.216891:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182bf expref: 24 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.216907:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 24 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.216913:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182db expref: 298 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.216918:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f7f63 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1833d expref: 298 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.216923:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1400/0x844e5faceb5f7f8d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1834b expref: 24 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.216929:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.216954:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1400/0x844e5faceb5f7f8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1834b expref: 24 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.216967:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1400/0x844e5faceb5f7f8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1834b expref: 24 pid: 19870 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.216977:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125405568:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.217054:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f7f63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1833d expref: 298 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.217061:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f7f63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1833d expref: 298 pid: 19870 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.217068:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa37800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125405696:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.217091:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182db expref: 298 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.217098:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182db expref: 298 pid: 14234 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.217104:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa36d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125405824:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.217123:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 24 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.217129:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 24 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.217135:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa37480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125405952:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.217154:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182bf expref: 24 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.217160:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182bf expref: 24 pid: 19870 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.217165:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa37100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125406080:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.217177:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b530e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.220147:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125405568:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.220166:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa37800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125405696:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.220173:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa36d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125405824:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.220179:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa37480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125405952:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.220185:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa37100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125406080:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.220210:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155644.220358:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.220388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.220416:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.220435:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.220453:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.220472:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126063232 00000100:00100000:2.0:1746155644.220477:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126063232 00000100:00100000:1.0:1746155644.220522:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126063360 00010000:00010000:2.0:1746155644.220525:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f7f63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1833d expref: 299 pid: 19870 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.220526:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126063360 00010000:00010000:1.0:1746155644.220537:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182db expref: 300 pid: 14234 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.220542:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126062848 00000100:00100000:2.0:1746155644.220544:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126062848 00000100:00100000:1.0:1746155644.220545:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126063104 00000100:00100000:1.0:1746155644.220546:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126063104 00010000:00010000:2.0:1746155644.220551:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1400/0x844e5faceb5f7f8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1834b expref: 26 pid: 19870 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.220552:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182bf expref: 26 pid: 19870 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.220559:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126062976 00000100:00100000:1.0:1746155644.220560:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126062976 00000100:00100000:2.0:1746155644.220563:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8835 00010000:00010000:1.0:1746155644.220566:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 27 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.220569:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1962:x1830976126063232:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155644.220573:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8836 00000100:00100000:1.0:1746155644.220577:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1962:x1830976126063360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.220579:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155644.220581:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.220583:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f7f63 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1833d expref: 300 pid: 19870 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.220584:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182db expref: 300 pid: 14234 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.220591:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f7f63 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1833d expref: 300 pid: 19870 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.220634:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8837 00000100:00100000:3.0:1746155644.220641:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976126062848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.220646:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.220650:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1400/0x844e5faceb5f7f8d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1834b expref: 27 pid: 19870 timeout: 873 lvb_type: 0 00000100:00100000:0.0:1746155644.220757:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8838 00000100:00100000:0.0:1746155644.220763:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976126063104:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155644.220769:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155644.220772:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182bf expref: 27 pid: 19870 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.220794:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182db expref: 300 pid: 14234 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.220811:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459a00/0x844e5faceb5f7eec lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182db expref: 300 pid: 14234 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.220825:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155644.220830:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.220839:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.220870:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1962:x1830976126063360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 292us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.220875:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8836 00000100:00100000:1.0:1746155644.220887:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8839 00000100:00100000:1.0:1746155644.220892:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976126062976:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155644.220923:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155644.220927:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 27 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.220934:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 27 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.220944:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f458a00/0x844e5faceb5f7ee5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182d4 expref: 27 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.220950:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f7f63 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1833d expref: 298 pid: 19870 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.220951:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155644.220954:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.220959:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155644.220961:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.220963:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.220967:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.220971:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976126062976:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 79us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.220975:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8839 00000100:00100000:2.0:1746155644.220978:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1962:x1830976126063232:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 410us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.220982:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8835 00010000:00010000:3.0:1746155644.221029:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1400/0x844e5faceb5f7f8d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1834b expref: 25 pid: 19870 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.221043:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6ef1400/0x844e5faceb5f7f8d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1834b expref: 25 pid: 19870 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.221052:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.221055:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.221059:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.221074:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976126062848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 434us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.221081:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8837 00010000:00010000:0.0:1746155644.221218:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182bf expref: 23 pid: 19870 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155644.221229:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc200/0x844e5faceb5f7ed0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f182bf expref: 23 pid: 19870 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155644.221250:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155644.221253:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155644.221259:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155644.221265:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155644.221550:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155644.221567:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976126063104:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 803us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155644.221572:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8838 00010000:00010000:3.0:1746155644.221634:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.221640:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000040:00080000:3.0:1746155644.222365:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3626, 88 off306008 00000004:00080000:3.0:1746155644.222372:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773371868727ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155644.222409:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3626, 88 off306272 00000004:00080000:3.0:1746155644.222414:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773371910978ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155644.222434:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3627, 88 off306360 00000004:00080000:3.0:1746155644.222437:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773371934012ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155644.222444:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3627, 88 off306096 00000004:00080000:3.0:1746155644.222446:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773371943538ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155644.222465:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3628, 88 off306184 00000004:00080000:3.0:1746155644.222468:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773371964735ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155644.222474:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3628, 88 off306448 00000004:00080000:3.0:1746155644.222477:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773371973772ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155644.222483:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3629, 88 off306536 00000004:00080000:3.0:1746155644.222485:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773371982186ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155644.222566:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3630, 88 off306624 00000004:00080000:3.0:1746155644.222569:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773372066458ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155644.222577:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3629, 88 off306272 00000004:00080000:3.0:1746155644.222578:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773372075565ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155644.222676:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3631, 88 off306712 00000004:00080000:3.0:1746155644.222679:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773372176300ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155644.222689:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3630, 88 off306360 00000004:00080000:3.0:1746155644.222691:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773372187692ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155644.222697:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3632, 88 off306800 00000004:00080000:3.0:1746155644.222699:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773372196386ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155644.222705:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3631, 88 off306448 00000004:00080000:3.0:1746155644.222707:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773372204470ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155644.222714:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3632, 88 off306536 00000004:00080000:3.0:1746155644.222716:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773372213596ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155644.222723:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3633, 88 off306624 00000004:00080000:3.0:1746155644.222726:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773372223185ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155644.222733:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3634, 88 off306712 00000004:00080000:3.0:1746155644.222735:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773372232497ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155644.222742:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3633, 88 off306888 00000004:00080000:3.0:1746155644.222745:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773372241792ns, next at 716011101328ns, rc = 0 00000004:00010000:3.0:1746155644.236958:0:20364:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ff68700 reply state ffff88009c17b800 transno 8589945337 ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155644.236970:0:20364:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746155644.237050:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:32427:x1830976126062720:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 20276us (20391us total) trans 8589945337 rc 0/0 00000100:00100000:3.0:1746155644.237058:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11171 00000001:00080000:0.0:1746155644.237108:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945335 is committed 00000001:00080000:0.0:1746155644.237114:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945311 is committed 00000001:00080000:0.0:1746155644.237119:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945334 is committed 00000001:00080000:0.0:1746155644.237123:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945332 is committed 00000001:00080000:0.0:1746155644.237128:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945336 is committed 00000001:00080000:0.0:1746155644.237131:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945333 is committed 00000001:00080000:0.0:1746155644.237174:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945337 is committed 00000004:00080000:0.0:1746155644.237178:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2817 committed 00000004:00080000:0.0:1746155644.237183:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2812 committed 00000004:00080000:0.0:1746155644.237188:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2811 committed 00000004:00080000:0.0:1746155644.237189:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2810 committed 00000004:00080000:0.0:1746155644.237190:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2809 committed 00000004:00080000:0.0:1746155644.237192:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2816 committed 00000004:00080000:0.0:1746155644.237193:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2808 committed 00000004:00080000:0.0:1746155644.237194:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2815 committed 00000004:00080000:0.0:1746155644.237196:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2807 committed 00000004:00080000:0.0:1746155644.237197:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2814 committed 00000004:00080000:0.0:1746155644.237198:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2813 committed 00000004:00080000:0.0:1746155644.237199:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2812 committed 00000004:00080000:0.0:1746155644.237201:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2806 committed 00000004:00080000:0.0:1746155644.237202:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2805 committed 00000004:00080000:0.0:1746155644.237203:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2811 committed 00000004:00080000:0.0:1746155644.237205:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2810 committed 00000004:00080000:0.0:1746155644.237206:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2804 committed 00010000:00010000:0.0:1746155644.237226:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155644.237233:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155644.237239:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155644.237244:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009470c000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155644.237247:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155644.237253:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155644.237269:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155644.237271:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155644.237274:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155644.237279:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009470c000/0x844e5faceb5f8425 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155644.237456:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125406592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.237521:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125406336:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155644.237521:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125406208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.237542:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125406464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155644.237628:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155644.237687:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125406592 00000100:00100000:2.0:1746155644.237692:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125406592 00000100:00100000:3.0:1746155644.237712:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155644.237724:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125407104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.237763:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125406976:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.237777:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155644.237777:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125406464 00000100:00100000:2.0:1746155644.237779:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125406464 00000100:00100000:3.0:1746155644.237787:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125407488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155644.237789:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125406976 00000100:00100000:2.0:1746155644.237790:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125406976 00000100:00100000:3.0:1746155644.237799:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155644.237800:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17203 00000100:00100000:2.0:1746155644.237804:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3297:x1830976125406592:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746155644.237855:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746155644.237939:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125408000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.237952:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.238014:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125407488 00000100:00100000:0.0:1746155644.238014:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125408000 00000100:00100000:1.0:1746155644.238017:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125407488 00000100:00100000:0.0:1746155644.238017:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125408000 00000100:00100000:1.0:1746155644.238032:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17204 00000100:00100000:0.0:1746155644.238036:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17205 00000100:00100000:1.0:1746155644.238037:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3296:x1830976125406464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155644.238039:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3296:x1830976125406976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.238061:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17206 00000100:00100000:1.0:1746155644.238065:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3296:x1830976125407488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.238099:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17207 00000100:00100000:3.0:1746155644.238104:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976125408000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.238209:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3296:x1830976125408000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (254us total) trans 21474841632 rc 0/0 00000100:00100000:3.0:1746155644.238213:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17207 00000100:00100000:3.0:1746155644.238232:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155644.238243:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125406848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.238257:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155644.238264:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125407360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.238275:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155644.238284:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125407872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.238294:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155644.238312:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125406336 00000100:00100000:3.0:1746155644.238315:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125406336 00000100:00100000:3.0:1746155644.238325:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125406848 00000100:00100000:3.0:1746155644.238326:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125406848 00000100:00100000:3.0:1746155644.238332:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125407360 00000100:00100000:3.0:1746155644.238334:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125407360 00000100:00100000:3.0:1746155644.238339:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125407872 00000100:00100000:3.0:1746155644.238340:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125407872 00000100:00100000:3.0:1746155644.238347:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17208 00000100:00100000:3.0:1746155644.238350:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3295:x1830976125406336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.238431:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3295:x1830976125406336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (198us total) trans 21474841633 rc 0/0 00000100:00100000:3.0:1746155644.238436:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17208 00000100:00100000:3.0:1746155644.238446:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17209 00000100:00100000:3.0:1746155644.238450:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3295:x1830976125406848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155644.238482:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3297:x1830976125406592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 677us (854us total) trans 17179874315 rc 0/0 00000100:00100000:2.0:1746155644.238487:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17203 00000100:00100000:2.0:1746155644.238496:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17210 00000100:00100000:2.0:1746155644.238500:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+26:3295:x1830976125407360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.238533:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3295:x1830976125406848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (275us total) trans 21474841634 rc 0/0 00000100:00100000:3.0:1746155644.238538:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17209 00000100:00100000:3.0:1746155644.238550:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17211 00000100:00100000:3.0:1746155644.238554:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3295:x1830976125407872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155644.238580:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:2.0:1746155644.238583:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:2.0:1746155644.238585:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155644.238586:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:2.0:1746155644.238588:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:2.0:1746155644.238604:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+27:3295:x1830976125407360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (327us total) trans 21474841635 rc 0/0 00000100:00100000:3.0:1746155644.238609:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3295:x1830976125407872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (313us total) trans 21474841636 rc 0/0 00000100:00100000:2.0:1746155644.238609:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17210 00000100:00100000:3.0:1746155644.238613:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17211 00000100:00100000:2.0:1746155644.238628:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746155644.238635:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094440380/2, rc 0, transno 21474841633 00000100:00100000:3.0:1746155644.238639:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125406336:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155644.238639:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125406720:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155644.238646:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094441880/2, rc 0, transno 21474841634 00000100:00100000:3.0:1746155644.238648:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125406848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155644.238652:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746155644.238654:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094442d80/2, rc 0, transno 21474841635 00000100:00100000:3.0:1746155644.238656:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125407360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155644.238660:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125407232:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155644.238661:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094443100/2, rc 0, transno 21474841636 00000100:00100000:3.0:1746155644.238663:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125407872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155644.238670:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155644.238673:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125406208 00000100:00100000:3.0:1746155644.238675:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125406208 00000100:00100000:2.0:1746155644.238678:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125407744:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.238685:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125406720 00000100:00100000:3.0:1746155644.238686:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125406720 00000100:00100000:2.0:1746155644.238690:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155644.238693:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125407232 00000100:00100000:3.0:1746155644.238695:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125407232 00000100:00100000:2.0:1746155644.238699:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746155644.238700:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125407744 00000100:00100000:3.0:1746155644.238702:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125407744 00000100:00100000:2.0:1746155644.238703:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125408128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.238708:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17212 00000100:00100000:3.0:1746155644.238711:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3298:x1830976125406208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155644.238722:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155644.238733:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125408128 00000100:00100000:2.0:1746155644.238735:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125408128 00000100:00100000:2.0:1746155644.238746:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17213 00000100:00100000:2.0:1746155644.238750:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3298:x1830976125406720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.238787:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976125406208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (158us total) trans 17179874316 rc 0/0 00000100:00100000:3.0:1746155644.238792:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17212 00000100:00100000:3.0:1746155644.238800:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17214 00000100:00100000:3.0:1746155644.238804:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+20:3298:x1830976125407232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155644.238819:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3298:x1830976125406720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (166us total) trans 21474841637 rc 0/0 00000100:00100000:2.0:1746155644.238823:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17213 00000100:00100000:2.0:1746155644.238832:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17215 00000100:00100000:2.0:1746155644.238836:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3298:x1830976125407744:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155644.238856:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17216 00000100:00100000:2.0:1746155644.238860:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+27:3298:x1830976125408128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.238923:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976125407488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 857us (1123us total) trans 17179874317 rc 0/0 00000100:00100000:1.0:1746155644.238928:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17206 00000100:00100000:2.0:1746155644.238929:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+28:3298:x1830976125408128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (206us total) trans 21474841638 rc 0/0 00000100:00100000:2.0:1746155644.238933:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17216 00000004:00080000:2.0:1746155644.238952:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094440e00/2, rc 0, transno 21474841638 00000100:00100000:2.0:1746155644.238955:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125408128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155644.238962:0:3298:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874297 gen 2 00000004:00080000:2.0:1746155644.238965:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f580e00, transno 17179874170 00000004:00080000:2.0:1746155644.238970:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f580000, transno 17179874171 00000004:00080000:2.0:1746155644.238972:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f580700, transno 17179874172 00000004:00080000:2.0:1746155644.238974:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f581f80, transno 17179874173 00000004:00080000:2.0:1746155644.238976:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f583800, transno 17179874174 00000004:00080000:2.0:1746155644.238978:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f581500, transno 17179874175 00000004:00080000:2.0:1746155644.238980:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f581180, transno 17179874176 00000004:00080000:2.0:1746155644.238982:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f582300, transno 17179874177 00000100:00100000:1.0:1746155644.239003:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976125406464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 965us (1291us total) trans 17179874318 rc 0/0 00000100:00100000:1.0:1746155644.239008:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17204 00000100:00100000:1.0:1746155644.239070:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976125407744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 233us (379us total) trans 17179874319 rc 0/0 00000100:00100000:1.0:1746155644.239075:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17215 00000100:00100000:0.0:1746155644.239235:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3296:x1830976125406976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1194us (1456us total) trans 17179874320 rc 0/0 00000100:00100000:0.0:1746155644.239240:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17205 00000100:00080000:0.0:1746155644.239254:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155644.239261:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.239274:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125407104 00000100:00100000:1.0:1746155644.239277:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125407104 00000100:00100000:1.0:1746155644.239291:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17217 00000100:00100000:1.0:1746155644.239295:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976125407104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.239376:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976125407104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (114us total) trans 21474841639 rc 0/0 00000100:00100000:1.0:1746155644.239380:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17217 00000100:00100000:3.0:1746155644.239594:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976125407232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 790us (923us total) trans 17179874321 rc 0/0 00000100:00100000:3.0:1746155644.239599:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17214 00000004:00080000:2.0:1746155644.239730:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012c2bf800, transno 17179874178 00000004:00080000:2.0:1746155644.239732:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f7100, transno 17179874182 00000004:00080000:2.0:1746155644.239734:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f4000, transno 17179874183 00000004:00080000:2.0:1746155644.239737:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f4700, transno 17179874184 00000004:00080000:2.0:1746155644.239739:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f7480, transno 17179874185 00000004:00080000:2.0:1746155644.239741:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f5f80, transno 17179874186 00000004:00080000:2.0:1746155644.239743:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f6a00, transno 17179874187 00000004:00080000:2.0:1746155644.239745:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f4e00, transno 17179874188 00000004:00080000:2.0:1746155644.239747:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f5880, transno 17179874189 00000004:00080000:2.0:1746155644.239749:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff69500, transno 17179874190 00000004:00080000:2.0:1746155644.239751:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff68000, transno 17179874191 00000004:00080000:2.0:1746155644.239753:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6b100, transno 17179874192 00000004:00080000:2.0:1746155644.239755:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff69880, transno 17179874193 00000004:00080000:2.0:1746155644.239757:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff68e00, transno 17179874194 00000004:00080000:2.0:1746155644.239759:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6ad80, transno 17179874195 00000004:00080000:2.0:1746155644.239761:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff68a80, transno 17179874196 00000004:00080000:2.0:1746155644.239763:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff69f80, transno 17179874197 00000004:00080000:2.0:1746155644.239764:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff69c00, transno 17179874198 00000004:00080000:2.0:1746155644.239766:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ff6a300, transno 17179874199 00000004:00080000:2.0:1746155644.239769:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01d0a80, transno 17179874205 00000004:00080000:2.0:1746155644.239771:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0dbb80, transno 17179874206 00000004:00080000:2.0:1746155644.239773:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01d3b80, transno 17179874207 00000004:00080000:2.0:1746155644.239774:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0d9c00, transno 17179874208 00000004:00080000:2.0:1746155644.239776:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01d2680, transno 17179874209 00000004:00080000:2.0:1746155644.239778:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01d1500, transno 17179874210 00000004:00080000:2.0:1746155644.239781:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0d9500, transno 17179874211 00000004:00080000:2.0:1746155644.239782:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01d0700, transno 17179874212 00000004:00080000:2.0:1746155644.239784:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca94700, transno 17179874213 00000004:00080000:2.0:1746155644.239786:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc7100, transno 17179874217 00000004:00080000:2.0:1746155644.239788:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc6a00, transno 17179874218 00000004:00080000:2.0:1746155644.239791:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc4a80, transno 17179874219 00000004:00080000:2.0:1746155644.239793:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc5180, transno 17179874220 00000004:00080000:2.0:1746155644.239794:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc7800, transno 17179874221 00000004:00080000:2.0:1746155644.239796:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc5c00, transno 17179874222 00000004:00080000:2.0:1746155644.239798:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc6680, transno 17179874223 00000004:00080000:2.0:1746155644.239799:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc6d80, transno 17179874224 00000004:00080000:2.0:1746155644.239801:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc51c00, transno 17179874225 00000004:00080000:2.0:1746155644.239803:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac5180, transno 17179874226 00000004:00080000:2.0:1746155644.239805:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac5f80, transno 17179874227 00000004:00080000:2.0:1746155644.239807:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac5c00, transno 17179874228 00000004:00080000:2.0:1746155644.239808:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac4e00, transno 17179874229 00000004:00080000:2.0:1746155644.239811:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac6d80, transno 17179874230 00000004:00080000:2.0:1746155644.239812:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac5880, transno 17179874231 00000004:00080000:2.0:1746155644.239814:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac4700, transno 17179874232 00000004:00080000:2.0:1746155644.239817:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f883480, transno 17179874233 00000004:00080000:2.0:1746155644.239818:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac4000, transno 17179874234 00000004:00080000:2.0:1746155644.239820:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9d180, transno 17179874243 00000004:00080000:2.0:1746155644.239821:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9d880, transno 17179874244 00000004:00080000:2.0:1746155644.239823:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9c700, transno 17179874245 00000004:00080000:2.0:1746155644.239826:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9dc00, transno 17179874246 00000004:00080000:2.0:1746155644.239828:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9ed80, transno 17179874247 00000004:00080000:2.0:1746155644.239830:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fff5c00, transno 17179874248 00000004:00080000:2.0:1746155644.239832:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6063100, transno 17179874249 00000004:00080000:2.0:1746155644.239833:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9c380, transno 17179874250 00000004:00080000:2.0:1746155644.239835:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130c9f800, transno 17179874251 00000004:00080000:2.0:1746155644.239837:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910ca300, transno 17179874255 00000004:00080000:2.0:1746155644.239839:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910c8700, transno 17179874256 00000004:00080000:2.0:1746155644.239841:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910c9f80, transno 17179874257 00000004:00080000:2.0:1746155644.239842:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910c8e00, transno 17179874258 00000004:00080000:2.0:1746155644.239844:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910cb100, transno 17179874259 00000004:00080000:2.0:1746155644.239846:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910cad80, transno 17179874260 00000004:00080000:2.0:1746155644.239848:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910c8000, transno 17179874261 00000004:00080000:2.0:1746155644.239849:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910cb480, transno 17179874262 00000004:00080000:2.0:1746155644.239852:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6062d80, transno 17179874263 00000004:00080000:2.0:1746155644.239854:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6062680, transno 17179874264 00000004:00080000:2.0:1746155644.239855:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6060e00, transno 17179874265 00000004:00080000:2.0:1746155644.239857:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdedf80, transno 17179874266 00000004:00080000:2.0:1746155644.239859:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6061500, transno 17179874267 00000004:00080000:2.0:1746155644.239860:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f881180, transno 17179874268 00000004:00080000:2.0:1746155644.239863:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6060a80, transno 17179874269 00000004:00080000:2.0:1746155644.239865:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f880a80, transno 17179874270 00000004:00080000:2.0:1746155644.239867:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6061c00, transno 17179874271 00000004:00080000:2.0:1746155644.239869:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6061f80, transno 17179874272 00000004:00080000:2.0:1746155644.239871:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c213480, transno 17179874277 00000004:00080000:2.0:1746155644.239873:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c213100, transno 17179874278 00000004:00080000:2.0:1746155644.239874:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c210a80, transno 17179874279 00000004:00080000:2.0:1746155644.239876:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c212300, transno 17179874280 00000004:00080000:2.0:1746155644.239878:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c211f80, transno 17179874281 00000004:00080000:2.0:1746155644.239879:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c210380, transno 17179874282 00000004:00080000:2.0:1746155644.239882:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c211180, transno 17179874283 00000004:00080000:2.0:1746155644.239883:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c213800, transno 17179874284 00000004:00080000:2.0:1746155644.239885:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01d0000, transno 17179874285 00000004:00080000:2.0:1746155644.239887:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910d9880, transno 17179874289 00000004:00080000:2.0:1746155644.239889:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01d0e00, transno 17179874290 00000004:00080000:2.0:1746155644.239891:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fb69880, transno 17179874291 00000004:00080000:2.0:1746155644.239893:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28ea00, transno 17179874292 00000004:00080000:2.0:1746155644.239904:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28c700, transno 17179874293 00000004:00080000:2.0:1746155644.239906:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f3ef480, transno 17179874294 00000004:00080000:2.0:1746155644.239908:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800910da680, transno 17179874295 00000004:00080000:2.0:1746155644.239910:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28d880, transno 17179874296 00000004:00080000:2.0:1746155644.239912:0:3298:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28dc00, transno 17179874297 00000100:00100000:2.0:1746155644.239917:0:3298:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009fa35180 x1830976125385984/t17179874298(17179874298) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746155658 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746155644.239930:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1f0380/2, rc 0, transno 17179874316 00000100:00100000:2.0:1746155644.239933:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125406208:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155644.239952:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125407616:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155644.239972:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155644.239993:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009045c700/2, rc 0, transno 17179874315 00000100:00100000:0.0:1746155644.239996:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125406592:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155644.240001:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094441f80/2, rc 0, transno 21474841639 00000100:00100000:0.0:1746155644.240003:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125407104:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155644.240014:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125407616 00000100:00100000:0.0:1746155644.240016:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125407616 00000100:00100000:1.0:1746155644.240061:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17218 00000100:00100000:1.0:1746155644.240066:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3297:x1830976125407616:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155644.240154:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009045fb80/2, rc 0, transno 17179874318 00000100:00100000:3.0:1746155644.240157:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125406464:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155644.240167:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009045c000/2, rc 0, transno 17179874320 00000100:00100000:3.0:1746155644.240169:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125406976:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155644.240175:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009045e680/2, rc 0, transno 17179874317 00000100:00100000:3.0:1746155644.240178:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125407488:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155644.240185:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094442680/2, rc 0, transno 21474841632 00000100:00100000:3.0:1746155644.240187:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125408000:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.240409:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976125407616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 343us (435us total) trans 17179874322 rc 0/0 00000100:00100000:1.0:1746155644.240414:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17218 00000100:00100000:1.0:1746155644.240493:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000004:00080000:1.0:1746155644.240530:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009045ca80/2, rc 0, transno 17179874322 00000100:00100000:1.0:1746155644.240534:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125407616:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.240570:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126063488 00000100:00100000:3.0:1746155644.240573:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126063488 00000100:00100000:3.0:1746155644.240592:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11172 00000100:00100000:3.0:1746155644.240596:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32427:x1830976126063488:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155644.240610:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.240623:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f842c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1861c expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.240660:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f842c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1861c expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.240671:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f842c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1861c expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1746155644.240886:0:14277:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 17 in progress, 2 in flight, 99 done 00000004:00080000:2.0:1746155644.240932:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094441500/2, rc 0, transno 21474841637 00000100:00100000:2.0:1746155644.240935:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125406720:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155644.240942:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009045e300/2, rc 0, transno 17179874321 00000100:00100000:2.0:1746155644.240944:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125407232:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155644.240949:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009045f480/2, rc 0, transno 17179874319 00000100:00100000:2.0:1746155644.240952:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125407744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155644.240958:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125408256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155644.240973:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746155644.241072:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.241075:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155644.241077:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4ac00, rc 0) 00000100:00100000:3.0:1746155644.241100:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32427:x1830976126063488:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 503us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.241105:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11172 00000100:00100000:2.0:1746155644.241153:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125408256 00000100:00100000:2.0:1746155644.241157:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125408256 00000100:00100000:2.0:1746155644.241169:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17219 00000100:00100000:2.0:1746155644.241173:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976125408256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155644.241258:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3298:x1830976125408256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (283us total) trans 17179874323 rc 0/0 00000100:00100000:2.0:1746155644.241263:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17219 00000004:00080000:3.0:1746155644.241266:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f580e00/2, rc 0, transno 17179874323 00000100:00100000:3.0:1746155644.241269:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125408256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155644.243569:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.243611:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126063616 00000100:00100000:3.0:1746155644.243616:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126063616 00000100:00100000:3.0:1746155644.243662:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11173 00000100:00100000:3.0:1746155644.243672:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32427:x1830976126063616:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155644.243684:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.243697:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4bc00/0x844e5faceb5f8433 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18623 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.243754:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4b000/0x844e5faceb5f843a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.243765:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4b000/0x844e5faceb5f843a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.243773:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4b000/0x844e5faceb5f843a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:3.0:1746155644.243792:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155644.243795:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155644.243805:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4b000/0x844e5faceb5f843a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.243825:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4bc00/0x844e5faceb5f8433 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18623 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.243837:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4b000/0x844e5faceb5f843a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18623 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.243842:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.243845:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155644.243846:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fe4b000, rc 0) 00000100:00100000:3.0:1746155644.243889:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32427:x1830976126063616:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 220us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.243903:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11173 00000100:00100000:0.0:1746155644.245890:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.245923:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.245946:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126063744 00000100:00100000:0.0:1746155644.245947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.245951:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126063744 00000100:00100000:0.0:1746155644.245960:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.245984:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126063872 00000100:00100000:0.0:1746155644.245984:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.245986:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126063872 00000100:00100000:2.0:1746155644.245997:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126064000 00000100:00100000:2.0:1746155644.245998:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126064000 00000100:00100000:2.0:1746155644.246006:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126064128 00000100:00100000:2.0:1746155644.246008:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126064128 00000100:00100000:2.0:1746155644.246016:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126064256 00000100:00100000:2.0:1746155644.246017:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126064256 00000100:00100000:2.0:1746155644.246028:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17220 00000100:00100000:0.0:1746155644.246031:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.246034:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126063744:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155644.246044:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155644.246052:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126064384 00000100:00100000:0.0:1746155644.246055:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126064384 00010000:00010000:2.0:1746155644.246056:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c800/0x844e5faceb5f8441 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1862a expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155644.246071:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17221 00002000:00010000:2.0:1746155644.246075:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e1:0x0] initial LVB size: 1048576, mtime: 0x6814387c, atime: 0x6814387b, ctime: 0x6814387b, blocks: 0x7e9 00000100:00100000:0.0:1746155644.246076:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126063872:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155644.246082:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.246086:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.246088:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.246090:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8800/0x844e5faceb5f8448 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18631 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.246095:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c800/0x844e5faceb5f8441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1862a expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746155644.246102:0:20200:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x6814387c, atime: 0x6814387b, ctime: 0x6814387c, blocks: 0x81f 00010000:00010000:2.0:1746155644.246105:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c800/0x844e5faceb5f8441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1862a expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.246108:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.246109:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.246112:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8800/0x844e5faceb5f8448 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18631 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.246114:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7c800, rc 0) 00010000:00010000:0.0:1746155644.246125:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8800/0x844e5faceb5f8448 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18631 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.246131:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d8800, rc 0) 00000100:00100000:2.0:1746155644.246140:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126063744:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 106us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155644.246141:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126063872:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 66us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.246145:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17220 00000100:00100000:0.0:1746155644.246147:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17221 00000100:00100000:0.0:1746155644.246156:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17222 00000100:00100000:2.0:1746155644.246158:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17223 00000100:00100000:0.0:1746155644.246160:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126064000:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:2.0:1746155644.246162:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126064128:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155644.246165:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.246167:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155644.246171:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9e00/0x844e5faceb5f844f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18638 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.246172:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff7de00/0x844e5faceb5f8456 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1863f expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155644.246179:0:20200:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x6814387c, atime: 0x6814387c, ctime: 0x6814387c, blocks: 0x821 00010000:00010000:0.0:1746155644.246186:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.246187:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:2.0:1746155644.246190:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e3:0x0] initial LVB size: 2097152, mtime: 0x6814387c, atime: 0x6814387b, ctime: 0x6814387b, blocks: 0x821 00010000:00010000:0.0:1746155644.246190:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9e00/0x844e5faceb5f844f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18638 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.246195:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.246196:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.246198:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9e00/0x844e5faceb5f844f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18638 expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.246199:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff7de00/0x844e5faceb5f8456 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1863f expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.246204:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d9e00, rc 0) 00010000:00010000:2.0:1746155644.246206:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff7de00/0x844e5faceb5f8456 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1863f expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.246212:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7de00, rc 0) 00000100:00100000:0.0:1746155644.246216:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126064000:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 56us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155644.246220:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17222 00000100:00100000:2.0:1746155644.246221:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126064128:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 59us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.246225:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17223 00000100:00100000:2.0:1746155644.246234:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17224 00000100:00100000:2.0:1746155644.246238:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126064256:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155644.246242:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.246248:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c400/0x844e5faceb5f845d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18646 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155644.246310:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17225 00000100:00100000:0.0:1746155644.246316:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126064384:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155644.246321:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155644.246329:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a285c00/0x844e5faceb5f8464 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1864d expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155644.246338:0:20200:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e2:0x0] initial LVB size: 4194304, mtime: 0x6814387c, atime: 0x6814387c, ctime: 0x6814387c, blocks: 0x1029 00010000:00010000:0.0:1746155644.246345:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.246346:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.246349:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a285c00/0x844e5faceb5f8464 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1864d expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.246357:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a285c00/0x844e5faceb5f8464 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1864d expref: 9 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.246363:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a285c00, rc 0) 00000100:00100000:0.0:1746155644.246377:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126064384:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 61us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155644.246381:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17225 00002000:00010000:2.0:1746155644.246539:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e4:0x0] initial LVB size: 5079552, mtime: 0x6814387c, atime: 0x6814387c, ctime: 0x6814387c, blocks: 0x1711 00010000:00010000:2.0:1746155644.246549:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.246550:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.246554:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c400/0x844e5faceb5f845d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18646 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.246567:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c400/0x844e5faceb5f845d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18646 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.246573:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7c400, rc 0) 00000100:00100000:2.0:1746155644.246592:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126064256:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 353us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.246596:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17224 00000100:00100000:0.0:1746155644.257336:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.257977:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126064640 00000100:00100000:3.0:1746155644.257986:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126064640 00000100:00100000:3.0:1746155644.258043:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8164 00000100:00100000:3.0:1746155644.258050:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976126064640:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155644.258078:0:31251:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b600/0x844e5faceb5f846b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.258096:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.258098:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.258102:0:31251:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b600/0x844e5faceb5f846b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.258113:0:31251:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b600/0x844e5faceb5f846b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155644.258713:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.259872:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.259914:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.259927:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.260079:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126064896 00000100:00100000:1.0:1746155644.260086:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126064896 00000100:00100000:2.0:1746155644.260104:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126065152 00000100:00100000:0.0:1746155644.260107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.260109:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126065152 00000100:00100000:1.0:1746155644.260121:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126065536 00000100:00100000:0.0:1746155644.260123:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126065408 00000100:00100000:1.0:1746155644.260124:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126065536 00000100:00100000:0.0:1746155644.260126:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126065408 00000100:00100000:2.0:1746155644.260132:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8165 00000100:00100000:2.0:1746155644.260138:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976126064896:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:1.0:1746155644.260140:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126065920 00000100:00100000:1.0:1746155644.260143:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126065920 00000100:00100000:0.0:1746155644.260150:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8166 00000100:00100000:0.0:1746155644.260156:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976126065152:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:1.0:1746155644.260161:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8167 00010000:00010000:2.0:1746155644.260165:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f8472 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.260166:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126065536:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155644.260170:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b54b5200/0x844e5faceb5f8479 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.260175:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.260176:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.260179:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f8472 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.260179:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.260180:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.260181:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f8480 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.260183:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b54b5200/0x844e5faceb5f8479 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.260189:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f8472 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.260189:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.260190:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b54b5200/0x844e5faceb5f8479 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.260191:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.260193:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f8480 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.260201:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f8480 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155644.260629:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8168 00000100:00100000:0.0:1746155644.260635:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126065408:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155644.260649:0:31253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136ac8e00/0x844e5faceb5f8487 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.260655:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.260656:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.260658:0:31253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136ac8e00/0x844e5faceb5f8487 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.260665:0:31253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136ac8e00/0x844e5faceb5f8487 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.260876:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.260912:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.260928:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126066176 00000100:00100000:3.0:1746155644.260932:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126066176 00000100:00100000:3.0:1746155644.260949:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126066432 00000100:00100000:3.0:1746155644.260950:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126066432 00000100:00100000:3.0:1746155644.260960:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8169 00000100:00100000:3.0:1746155644.260965:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1962:x1830976126065920:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155644.260979:0:31249:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f459200/0x844e5faceb5f848e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.260986:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.260987:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.260991:0:31249:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f459200/0x844e5faceb5f848e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.260999:0:31249:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f459200/0x844e5faceb5f848e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155644.261326:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8170 00000100:00100000:0.0:1746155644.261332:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976126066176:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155644.261345:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136ac9800/0x844e5faceb5f8495 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.261352:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.261353:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.261356:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136ac9800/0x844e5faceb5f8495 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.261363:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136ac9800/0x844e5faceb5f8495 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.261412:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8171 00000100:00100000:1.0:1746155644.261419:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976126066432:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155644.261432:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f849c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.261439:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.261441:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.261443:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f849c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.261451:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f849c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.267228:0:31251:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b600/0x844e5faceb5f846b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.267243:0:31251:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b600/0x844e5faceb5f846b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.267251:0:31251:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b600/0x844e5faceb5f846b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.267257:0:31251:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fe4b600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155644.267265:0:31251:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b600/0x844e5faceb5f846b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.267272:0:31251:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b600/0x844e5faceb5f846b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.267286:0:31251:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b600/0x844e5faceb5f846b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.267292:0:31251:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fe4b600/0x844e5faceb5f846b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.267358:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1962:x1830976126064640:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 9305us (10027us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.267367:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8164 00010000:00010000:2.0:1746155644.270565:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f8480 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.270581:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f8480 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.270589:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f8480 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.270600:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009470c000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155644.270603:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f8480 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.270610:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f8480 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.270627:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f8480 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.270633:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f8480 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.270690:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976126065536:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 10519us (10771us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.270698:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8167 00010000:00010000:2.0:1746155644.276735:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f8472 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.276748:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f8472 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.276755:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f8472 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.276761:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff7cc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155644.276764:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f8472 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.276772:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f8472 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.276786:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f8472 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.276792:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f8472 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.276869:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1963:x1830976126064896:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 16727us (18153us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.276878:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8165 00010000:00010000:1.0:1746155644.278890:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f849c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.278913:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f849c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.278920:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f849c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.278925:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009470d600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155644.278928:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f849c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.278933:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f849c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.278947:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f849c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.278952:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009470d600/0x844e5faceb5f849c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.279023:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976126066432:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 17603us (18108us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155644.279035:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8171 00010000:00010000:2.0:1746155644.282377:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136ac9800/0x844e5faceb5f8495 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.282390:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136ac9800/0x844e5faceb5f8495 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.282397:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136ac9800/0x844e5faceb5f8495 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.282402:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136ac9800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155644.282405:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136ac9800/0x844e5faceb5f8495 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.282412:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136ac9800/0x844e5faceb5f8495 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.282428:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136ac9800/0x844e5faceb5f8495 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.282434:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136ac9800/0x844e5faceb5f8495 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.282497:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976126066176:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 21161us (21617us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.282534:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8170 00010000:00010000:3.0:1746155644.286749:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746155644.287084:0:25394:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800b54b5200/0x844e5faceb5f8479 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.287098:0:25394:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b54b5200/0x844e5faceb5f8479 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.287106:0:25394:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b54b5200/0x844e5faceb5f8479 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.287112:0:25394:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b54b5200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155644.287117:0:25394:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b54b5200/0x844e5faceb5f8479 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.287123:0:25394:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b54b5200/0x844e5faceb5f8479 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.287138:0:25394:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b54b5200/0x844e5faceb5f8479 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.287144:0:25394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b54b5200/0x844e5faceb5f8479 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.287217:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976126065152:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 27055us (27340us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155644.287227:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8166 00010000:00010000:3.0:1746155644.290449:0:31249:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f459200/0x844e5faceb5f848e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.290462:0:31249:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f459200/0x844e5faceb5f848e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.290469:0:31249:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f459200/0x844e5faceb5f848e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.290474:0:31249:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f459200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155644.290477:0:31249:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f459200/0x844e5faceb5f848e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.290483:0:31249:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f459200/0x844e5faceb5f848e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.290496:0:31249:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f459200/0x844e5faceb5f848e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.290530:0:31249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f459200/0x844e5faceb5f848e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.290592:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976126065920:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 29623us (30480us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.290600:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8169 00010000:00010000:1.0:1746155644.291856:0:31253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136ac8e00/0x844e5faceb5f8487 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.291865:0:31253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136ac8e00/0x844e5faceb5f8487 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.291871:0:31253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136ac8e00/0x844e5faceb5f8487 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.291877:0:31253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136ac8e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155644.291879:0:31253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136ac8e00/0x844e5faceb5f8487 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.291885:0:31253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136ac8e00/0x844e5faceb5f8487 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.291905:0:31253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136ac8e00/0x844e5faceb5f8487 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.291911:0:31253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136ac8e00/0x844e5faceb5f8487 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.292017:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976126065408:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 31379us (32085us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155644.292025:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8168 00000100:00100000:0.0:1746155644.295429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.295483:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126066688 00000100:00100000:2.0:1746155644.295490:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126066688 00000100:00100000:2.0:1746155644.295571:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11174 00000100:00100000:2.0:1746155644.295579:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32427:x1830976126066688:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155644.295625:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.295646:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4b000/0x844e5faceb5f843a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18623 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.295674:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.295678:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155644.295708:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f84a3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.295774:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f84a3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.295783:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f84a3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00010000:2.0:1746155644.295927:0:20364:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b24e300 reply state ffff880136a04000 transno 8589945338 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f84a3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155644.295933:0:20364:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746155644.296001:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32427:x1830976126066688:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 422us (577us total) trans 8589945338 rc 0/0 00000100:00100000:2.0:1746155644.296006:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11174 00010000:00010000:2.0:1746155644.298668:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f84a3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.298680:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f84a3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.298686:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f84a3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.298691:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff7ce00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.298695:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f84a3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.298700:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f84a3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.298712:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.298714:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155644.298716:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f84a3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.298720:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7ce00/0x844e5faceb5f84a3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155644.299568:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.299635:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.299801:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126066816 00000100:00100000:3.0:1746155644.299809:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126066816 00000100:00100000:3.0:1746155644.299841:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126066944 00000100:00100000:3.0:1746155644.299842:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126066944 00000100:00100000:3.0:1746155644.299857:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17226 00000100:00100000:3.0:1746155644.299864:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126066816:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:2.0:1746155644.299890:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17227 00000100:00100000:2.0:1746155644.299906:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126066944:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155644.300008:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155644.300008:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155644.300011:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:2.0:1746155644.300011:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.300013:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155643 -> 1746155644 00002000:00010000:2.0:1746155644.300013:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155643 -> 1746155644 00002000:00010000:3.0:1746155644.300015:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155643 -> 1746155644 00002000:00010000:2.0:1746155644.300015:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.300017:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00002000:00010000:2.0:1746155644.300017:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746155644.300062:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126066816:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 198us (497us total) trans 17179874324 rc 0/0 00000100:00100000:2.0:1746155644.300065:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126066944:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 157us (426us total) trans 21474841640 rc 0/0 00000100:00100000:3.0:1746155644.300068:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17226 00000100:00100000:2.0:1746155644.300070:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17227 00000100:00100000:0.0:1746155644.300293:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.300347:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.300490:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126067200 00000100:00100000:3.0:1746155644.300493:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126067200 00000100:00100000:3.0:1746155644.300768:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126067456 00000100:00100000:3.0:1746155644.300771:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126067456 00000100:00100000:2.0:1746155644.300774:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17228 00000100:00100000:2.0:1746155644.300779:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126067200:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:3.0:1746155644.300790:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17229 00000100:00100000:3.0:1746155644.300794:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126067456:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155644.300845:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746155644.300845:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155644.300847:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:2.0:1746155644.300847:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.300849:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:2.0:1746155644.300849:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155643 -> 1746155644 00002000:00010000:3.0:1746155644.300851:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:2.0:1746155644.300851:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155643 -> 1746155644 00002000:00010000:3.0:1746155644.300853:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00002000:00010000:2.0:1746155644.300853:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155644.300885:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126067456:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 90us (538us total) trans 21474841641 rc 0/0 00000100:00100000:2.0:1746155644.300885:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126067200:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 105us (593us total) trans 17179874325 rc 0/0 00000100:00100000:2.0:1746155644.300890:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17228 00000100:00100000:3.0:1746155644.300905:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17229 00000100:00100000:0.0:1746155644.301009:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.301020:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126067072 00000100:00100000:2.0:1746155644.301023:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126067072 00000100:00100000:2.0:1746155644.301046:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17230 00000100:00100000:1.0:1746155644.301048:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.301050:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126067072:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:3.0:1746155644.301090:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126067328 00000100:00100000:3.0:1746155644.301093:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126067328 00002000:00010000:2.0:1746155644.301110:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155644.301112:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:2.0:1746155644.301114:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00000100:00100000:3.0:1746155644.301116:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17231 00002000:00010000:2.0:1746155644.301116:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:2.0:1746155644.301117:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155644.301121:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126067328:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:2.0:1746155644.301136:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976126067072:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 85us (129us total) trans 21474841642 rc 0/0 00000100:00100000:2.0:1746155644.301141:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17230 00002000:00010000:3.0:1746155644.301171:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:3.0:1746155644.301174:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.301175:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.301177:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.301178:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:3.0:1746155644.301204:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126067328:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 82us (156us total) trans 17179874326 rc 0/0 00000100:00100000:3.0:1746155644.301208:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17231 00000100:00100000:0.0:1746155644.304309:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.305717:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126067712 00000100:00100000:1.0:1746155644.305726:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126067712 00000100:00100000:1.0:1746155644.305774:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4750 00000100:00100000:1.0:1746155644.305782:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32427:x1830976126067712:12345-192.168.202.51@tcp:35:lfs.0 00000004:00010000:1.0:1746155644.305828:0:16336:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x35e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131004200/0x844e5faceb5f83ed lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18615 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.305865:0:16336:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16336 initiator: MDT0 00010000:00010000:1.0:1746155644.305875:0:16336:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f842c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1861c expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.305882:0:16336:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16336 initiator: MDT0 00010000:00010000:1.0:1746155644.305921:0:16336:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f842c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1861c expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.305931:0:16336:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f842c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1861c expref: 9 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.305942:0:16336:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16336:1830976125408384:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.306889:0:16336:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155644.308664:0:16336:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:16336:1830976125408384:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.308682:0:16336:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:0.0:1746155644.308918:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.308967:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126067840 00000100:00100000:2.0:1746155644.308973:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126067840 00010000:00010000:2.0:1746155644.309003:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f842c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1861c expref: 10 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.309037:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8840 00000100:00100000:2.0:1746155644.309043:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126067840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.309056:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.309060:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f842c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1861c expref: 10 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.309070:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f842c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1861c expref: 10 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.309088:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fe4ac00/0x844e5faceb5f842c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1861c expref: 10 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.309099:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.309103:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155644.309113:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155644.309119:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16336 initiator: MDT0 00010000:00010000:2.0:1746155644.309145:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155644.309175:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126067840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 132us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.309181:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8840 00010000:00010000:0.0:1746155644.309331:0:16336:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00010000:00010000:0.0:1746155644.309337:0:16336:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000040:00080000:0.0:1746155644.309878:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3635, 88 off306800 00000004:00080000:0.0:1746155644.309885:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773459381322ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155644.309941:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3634, 88 off306976 00000004:00080000:0.0:1746155644.309945:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773459441856ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155644.309957:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3635, 88 off307064 00000004:00080000:0.0:1746155644.309960:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773459456741ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155644.309967:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3636, 88 off306888 00000004:00080000:0.0:1746155644.309969:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773459466614ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155644.309975:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3637, 88 off306976 00000004:00080000:0.0:1746155644.309978:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773459474909ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155644.310002:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3636, 88 off307152 00000004:00080000:0.0:1746155644.310005:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773459502176ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155644.310014:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3637, 88 off307240 00000004:00080000:0.0:1746155644.310017:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773459514306ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155644.310025:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3638, 88 off307328 00000004:00080000:0.0:1746155644.310028:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773459525031ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155644.310036:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3638, 88 off307064 00000004:00080000:0.0:1746155644.310039:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773459536074ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155644.310172:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3639, 88 off307416 00000004:00080000:0.0:1746155644.310177:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773459673892ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155644.310202:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3639, 88 off307152 00000004:00080000:0.0:1746155644.310205:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773459702432ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155644.310807:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3640, 88 off307504 00000004:00080000:0.0:1746155644.310811:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773460308437ns, next at 716011101328ns, rc = 0 00000040:00080000:0.0:1746155644.310822:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3640, 88 off307240 00000004:00080000:0.0:1746155644.310824:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773460321092ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155644.310830:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3641, 88 off307328 00000004:00080000:0.0:1746155644.310832:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773460329169ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155644.310838:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3642, 88 off307416 00000004:00080000:0.0:1746155644.310840:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773460336844ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155644.310845:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3643, 88 off307504 00000004:00080000:0.0:1746155644.310847:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773460344267ns, next at 716024381471ns, rc = 0 00000040:00080000:0.0:1746155644.310854:0:16336:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3641, 88 off307592 00000004:00080000:0.0:1746155644.310856:0:16336:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773460352775ns, next at 716011101328ns, rc = 0 00000001:00080000:0.0:1746155644.327771:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945339 is committed 00000004:00080000:0.0:1746155644.327796:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2825 committed 00000004:00080000:0.0:1746155644.327801:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2821 committed 00000004:00080000:0.0:1746155644.327841:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2820 committed 00000004:00080000:0.0:1746155644.327843:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2819 committed 00000004:00080000:0.0:1746155644.327844:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2818 committed 00000004:00080000:0.0:1746155644.327846:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2824 committed 00000004:00080000:0.0:1746155644.327847:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2817 committed 00000004:00080000:0.0:1746155644.327849:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2823 committed 00000004:00080000:0.0:1746155644.327927:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2816 committed 00000004:00080000:0.0:1746155644.327930:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2822 committed 00000004:00080000:0.0:1746155644.327931:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2821 committed 00000004:00080000:0.0:1746155644.327933:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2820 committed 00000004:00080000:0.0:1746155644.327934:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2815 committed 00000004:00080000:0.0:1746155644.327936:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2814 committed 00000004:00080000:0.0:1746155644.327937:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2819 committed 00000004:00080000:0.0:1746155644.327938:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2818 committed 00000004:00080000:0.0:1746155644.327939:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2813 committed 00000004:00010000:0.0:1746155644.327972:0:16336:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b24f800 reply state ffff88012fe8a400 transno 8589945339 ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16336 initiator: MDT0 00000100:00100000:0.0:1746155644.327981:0:16336:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746155644.327987:0:16336:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155644.327989:0:16336:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155644.327996:0:16336:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131004200/0x844e5faceb5f83ed lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18615 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746155644.328069:0:16336:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746155644.328078:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32427:x1830976126067712:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 22297us (23776us total) trans 8589945339 rc 0/0 00000100:00100000:0.0:1746155644.328085:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4750 00000100:00100000:3.0:1746155644.328195:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125408512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.328195:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125408896:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155644.328245:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125408640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.328295:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155644.328310:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.328318:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125409280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.328321:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125409024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.328332:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155644.328338:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125408896 00000100:00100000:1.0:1746155644.328342:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125409408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.328343:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125408896 00000100:00100000:1.0:1746155644.328353:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.328363:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009feda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125409920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.328367:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125408512 00000100:00100000:3.0:1746155644.328368:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125408512 00000100:00100000:1.0:1746155644.328373:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.328382:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125410432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.328393:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746155644.328540:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16336 initiator: MDT0 00010000:00010000:0.0:1746155644.328547:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16336 initiator: MDT0 00010000:00010000:0.0:1746155644.328552:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16336 initiator: MDT0 00010000:00010000:0.0:1746155644.328557:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009470ce00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155644.328560:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16336 initiator: MDT0 00010000:00010000:0.0:1746155644.328565:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16336 initiator: MDT0 00010000:00010000:0.0:1746155644.328574:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155644.328576:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155644.328579:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16336 initiator: MDT0 00010000:00010000:0.0:1746155644.328583:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009470ce00/0x844e5faceb5f84aa lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16336 initiator: MDT0 00000100:00100000:3.0:1746155644.328714:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125409280 00000100:00100000:3.0:1746155644.328717:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125409280 00000100:00100000:1.0:1746155644.328725:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1746155644.328729:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125409408 00000100:00100000:1.0:1746155644.328730:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125408768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.328731:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125409408 00000100:00100000:3.0:1746155644.328740:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125409920 00000100:00100000:3.0:1746155644.328741:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125409920 00000100:00100000:1.0:1746155644.328746:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155644.328749:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125410432 00000100:00100000:3.0:1746155644.328750:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125410432 00000100:00100000:1.0:1746155644.328754:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125409536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.328756:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125408768 00000100:00100000:3.0:1746155644.328757:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125408768 00000100:00100000:3.0:1746155644.328764:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17232 00000100:00100000:1.0:1746155644.328765:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155644.328769:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+25:3297:x1830976125408896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.328771:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125410048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.328782:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.328797:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125409536 00000100:00100000:1.0:1746155644.328798:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125409536 00000100:00100000:1.0:1746155644.328808:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125410048 00000100:00100000:1.0:1746155644.328809:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125410048 00000100:00100000:1.0:1746155644.328816:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17233 00000100:00100000:1.0:1746155644.328820:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3295:x1830976125408512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155644.328912:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155644.328912:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155644.328915:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155644.328915:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.328917:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155644.328917:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.328919:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155644.328919:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.328921:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:1.0:1746155644.328921:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:1.0:1746155644.328939:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3295:x1830976125408512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (627us total) trans 21474841643 rc 0/0 00000100:00100000:3.0:1746155644.328940:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+26:3297:x1830976125408896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (645us total) trans 17179874327 rc 0/0 00000100:00100000:3.0:1746155644.328945:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17232 00000100:00100000:1.0:1746155644.328947:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17233 00000100:00100000:1.0:1746155644.328955:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17234 00000100:00100000:1.0:1746155644.328959:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3297:x1830976125409280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.329031:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+26:3297:x1830976125409280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (697us total) trans 17179874328 rc 0/0 00000100:00100000:3.0:1746155644.329454:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17235 00000100:00100000:3.0:1746155644.329588:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+34:3297:x1830976125409408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155644.329635:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17236 00000100:00100000:2.0:1746155644.329641:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+26:3297:x1830976125409920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155644.329716:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3297:x1830976125409920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (1342us total) trans 17179874329 rc 0/0 00000100:00100000:2.0:1746155644.329721:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17236 00000100:00100000:2.0:1746155644.329730:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17237 00000100:00100000:2.0:1746155644.329733:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3297:x1830976125410432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155644.329791:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746155644.329793:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.329795:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.329797:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.329798:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155644.329834:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17238 00000100:00100000:1.0:1746155644.329838:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17234 00000100:00100000:0.0:1746155644.329839:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976125408768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.329848:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17239 00000100:00100000:1.0:1746155644.329851:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976125409536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155644.329912:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17240 00000100:00100000:0.0:1746155644.329917:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3297:x1830976125410048:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.329995:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+38:3297:x1830976125409408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 409us (1640us total) trans 21474841644 rc 0/0 00000100:00100000:1.0:1746155644.329996:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3297:x1830976125409536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 144us (1230us total) trans 21474841645 rc 0/0 00000100:00100000:3.0:1746155644.330000:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17235 00000100:00100000:1.0:1746155644.330002:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17239 00000100:00100000:3.0:1746155644.330021:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746155644.330035:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f881180/2, rc 0, transno 21474841645 00000100:00100000:3.0:1746155644.330037:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125409664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.330039:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125409536:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155644.330047:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0d9c00/2, rc 0, transno 17179874327 00000100:00100000:3.0:1746155644.330052:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.330053:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125408896:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155644.330059:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feda300/2, rc 0, transno 17179874328 00000100:00100000:3.0:1746155644.330060:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125410176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.330061:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125409280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155644.330067:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f883480/2, rc 0, transno 21474841644 00000100:00100000:1.0:1746155644.330069:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125409408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.330072:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746155644.330075:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009feda680/2, rc 0, transno 17179874329 00000100:00100000:1.0:1746155644.330077:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009feda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125409920:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155644.330086:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f881c00/2, rc 0, transno 21474841643 00000100:00100000:1.0:1746155644.330087:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125409024 00000100:00100000:3.0:1746155644.330089:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125408512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.330089:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125409024 00000100:00100000:3.0:1746155644.330098:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125409664 00000100:00100000:3.0:1746155644.330100:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125409664 00000100:00100000:1.0:1746155644.330102:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125410176 00000100:00100000:1.0:1746155644.330103:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125410176 00000100:00100000:3.0:1746155644.330110:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17241 00000100:00100000:1.0:1746155644.330113:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17242 00000100:00100000:3.0:1746155644.330114:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3295:x1830976125409024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.330116:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3295:x1830976125409664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.330134:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17243 00000100:00100000:3.0:1746155644.330138:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3295:x1830976125410176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.330194:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3295:x1830976125409664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (140us total) trans 17179874330 rc 0/0 00000100:00100000:1.0:1746155644.330198:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17242 00000100:00100000:3.0:1746155644.330202:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3295:x1830976125410176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (129us total) trans 17179874331 rc 0/0 00000100:00100000:3.0:1746155644.330206:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17243 00000004:00080000:1.0:1746155644.330214:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fed8700/2, rc 0, transno 17179874330 00000100:00100000:1.0:1746155644.330218:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125409664:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155644.330223:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac4380/2, rc 0, transno 17179874331 00000100:00100000:1.0:1746155644.330225:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125410176:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155644.330262:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:3.0:1746155644.330264:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.330266:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.330267:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.330269:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:3.0:1746155644.330285:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3295:x1830976125409024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (263us total) trans 17179874332 rc 0/0 00000100:00100000:3.0:1746155644.330289:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17241 00000004:00080000:1.0:1746155644.330289:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0d9500/2, rc 0, transno 17179874332 00000100:00100000:1.0:1746155644.330292:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125409024:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.330319:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125410560:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.330334:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155644.330359:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3297:x1830976125410048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 442us (1576us total) trans 21474841647 rc 0/0 00000004:00080000:1.0:1746155644.330361:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f880700/2, rc 0, transno 21474841647 00000100:00100000:1.0:1746155644.330363:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125410048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155644.330364:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17240 00000100:00100000:0.0:1746155644.330371:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125410560 00000100:00100000:0.0:1746155644.330373:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125410560 00000100:00100000:0.0:1746155644.330383:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17244 00000100:00100000:0.0:1746155644.330387:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3298:x1830976125410560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155644.330450:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3298:x1830976125410560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (114us total) trans 17179874333 rc 0/0 00000004:00080000:1.0:1746155644.330454:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fac6d80/2, rc 0, transno 17179874333 00000100:00100000:0.0:1746155644.330455:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17244 00000100:00100000:1.0:1746155644.330457:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125410560:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155644.330548:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155644.330551:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155644.330553:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155644.330554:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155644.330556:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155644.330576:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976125408768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 738us (1829us total) trans 21474841646 rc 0/0 00000100:00100000:1.0:1746155644.330582:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17238 00000004:00080000:1.0:1746155644.330602:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f880380/2, rc 0, transno 21474841646 00000100:00100000:1.0:1746155644.330605:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125408768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155644.330703:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3297:x1830976125410432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 968us (2308us total) trans 21474841648 rc 0/0 00000100:00100000:2.0:1746155644.330708:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17237 00000004:00080000:1.0:1746155644.330715:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f883800/2, rc 0, transno 21474841648 00000100:00100000:1.0:1746155644.330718:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125410432:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155644.330722:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155644.330734:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fedbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125409152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155644.330746:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155644.330753:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125409792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.330757:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125408640 00000100:00100000:1.0:1746155644.330759:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125408640 00000100:00100000:2.0:1746155644.330766:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.330770:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125409152 00000100:00100000:1.0:1746155644.330771:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125409152 00000100:00100000:2.0:1746155644.330775:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125410304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.330779:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125409792 00000100:00100000:1.0:1746155644.330780:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125409792 00000100:00100000:2.0:1746155644.330788:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.330789:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17245 00000100:00100000:1.0:1746155644.330793:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976125408640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155644.330803:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125410304 00000100:00100000:2.0:1746155644.330805:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125410304 00000100:00100000:2.0:1746155644.330817:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17246 00000100:00100000:2.0:1746155644.330821:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976125409152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155644.330856:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155644.330858:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155644.330860:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155644.330861:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155644.330863:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:2.0:1746155644.330882:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3296:x1830976125409152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (134us total) trans 17179874335 rc 0/0 00000100:00100000:1.0:1746155644.330882:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3296:x1830976125408640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (159us total) trans 17179874334 rc 0/0 00000100:00100000:2.0:1746155644.330886:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17246 00000100:00100000:1.0:1746155644.330888:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17245 00000100:00100000:1.0:1746155644.330907:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17247 00000100:00100000:1.0:1746155644.330911:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3296:x1830976125409792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155644.330915:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17248 00000100:00100000:2.0:1746155644.330918:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3296:x1830976125410304:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155644.330944:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0dbb80/2, rc 0, transno 17179874334 00000100:00100000:2.0:1746155644.330947:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125408640:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155644.330953:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fedbb80/2, rc 0, transno 17179874335 00000100:00100000:2.0:1746155644.330955:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fedbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125409152:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155644.330979:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:1.0:1746155644.330981:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155644.330983:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746155644.330985:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155644.330986:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746155644.331006:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3296:x1830976125409792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (238us total) trans 21474841649 rc 0/0 00000100:00100000:2.0:1746155644.331007:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3296:x1830976125410304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (218us total) trans 21474841650 rc 0/0 00000100:00100000:1.0:1746155644.331011:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17247 00000100:00100000:2.0:1746155644.331012:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17248 00000004:00080000:2.0:1746155644.331027:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f880a80/2, rc 0, transno 21474841649 00000100:00100000:2.0:1746155644.331029:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125409792:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155644.331035:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f880000/2, rc 0, transno 21474841650 00000100:00100000:2.0:1746155644.331037:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125410304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155644.331088:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.331236:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126067968 00000100:00100000:2.0:1746155644.331240:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126067968 00000100:00100000:2.0:1746155644.331298:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11175 00000100:00100000:2.0:1746155644.331301:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32427:x1830976126067968:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155644.331312:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.331323:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57c00/0x844e5faceb5f84b1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18654 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.331356:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57c00/0x844e5faceb5f84b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18654 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.331364:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57c00/0x844e5faceb5f84b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18654 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.331374:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.331376:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155644.331377:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a57c00, rc 0) 00000100:00100000:2.0:1746155644.331554:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b24fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32427:x1830976126067968:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 251us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.331559:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11175 00000100:00100000:0.0:1746155644.333696:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.333901:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126068224 00000100:00100000:2.0:1746155644.333908:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126068224 00000100:00100000:2.0:1746155644.333946:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4751 00000100:00100000:2.0:1746155644.333953:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32427:x1830976126068224:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:2.0:1746155644.334372:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32427:x1830976126068224:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 418us (679us total) trans 8589945340 rc 0/0 00000100:00100000:2.0:1746155644.334379:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4751 00000100:00100000:0.0:1746155644.349224:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.349392:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126068480 00000100:00100000:2.0:1746155644.349400:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126068480 00000100:00100000:2.0:1746155644.349450:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11176 00000100:00100000:2.0:1746155644.349457:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32434:x1830976126068480:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155644.349478:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.349494:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x844e5faceb5f84b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1865b expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.349610:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081e00/0x844e5faceb5f84bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155644.349947:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.350012:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126068736 00000100:00100000:3.0:1746155644.350017:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126068736 00010000:00010000:2.0:1746155644.350024:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081e00/0x844e5faceb5f84bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.350035:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081e00/0x844e5faceb5f84bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155644.350053:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11177 00000100:00100000:3.0:1746155644.350059:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32436:x1830976126068736:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155644.350069:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.350077:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8200/0x844e5faceb5f84c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18662 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.350125:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9800/0x844e5faceb5f84cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.350133:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9800/0x844e5faceb5f84cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.350140:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9800/0x844e5faceb5f84cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.350141:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080e00/0x844e5faceb5f84d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.350147:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9200/0x844e5faceb5f84db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.350148:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080e00/0x844e5faceb5f84d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.350154:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080e00/0x844e5faceb5f84d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.350155:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9200/0x844e5faceb5f84db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.350160:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9200/0x844e5faceb5f84db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.350249:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081600/0x844e5faceb5f84e2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.350250:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9600/0x844e5faceb5f84e9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.350256:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081600/0x844e5faceb5f84e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.350262:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081600/0x844e5faceb5f84e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.350265:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9600/0x844e5faceb5f84e9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.350271:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9600/0x844e5faceb5f84e9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155644.350272:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155644.350276:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155644.350340:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081e00/0x844e5faceb5f84bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.350346:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081e00/0x844e5faceb5f84bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.350351:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9800/0x844e5faceb5f84cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.350351:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081e00/0x844e5faceb5f84bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.350356:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9800/0x844e5faceb5f84cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.350361:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9800/0x844e5faceb5f84cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.350364:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f081e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155644.350368:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4d9800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.350368:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081e00/0x844e5faceb5f84bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.350371:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9800/0x844e5faceb5f84cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.350373:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081e00/0x844e5faceb5f84bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.350375:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9800/0x844e5faceb5f84cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.350384:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155644.350386:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155644.350389:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081e00/0x844e5faceb5f84bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.350392:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155644.350393:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081e00/0x844e5faceb5f84bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.350394:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155644.350396:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9800/0x844e5faceb5f84cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.350401:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9800/0x844e5faceb5f84cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.350402:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080e00/0x844e5faceb5f84d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.350406:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080e00/0x844e5faceb5f84d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.350410:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080e00/0x844e5faceb5f84d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.350417:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f080e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.350419:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080e00/0x844e5faceb5f84d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.350423:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9200/0x844e5faceb5f84db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.350427:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9200/0x844e5faceb5f84db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.350431:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9200/0x844e5faceb5f84db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.350434:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080e00/0x844e5faceb5f84d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.350435:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f4d9200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155644.350437:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9200/0x844e5faceb5f84db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.350440:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ae84800) 00010000:00010000:2.0:1746155644.350441:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155644.350443:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9200/0x844e5faceb5f84db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.350444:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080e00/0x844e5faceb5f84d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.350448:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080e00/0x844e5faceb5f84d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.350450:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ae84800) 00010000:00010000:3.0:1746155644.350452:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155644.350454:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9200/0x844e5faceb5f84db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.350458:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9200/0x844e5faceb5f84db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.350475:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f080c00/0x844e5faceb5f84b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1865b expref: 289 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.350482:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8200/0x844e5faceb5f84c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18662 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.350485:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081600/0x844e5faceb5f84e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1865b expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.350490:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.350491:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9600/0x844e5faceb5f84e9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18662 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.350492:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155644.350494:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f081600, rc 0) 00010000:00010000:3.0:1746155644.350496:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.350498:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155644.350499:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d9600, rc 0) 00000100:00100000:2.0:1746155644.350625:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32434:x1830976126068480:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1168us (1407us total) trans 8589945341 rc 0/0 00000100:00100000:3.0:1746155644.350628:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32436:x1830976126068736:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 569us (681us total) trans 8589945342 rc 0/0 00000100:00100000:2.0:1746155644.350631:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11176 00000100:00100000:3.0:1746155644.350634:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11177 00000100:00100000:0.0:1746155644.354128:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.354173:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126068992 00000100:00100000:3.0:1746155644.354181:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126068992 00000100:00100000:0.0:1746155644.354205:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.354225:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11178 00000100:00100000:3.0:1746155644.354232:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32436:x1830976126068992:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155644.354299:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.354302:0:14234:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746155644.354322:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9600/0x844e5faceb5f84e9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18662 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.354336:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.354340:0:14234:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155644.354348:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9a00/0x844e5faceb5f84fe lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18669 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.354385:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.354395:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57c00/0x844e5faceb5f84b1 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18654 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.354402:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081600/0x844e5faceb5f84e2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1865b expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.354408:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.354554:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081600/0x844e5faceb5f84e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1865b expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.354564:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081600/0x844e5faceb5f84e2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1865b expref: 287 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.354598:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126069120 00000100:00100000:2.0:1746155644.354601:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126069120 00000100:00100000:2.0:1746155644.354622:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17249 00000100:00100000:0.0:1746155644.354626:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.354627:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32438:x1830976126069120:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155644.354635:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.354644:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f080a00/0x844e5faceb5f850c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18670 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.354724:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125410688:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.354800:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57c00/0x844e5faceb5f84b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18654 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.354808:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57c00/0x844e5faceb5f84b1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18654 expref: 7 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.354831:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.354833:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.354838:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f080a00/0x844e5faceb5f850c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18670 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.354849:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f080a00/0x844e5faceb5f850c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18670 expref: 26 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.354857:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f080a00, rc 0) 00000100:00100000:2.0:1746155644.354875:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:32438:x1830976126069120:12345-192.168.202.51@tcp:101:cat.0 Request processed in 247us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.354880:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17249 00000100:00100000:2.0:1746155644.354908:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126069376 00000100:00100000:2.0:1746155644.354910:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126069376 00000100:00100000:2.0:1746155644.354932:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11179 00000100:00100000:2.0:1746155644.354937:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32439:x1830976126069376:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155644.354943:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.354949:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f8513 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18677 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.355153:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125410816:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.355183:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746155644.355302:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f851a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355314:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f851a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355322:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f851a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355331:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c200/0x844e5faceb5f8521 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355337:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c200/0x844e5faceb5f8521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355341:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c200/0x844e5faceb5f8521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355412:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d400/0x844e5faceb5f8528 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355417:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d400/0x844e5faceb5f8528 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355422:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d400/0x844e5faceb5f8528 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155644.355428:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155644.355483:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d400/0x844e5faceb5f8528 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355489:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d400/0x844e5faceb5f8528 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355494:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d400/0x844e5faceb5f8528 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355528:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd4d400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.355531:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d400/0x844e5faceb5f8528 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355536:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d400/0x844e5faceb5f8528 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355542:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.355544:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1746155644.355547:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d400/0x844e5faceb5f8528 lrc: 2/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355551:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4d400/0x844e5faceb5f8528 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x11/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355560:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f851a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355564:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f851a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355568:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f851a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355571:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd4dc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.355572:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f851a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355576:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f851a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355581:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155644.355582:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155644.355584:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f851a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355587:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4dc00/0x844e5faceb5f851a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355592:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c200/0x844e5faceb5f8521 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355606:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c200/0x844e5faceb5f8521 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355611:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c200/0x844e5faceb5f8521 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355614:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fd4c200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.355616:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c200/0x844e5faceb5f8521 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355620:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c200/0x844e5faceb5f8521 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355624:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ae84c00) 00010000:00010000:2.0:1746155644.355626:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155644.355627:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c200/0x844e5faceb5f8521 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355631:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c200/0x844e5faceb5f8521 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.355655:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f8513 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18677 expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.355660:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7cc00/0x844e5faceb5f8513 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18677 expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.355667:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff7cc00, rc 0) 00000100:00100000:2.0:1746155644.355696:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32439:x1830976126069376:12345-192.168.202.51@tcp:101:cat.0 Request processed in 758us (1070us total) trans 8589945343 rc 301/301 00000100:00100000:2.0:1746155644.355700:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11179 00000100:00100000:0.0:1746155644.356977:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.357039:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126069504 00000100:00100000:2.0:1746155644.357044:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126069504 00000100:00100000:2.0:1746155644.357170:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11180 00000100:00100000:2.0:1746155644.357179:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32439:x1830976126069504:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155644.357190:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.357201:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c000/0x844e5faceb5f8536 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1867e expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.357209:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125410688:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.357217:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125410816:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.357237:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.357248:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.357257:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.357262:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.357273:0:20364:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.357279:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155644.358344:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.358412:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.358624:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126069632 00000100:00100000:2.0:1746155644.358628:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126069632 00000100:00100000:3.0:1746155644.358641:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126069760 00000100:00100000:3.0:1746155644.358646:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126069760 00010000:00010000:2.0:1746155644.358647:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57c00/0x844e5faceb5f84b1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18654 expref: 8 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.358667:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081600/0x844e5faceb5f84e2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1865b expref: 288 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.358667:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8841 00000100:00100000:2.0:1746155644.358673:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126069632:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.358681:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.358685:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57c00/0x844e5faceb5f84b1 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18654 expref: 8 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.358692:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8842 00010000:00010000:2.0:1746155644.358694:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57c00/0x844e5faceb5f84b1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18654 expref: 8 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.358699:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1961:x1830976126069760:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.358707:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.358708:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57c00/0x844e5faceb5f84b1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18654 expref: 8 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.358712:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081600/0x844e5faceb5f84e2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1865b expref: 288 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.358721:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081600/0x844e5faceb5f84e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1865b expref: 288 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.358727:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.358731:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.358736:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.358741:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.358745:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.358750:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155644.358790:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126069632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 117us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.358799:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8841 00010000:00010000:3.0:1746155644.359280:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f081600/0x844e5faceb5f84e2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1865b expref: 288 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.359288:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.359291:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.359294:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.359300:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.359304:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.359307:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.359309:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.359325:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155644.359352:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155644.359358:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00000100:00100000:3.0:1746155644.359372:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1961:x1830976126069760:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 674us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.359378:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8842 00000100:00100000:0.0:1746155644.359432:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000040:00080000:2.0:1746155644.359886:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3644, 88 off307592 00000004:00080000:2.0:1746155644.359905:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773509388564ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155644.359956:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3642, 88 off307680 00000004:00080000:2.0:1746155644.359959:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773509456209ns, next at 716011101328ns, rc = 0 00000100:00100000:1.0:1746155644.359959:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126070016 00000100:00100000:1.0:1746155644.359965:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126070016 00000040:00080000:2.0:1746155644.359982:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3643, 88 off307768 00000004:00080000:2.0:1746155644.359984:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773509481460ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155644.359992:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3645, 88 off307680 00000004:00080000:2.0:1746155644.359996:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773509492645ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155644.360002:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3646, 88 off307768 00000004:00080000:2.0:1746155644.360004:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773509501207ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155644.360011:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3644, 88 off307856 00000004:00080000:2.0:1746155644.360013:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773509510255ns, next at 716011101328ns, rc = 0 00002000:00100000:1.0:1746155644.360074:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009ca94700 x1830976126070016/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.360082:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94700 with x1830976126070016 ext(0->1048575) 00002000:00010000:1.0:1746155644.360087:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca94700 00000100:00100000:1.0:1746155644.360106:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8172 00000100:00100000:1.0:1746155644.360114:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976126070016:12345-192.168.202.51@tcp:3:cat.0 00000040:00080000:2.0:1746155644.360954:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3645, 88 off307944 00000004:00080000:2.0:1746155644.360959:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773510456050ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155644.360974:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3646, 88 off308032 00000004:00080000:2.0:1746155644.360976:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773510473383ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155644.360986:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3647, 88 off307856 00000004:00080000:2.0:1746155644.360988:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773510484993ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155644.361108:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3647, 88 off308120 00000004:00080000:2.0:1746155644.361112:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773510609230ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155644.361122:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3648, 88 off307944 00000004:00080000:2.0:1746155644.361125:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773510621753ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155644.361131:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3648, 88 off308208 00000004:00080000:2.0:1746155644.361133:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773510629925ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155644.361139:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3649, 88 off308032 00000004:00080000:2.0:1746155644.361141:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773510637831ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155644.361146:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3650, 88 off308120 00000004:00080000:2.0:1746155644.361148:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773510645597ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155644.361154:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3651, 88 off308208 00000004:00080000:2.0:1746155644.361156:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773510652886ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155644.361161:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3652, 88 off308296 00000004:00080000:2.0:1746155644.361163:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 773510660406ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155644.361169:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3649, 88 off308296 00000004:00080000:2.0:1746155644.361171:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773510668166ns, next at 716011101328ns, rc = 0 00000100:00100000:0.0:1746155644.375087:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976126070016:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14968us (15651us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155644.375097:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8172 00002000:00100000:0.0:1746155644.375107:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009ca94700 x1830976126070016/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155644.375115:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94700 with x1830976126070016 ext(0->1048575) 00002000:00010000:0.0:1746155644.375119:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca94700 00000001:00080000:1.0:1746155644.376461:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945344 is committed 00000004:00080000:1.0:1746155644.376466:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2833 committed 00000004:00080000:1.0:1746155644.376471:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2830 committed 00000004:00080000:1.0:1746155644.376475:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2829 committed 00000004:00080000:1.0:1746155644.376476:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2828 committed 00000004:00080000:1.0:1746155644.376478:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2827 committed 00000004:00080000:1.0:1746155644.376479:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2832 committed 00000004:00080000:1.0:1746155644.376481:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2826 committed 00000004:00080000:1.0:1746155644.376482:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2831 committed 00000004:00080000:1.0:1746155644.376483:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2825 committed 00000004:00080000:1.0:1746155644.376485:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2830 committed 00000004:00080000:1.0:1746155644.376486:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2829 committed 00000004:00080000:1.0:1746155644.376487:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2828 committed 00000004:00080000:1.0:1746155644.376489:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2824 committed 00000004:00080000:1.0:1746155644.376490:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2823 committed 00000004:00080000:1.0:1746155644.376492:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2827 committed 00000004:00080000:1.0:1746155644.376494:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2826 committed 00000004:00080000:1.0:1746155644.376496:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2822 committed 00000001:00080000:1.0:1746155644.376520:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945341 is committed 00000001:00080000:1.0:1746155644.376523:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945340 is committed 00010000:00010000:3.0:1746155644.376531:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18669 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.376543:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.376545:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746155644.376548:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.376555:0:14234:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.376559:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.376587:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9a00/0x844e5faceb5f84fe lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18669 expref: 10 pid: 14234 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746155644.376604:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18669 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.376630:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fbca400, rc 0) 00000100:00100000:3.0:1746155644.376662:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32436:x1830976126068992:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 22430us (22539us total) trans 8589945344 rc 0/0 00000100:00100000:3.0:1746155644.376669:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11178 00010000:00010000:2.0:1746155644.376688:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.376695:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155644.376727:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155644.376731:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:1.0:1746155644.376771:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125410944:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.376813:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.376831:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125411456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.376842:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.376851:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125411968:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.376861:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.376872:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125412480:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.376874:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125410944 00000100:00100000:0.0:1746155644.376876:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125411456 00000100:00100000:3.0:1746155644.376879:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125410944 00000100:00100000:0.0:1746155644.376879:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125411456 00000100:00100000:1.0:1746155644.376883:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.376902:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1746155644.376907:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125411072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155644.376911:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125411968 00000100:00100000:0.0:1746155644.376914:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125411968 00000100:00100000:3.0:1746155644.376921:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125412480 00000004:00010000:2.0:1746155644.376922:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155644.376924:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125412480 00000100:00100000:0.0:1746155644.376927:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17250 00000100:00100000:0.0:1746155644.376932:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+33:3295:x1830976125411456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.376938:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17251 00000100:00100000:3.0:1746155644.376943:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3295:x1830976125410944:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1746155644.376944:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c000/0x844e5faceb5f8536 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1867e expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.376954:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1867e expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.376963:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.376965:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746155644.376967:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd4c400, rc 0) 00000100:00100000:2.0:1746155644.376987:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32439:x1830976126069504:12345-192.168.202.51@tcp:101:cat.0 Request processed in 19810us (20012us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.376988:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17252 00000100:00100000:2.0:1746155644.376992:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11180 00000100:00100000:3.0:1746155644.376993:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3295:x1830976125411968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155644.377011:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17253 00000100:00100000:2.0:1746155644.377016:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+38:3295:x1830976125412480:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155644.377068:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3295:x1830976125411456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (224us total) trans 17179874336 rc 0/0 00000100:00100000:0.0:1746155644.377073:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17250 00000100:00100000:1.0:1746155644.377101:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.377112:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125411584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155644.377113:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125411072 00000100:00100000:0.0:1746155644.377115:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125411072 00000100:00100000:1.0:1746155644.377124:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746155644.377259:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:2.0:1746155644.377262:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:2.0:1746155644.377264:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155644.377266:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:2.0:1746155644.377267:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00002000:00010000:3.0:1746155644.377285:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:2.0:1746155644.377286:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+39:3295:x1830976125412480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 270us (401us total) trans 21474841651 rc 0/0 00002000:00010000:3.0:1746155644.377288:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.377290:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.377291:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00000100:00100000:2.0:1746155644.377292:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17253 00002000:00010000:3.0:1746155644.377293:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:3.0:1746155644.377313:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3295:x1830976125410944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 370us (502us total) trans 17179874337 rc 0/0 00000100:00100000:3.0:1746155644.377318:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17251 00000100:00100000:1.0:1746155644.377322:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125412096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.377337:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155644.377337:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125411584 00000100:00100000:0.0:1746155644.377339:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125411584 00000100:00100000:1.0:1746155644.377348:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125412608:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155644.377354:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125412096 00000100:00100000:0.0:1746155644.377356:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125412096 00000100:00100000:1.0:1746155644.377359:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746155644.377432:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc5180/2, rc 0, transno 21474841651 00000100:00100000:1.0:1746155644.377435:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125412480:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155644.377444:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f581180/2, rc 0, transno 17179874337 00000100:00100000:1.0:1746155644.377448:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125410944:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155644.377453:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1f2300/2, rc 0, transno 17179874336 00000100:00100000:1.0:1746155644.377455:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125411456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.377465:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125411200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155644.377484:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125412608 00000100:00100000:0.0:1746155644.377486:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125412608 00000100:00100000:2.0:1746155644.377488:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17254 00000100:00100000:3.0:1746155644.377493:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17255 00000100:00100000:2.0:1746155644.377493:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+35:3295:x1830976125411072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.377498:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3295:x1830976125411584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155644.377498:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17256 00000100:00100000:0.0:1746155644.377519:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976125412096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155644.377573:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155644.377575:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155644.377576:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:2.0:1746155644.377577:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:0.0:1746155644.377577:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:2.0:1746155644.377579:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:0.0:1746155644.377579:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:2.0:1746155644.377581:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:0.0:1746155644.377581:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:0.0:1746155644.377582:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155644.377623:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.377633:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125411712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.377635:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3295:x1830976125411584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 137us (510us total) trans 17179874339 rc 0/0 00000100:00100000:0.0:1746155644.377635:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3295:x1830976125412096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (297us total) trans 21474841652 rc 0/0 00000100:00100000:0.0:1746155644.377640:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17256 00000100:00100000:3.0:1746155644.377642:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17255 00000100:00100000:1.0:1746155644.377646:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155644.377648:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125411200 00000100:00100000:3.0:1746155644.377651:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125411712 00000100:00100000:0.0:1746155644.377651:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125411200 00000100:00100000:3.0:1746155644.377653:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125411712 00000100:00100000:1.0:1746155644.377653:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125412224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155644.377660:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17257 00000100:00100000:1.0:1746155644.377664:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155644.377664:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976125412608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.377665:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17258 00000100:00100000:3.0:1746155644.377669:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+38:3297:x1830976125411200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.377670:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125412736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.377680:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.377687:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746155644.377691:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125411328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.377702:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.377709:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125411840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.377720:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155644.377726:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125412352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155644.377730:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3295:x1830976125412608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (369us total) trans 21474841653 rc 0/0 00002000:00010000:3.0:1746155644.377733:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00000100:00100000:0.0:1746155644.377734:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17257 00002000:00010000:3.0:1746155644.377735:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00000100:00100000:1.0:1746155644.377736:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746155644.377737:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.377739:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.377740:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:1.0:1746155644.377742:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125412864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155644.377742:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125412224 00000100:00100000:0.0:1746155644.377744:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125412224 00000100:00100000:0.0:1746155644.377750:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125412736 00000100:00100000:0.0:1746155644.377752:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125412736 00000100:00100000:1.0:1746155644.377755:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155644.377757:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125411328 00000100:00100000:0.0:1746155644.377758:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125411328 00000100:00100000:3.0:1746155644.377759:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+39:3297:x1830976125411200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (135us total) trans 17179874340 rc 0/0 00000100:00100000:3.0:1746155644.377764:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17258 00000100:00100000:0.0:1746155644.377764:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125411840 00000100:00100000:0.0:1746155644.377765:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125411840 00000004:00080000:1.0:1746155644.377767:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f580000/2, rc 0, transno 17179874340 00000100:00100000:1.0:1746155644.377770:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125411200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155644.377771:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125412352 00000100:00100000:0.0:1746155644.377772:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125412352 00000100:00100000:3.0:1746155644.377773:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125412864 00000100:00100000:3.0:1746155644.377776:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125412864 00000100:00100000:0.0:1746155644.377779:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17259 00000100:00100000:0.0:1746155644.377782:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3297:x1830976125411712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.377787:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17260 00000100:00100000:3.0:1746155644.377790:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3297:x1830976125412224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.377797:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17261 00000100:00100000:1.0:1746155644.377802:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3297:x1830976125412736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155644.377854:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746155644.377856:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00000100:00100000:0.0:1746155644.377856:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3297:x1830976125411712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 73us (208us total) trans 17179874341 rc 0/0 00002000:00010000:3.0:1746155644.377858:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00000100:00100000:0.0:1746155644.377861:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17259 00002000:00010000:3.0:1746155644.377864:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.377866:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155644.377870:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17262 00000100:00100000:1.0:1746155644.377871:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3297:x1830976125412736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (190us total) trans 21474841655 rc 0/0 00000100:00100000:0.0:1746155644.377874:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3297:x1830976125411328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155644.377876:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17261 00000100:00100000:1.0:1746155644.377884:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17263 00000100:00100000:3.0:1746155644.377885:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3297:x1830976125412224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (220us total) trans 21474841654 rc 0/0 00000100:00100000:1.0:1746155644.377887:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3297:x1830976125411840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.377903:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17260 00000100:00100000:3.0:1746155644.377913:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17264 00000100:00100000:3.0:1746155644.377917:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3297:x1830976125412352:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155644.377954:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3297:x1830976125411840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (232us total) trans 17179874343 rc 0/0 00000100:00100000:0.0:1746155644.377954:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a62a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+42:3297:x1830976125411328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (249us total) trans 17179874342 rc 0/0 00000100:00100000:1.0:1746155644.377958:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17263 00000100:00100000:0.0:1746155644.377960:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17262 00000100:00100000:0.0:1746155644.377967:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17265 00000100:00100000:0.0:1746155644.377971:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3297:x1830976125412864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155644.377991:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3297:x1830976125412352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (253us total) trans 21474841656 rc 0/0 00000100:00100000:3.0:1746155644.377996:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17264 00002000:00010000:3.0:1746155644.378034:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155644.378036:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.378038:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:3.0:1746155644.378039:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00000100:00100000:0.0:1746155644.378039:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+46:3297:x1830976125412864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (282us total) trans 21474841657 rc 0/0 00002000:00010000:3.0:1746155644.378041:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155644.378044:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17265 00000100:00100000:3.0:1746155644.378059:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3295:x1830976125411968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1066us (1196us total) trans 21474841658 rc 0/0 00000100:00100000:3.0:1746155644.378064:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17252 00000100:00100000:2.0:1746155644.378134:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3295:x1830976125411072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 640us (1032us total) trans 17179874338 rc 0/0 00000100:00100000:2.0:1746155644.378139:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17254 00000100:00100000:3.0:1746155644.378307:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746155644.378314:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125412992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155644.378333:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155644.378378:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125412992 00000100:00100000:2.0:1746155644.378381:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125412992 00000100:00100000:2.0:1746155644.378396:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17266 00000100:00100000:2.0:1746155644.378400:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3296:x1830976125412992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155644.378472:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3296:x1830976125412992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (138us total) trans 17179874344 rc 0/0 00000100:00100000:2.0:1746155644.378477:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17266 00000004:00080000:3.0:1746155644.378532:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f4700/2, rc 0, transno 17179874344 00000100:00100000:3.0:1746155644.378536:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125412992:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155644.378663:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1f0e00/2, rc 0, transno 17179874342 00000100:00100000:1.0:1746155644.378666:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125411328:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155644.378672:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f4000/2, rc 0, transno 17179874343 00000100:00100000:1.0:1746155644.378674:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125411840:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155644.378681:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc4a80/2, rc 0, transno 21474841656 00000100:00100000:1.0:1746155644.378683:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125412352:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155644.378688:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc6680/2, rc 0, transno 21474841657 00000100:00100000:1.0:1746155644.378690:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125412864:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155644.378695:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f7100/2, rc 0, transno 17179874341 00000100:00100000:1.0:1746155644.378697:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125411712:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155644.378702:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc6a00/2, rc 0, transno 21474841654 00000100:00100000:1.0:1746155644.378704:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125412224:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155644.378709:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc5c00/2, rc 0, transno 21474841655 00000100:00100000:1.0:1746155644.378712:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125412736:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155644.378723:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f582300/2, rc 0, transno 17179874338 00000100:00100000:1.0:1746155644.378725:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125411072:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155644.378730:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1f2a00/2, rc 0, transno 17179874339 00000100:00100000:1.0:1746155644.378733:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125411584:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155644.378738:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc7100/2, rc 0, transno 21474841652 00000100:00100000:1.0:1746155644.378741:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125412096:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155644.378746:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc7800/2, rc 0, transno 21474841653 00000100:00100000:1.0:1746155644.378748:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125412608:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155644.378754:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc5500/2, rc 0, transno 21474841658 00000100:00100000:1.0:1746155644.378756:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125411968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155644.379974:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.380008:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126070144 00000100:00100000:3.0:1746155644.380012:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126070144 00000100:00100000:3.0:1746155644.380041:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17267 00000100:00100000:3.0:1746155644.380050:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32436:x1830976126070144:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155644.380060:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.380072:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18685 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.380090:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c800/0x844e5faceb5f8441 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1862a expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.380097:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f080a00/0x844e5faceb5f850c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18670 expref: 25 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.380102:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.380104:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.380107:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.380126:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f080a00/0x844e5faceb5f850c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18670 expref: 25 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.380136:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f080a00/0x844e5faceb5f850c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18670 expref: 25 pid: 29728 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.380145:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125413120:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.380210:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c800/0x844e5faceb5f8441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1862a expref: 10 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.380217:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c800/0x844e5faceb5f8441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1862a expref: 10 pid: 20796 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746155644.380226:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125413248:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.380248:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155644.380635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.380672:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126070272 00000100:00100000:2.0:1746155644.380676:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126070272 00000100:00100000:0.0:1746155644.380683:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.380730:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126070400 00000100:00100000:2.0:1746155644.380733:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126070400 00000100:00100000:0.0:1746155644.380736:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17268 00000100:00100000:0.0:1746155644.380741:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126070272:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155644.380746:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17269 00010000:00010000:0.0:1746155644.380748:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155644.380750:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126070400:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155644.380754:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a3aaa00/0x844e5faceb5f854b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1868c expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.380755:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.380761:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092872c00/0x844e5faceb5f8552 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18693 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.380763:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.380769:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.380770:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.380770:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a3aaa00/0x844e5faceb5f854b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1868c expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.380775:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092872c00/0x844e5faceb5f8552 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18693 expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.380777:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a3aaa00/0x844e5faceb5f854b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1868c expref: 16 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.380785:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092872c00/0x844e5faceb5f8552 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18693 expref: 14 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.380785:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a3aaa00, rc 0) 00010000:00010000:2.0:1746155644.380791:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092872c00, rc 0) 00000100:00100000:2.0:1746155644.380815:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126070400:12345-192.168.202.51@tcp:101:cat.0 Request processed in 63us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155644.380815:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126070272:12345-192.168.202.51@tcp:101:cat.0 Request processed in 73us (179us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155644.380819:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17269 00000100:00100000:0.0:1746155644.380822:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17268 00000100:00100000:0.0:1746155644.381347:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.381492:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126070528 00000100:00100000:3.0:1746155644.381496:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126070528 00000100:00100000:3.0:1746155644.381542:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17270 00000100:00100000:3.0:1746155644.381549:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126070528:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155644.381556:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.381564:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d1da600/0x844e5faceb5f8559 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1869a expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.381575:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.381576:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.381581:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d1da600/0x844e5faceb5f8559 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1869a expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.381590:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d1da600/0x844e5faceb5f8559 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1869a expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.381597:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d1da600, rc 0) 00000100:00100000:3.0:1746155644.381628:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126070528:12345-192.168.202.51@tcp:101:cat.0 Request processed in 79us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.381633:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17270 00000100:00100000:0.0:1746155644.383605:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.383702:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.383712:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125413120:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.383722:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125413248:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155644.383726:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.383745:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126070656 00010000:00010000:3.0:1746155644.383746:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 14 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.383750:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126070656 00000100:00100000:0.0:1746155644.383758:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.383773:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126070784 00000100:00100000:2.0:1746155644.383775:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126070784 00010000:00010000:3.0:1746155644.383776:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b2200, rc 0) 00000100:00100000:2.0:1746155644.383785:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126071040 00000100:00100000:2.0:1746155644.383786:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126071040 00000100:00100000:2.0:1746155644.383798:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17271 00000100:00100000:2.0:1746155644.383804:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126070656:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155644.383806:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17272 00000100:00100000:3.0:1746155644.383807:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32436:x1830976126070144:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3759us (3833us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.383812:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17267 00010000:00010000:2.0:1746155644.383814:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155644.383815:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976126070784:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155644.383823:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f8560 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186a1 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.383825:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155644.383828:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17273 00000100:00100000:3.0:1746155644.383834:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126071040:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155644.383834:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f8567 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186a8 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.383836:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.383838:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.383840:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.383843:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f8560 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a1 expref: 17 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.383847:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.383848:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5f856e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186af expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.383849:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.383853:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f8560 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a1 expref: 17 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.383855:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f8567 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a8 expref: 17 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.383859:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.383860:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092872200, rc 0) 00010000:00010000:3.0:1746155644.383861:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.383864:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5f856e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186af expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.383866:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f8567 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a8 expref: 17 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.383872:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5f856e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186af expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.383874:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a3aac00, rc 0) 00000100:00100000:2.0:1746155644.383876:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976126070656:12345-192.168.202.51@tcp:101:cat.0 Request processed in 73us (276us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155644.383878:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c7b2c00, rc 0) 00000100:00100000:2.0:1746155644.383881:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17271 00000100:00100000:0.0:1746155644.383909:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976126070784:12345-192.168.202.51@tcp:101:cat.0 Request processed in 94us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.383912:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126071040:12345-192.168.202.51@tcp:101:cat.0 Request processed in 78us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155644.383915:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17272 00000100:00100000:3.0:1746155644.383918:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17273 00000100:00100000:3.0:1746155644.383935:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126070912 00000100:00100000:3.0:1746155644.383937:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126070912 00010000:00010000:3.0:1746155644.383949:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c800/0x844e5faceb5f8441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1862a expref: 11 pid: 20796 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746155644.383966:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8843 00000100:00100000:3.0:1746155644.383970:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126070912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.383977:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.383993:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c800/0x844e5faceb5f8441 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1862a expref: 11 pid: 20796 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.384002:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c800/0x844e5faceb5f8441 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1862a expref: 11 pid: 20796 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.384015:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c800/0x844e5faceb5f8441 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1862a expref: 11 pid: 20796 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.384023:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.384048:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126070912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 77us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.384054:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8843 00000100:00100000:0.0:1746155644.390613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.390644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.390674:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126071168 00000100:00100000:1.0:1746155644.390682:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126071168 00000100:00100000:1.0:1746155644.390721:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126071296 00000100:00100000:1.0:1746155644.390723:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126071296 00000100:00100000:0.0:1746155644.390734:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17274 00000100:00100000:1.0:1746155644.390740:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17275 00000100:00100000:0.0:1746155644.390741:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32438:x1830976126071168:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155644.390746:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32439:x1830976126071296:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155644.390754:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155644.390754:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155644.390765:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f088000/0x844e5faceb5f8575 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186b6 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.390766:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f857c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186bd expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.390783:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.390784:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.390785:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.390788:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.390790:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f088000/0x844e5faceb5f8575 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186b6 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.390793:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155644.390797:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f857c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186bd expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.390800:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f088000/0x844e5faceb5f8575 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186b6 expref: 17 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.390805:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f088000, rc 0) 00010000:00010000:1.0:1746155644.390825:0:4461:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [892928->897023] (req 892928->897023) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 17 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.390835:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f857c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186bd expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.390843:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f459a00, rc 0) 00000100:00100000:0.0:1746155644.390875:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:32438:x1830976126071168:12345-192.168.202.51@tcp:101:cat.0 Request processed in 135us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.390876:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32439:x1830976126071296:12345-192.168.202.51@tcp:101:cat.0 Request processed in 129us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155644.390880:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17274 00000100:00100000:1.0:1746155644.390882:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17275 00000100:00100000:0.0:1746155644.391683:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.391730:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126071424 00000100:00100000:3.0:1746155644.391734:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126071424 00010000:00010000:3.0:1746155644.391750:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f080a00/0x844e5faceb5f850c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18670 expref: 26 pid: 29728 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.391774:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8844 00000100:00100000:3.0:1746155644.391779:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976126071424:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.391785:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.391800:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f080a00/0x844e5faceb5f850c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18670 expref: 26 pid: 29728 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.391806:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f080a00/0x844e5faceb5f850c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18670 expref: 26 pid: 29728 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.391816:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f080a00/0x844e5faceb5f850c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18670 expref: 26 pid: 29728 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.391824:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.391825:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.391827:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.391832:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.391844:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.391850:0:9789:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 16 pid: 8437 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.391856:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125413504:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155644.391968:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155644.392483:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.392688:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126071552 00000100:00100000:2.0:1746155644.392693:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126071552 00000100:00100000:2.0:1746155644.392741:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11181 00000100:00100000:2.0:1746155644.392747:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32438:x1830976126071552:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155644.392760:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.392772:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092872800/0x844e5faceb5f8583 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186c4 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.392836:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092872800/0x844e5faceb5f8583 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186c4 expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.392846:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092872800/0x844e5faceb5f8583 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186c4 expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.392859:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.392862:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155644.392864:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092872800, rc 0) 00000100:00100000:2.0:1746155644.392940:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32438:x1830976126071552:12345-192.168.202.51@tcp:101:cat.0 Request processed in 192us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.392945:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11181 00000100:00100000:3.0:1746155644.394038:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125413504:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155644.394053:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155644.394130:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.394208:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976126071424:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2428us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.394216:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8844 00000100:00100000:0.0:1746155644.394476:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126071808 00000100:00100000:0.0:1746155644.394480:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126071808 00002000:00100000:0.0:1746155644.394544:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e1:0x0] (892928->897023) req@ffff8800910c8700 x1830976126071808/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155644.394552:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8700 with x1830976126071808 ext(892928->897023) 00010000:00010000:0.0:1746155644.394559:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 17 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155644.394575:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 17 pid: 8437 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746155644.394581:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910c8700 00000100:00100000:0.0:1746155644.394595:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1428 00000100:00100000:0.0:1746155644.394601:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976126071808:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155644.394717:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976126071808:12345-192.168.202.51@tcp:3:cat.0 Request processed in 116us (588us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155644.394723:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1428 00002000:00100000:0.0:1746155644.394727:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e1:0x0] (892928->897023) req@ffff8800910c8700 x1830976126071808/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/4536 e 0 to 0 dl 1746155655 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155644.394734:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8700 with x1830976126071808 ext(892928->897023) 00010000:00010000:0.0:1746155644.394738:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 17 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:0.0:1746155644.394746:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 17 pid: 8437 timeout: 873 lvb_type: 0 00002000:00010000:0.0:1746155644.394752:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910c8700 00000100:00100000:2.0:1746155644.397905:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.397932:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.397942:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.397959:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126072576 00000100:00100000:3.0:1746155644.397960:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126072064 00000100:00100000:3.0:1746155644.397965:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126072064 00000100:00100000:2.0:1746155644.397965:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126072576 00000100:00100000:2.0:1746155644.397993:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4752 00002000:00100000:3.0:1746155644.397996:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800936f7480 x1830976126072064/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746155644.397999:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32436:x1830976126072576:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155644.398001:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126072320 00002000:00100000:3.0:1746155644.398002:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f7480 with x1830976126072064 ext(1048576->2097151) 00000100:00100000:1.0:1746155644.398004:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126072320 00002000:00010000:3.0:1746155644.398005:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f7480 00000100:00100000:3.0:1746155644.398016:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8173 00000100:00100000:3.0:1746155644.398020:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976126072064:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:1.0:1746155644.398021:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e1:0x0] (892928->897023) req@ffff8800910c9f80 x1830976126072320/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 4584/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.398028:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c9f80 with x1830976126072320 ext(892928->897023) 00010000:00010000:1.0:1746155644.398034:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 17 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.398045:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 17 pid: 8437 timeout: 873 lvb_type: 0 00002000:00010000:1.0:1746155644.398050:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910c9f80 00000100:00100000:1.0:1746155644.398062:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1429 00000100:00100000:1.0:1746155644.398066:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976126072320:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155644.398182:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32436:x1830976126072576:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 183us (239us total) trans 8589945345 rc 0/0 00000100:00100000:2.0:1746155644.398190:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4752 00000100:00100000:1.0:1746155644.398283:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976126072320:12345-192.168.202.51@tcp:4:cat.0 Request processed in 215us (350us total) trans 17179874345 rc 0/0 00000100:00100000:1.0:1746155644.398288:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1429 00002000:00100000:1.0:1746155644.398293:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e1:0x0] (892928->897023) req@ffff8800910c9f80 x1830976126072320/t17179874345(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 4584/448 e 0 to 0 dl 1746155655 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.398299:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c9f80 with x1830976126072320 ext(892928->897023) 00010000:00010000:1.0:1746155644.398304:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 19 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.398312:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 19 pid: 8437 timeout: 873 lvb_type: 0 00002000:00010000:1.0:1746155644.398318:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800910c9f80 00000100:00100000:0.0:1746155644.404763:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.404809:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.404922:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126072704 00000100:00100000:3.0:1746155644.404929:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126072704 00010000:00010000:3.0:1746155644.404957:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 19 pid: 8437 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.405252:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126072832 00000100:00100000:1.0:1746155644.405256:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126072832 00000100:00100000:1.0:1746155644.405281:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17276 00000100:00100000:1.0:1746155644.405287:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32434:x1830976126072832:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155644.405300:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.405311:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186cb expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.405333:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff7de00/0x844e5faceb5f8456 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1863f expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.405341:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f8560 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a1 expref: 19 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.405352:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.405353:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.405356:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [2084864->2097151] (req 2084864->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 26 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.405379:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f8560 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a1 expref: 19 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.405389:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f8560 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a1 expref: 19 pid: 29728 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746155644.405398:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125413632:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.405544:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8845 00000100:00100000:3.0:1746155644.405551:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126072704:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.405559:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.405579:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 19 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.405588:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 19 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.405602:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c7b2200/0x844e5faceb5f8544 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 892928->897023) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18685 expref: 19 pid: 8437 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.405616:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.405617:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.405622:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f857c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186bd expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.405628:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f857c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186bd expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.405647:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f857c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186bd expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.405653:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125413760:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155644.406103:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff7de00/0x844e5faceb5f8456 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1863f expref: 9 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.406111:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff7de00/0x844e5faceb5f8456 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1863f expref: 9 pid: 20796 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746155644.406119:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125413888:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.406150:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746155644.406411:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155644.407533:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976126072064:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9508us (9639us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.407543:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8173 00002000:00100000:3.0:1746155644.407551:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800936f7480 x1830976126072064/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.407560:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f7480 with x1830976126072064 ext(1048576->2097151) 00002000:00010000:3.0:1746155644.407564:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f7480 00000100:00100000:0.0:1746155644.408285:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.408334:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.408360:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125413760:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155644.408375:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.408401:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126072704:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2851us (3645us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.408411:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8845 00000100:00100000:3.0:1746155644.408425:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126072960 00000100:00100000:3.0:1746155644.408429:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126072960 00010000:00010000:3.0:1746155644.408442:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f8560 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a1 expref: 18 pid: 29728 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746155644.408458:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126073088 00000100:00100000:3.0:1746155644.408460:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126073088 00000100:00100000:2.0:1746155644.408464:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8846 00010000:00010000:3.0:1746155644.408466:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff7de00/0x844e5faceb5f8456 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1863f expref: 10 pid: 20796 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746155644.408472:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126072960:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155644.408479:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8847 00010000:00010000:2.0:1746155644.408481:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155644.408484:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126073088:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.408490:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.408497:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f8560 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a1 expref: 18 pid: 29728 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.408498:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff7de00/0x844e5faceb5f8456 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1863f expref: 10 pid: 20796 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.408523:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff7de00/0x844e5faceb5f8456 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1863f expref: 10 pid: 20796 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.408531:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f8560 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a1 expref: 18 pid: 29728 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746155644.408534:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125413632:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.408542:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125413888:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.408678:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff7de00/0x844e5faceb5f8456 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1863f expref: 10 pid: 20796 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.408686:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092872200/0x844e5faceb5f8560 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a1 expref: 18 pid: 29728 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746155644.408686:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [2084864->2097151] (req 2084864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 26 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.408688:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.408690:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.408695:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 26 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.408705:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 26 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.408712:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155644.408712:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009470c000, rc 0) 00010000:00010000:3.0:1746155644.408724:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 26 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.408728:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976126072960:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 257us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.408731:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:32434:x1830976126072832:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3445us (3922us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.408733:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125414016:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155644.408734:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8846 00000100:00100000:1.0:1746155644.408737:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17276 00000100:00100000:3.0:1746155644.408760:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155644.409728:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125414016:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155644.409737:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.409769:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126073088:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1283us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.409774:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8847 00000100:00100000:0.0:1746155644.410357:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.410429:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126073344 00000100:00100000:3.0:1746155644.410433:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126073344 00002000:00100000:3.0:1746155644.410457:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (2084864->2088959) req@ffff8800910c8000 x1830976126073344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.410465:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8000 with x1830976126073344 ext(2084864->2088959) 00002000:00010000:3.0:1746155644.410469:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910c8000 00000100:00100000:3.0:1746155644.410493:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8174 00000100:00100000:3.0:1746155644.410498:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976126073344:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155644.410621:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976126073344:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 123us (265us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155644.410630:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8174 00002000:00100000:3.0:1746155644.410634:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (2084864->2088959) req@ffff8800910c8000 x1830976126073344/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/4536 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.410641:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8000 with x1830976126073344 ext(2084864->2088959) 00002000:00010000:3.0:1746155644.410644:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910c8000 00000100:00100000:0.0:1746155644.411488:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.411817:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.411829:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.411886:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126073728 00000100:00100000:1.0:1746155644.411890:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126073728 00000100:00100000:1.0:1746155644.411923:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17277 00000100:00100000:1.0:1746155644.411928:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:32438:x1830976126073728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155644.411938:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.411950:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea97a00/0x844e5faceb5f8591 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186d2 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.411966:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.411968:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.411973:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea97a00/0x844e5faceb5f8591 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d2 expref: 18 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.411984:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea97a00/0x844e5faceb5f8591 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d2 expref: 18 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.411993:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea97a00, rc 0) 00000100:00100000:1.0:1746155644.412012:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:32438:x1830976126073728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 84us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.412017:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17277 00000100:00100000:0.0:1746155644.412102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.412184:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126073984 00000100:00100000:2.0:1746155644.412188:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126073984 00002000:00100000:2.0:1746155644.412205:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800910c8e00 x1830976126073984/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.412213:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8e00 with x1830976126073984 ext(1048576->2097151) 00002000:00010000:2.0:1746155644.412216:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c8e00 00000100:00100000:2.0:1746155644.412224:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126073856 00000100:00100000:2.0:1746155644.412226:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126073856 00002000:00100000:2.0:1746155644.412234:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800910cad80 x1830976126073856/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.412240:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cad80 with x1830976126073856 ext(1048576->2097151) 00002000:00010000:2.0:1746155644.412243:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910cad80 00000100:00100000:2.0:1746155644.412249:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126074240 00000100:00100000:2.0:1746155644.412250:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126074240 00002000:00100000:2.0:1746155644.412258:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88012cded500 x1830976126074240/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.412264:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded500 with x1830976126074240 ext(0->1048575) 00002000:00010000:2.0:1746155644.412266:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cded500 00000100:00100000:2.0:1746155644.412273:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8175 00000100:00100000:2.0:1746155644.412277:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1963:x1830976126073984:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.413189:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8176 00000100:00100000:2.0:1746155644.413194:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1963:x1830976126073856:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.413998:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8177 00000100:00100000:2.0:1746155644.414004:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1963:x1830976126074240:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155644.414234:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.415486:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126074368 00000100:00100000:0.0:1746155644.415494:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126074368 00000100:00100000:0.0:1746155644.415541:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17278 00000100:00100000:0.0:1746155644.415546:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:32434:x1830976126074368:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155644.415557:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155644.415571:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186d9 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.415592:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c400/0x844e5faceb5f845d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18646 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.415599:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f8567 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a8 expref: 18 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.415605:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.415606:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.415610:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->2662399] (req 2097152->2662399) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 27 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.415633:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f8567 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a8 expref: 18 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.415649:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f8567 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a8 expref: 18 pid: 10591 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746155644.415690:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6063100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125414144:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155644.416591:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c400/0x844e5faceb5f845d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18646 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.416601:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c400/0x844e5faceb5f845d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18646 expref: 8 pid: 20796 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746155644.416610:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125414272:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155644.416808:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155644.417299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.417330:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.417374:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126074752 00000100:00100000:1.0:1746155644.417383:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126074752 00000100:00100000:2.0:1746155644.417390:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126074880 00000100:00100000:2.0:1746155644.417394:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126074880 00002000:00100000:2.0:1746155644.417408:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a6060e00 x1830976126074880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.417408:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2084863) req@ffff8800a6062680 x1830976126074752/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.417417:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060e00 with x1830976126074880 ext(1048576->2097151) 00002000:00100000:1.0:1746155644.417417:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6062680 with x1830976126074752 ext(1048576->2084863) 00002000:00010000:2.0:1746155644.417421:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6060e00 00002000:00010000:1.0:1746155644.417421:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6062680 00000100:00100000:2.0:1746155644.417465:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8178 00000100:00100000:1.0:1746155644.417468:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8179 00000100:00100000:2.0:1746155644.417470:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976126074880:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155644.417472:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976126074752:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155644.418985:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6063100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125414144:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.419200:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1963:x1830976126073984:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6921us (7382us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.419209:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8175 00002000:00100000:2.0:1746155644.419216:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800910c8e00 x1830976126073984/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.419224:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910c8e00 with x1830976126073984 ext(1048576->2097151) 00002000:00010000:2.0:1746155644.419228:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910c8e00 00000100:00100000:0.0:1746155644.419343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.419500:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126075008 00000100:00100000:3.0:1746155644.419516:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126075008 00010000:00010000:3.0:1746155644.419537:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f8567 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a8 expref: 19 pid: 10591 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746155644.419570:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8848 00000100:00100000:3.0:1746155644.419576:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126075008:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.419586:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.419600:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f8567 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a8 expref: 19 pid: 10591 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.419610:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f8567 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a8 expref: 19 pid: 10591 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.419627:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f8567 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186a8 expref: 19 pid: 10591 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.419651:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.419681:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126075008:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 105us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.419691:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8848 00000100:00100000:2.0:1746155644.422047:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1963:x1830976126073856:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8844us (10208us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.422056:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8176 00002000:00100000:2.0:1746155644.422064:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff8800910cad80 x1830976126073856/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.422072:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910cad80 with x1830976126073856 ext(1048576->2097151) 00002000:00010000:2.0:1746155644.422077:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910cad80 00000100:00100000:0.0:1746155644.422905:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.422990:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126075136 00000100:00100000:2.0:1746155644.422995:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126075136 00010000:00010000:2.0:1746155644.423016:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c400/0x844e5faceb5f845d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18646 expref: 9 pid: 20796 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746155644.423045:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8849 00000100:00100000:2.0:1746155644.423051:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126075136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.423061:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.423078:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c400/0x844e5faceb5f845d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18646 expref: 9 pid: 20796 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.423093:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c400/0x844e5faceb5f845d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18646 expref: 9 pid: 20796 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.423112:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.423114:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.423120:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.423160:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff7c400/0x844e5faceb5f845d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18646 expref: 9 pid: 20796 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746155644.423176:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a6062d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125414272:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.423786:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.423826:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.423836:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5c4de00, rc 0) 00000100:00100000:1.0:1746155644.423867:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:32434:x1830976126074368:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8321us (9633us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.423873:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17278 00010000:00010000:2.0:1746155644.423981:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 28 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.423992:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125414400:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155644.424047:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155644.424226:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1963:x1830976126074240:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10220us (12122us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.424233:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8177 00002000:00100000:3.0:1746155644.424239:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88012cded500 x1830976126074240/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.424246:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded500 with x1830976126074240 ext(0->1048575) 00002000:00010000:3.0:1746155644.424249:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cded500 00000100:00100000:2.0:1746155644.426531:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125414400:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155644.426545:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155644.426588:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126075136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3536us (3694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.426595:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8849 00000100:00100000:3.0:1746155644.426832:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6060e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976126074880:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9359us (9498us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.426838:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8178 00002000:00100000:3.0:1746155644.426844:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a6060e00 x1830976126074880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.426850:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6060e00 with x1830976126074880 ext(1048576->2097151) 00002000:00010000:3.0:1746155644.426853:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6060e00 00000100:00100000:0.0:1746155644.431758:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976126074752:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 14277us (14451us total) trans 0 rc 1036288/1036288 00000100:00100000:0.0:1746155644.431766:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8179 00002000:00100000:0.0:1746155644.431774:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2084863) req@ffff8800a6062680 x1830976126074752/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1036288/1036288 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155644.431781:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6062680 with x1830976126074752 ext(1048576->2084863) 00002000:00010000:0.0:1746155644.431785:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6062680 00000100:00100000:0.0:1746155644.433447:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.433532:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126075392 00000100:00100000:2.0:1746155644.433538:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126075392 00002000:00100000:2.0:1746155644.433565:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2658304->2662399) req@ffff8800a6061c00 x1830976126075392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.433575:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6061c00 with x1830976126075392 ext(2658304->2662399) 00002000:00010000:2.0:1746155644.433578:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6061c00 00000100:00100000:2.0:1746155644.433599:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8180 00000100:00100000:2.0:1746155644.433603:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976126075392:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155644.433711:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976126075392:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 107us (268us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155644.433715:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8180 00002000:00100000:2.0:1746155644.433718:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2658304->2662399) req@ffff8800a6061c00 x1830976126075392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/4536 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.433722:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6061c00 with x1830976126075392 ext(2658304->2662399) 00002000:00010000:2.0:1746155644.433724:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a6061c00 00000100:00100000:0.0:1746155644.434211:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.434272:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126075520 00000100:00100000:1.0:1746155644.434276:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126075520 00000100:00100000:1.0:1746155644.434300:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17279 00000100:00100000:1.0:1746155644.434304:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32439:x1830976126075520:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155644.434330:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.434344:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f859f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186e0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.434365:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 26 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.434371:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155644.434373:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155644.434376:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f859f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e0 expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.434401:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 26 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.434410:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 26 pid: 10591 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.434421:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125414528:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.434486:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155644.436001:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.436054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.436125:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126075904 00000100:00100000:1.0:1746155644.436125:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126075776 00000100:00100000:3.0:1746155644.436130:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126075904 00000100:00100000:1.0:1746155644.436130:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126075776 00002000:00100000:3.0:1746155644.436154:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (2084864->2097151) req@ffff8800a6063100 x1830976126075904/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 12776/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746155644.436154:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4753 00000100:00100000:1.0:1746155644.436159:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32434:x1830976126075776:12345-192.168.202.51@tcp:35:multiop.0 00002000:00100000:3.0:1746155644.436162:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6063100 with x1830976126075904 ext(2084864->2097151) 00010000:00010000:3.0:1746155644.436168:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 27 pid: 10591 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.436178:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 27 pid: 10591 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155644.436185:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a6063100 00000100:00100000:3.0:1746155644.436202:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1430 00000100:00100000:3.0:1746155644.436207:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976126075904:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155644.436584:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32434:x1830976126075776:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 147us (309us total) trans 8589945346 rc 0/0 00000100:00100000:1.0:1746155644.436590:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4753 00000100:00100000:1.0:1746155644.436621:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125414528:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.436638:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f859f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e0 expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.436649:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012a3aac00, rc 0) 00000100:00100000:1.0:1746155644.436675:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6061f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32439:x1830976126075520:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2371us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.436676:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1963:x1830976126075904:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 468us (621us total) trans 17179874346 rc 0/0 00000100:00100000:3.0:1746155644.436681:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1430 00000100:00100000:1.0:1746155644.436681:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17279 00002000:00100000:3.0:1746155644.436686:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (2084864->2097151) req@ffff8800a6063100 x1830976126075904/t17179874346(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 12776/448 e 0 to 0 dl 1746155655 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.436693:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6063100 with x1830976126075904 ext(2084864->2097151) 00010000:00010000:3.0:1746155644.436706:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 29 pid: 10591 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.436715:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 29 pid: 10591 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155644.436723:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a6063100 00000100:00100000:0.0:1746155644.438433:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.438533:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126076160 00000100:00100000:3.0:1746155644.438539:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126076160 00002000:00100000:3.0:1746155644.438567:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2662400->3145727) req@ffff88009c213480 x1830976126076160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.438576:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213480 with x1830976126076160 ext(2662400->3145727) 00002000:00010000:3.0:1746155644.438581:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c213480 00000100:00100000:3.0:1746155644.438603:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8181 00000100:00100000:3.0:1746155644.438610:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976126076160:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.439679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.439744:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126076288 00000100:00100000:3.0:1746155644.439748:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126076288 00010000:00010000:3.0:1746155644.439766:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 31 pid: 10591 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.439785:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8850 00000100:00100000:3.0:1746155644.439790:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976126076288:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.439798:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.439810:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 31 pid: 10591 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.439819:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 31 pid: 10591 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.439837:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009470c000/0x844e5faceb5f858a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2084864->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186cb expref: 31 pid: 10591 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.439948:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.439951:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.439957:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f859f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e0 expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.439964:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f859f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e0 expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.439989:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f859f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e0 expref: 16 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.440000:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125414656:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155644.440163:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155644.441922:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125414656:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155644.441942:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.442258:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976126076288:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2466us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.442266:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8850 00000100:00100000:3.0:1746155644.443424:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976126076160:12345-192.168.202.51@tcp:3:cat.0 Request processed in 4812us (4992us total) trans 0 rc 483328/483328 00000100:00100000:3.0:1746155644.443433:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8181 00002000:00100000:3.0:1746155644.443442:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2662400->3145727) req@ffff88009c213480 x1830976126076160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 483328/483328 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.443450:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213480 with x1830976126076160 ext(2662400->3145727) 00002000:00010000:3.0:1746155644.443454:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c213480 00000100:00100000:0.0:1746155644.443688:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.444159:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126076544 00000100:00100000:3.0:1746155644.444164:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126076544 00002000:00100000:3.0:1746155644.444190:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009c213100 x1830976126076544/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.444196:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213100 with x1830976126076544 ext(1048576->2097151) 00002000:00010000:3.0:1746155644.444199:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c213100 00000100:00100000:3.0:1746155644.444223:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8182 00000100:00100000:3.0:1746155644.444229:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976126076544:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.446387:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.446441:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126076672 00000100:00100000:1.0:1746155644.446447:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126076672 00000100:00100000:1.0:1746155644.446756:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17280 00000100:00100000:1.0:1746155644.446762:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:32438:x1830976126076672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155644.446783:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.446797:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b5257c00/0x844e5faceb5f85a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186e7 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.446817:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.446818:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.446825:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5257c00/0x844e5faceb5f85a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e7 expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.446839:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b5257c00/0x844e5faceb5f85a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e7 expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.446848:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5257c00, rc 0) 00000100:00100000:1.0:1746155644.446902:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32438:x1830976126076672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 131us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.446908:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17280 00000100:00100000:3.0:1746155644.450859:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976126076544:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6265us (6806us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.450871:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8182 00002000:00100000:3.0:1746155644.450880:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009c213100 x1830976126076544/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.450900:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c213100 with x1830976126076544 ext(1048576->2097151) 00002000:00010000:3.0:1746155644.450904:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c213100 00000100:00100000:0.0:1746155644.453939:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.454008:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.454047:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.454076:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126077056 00000100:00100000:1.0:1746155644.454084:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126077056 00000100:00100000:3.0:1746155644.454107:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126077440 00000100:00100000:2.0:1746155644.454107:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126077184 00000100:00100000:3.0:1746155644.454111:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126077440 00000100:00100000:2.0:1746155644.454111:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126077184 00002000:00100000:1.0:1746155644.454118:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009c210a80 x1830976126077056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.454125:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210a80 with x1830976126077056 ext(2097152->3145727) 00002000:00100000:3.0:1746155644.454126:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009c211f80 x1830976126077440/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.454126:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009c212300 x1830976126077184/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:1.0:1746155644.454130:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c210a80 00002000:00100000:3.0:1746155644.454134:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211f80 with x1830976126077440 ext(3145728->4194303) 00002000:00100000:2.0:1746155644.454134:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212300 with x1830976126077184 ext(3145728->4194303) 00002000:00010000:3.0:1746155644.454137:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c211f80 00002000:00010000:2.0:1746155644.454137:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c212300 00000100:00100000:1.0:1746155644.454147:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8183 00000100:00100000:2.0:1746155644.454151:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8184 00000100:00100000:1.0:1746155644.454153:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126077056:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.454156:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976126077440:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155644.454157:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8185 00000100:00100000:3.0:1746155644.454162:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126077184:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155644.456746:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.456788:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126077568 00000100:00100000:1.0:1746155644.456793:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126077568 00000100:00100000:1.0:1746155644.456831:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17281 00000100:00100000:1.0:1746155644.456838:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32439:x1830976126077568:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155644.456852:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.456865:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5256e00/0x844e5faceb5f85ad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186ee expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.456886:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.456905:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155644.456906:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155644.456909:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5256e00/0x844e5faceb5f85ad lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186ee expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.456934:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 29 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.456949:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 29 pid: 4461 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.456960:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125414784:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.457012:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b480 going to sleep for 11 seconds 00000100:00100000:1.0:1746155644.460728:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125414784:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.460764:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5256e00/0x844e5faceb5f85ad lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186ee expref: 18 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.460779:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5256e00, rc 0) 00000100:00100000:1.0:1746155644.460831:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32439:x1830976126077568:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3992us (4089us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.460838:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17281 00000100:00100000:3.0:1746155644.461395:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126077184:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7231us (7385us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.461403:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8185 00002000:00100000:3.0:1746155644.461412:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009c212300 x1830976126077184/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.461420:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c212300 with x1830976126077184 ext(3145728->4194303) 00002000:00010000:3.0:1746155644.461424:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c212300 00000100:00100000:0.0:1746155644.463035:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.463126:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126077696 00000100:00100000:3.0:1746155644.463133:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126077696 00002000:00100000:3.0:1746155644.463163:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->2662399) req@ffff88009c210380 x1830976126077696/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.463171:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210380 with x1830976126077696 ext(2097152->2662399) 00010000:00010000:3.0:1746155644.463178:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 30 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.463190:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 30 pid: 4461 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155644.463196:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c210380 00000100:00100000:3.0:1746155644.463226:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1431 00000100:00100000:3.0:1746155644.463253:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976126077696:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155644.463835:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976126077056:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9680us (9902us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155644.463850:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8183 00002000:00100000:1.0:1746155644.463857:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009c210a80 x1830976126077056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.463865:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210a80 with x1830976126077056 ext(2097152->3145727) 00002000:00010000:1.0:1746155644.463868:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c210a80 00000100:00100000:1.0:1746155644.466316:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976126077440:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12152us (12261us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155644.466326:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8184 00002000:00100000:1.0:1746155644.466335:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009c211f80 x1830976126077440/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.466362:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c211f80 with x1830976126077440 ext(3145728->4194303) 00010000:00010000:1.0:1746155644.466370:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 30 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.466382:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 30 pid: 4461 timeout: 873 lvb_type: 0 00002000:00010000:1.0:1746155644.466389:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c211f80 00000100:00100000:0.0:1746155644.467367:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.467498:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126077824 00000100:00100000:1.0:1746155644.467529:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126077824 00000100:00100000:1.0:1746155644.467567:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17282 00000100:00100000:1.0:1746155644.467574:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:32438:x1830976126077824:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155644.467586:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.467599:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b5257400/0x844e5faceb5f85b4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186f5 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.467618:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155644.467621:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155644.467625:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5257400/0x844e5faceb5f85b4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186f5 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.467634:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b5257400/0x844e5faceb5f85b4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186f5 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.467643:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b5257400, rc 0) 00000100:00100000:1.0:1746155644.467677:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c211180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:32438:x1830976126077824:12345-192.168.202.51@tcp:101:cat.0 Request processed in 103us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.467682:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17282 00000100:00100000:3.0:1746155644.469166:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976126077696:12345-192.168.202.51@tcp:4:cat.0 Request processed in 5930us (6132us total) trans 17179874347 rc 0/0 00000100:00100000:3.0:1746155644.469174:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1431 00002000:00100000:3.0:1746155644.469181:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->2662399) req@ffff88009c210380 x1830976126077696/t17179874347(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/448 e 0 to 0 dl 1746155655 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.469188:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c210380 with x1830976126077696 ext(2097152->2662399) 00010000:00010000:3.0:1746155644.469194:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 31 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.469204:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 31 pid: 4461 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155644.469214:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c210380 00000100:00100000:0.0:1746155644.472232:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.472321:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126077952 00000100:00100000:3.0:1746155644.472329:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126077952 00010000:00010000:3.0:1746155644.472358:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 31 pid: 4461 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.472392:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8851 00000100:00100000:3.0:1746155644.472399:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976126077952:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.472410:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.472427:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 31 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.472437:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 31 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.472455:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4de00/0x844e5faceb5f8598 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2662399) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d9 expref: 31 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.472482:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.472484:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.472490:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5256e00/0x844e5faceb5f85ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186ee expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.472498:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5256e00/0x844e5faceb5f85ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186ee expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.472528:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.472529:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.472532:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5257400/0x844e5faceb5f85b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186f5 expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.472539:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5257400/0x844e5faceb5f85b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186f5 expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.472564:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5257400/0x844e5faceb5f85b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186f5 expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.472575:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125414912:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155644.472638:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5256e00/0x844e5faceb5f85ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186ee expref: 17 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.472646:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125415040:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155644.472663:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155644.473828:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125414912:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155644.473836:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125415040:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155644.473848:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.473876:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c213800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976126077952:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1477us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.473883:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8851 00000100:00100000:0.0:1746155644.475431:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.475482:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126078208 00000100:00100000:3.0:1746155644.475488:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126078208 00002000:00100000:3.0:1746155644.475549:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a01d0a80 x1830976126078208/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.475557:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d0a80 with x1830976126078208 ext(3145728->4194303) 00002000:00010000:3.0:1746155644.475562:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d0a80 00000100:00100000:3.0:1746155644.475588:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8186 00000100:00100000:3.0:1746155644.475594:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976126078208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155644.480259:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.480288:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.480319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.480357:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126078464 00000100:00100000:1.0:1746155644.480357:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126078720 00000100:00100000:2.0:1746155644.480364:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126078464 00000100:00100000:1.0:1746155644.480364:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126078720 00000100:00100000:3.0:1746155644.480383:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126078848 00000100:00100000:3.0:1746155644.480387:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126078848 00002000:00100000:2.0:1746155644.480398:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a01d2680 x1830976126078464/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.480398:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a01d3b80 x1830976126078720/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.480405:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a01d1500 x1830976126078848/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.480407:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d2680 with x1830976126078464 ext(2097152->3145727) 00002000:00100000:1.0:1746155644.480407:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d3b80 with x1830976126078720 ext(3145728->4194303) 00002000:00010000:2.0:1746155644.480411:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d2680 00002000:00010000:1.0:1746155644.480411:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d3b80 00002000:00100000:3.0:1746155644.480412:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d1500 with x1830976126078848 ext(2097152->3145727) 00002000:00010000:3.0:1746155644.480415:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01d1500 00000100:00100000:1.0:1746155644.480431:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8187 00000100:00100000:3.0:1746155644.480437:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8188 00000100:00100000:1.0:1746155644.480437:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126078464:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.480441:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8189 00000100:00100000:3.0:1746155644.480442:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976126078720:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.480446:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976126078848:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155644.481716:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976126078208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6117us (6282us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.481724:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8186 00002000:00100000:3.0:1746155644.481730:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a01d0a80 x1830976126078208/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.481737:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d0a80 with x1830976126078208 ext(3145728->4194303) 00002000:00010000:3.0:1746155644.481741:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d0a80 00000100:00100000:1.0:1746155644.482485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.482576:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126079232 00000100:00100000:3.0:1746155644.482582:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126079232 00002000:00100000:3.0:1746155644.482605:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f4fdf80 x1830976126079232/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.482613:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fdf80 with x1830976126079232 ext(3145728->4194303) 00002000:00010000:3.0:1746155644.482617:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fdf80 00000100:00100000:3.0:1746155644.482643:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8190 00000100:00100000:3.0:1746155644.482649:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126079232:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.488636:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126078464:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8191us (8339us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.488645:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8187 00002000:00100000:2.0:1746155644.488653:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a01d2680 x1830976126078464/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.488659:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d2680 with x1830976126078464 ext(2097152->3145727) 00002000:00010000:2.0:1746155644.488663:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d2680 00000100:00100000:3.0:1746155644.490863:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976126078720:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10414us (10610us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.490873:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8188 00002000:00100000:3.0:1746155644.490882:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a01d3b80 x1830976126078720/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.490890:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d3b80 with x1830976126078720 ext(3145728->4194303) 00002000:00010000:3.0:1746155644.490904:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d3b80 00000100:00100000:0.0:1746155644.492474:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.494577:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126079488 00000100:00100000:1.0:1746155644.494586:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126079488 00000100:00100000:0.0:1746155644.494611:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.494630:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126079360 00000100:00100000:1.0:1746155644.494632:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126079360 00000100:00100000:0.0:1746155644.494641:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17283 00000100:00100000:0.0:1746155644.494649:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976126079488:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155644.494660:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17284 00000100:00100000:1.0:1746155644.494664:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976126079360:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155644.494664:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.494670:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.494678:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801369b9c00/0x844e5faceb5f85bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f186fc expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.494678:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312fbe00/0x844e5faceb5f85c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18703 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.494696:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.494696:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.494698:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.494698:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.494704:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801369b9c00/0x844e5faceb5f85bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186fc expref: 33 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.494704:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fbe00/0x844e5faceb5f85c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18703 expref: 33 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.494721:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801369b9c00/0x844e5faceb5f85bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186fc expref: 33 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.494721:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312fbe00/0x844e5faceb5f85c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18703 expref: 33 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.494729:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369b9c00, rc 0) 00010000:00010000:0.0:1746155644.494729:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fbe00, rc 0) 00000100:00100000:1.0:1746155644.494760:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976126079360:12345-192.168.202.51@tcp:101:cat.0 Request processed in 94us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155644.494760:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976126079488:12345-192.168.202.51@tcp:101:cat.0 Request processed in 112us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155644.494765:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17283 00000100:00100000:1.0:1746155644.494767:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17284 00000100:00100000:1.0:1746155644.495275:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976126078848:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14827us (14954us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155644.495282:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8189 00002000:00100000:1.0:1746155644.495289:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a01d1500 x1830976126078848/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.495297:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d1500 with x1830976126078848 ext(2097152->3145727) 00002000:00010000:1.0:1746155644.495301:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a01d1500 00000100:00100000:3.0:1746155644.497017:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126079232:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14363us (14529us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.497026:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8190 00002000:00100000:3.0:1746155644.497034:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f4fdf80 x1830976126079232/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.497040:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fdf80 with x1830976126079232 ext(3145728->4194303) 00002000:00010000:3.0:1746155644.497044:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fdf80 00000100:00100000:0.0:1746155644.498949:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.499125:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126079744 00000100:00100000:3.0:1746155644.499132:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126079744 00002000:00100000:3.0:1746155644.499166:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800a01d0e00 x1830976126079744/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.499180:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d0e00 with x1830976126079744 ext(4194304->5083135) 00002000:00010000:3.0:1746155644.499184:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d0e00 00000100:00100000:3.0:1746155644.499214:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8191 00000100:00100000:3.0:1746155644.499221:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976126079744:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155644.502438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.502498:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126080000 00000100:00100000:1.0:1746155644.503298:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126080000 00002000:00100000:1.0:1746155644.503334:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009fb69880 x1830976126080000/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.503343:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69880 with x1830976126080000 ext(4194304->5083135) 00002000:00010000:1.0:1746155644.503347:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb69880 00000100:00100000:1.0:1746155644.503374:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8192 00000100:00100000:1.0:1746155644.503380:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fb69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976126080000:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155644.506527:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976126079744:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7297us (7572us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155644.506536:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8191 00002000:00100000:3.0:1746155644.506546:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800a01d0e00 x1830976126079744/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.506554:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d0e00 with x1830976126079744 ext(4194304->5083135) 00002000:00010000:3.0:1746155644.506559:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d0e00 00000100:00100000:1.0:1746155644.509651:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fb69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976126080000:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6262us (7212us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155644.509662:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8192 00002000:00100000:1.0:1746155644.509672:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009fb69880 x1830976126080000/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.509681:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fb69880 with x1830976126080000 ext(4194304->5083135) 00002000:00010000:1.0:1746155644.509686:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fb69880 00000100:00100000:0.0:1746155644.518851:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.518942:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126080256 00000100:00100000:1.0:1746155644.518950:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126080256 00000100:00100000:1.0:1746155644.519002:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4754 00000100:00100000:1.0:1746155644.519010:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea57450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32439:x1830976126080256:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155644.519724:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea57450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32439:x1830976126080256:12345-192.168.202.51@tcp:35:cat.0 Request processed in 714us (878us total) trans 8589945347 rc 0/0 00000100:00100000:1.0:1746155644.519730:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4754 00000100:00100000:0.0:1746155644.522487:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.522810:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126080512 00000100:00100000:2.0:1746155644.522817:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126080512 00000100:00100000:2.0:1746155644.522859:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11182 00000100:00100000:2.0:1746155644.522864:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32445:x1830976126080512:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155644.522883:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.522918:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459200/0x844e5faceb5f85c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1870a expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.522996:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f800/0x844e5faceb5f85d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523007:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f800/0x844e5faceb5f85d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523019:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f800/0x844e5faceb5f85d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523031:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f85d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523036:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f85d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523040:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f85d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523122:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f85de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523129:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f85de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523135:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f85de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155644.523142:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155644.523206:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f800/0x844e5faceb5f85d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523211:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f800/0x844e5faceb5f85d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523217:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f800/0x844e5faceb5f85d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523221:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a76f800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.523224:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f800/0x844e5faceb5f85d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523230:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f800/0x844e5faceb5f85d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523239:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155644.523241:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155644.523244:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f800/0x844e5faceb5f85d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523248:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76f800/0x844e5faceb5f85d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523273:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f85d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523278:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f85d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523282:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f85d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523286:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c51aa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.523288:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f85d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523292:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f85d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523297:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ae84a00) 00010000:00010000:2.0:1746155644.523299:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155644.523300:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f85d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523304:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f85d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.523330:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f459200/0x844e5faceb5f85c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1870a expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.523340:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f85de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1870a expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.523345:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.523346:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155644.523348:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5fabc00, rc 0) 00000100:00100000:2.0:1746155644.523383:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32445:x1830976126080512:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 518us (902us total) trans 8589945348 rc 0/0 00000100:00100000:2.0:1746155644.523388:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11182 00000100:00100000:0.0:1746155644.552498:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.552622:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126080768 00000100:00100000:2.0:1746155644.552630:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126080768 00000100:00100000:2.0:1746155644.552678:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11183 00000100:00100000:2.0:1746155644.552684:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32448:x1830976126080768:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155644.552703:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.552718:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1ddc800/0x844e5faceb5f85ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18711 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.552799:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f85f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.552808:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f85f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.552815:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f85f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.552826:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173e00/0x844e5faceb5f85fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.552829:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173e00/0x844e5faceb5f85fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.552832:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173e00/0x844e5faceb5f85fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.552907:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173000/0x844e5faceb5f8601 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.552914:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173000/0x844e5faceb5f8601 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.552918:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173000/0x844e5faceb5f8601 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155644.552925:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155644.552984:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f85f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.552990:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f85f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.552995:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f85f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.553000:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc67a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.553003:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f85f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.553009:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f85f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.553018:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155644.553021:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155644.553024:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f85f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.553029:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f85f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.553054:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173e00/0x844e5faceb5f85fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.553060:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173e00/0x844e5faceb5f85fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.553064:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173e00/0x844e5faceb5f85fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.553068:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c173e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.553070:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173e00/0x844e5faceb5f85fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.553075:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173e00/0x844e5faceb5f85fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.553082:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ae84100) 00010000:00010000:2.0:1746155644.553084:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155644.553086:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173e00/0x844e5faceb5f85fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.553090:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173e00/0x844e5faceb5f85fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.553118:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b1ddc800/0x844e5faceb5f85ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18711 expref: 291 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.553129:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173000/0x844e5faceb5f8601 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18711 expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.553134:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.553136:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155644.553138:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c173000, rc 0) 00000100:00100000:2.0:1746155644.553200:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32448:x1830976126080768:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 515us (709us total) trans 8589945349 rc 0/0 00000100:00100000:2.0:1746155644.553205:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11183 00000100:00100000:0.0:1746155644.579025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.579088:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126080896 00000100:00100000:3.0:1746155644.579097:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126080896 00000100:00100000:3.0:1746155644.579143:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17285 00000100:00100000:3.0:1746155644.579150:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32445:x1830976126080896:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155644.579165:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.579178:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18718 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.579200:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f859f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e0 expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.579208:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312fbe00/0x844e5faceb5f85c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18703 expref: 31 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.579218:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.579220:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.579223:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1785856->2097151] (req 1785856->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 19 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.579251:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312fbe00/0x844e5faceb5f85c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18703 expref: 31 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.579262:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312fbe00/0x844e5faceb5f85c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18703 expref: 31 pid: 19959 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746155644.579275:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125415168:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.579360:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f859f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e0 expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.579368:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f859f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e0 expref: 19 pid: 4461 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.579376:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125415296:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.579392:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155644.580544:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125415168:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.580554:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125415296:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.580571:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1785856->2097151] (req 1785856->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 19 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.580590:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fed9000, rc 0) 00000100:00100000:3.0:1746155644.580618:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32445:x1830976126080896:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1468us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.580624:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17285 00000100:00100000:0.0:1746155644.582476:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.582616:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.582664:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126081024 00000100:00100000:3.0:1746155644.582671:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126081024 00010000:00010000:3.0:1746155644.582697:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f859f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e0 expref: 19 pid: 4461 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.582730:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126081152 00000100:00100000:3.0:1746155644.582733:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126081152 00010000:00010000:3.0:1746155644.582756:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fbe00/0x844e5faceb5f85c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18703 expref: 32 pid: 19959 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746155644.582768:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8852 00000100:00100000:3.0:1746155644.582775:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8853 00000100:00100000:2.0:1746155644.582776:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126081024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.582787:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155644.582793:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976126081152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.582800:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.582803:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f859f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e0 expref: 19 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.582808:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312fbe00/0x844e5faceb5f85c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18703 expref: 32 pid: 19959 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.582817:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f859f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e0 expref: 19 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.582834:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012a3aac00/0x844e5faceb5f859f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e0 expref: 19 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.582836:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312fbe00/0x844e5faceb5f85c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18703 expref: 32 pid: 19959 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.582849:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312fbe00/0x844e5faceb5f85c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18703 expref: 32 pid: 19959 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.582850:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.582851:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.582857:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.582867:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.582878:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.582940:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976126081152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 159us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.582947:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8853 00010000:00010000:2.0:1746155644.583008:0:15879:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.583018:0:15879:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125415424:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155644.583078:0:15879:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3326c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.584486:0:15879:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:15879:1830976125415424:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155644.584497:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155644.584578:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126081024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1802us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.584584:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8852 00000100:00100000:0.0:1746155644.586883:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.586971:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126081408 00000100:00100000:1.0:1746155644.586977:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126081408 00002000:00100000:1.0:1746155644.587009:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e3:0x0] (1785856->1789951) req@ffff88009f3ef800 x1830976126081408/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.587018:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ef800 with x1830976126081408 ext(1785856->1789951) 00002000:00010000:1.0:1746155644.587023:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3ef800 00000100:00100000:1.0:1746155644.587053:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8193 00000100:00100000:1.0:1746155644.587059:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126081408:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155644.587205:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126081408:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 146us (326us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155644.587212:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8193 00002000:00100000:1.0:1746155644.587217:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e3:0x0] (1785856->1789951) req@ffff88009f3ef800 x1830976126081408/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/4536 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.587224:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f3ef800 with x1830976126081408 ext(1785856->1789951) 00002000:00010000:1.0:1746155644.587227:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f3ef800 00000100:00100000:0.0:1746155644.593176:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.593340:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.593397:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126081536 00000100:00100000:1.0:1746155644.593405:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126081536 00000100:00100000:3.0:1746155644.593414:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126081664 00000100:00100000:3.0:1746155644.593418:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126081664 00000100:00100000:3.0:1746155644.593608:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17286 00000100:00100000:1.0:1746155644.593614:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17287 00000100:00100000:3.0:1746155644.593615:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32448:x1830976126081536:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:1.0:1746155644.593621:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32445:x1830976126081664:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155644.593629:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.593629:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.593642:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1871f expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.593642:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18726 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.593663:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9e00/0x844e5faceb5f844f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18638 expref: 11 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.593663:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5256e00/0x844e5faceb5f85ad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186ee expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.593671:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea97a00/0x844e5faceb5f8591 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d2 expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.593671:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b5257400/0x844e5faceb5f85b4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186f5 expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.593677:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d1da600/0x844e5faceb5f8559 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1869a expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.593677:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.593679:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.593681:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.593682:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155644.593682:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 19 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.593685:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1482752->1974271] (req 1482752->1974271) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.593705:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d1da600/0x844e5faceb5f8559 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1869a expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.593705:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5257400/0x844e5faceb5f85b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186f5 expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.593714:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d1da600/0x844e5faceb5f8559 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1869a expref: 15 pid: 9235 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746155644.593715:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5257400/0x844e5faceb5f85b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186f5 expref: 30 pid: 4461 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.593724:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125415552:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.593724:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125415680:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.593802:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea97a00/0x844e5faceb5f8591 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d2 expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.593810:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ea97a00/0x844e5faceb5f8591 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d2 expref: 20 pid: 10591 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.593818:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125415808:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.593843:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9e00/0x844e5faceb5f844f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18638 expref: 11 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.593850:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9e00/0x844e5faceb5f844f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18638 expref: 11 pid: 20200 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746155644.593857:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125415936:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.593873:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00010000:00010000:1.0:1746155644.593880:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b5256e00/0x844e5faceb5f85ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186ee expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.593888:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b5256e00/0x844e5faceb5f85ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186ee expref: 19 pid: 4461 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.593906:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125416064:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.593925:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155644.596928:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125415680:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.596938:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125416064:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.596962:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->2453503] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 19 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.596977:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801369b8a00, rc 0) 00000100:00100000:1.0:1746155644.597009:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32445:x1830976126081664:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3388us (3669us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.597015:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125415552:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.597015:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17287 00000100:00100000:3.0:1746155644.597027:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125415808:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.597034:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125415936:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.597057:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1482752->1974271] (req 1482752->1974271) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.597067:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fed9600, rc 0) 00000100:00100000:3.0:1746155644.597084:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f3ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:32448:x1830976126081536:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3471us (3916us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.597090:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17286 00000100:00100000:0.0:1746155644.598449:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.598478:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.598536:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.598595:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126082048 00000100:00100000:2.0:1746155644.598599:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126081792 00000100:00100000:3.0:1746155644.598600:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126082048 00000100:00100000:2.0:1746155644.598603:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126081792 00010000:00010000:3.0:1746155644.598622:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d1da600/0x844e5faceb5f8559 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1869a expref: 16 pid: 9235 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.598622:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea97a00/0x844e5faceb5f8591 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d2 expref: 20 pid: 10591 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.598640:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126081920 00000100:00100000:3.0:1746155644.598642:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126081920 00000100:00100000:2.0:1746155644.598650:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8854 00010000:00010000:3.0:1746155644.598652:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9e00/0x844e5faceb5f844f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18638 expref: 12 pid: 20200 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746155644.598656:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f822050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976126082048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.598666:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155644.598672:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8855 00000100:00100000:3.0:1746155644.598677:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126081792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.598683:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.598683:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d1da600/0x844e5faceb5f8559 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1869a expref: 16 pid: 9235 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.598691:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ea97a00/0x844e5faceb5f8591 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d2 expref: 20 pid: 10591 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.598696:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d1da600/0x844e5faceb5f8559 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1869a expref: 16 pid: 9235 timeout: 873 lvb_type: 1 00000100:00100000:0.0:1746155644.598725:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8856 00000100:00100000:0.0:1746155644.598731:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976126081920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155644.598736:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.598989:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ea97a00/0x844e5faceb5f8591 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d2 expref: 20 pid: 10591 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.599007:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea97a00/0x844e5faceb5f8591 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186d2 expref: 20 pid: 10591 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.599022:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.599061:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976126081792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 382us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.599066:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8855 00010000:00010000:2.0:1746155644.599108:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d1da600/0x844e5faceb5f8559 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1869a expref: 16 pid: 9235 timeout: 873 lvb_type: 1 00010000:00010000:2.0:1746155644.599120:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155644.599136:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f822050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976126082048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 480us (691us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155644.599137:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9e00/0x844e5faceb5f844f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18638 expref: 12 pid: 20200 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746155644.599141:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8854 00010000:00010000:0.0:1746155644.599145:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9e00/0x844e5faceb5f844f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18638 expref: 12 pid: 20200 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746155644.599156:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9e00/0x844e5faceb5f844f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18638 expref: 12 pid: 20200 timeout: 873 lvb_type: 1 00010000:00010000:0.0:1746155644.599167:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.599169:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.599175:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.599182:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.599254:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.599265:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125416192:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155644.599319:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155644.600588:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125416192:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155644.600598:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.600616:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976126081920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1886us (2080us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.600622:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8856 00000100:00100000:0.0:1746155644.601790:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.601818:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.601867:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126082176 00000100:00100000:2.0:1746155644.601873:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126082176 00000100:00100000:0.0:1746155644.601876:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155644.601906:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5257400/0x844e5faceb5f85b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186f5 expref: 31 pid: 4461 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.601924:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126082304 00000100:00100000:2.0:1746155644.601926:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126082304 00010000:00010000:2.0:1746155644.601936:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b5256e00/0x844e5faceb5f85ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186ee expref: 19 pid: 4461 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.601945:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8857 00000100:00100000:1.0:1746155644.601952:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1961:x1830976126082176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155644.601963:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155644.601979:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5257400/0x844e5faceb5f85b4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186f5 expref: 31 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.601988:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5257400/0x844e5faceb5f85b4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186f5 expref: 31 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.602003:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5257400/0x844e5faceb5f85b4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186f5 expref: 31 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.602020:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.602040:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976126082176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 89us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.602070:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126082560 00000100:00100000:3.0:1746155644.602074:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126082560 00000100:00100000:3.0:1746155644.602086:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8858 00000100:00100000:3.0:1746155644.602093:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1963:x1830976126082304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.602100:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.602109:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b5256e00/0x844e5faceb5f85ad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186ee expref: 19 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.602118:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b5256e00/0x844e5faceb5f85ad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186ee expref: 19 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.602130:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b5256e00/0x844e5faceb5f85ad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186ee expref: 19 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.602138:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.602140:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.602144:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 18 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.602155:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 18 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.602208:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 18 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.602218:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125416320:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155644.602379:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00002000:00100000:3.0:1746155644.602407:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1482752->1486847) req@ffff880099efb450 x1830976126082560/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.602416:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099efb450 with x1830976126082560 ext(1482752->1486847) 00002000:00010000:3.0:1746155644.602419:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099efb450 00000100:00100000:3.0:1746155644.602442:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8194 00000100:00100000:3.0:1746155644.602447:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126082560:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155644.602548:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8857 00000100:00100000:3.0:1746155644.602576:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126082560:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 128us (698us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155644.602582:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8194 00002000:00100000:3.0:1746155644.602587:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1482752->1486847) req@ffff880099efb450 x1830976126082560/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/4536 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.602594:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099efb450 with x1830976126082560 ext(1482752->1486847) 00002000:00010000:3.0:1746155644.602597:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099efb450 00000100:00100000:3.0:1746155644.605380:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125416320:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155644.605400:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.605438:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1963:x1830976126082304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3346us (3619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.605446:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8858 00000100:00100000:0.0:1746155644.606656:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.606837:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126082816 00000100:00100000:3.0:1746155644.606843:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126082816 00002000:00100000:3.0:1746155644.606875:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (2449408->2453503) req@ffff88009366df80 x1830976126082816/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.606883:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366df80 with x1830976126082816 ext(2449408->2453503) 00002000:00010000:3.0:1746155644.606887:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366df80 00000100:00100000:3.0:1746155644.606926:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8195 00000100:00100000:3.0:1746155644.606933:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126082816:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155644.607343:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126082816:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 408us (687us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155644.607349:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8195 00002000:00100000:3.0:1746155644.607355:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (2449408->2453503) req@ffff88009366df80 x1830976126082816/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/4536 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.607362:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366df80 with x1830976126082816 ext(2449408->2453503) 00002000:00010000:3.0:1746155644.607365:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366df80 00000100:00100000:0.0:1746155644.609982:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.610028:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.610173:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126083072 00000100:00100000:1.0:1746155644.610179:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126083072 00000100:00100000:1.0:1746155644.610218:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4755 00000100:00100000:1.0:1746155644.610224:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32445:x1830976126083072:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155644.610441:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126083328 00000100:00100000:3.0:1746155644.610445:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126083328 00002000:00100000:3.0:1746155644.610466:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1970176->1974271) req@ffff88009366d500 x1830976126083328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.610474:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d500 with x1830976126083328 ext(1970176->1974271) 00002000:00010000:3.0:1746155644.610479:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366d500 00000100:00100000:3.0:1746155644.610490:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8196 00000100:00100000:3.0:1746155644.610496:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126083328:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155644.611195:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32445:x1830976126083072:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 969us (1219us total) trans 8589945350 rc 0/0 00000100:00100000:1.0:1746155644.611201:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4755 00000100:00100000:3.0:1746155644.611375:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126083328:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 879us (1346us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155644.611381:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8196 00002000:00100000:3.0:1746155644.611386:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1970176->1974271) req@ffff88009366d500 x1830976126083328/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/4536 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.611400:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d500 with x1830976126083328 ext(1970176->1974271) 00002000:00010000:3.0:1746155644.611406:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366d500 00000100:00100000:0.0:1746155644.613929:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.614006:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126083584 00000100:00100000:1.0:1746155644.614012:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126083584 00000100:00100000:1.0:1746155644.614054:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4756 00000100:00100000:1.0:1746155644.614060:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32448:x1830976126083584:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155644.614213:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32448:x1830976126083584:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 153us (288us total) trans 8589945351 rc 0/0 00000100:00100000:1.0:1746155644.614219:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4756 00000100:00100000:0.0:1746155644.648358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.648446:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126083840 00000100:00100000:2.0:1746155644.648454:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126083840 00000100:00100000:2.0:1746155644.648532:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11184 00000100:00100000:2.0:1746155644.648540:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32453:x1830976126083840:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155644.648636:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.648652:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0x844e5faceb5f8624 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1872d expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.648727:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801313f2200/0x844e5faceb5f862b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.648740:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801313f2200/0x844e5faceb5f862b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.648749:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801313f2200/0x844e5faceb5f862b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155644.648758:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155644.648845:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173600/0x844e5faceb5f8624 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1872d expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.648869:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801313f2200/0x844e5faceb5f862b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1872d expref: 15 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.648876:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.648878:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746155644.648880:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801313f2200, rc 0) 00000100:00100000:2.0:1746155644.648944:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32453:x1830976126083840:12345-192.168.202.51@tcp:101:cat.0 Request processed in 404us (592us total) trans 8589945352 rc 0/0 00000100:00100000:2.0:1746155644.649049:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11184 00000100:00100000:0.0:1746155644.650252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.650321:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126083968 00000100:00100000:3.0:1746155644.650325:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126083968 00000100:00100000:3.0:1746155644.650362:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17288 00000100:00100000:3.0:1746155644.650372:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126083968:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155644.650381:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.650391:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8639 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18734 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.650427:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125416448:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155644.650520:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece3c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746155644.651824:0:9235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime: 1746155644 -> 1746155645 00002000:00010000:3.0:1746155644.651827:0:9235:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime: 1746155644 -> 1746155645 00000100:00100000:3.0:1746155644.651841:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125416448:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155644.651860:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8639 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18734 expref: 16 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.651867:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8639 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18734 expref: 16 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.651875:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0fe00, rc 0) 00000100:00100000:3.0:1746155644.651919:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126083968:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1550us (1667us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155644.651925:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17288 00000100:00100000:0.0:1746155644.655239:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.656720:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126084096 00000100:00100000:3.0:1746155644.656728:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126084096 00000100:00100000:3.0:1746155644.656773:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17289 00000100:00100000:3.0:1746155644.656780:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32453:x1830976126084096:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155644.656793:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.656807:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8640 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1873b expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.656831:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.656838:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155644.656840:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155644.656842:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8640 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1873b expref: 16 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.656866:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.656881:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 18 pid: 9235 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.656900:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125416576:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.656975:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155644.659060:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.659151:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126084224 00000100:00100000:2.0:1746155644.659157:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126084224 00002000:00100000:2.0:1746155644.659188:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1482752->1974271) req@ffff88009366f800 x1830976126084224/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.659196:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366f800 with x1830976126084224 ext(1482752->1974271) 00010000:00010000:2.0:1746155644.659203:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 19 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.659214:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 19 pid: 9235 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746155644.659220:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009366f800 00000100:00100000:2.0:1746155644.659234:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1432 00000100:00100000:2.0:1746155644.659240:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126084224:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155644.660757:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125416576:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.660780:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8640 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1873b expref: 16 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.660793:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0fe00, rc 0) 00000100:00100000:3.0:1746155644.660873:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32453:x1830976126084096:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4094us (5640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.660964:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17289 00000100:00100000:2.0:1746155644.674122:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976126084224:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 14875us (15057us total) trans 21474841659 rc 0/0 00000100:00100000:2.0:1746155644.674133:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1432 00002000:00100000:2.0:1746155644.674143:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1482752->1974271) req@ffff88009366f800 x1830976126084224/t21474841659(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/448 e 0 to 0 dl 1746155655 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.674153:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366f800 with x1830976126084224 ext(1482752->1974271) 00010000:00010000:2.0:1746155644.674161:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 21 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.674175:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 21 pid: 9235 timeout: 873 lvb_type: 0 00002000:00010000:2.0:1746155644.674181:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009366f800 00000100:00100000:0.0:1746155644.676254:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.677168:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126084352 00000100:00100000:3.0:1746155644.677176:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126084352 00010000:00010000:3.0:1746155644.677209:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 21 pid: 9235 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.677245:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8859 00000100:00100000:3.0:1746155644.677252:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126084352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.677263:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.677280:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 21 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.677295:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 21 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.677312:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fed9600/0x844e5faceb5f8616 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1482752->1974271) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1871f expref: 21 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.677326:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.677327:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.677333:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8640 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1873b expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.677339:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8640 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1873b expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.677364:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8640 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1873b expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.677375:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125416704:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155644.677443:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155644.678542:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125416704:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155644.678559:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.678587:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126084352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1336us (2336us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.678592:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8859 00000100:00100000:3.0:1746155644.681357:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.681401:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.681403:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126084608 00000100:00100000:2.0:1746155644.681411:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126084608 00002000:00100000:2.0:1746155644.681447:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009fac5180 x1830976126084608/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.681455:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac5180 with x1830976126084608 ext(1048576->2097151) 00002000:00010000:2.0:1746155644.681460:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fac5180 00000100:00100000:2.0:1746155644.681485:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126084864 00000100:00100000:2.0:1746155644.681487:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126084864 00002000:00100000:2.0:1746155644.681514:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1785855) req@ffff88009fac6680 x1830976126084864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.681522:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6680 with x1830976126084864 ext(1048576->1785855) 00002000:00010000:2.0:1746155644.681524:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac6680 00000100:00100000:0.0:1746155644.681534:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8197 00000100:00100000:2.0:1746155644.681541:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8198 00000100:00100000:0.0:1746155644.681544:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126084608:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.681547:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126084864:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.691078:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126084864:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9521us (9666us total) trans 0 rc 737280/737280 00000100:00100000:2.0:1746155644.691089:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8198 00002000:00100000:2.0:1746155644.691100:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1785855) req@ffff88009fac6680 x1830976126084864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 737280/737280 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.691108:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6680 with x1830976126084864 ext(1048576->1785855) 00002000:00010000:2.0:1746155644.691113:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac6680 00000100:00100000:1.0:1746155644.691128:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126084608:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9585us (9775us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155644.691136:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8197 00002000:00100000:1.0:1746155644.691141:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009fac5180 x1830976126084608/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.691148:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac5180 with x1830976126084608 ext(1048576->2097151) 00002000:00010000:1.0:1746155644.691152:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fac5180 00000100:00100000:0.0:1746155644.704499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.704604:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126085120 00000100:00100000:1.0:1746155644.704615:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126085120 00000100:00100000:0.0:1746155644.704625:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:1.0:1746155644.704652:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2453504->3502079) req@ffff88009366e680 x1830976126085120/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.704660:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366e680 with x1830976126085120 ext(2453504->3502079) 00002000:00010000:1.0:1746155644.704665:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366e680 00000100:00100000:1.0:1746155644.704690:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126085248 00000100:00100000:1.0:1746155644.704693:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126085248 00002000:00100000:1.0:1746155644.704704:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3502080->4194303) req@ffff88009366c000 x1830976126085248/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.704710:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366c000 with x1830976126085248 ext(3502080->4194303) 00002000:00010000:1.0:1746155644.704713:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366c000 00000100:00100000:3.0:1746155644.704724:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8199 00000100:00100000:1.0:1746155644.704729:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8200 00000100:00100000:1.0:1746155644.704735:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976126085248:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155644.704738:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1963:x1830976126085120:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155644.710301:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1962:x1830976126085248:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5558us (5667us total) trans 0 rc 692224/692224 00000100:00100000:1.0:1746155644.710311:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8200 00002000:00100000:1.0:1746155644.710320:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3502080->4194303) req@ffff88009366c000 x1830976126085248/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 692224/692224 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.710329:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366c000 with x1830976126085248 ext(3502080->4194303) 00002000:00010000:1.0:1746155644.710334:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366c000 00000100:00100000:3.0:1746155644.713948:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1963:x1830976126085120:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9209us (9448us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.713959:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8199 00002000:00100000:3.0:1746155644.713968:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (2453504->3502079) req@ffff88009366e680 x1830976126085120/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.713977:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366e680 with x1830976126085120 ext(2453504->3502079) 00002000:00010000:3.0:1746155644.713982:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366e680 00000100:00100000:0.0:1746155644.722448:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.722611:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126085632 00000100:00100000:3.0:1746155644.722619:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126085632 00002000:00100000:3.0:1746155644.722656:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009fc51f80 x1830976126085632/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.722666:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc51f80 with x1830976126085632 ext(4194304->5083135) 00002000:00010000:3.0:1746155644.722670:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc51f80 00000100:00100000:3.0:1746155644.722701:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8201 00000100:00100000:3.0:1746155644.722709:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1963:x1830976126085632:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155644.727904:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.727939:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.728529:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126085760 00000100:00100000:3.0:1746155644.728538:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126085760 00000100:00100000:0.0:1746155644.728545:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.728560:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126085888 00000100:00100000:0.0:1746155644.728563:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126085888 00000100:00100000:3.0:1746155644.728774:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126086016 00000100:00100000:3.0:1746155644.728776:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126086016 00000100:00100000:3.0:1746155644.728989:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17290 00000100:00100000:3.0:1746155644.728995:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126085760:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155644.729009:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155644.729012:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17291 00000100:00100000:0.0:1746155644.729019:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976126085888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155644.729023:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f8647 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18742 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.729026:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155644.729034:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f5aa400/0x844e5faceb5f864e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18749 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.729040:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.729042:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.729049:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f8647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18742 expref: 21 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.729062:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f8647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18742 expref: 21 pid: 9235 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155644.729067:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125416832:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155644.729070:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0e200, rc 0) 00000100:00100000:3.0:1746155644.729102:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126085760:12345-192.168.202.51@tcp:101:cat.0 Request processed in 107us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.729105:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17292 00000100:00100000:3.0:1746155644.729109:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17290 00000100:00100000:1.0:1746155644.729116:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976126086016:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155644.729123:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.729129:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fed8400/0x844e5faceb5f8655 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18750 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155644.729421:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125416960:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155644.729644:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d773c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.729945:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1963:x1830976126085632:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7236us (7503us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155644.729953:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8201 00002000:00100000:2.0:1746155644.729960:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009fc51f80 x1830976126085632/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.729968:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc51f80 with x1830976126085632 ext(4194304->5083135) 00002000:00010000:2.0:1746155644.729972:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc51f80 00000100:00100000:1.0:1746155644.730284:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b300 going to sleep for 11 seconds 00002000:00010000:1.0:1746155644.733298:0:19959:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155644 -> 1746155645 00002000:00010000:1.0:1746155644.733303:0:19959:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155644 -> 1746155645 00002000:00010000:1.0:1746155644.733306:0:19959:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime: 1746155644 -> 1746155645 00000100:00100000:1.0:1746155644.733324:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125416960:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155644.733347:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fed8400/0x844e5faceb5f8655 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18750 expref: 33 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.733358:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fed8400/0x844e5faceb5f8655 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18750 expref: 33 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.733378:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fed8400, rc 0) 00000100:00100000:1.0:1746155644.733408:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976126086016:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4297us (4863us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155644.733414:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17292 00002000:00010000:2.0:1746155644.733556:0:4461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime: 1746155644 -> 1746155645 00002000:00010000:2.0:1746155644.733560:0:4461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime: 1746155644 -> 1746155645 00002000:00010000:2.0:1746155644.733561:0:4461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime: 1746155644 -> 1746155645 00000100:00100000:2.0:1746155644.733570:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc53480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125416832:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155644.733585:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f5aa400/0x844e5faceb5f864e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18749 expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.733592:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f5aa400/0x844e5faceb5f864e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18749 expref: 31 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.733612:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f5aa400, rc 0) 00000100:00100000:2.0:1746155644.733632:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1960:x1830976126085888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4614us (5692us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155644.733638:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17291 00000100:00100000:0.0:1746155644.735727:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.735777:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126086272 00000100:00100000:2.0:1746155644.735783:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126086272 00000100:00100000:2.0:1746155644.735829:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11185 00000100:00100000:2.0:1746155644.735836:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32459:x1830976126086272:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155644.735855:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.735869:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f865c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18757 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.735958:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.735972:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1867e expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.735978:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f85de lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1870a expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.735985:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173000/0x844e5faceb5f8601 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18711 expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.735990:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.736017:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173000/0x844e5faceb5f8601 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18711 expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.736027:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173000/0x844e5faceb5f8601 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18711 expref: 290 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.736037:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125417088:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.736663:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f85de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1870a expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.736670:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f85de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1870a expref: 16 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.736678:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125417216:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.737787:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1867e expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.737795:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1867e expref: 16 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.737802:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125417344:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.738084:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.738388:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125417088:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.738567:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.738690:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126086400 00000100:00100000:3.0:1746155644.738695:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126086400 00010000:00010000:3.0:1746155644.738718:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173000/0x844e5faceb5f8601 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18711 expref: 291 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.738739:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8860 00000100:00100000:3.0:1746155644.738745:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1961:x1830976126086400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.738753:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.738758:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173000/0x844e5faceb5f8601 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18711 expref: 291 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.738765:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173000/0x844e5faceb5f8601 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18711 expref: 291 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.738785:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c173000/0x844e5faceb5f8601 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18711 expref: 291 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.738977:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.738981:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.738988:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.738992:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.739089:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1961:x1830976126086400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 344us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.739095:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8860 00000100:00100000:2.0:1746155644.739605:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125417216:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.739613:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125417344:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.739629:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155644.740663:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.740706:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126086528 00000100:00100000:3.0:1746155644.740710:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126086528 00010000:00010000:3.0:1746155644.740727:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f85de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1870a expref: 17 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.740755:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8861 00000100:00100000:3.0:1746155644.740762:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976126086528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.740769:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.740774:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f85de lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1870a expref: 17 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.740782:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f85de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1870a expref: 17 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.740800:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5fabc00/0x844e5faceb5f85de lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1870a expref: 17 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.740812:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.740816:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.740822:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.740827:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.740856:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976126086528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 94us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.740862:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8861 00000100:00100000:0.0:1746155644.740990:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.741248:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126087040 00000100:00100000:3.0:1746155644.741252:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126087040 00000100:00100000:2.0:1746155644.741252:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:3.0:1746155644.741274:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fc52680 x1830976126087040/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.741282:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc52680 with x1830976126087040 ext(0->1048575) 00002000:00010000:3.0:1746155644.741286:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc52680 00000100:00100000:1.0:1746155644.741292:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126086656 00000100:00100000:1.0:1746155644.741296:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126086656 00000100:00100000:3.0:1746155644.741298:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8202 00000100:00100000:3.0:1746155644.741303:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976126087040:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:1.0:1746155644.741310:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1867e expref: 16 pid: 20364 timeout: 873 lvb_type: 0 00000100:00100000:1.0:1746155644.741326:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8862 00000100:00100000:1.0:1746155644.741331:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976126086656:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155644.741337:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155644.741340:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1867e expref: 16 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.741348:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1867e expref: 16 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.741364:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fd4c400/0x844e5faceb5f853d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1867e expref: 16 pid: 20364 timeout: 873 lvb_type: 0 00010000:00010000:1.0:1746155644.741374:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155644.741378:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.741384:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.741389:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155644.741402:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.741419:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976126086656:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 88us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.741424:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8862 00000100:00100000:1.0:1746155644.741462:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155644.741528:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.741535:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155644.741549:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155644.741641:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f865c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18757 expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.741665:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18757 expref: 15 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.741671:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.741673:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155644.741674:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26e600, rc 0) 00000100:00100000:2.0:1746155644.741694:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32459:x1830976126086272:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5858us (5971us total) trans 8589945353 rc 0/0 00000100:00100000:2.0:1746155644.741699:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11185 00000100:00100000:0.0:1746155644.741855:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126087168 00000100:00100000:0.0:1746155644.741858:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126087168 00002000:00100000:0.0:1746155644.741873:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009f4fed80 x1830976126087168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155644.741883:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fed80 with x1830976126087168 ext(1048576->2097151) 00002000:00010000:0.0:1746155644.741887:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fed80 00000100:00100000:0.0:1746155644.741908:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8203 00000100:00100000:0.0:1746155644.741913:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976126087168:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155644.750536:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:1961:x1830976126087040:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9225us (9538us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.750547:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8202 00002000:00100000:3.0:1746155644.750556:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009fc52680 x1830976126087040/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.750566:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc52680 with x1830976126087040 ext(0->1048575) 00002000:00010000:3.0:1746155644.750570:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fc52680 00000100:00100000:2.0:1746155644.751177:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976126087168:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9263us (9713us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.751184:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8203 00002000:00100000:2.0:1746155644.751189:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009f4fed80 x1830976126087168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.751195:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fed80 with x1830976126087168 ext(1048576->2097151) 00002000:00010000:2.0:1746155644.751198:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fed80 00000100:00100000:0.0:1746155644.760352:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.760448:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126087296 00000100:00100000:2.0:1746155644.760457:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126087296 00000100:00100000:2.0:1746155644.760533:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17293 00000100:00100000:2.0:1746155644.760541:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+30:32458:x1830976126087296:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155644.760558:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.760573:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8671 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1875e expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.760600:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.760607:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155644.760609:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155644.760612:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8671 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1875e expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.760637:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.760647:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 17 pid: 9235 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.760664:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125417472:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.761967:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.762255:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125417472:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.762274:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8671 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1875e expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.762289:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26f600, rc 0) 00000100:00100000:2.0:1746155644.762317:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:32458:x1830976126087296:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1777us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.762324:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17293 00000100:00100000:0.0:1746155644.762609:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.762665:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126087424 00000100:00100000:3.0:1746155644.762670:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126087424 00002000:00100000:3.0:1746155644.762696:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e3:0x0] (1785856->2097151) req@ffff88009fc53b80 x1830976126087424/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.762704:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc53b80 with x1830976126087424 ext(1785856->2097151) 00010000:00010000:3.0:1746155644.762709:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 18 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.762719:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 18 pid: 9235 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155644.762726:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc53b80 00000100:00100000:3.0:1746155644.762738:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1433 00000100:00100000:3.0:1746155644.762743:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976126087424:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155644.767750:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976126087424:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 4997us (5132us total) trans 17179874348 rc 0/0 00000100:00100000:3.0:1746155644.767760:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1433 00002000:00100000:3.0:1746155644.767771:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e3:0x0] (1785856->2097151) req@ffff88009fc53b80 x1830976126087424/t17179874348(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/448 e 0 to 0 dl 1746155655 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.767780:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc53b80 with x1830976126087424 ext(1785856->2097151) 00010000:00010000:3.0:1746155644.767787:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 20 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.767801:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 20 pid: 9235 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155644.767808:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fc53b80 00000100:00100000:0.0:1746155644.770902:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.770982:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126087552 00000100:00100000:2.0:1746155644.770989:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126087552 00010000:00010000:2.0:1746155644.771012:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 20 pid: 9235 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.771043:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8863 00000100:00100000:2.0:1746155644.771049:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126087552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.771059:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.771076:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 20 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.771086:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 20 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.771108:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fed9000/0x844e5faceb5f860f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1785856->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18718 expref: 20 pid: 9235 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.771131:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.771133:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.771257:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8671 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1875e expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.771266:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8671 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1875e expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.771295:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8671 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1875e expref: 30 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.771310:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125417600:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155644.771378:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.772491:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125417600:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155644.772526:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155644.772547:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126087552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1497us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.772553:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8863 00000100:00100000:0.0:1746155644.774225:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.774286:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126087808 00000100:00100000:3.0:1746155644.774291:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126087808 00002000:00100000:3.0:1746155644.774320:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009b881c00 x1830976126087808/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.774328:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881c00 with x1830976126087808 ext(1048576->2097151) 00002000:00010000:3.0:1746155644.774332:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881c00 00000100:00100000:3.0:1746155644.774347:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8204 00000100:00100000:3.0:1746155644.774352:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976126087808:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155644.779310:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:1960:x1830976126087808:12345-192.168.202.51@tcp:3:cat.0 Request processed in 4946us (5075us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.779321:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8204 00002000:00100000:3.0:1746155644.779330:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009b881c00 x1830976126087808/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.779339:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881c00 with x1830976126087808 ext(1048576->2097151) 00002000:00010000:3.0:1746155644.779344:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881c00 00000100:00100000:0.0:1746155644.784706:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.784804:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126087936 00000100:00100000:2.0:1746155644.784812:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126087936 00000100:00100000:2.0:1746155644.784864:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17294 00000100:00100000:2.0:1746155644.784872:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+31:32458:x1830976126087936:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155644.784900:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.784914:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f26fa00/0x844e5faceb5f8678 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18765 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.784939:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 18 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.784947:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155644.784948:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155644.784951:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26fa00/0x844e5faceb5f8678 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18765 expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.784974:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 18 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.784984:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 18 pid: 10591 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.784994:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125417728:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.785265:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.786393:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125417728:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.786411:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f26fa00/0x844e5faceb5f8678 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18765 expref: 32 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.786422:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26fa00, rc 0) 00000100:00100000:2.0:1746155644.786444:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:32458:x1830976126087936:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1574us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.786451:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17294 00000100:00100000:0.0:1746155644.787572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.787639:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126088064 00000100:00100000:3.0:1746155644.787645:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126088064 00002000:00100000:3.0:1746155644.787674:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->4157439) req@ffff88009b881500 x1830976126088064/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 504/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.787688:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881500 with x1830976126088064 ext(2097152->4157439) 00010000:00010000:3.0:1746155644.787694:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 19 pid: 10591 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.787705:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 19 pid: 10591 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155644.787711:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b881500 00000100:00100000:3.0:1746155644.787757:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1434 00000100:00100000:3.0:1746155644.787764:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126088064:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155644.795022:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126088064:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 7250us (7443us total) trans 17179874349 rc 0/0 00000100:00100000:3.0:1746155644.795031:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1434 00002000:00100000:3.0:1746155644.795039:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->4157439) req@ffff88009b881500 x1830976126088064/t17179874349(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 504/448 e 0 to 0 dl 1746155655 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.795047:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881500 with x1830976126088064 ext(2097152->4157439) 00010000:00010000:3.0:1746155644.795056:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 21 pid: 10591 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.795069:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 21 pid: 10591 timeout: 873 lvb_type: 0 00002000:00010000:3.0:1746155644.795075:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b881500 00000100:00100000:0.0:1746155644.799148:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.799239:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126088192 00000100:00100000:2.0:1746155644.799246:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126088192 00010000:00010000:2.0:1746155644.799269:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 21 pid: 10591 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.799826:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8864 00000100:00100000:2.0:1746155644.799833:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976126088192:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.799844:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.799862:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 21 pid: 10591 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.799874:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 21 pid: 10591 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.799908:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801369b8a00/0x844e5faceb5f861d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2453503) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18726 expref: 21 pid: 10591 timeout: 873 lvb_type: 0 00010000:00010000:2.0:1746155644.800433:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.800435:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.800442:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f26fa00/0x844e5faceb5f8678 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18765 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.800450:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26fa00/0x844e5faceb5f8678 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18765 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.800478:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f26fa00/0x844e5faceb5f8678 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18765 expref: 31 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.800489:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125417856:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155644.800594:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.802242:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125417856:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155644.802256:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155644.802293:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976126088192:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2459us (3150us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.802301:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8864 00000100:00100000:0.0:1746155644.805763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.805797:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.805823:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126088448 00000100:00100000:3.0:1746155644.805831:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126088448 00000100:00100000:1.0:1746155644.805851:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126088704 00000100:00100000:1.0:1746155644.805855:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126088704 00002000:00100000:3.0:1746155644.805865:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009b880700 x1830976126088448/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.805871:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009b880a80 x1830976126088704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.805874:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880700 with x1830976126088448 ext(2097152->3145727) 00002000:00010000:3.0:1746155644.805878:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b880700 00002000:00100000:1.0:1746155644.805878:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880a80 with x1830976126088704 ext(3145728->4194303) 00002000:00010000:1.0:1746155644.805881:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b880a80 00000100:00100000:3.0:1746155644.806845:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8205 00000100:00100000:3.0:1746155644.806856:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976126088448:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.806877:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8206 00000100:00100000:2.0:1746155644.806904:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976126088704:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155644.813902:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976126088448:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7032us (8129us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.813913:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8205 00002000:00100000:3.0:1746155644.813926:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009b880700 x1830976126088448/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.813934:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880700 with x1830976126088448 ext(2097152->3145727) 00002000:00010000:3.0:1746155644.813940:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b880700 00000100:00100000:2.0:1746155644.817352:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976126088704:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10459us (11545us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.817363:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8206 00002000:00100000:2.0:1746155644.817373:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009b880a80 x1830976126088704/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.817383:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b880a80 with x1830976126088704 ext(3145728->4194303) 00002000:00010000:2.0:1746155644.817388:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b880a80 00000100:00100000:0.0:1746155644.823883:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.824350:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126088960 00000100:00100000:2.0:1746155644.824365:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126088960 00002000:00100000:2.0:1746155644.824406:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009b881180 x1830976126088960/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.824415:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881180 with x1830976126088960 ext(4194304->5083135) 00002000:00010000:2.0:1746155644.824420:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881180 00000100:00100000:2.0:1746155644.824451:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8207 00000100:00100000:2.0:1746155644.824458:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976126088960:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.831609:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1963:x1830976126088960:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7144us (7725us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155644.831619:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8207 00002000:00100000:2.0:1746155644.831629:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009b881180 x1830976126088960/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.831638:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881180 with x1830976126088960 ext(4194304->5083135) 00002000:00010000:2.0:1746155644.831644:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881180 00000100:00100000:0.0:1746155644.836905:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.837377:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126089216 00000100:00100000:2.0:1746155644.837385:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126089216 00000100:00100000:2.0:1746155644.837437:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11186 00000100:00100000:2.0:1746155644.837444:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32463:x1830976126089216:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155644.837462:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.837476:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f800/0x844e5faceb5f867f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1876c expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.837599:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fe00/0x844e5faceb5f8686 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837610:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fe00/0x844e5faceb5f8686 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837619:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fe00/0x844e5faceb5f8686 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837629:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f868d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837638:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f868d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837643:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f868d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837725:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f200/0x844e5faceb5f8694 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837732:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f200/0x844e5faceb5f8694 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837738:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f200/0x844e5faceb5f8694 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155644.837745:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155644.837807:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fe00/0x844e5faceb5f8686 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837812:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fe00/0x844e5faceb5f8686 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837816:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fe00/0x844e5faceb5f8686 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837821:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26fe00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.837823:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fe00/0x844e5faceb5f8686 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837828:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fe00/0x844e5faceb5f8686 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837836:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155644.837839:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155644.837842:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fe00/0x844e5faceb5f8686 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837846:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fe00/0x844e5faceb5f8686 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837875:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f868d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837880:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f868d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837884:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f868d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837887:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26fc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.837913:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f868d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837917:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f868d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837923:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ae84000) 00010000:00010000:2.0:1746155644.837924:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155644.837926:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f868d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837931:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f868d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.837963:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f800/0x844e5faceb5f867f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1876c expref: 293 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.837976:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f200/0x844e5faceb5f8694 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1876c expref: 292 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.837981:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.837983:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155644.837985:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26f200, rc 0) 00000100:00100000:2.0:1746155644.838039:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32463:x1830976126089216:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 595us (1150us total) trans 8589945354 rc 0/0 00000100:00100000:2.0:1746155644.838045:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11186 00000100:00100000:0.0:1746155644.847131:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.847184:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126089344 00000100:00100000:2.0:1746155644.847192:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126089344 00000100:00100000:2.0:1746155644.847237:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17295 00000100:00100000:2.0:1746155644.847244:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:32463:x1830976126089344:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155644.847258:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.847272:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18773 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.847297:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a285c00/0x844e5faceb5f8464 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1864d expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.847304:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b5257c00/0x844e5faceb5f85a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e7 expref: 22 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.847311:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5f856e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186af expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.847320:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.847322:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.847324:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 22 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.847347:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5f856e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186af expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.847356:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5f856e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186af expref: 15 pid: 8437 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746155644.847366:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125417984:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.847454:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b5257c00/0x844e5faceb5f85a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e7 expref: 22 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.847461:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b5257c00/0x844e5faceb5f85a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e7 expref: 22 pid: 4461 timeout: 873 lvb_type: 0 00000100:00100000:2.0:1746155644.847468:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125418112:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155644.847489:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a285c00/0x844e5faceb5f8464 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1864d expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.847496:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a285c00/0x844e5faceb5f8464 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1864d expref: 10 pid: 20200 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746155644.847538:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125418240:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.847566:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3320c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155644.850680:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.850721:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.850749:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126089472 00000100:00100000:3.0:1746155644.850756:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126089472 00010000:00010000:3.0:1746155644.850783:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5f856e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186af expref: 16 pid: 8437 timeout: 873 lvb_type: 1 00000100:00100000:1.0:1746155644.850798:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126089600 00000100:00100000:1.0:1746155644.850802:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126089600 00000100:00100000:3.0:1746155644.850812:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8865 00010000:00010000:1.0:1746155644.850817:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a285c00/0x844e5faceb5f8464 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1864d expref: 11 pid: 20200 timeout: 873 lvb_type: 1 00000100:00100000:3.0:1746155644.850821:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1963:x1830976126089472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.850831:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155644.850841:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8866 00000100:00100000:1.0:1746155644.850847:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976126089600:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.850850:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5f856e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186af expref: 16 pid: 8437 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746155644.850852:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155644.850861:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009a285c00/0x844e5faceb5f8464 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1864d expref: 11 pid: 20200 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.850867:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5f856e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186af expref: 16 pid: 8437 timeout: 873 lvb_type: 1 00000100:00100000:2.0:1746155644.851037:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125417984:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.851051:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125418112:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155644.851058:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125418240:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.851199:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a285c00/0x844e5faceb5f8464 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1864d expref: 11 pid: 20200 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746155644.851220:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a285c00/0x844e5faceb5f8464 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1864d expref: 11 pid: 20200 timeout: 873 lvb_type: 1 00010000:00010000:3.0:1746155644.851296:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c7b2c00/0x844e5faceb5f856e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186af expref: 16 pid: 8437 timeout: 873 lvb_type: 1 00010000:00010000:1.0:1746155644.851766:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.851800:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976126089600:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 952us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.851807:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8866 00010000:00010000:2.0:1746155644.851934:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2928640->3145727] (req 2928640->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 22 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.851945:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26f000, rc 0) 00010000:00010000:3.0:1746155644.852062:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155644.852447:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32463:x1830976126089344:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5201us (5321us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.852453:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17295 00000100:00100000:3.0:1746155644.852570:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1963:x1830976126089472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1750us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.852576:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8865 00000100:00100000:1.0:1746155644.852610:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.852619:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126089728 00000100:00100000:3.0:1746155644.852622:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126089728 00010000:00010000:3.0:1746155644.852633:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b5257c00/0x844e5faceb5f85a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e7 expref: 22 pid: 4461 timeout: 873 lvb_type: 0 00000100:00100000:3.0:1746155644.852650:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8867 00000100:00100000:3.0:1746155644.852655:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976126089728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.852661:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.852669:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800b5257c00/0x844e5faceb5f85a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e7 expref: 22 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.852678:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b5257c00/0x844e5faceb5f85a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e7 expref: 22 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.852688:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b5257c00/0x844e5faceb5f85a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186e7 expref: 22 pid: 4461 timeout: 873 lvb_type: 0 00010000:00010000:3.0:1746155644.852696:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.852698:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.852703:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.852709:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.852728:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.852737:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125418368:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155644.852791:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155644.853209:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.853247:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126089984 00000100:00100000:3.0:1746155644.853251:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126089984 00000100:00100000:3.0:1746155644.853280:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11187 00000100:00100000:3.0:1746155644.853286:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32467:x1830976126089984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155644.853301:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.853312:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094948400/0x844e5faceb5f86a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1877a expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.853385:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094948600/0x844e5faceb5f86b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853395:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094948600/0x844e5faceb5f86b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853407:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094948600/0x844e5faceb5f86b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853418:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094948800/0x844e5faceb5f86b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853423:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094948800/0x844e5faceb5f86b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853428:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094948800/0x844e5faceb5f86b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853542:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094948a00/0x844e5faceb5f86be lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853549:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094948a00/0x844e5faceb5f86be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853554:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094948a00/0x844e5faceb5f86be lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:3.0:1746155644.853561:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155644.853629:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094948600/0x844e5faceb5f86b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853634:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094948600/0x844e5faceb5f86b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853640:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094948600/0x844e5faceb5f86b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853645:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094948600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155644.853648:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094948600/0x844e5faceb5f86b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853654:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094948600/0x844e5faceb5f86b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853661:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155644.853664:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155644.853667:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094948600/0x844e5faceb5f86b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853672:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094948600/0x844e5faceb5f86b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853679:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094948800/0x844e5faceb5f86b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853683:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094948800/0x844e5faceb5f86b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853688:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094948800/0x844e5faceb5f86b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853691:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094948800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155644.853693:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094948800/0x844e5faceb5f86b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853698:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094948800/0x844e5faceb5f86b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853703:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0c00) 00010000:00010000:3.0:1746155644.853705:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155644.853706:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094948800/0x844e5faceb5f86b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853710:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094948800/0x844e5faceb5f86b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155644.853739:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094948400/0x844e5faceb5f86a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1877a expref: 18 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.853748:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094948a00/0x844e5faceb5f86be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1877a expref: 17 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.853754:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.853756:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155644.853758:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094948a00, rc 0) 00000100:00100000:3.0:1746155644.853793:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32467:x1830976126089984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 506us (583us total) trans 8589945355 rc 0/0 00000100:00100000:3.0:1746155644.853798:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11187 00000100:00100000:3.0:1746155644.854447:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125418368:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155644.854465:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.854489:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976126089728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1833us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.854495:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8867 00000100:00100000:0.0:1746155644.854835:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.854979:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126090240 00000100:00100000:2.0:1746155644.854983:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126090240 00002000:00100000:2.0:1746155644.855003:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2928640->2932735) req@ffff88009fed8000 x1830976126090240/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.855011:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed8000 with x1830976126090240 ext(2928640->2932735) 00002000:00010000:2.0:1746155644.855015:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fed8000 00000100:00100000:2.0:1746155644.855033:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8208 00000100:00100000:2.0:1746155644.855038:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976126090240:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155644.855132:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976126090240:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 93us (296us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155644.855140:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8208 00002000:00100000:2.0:1746155644.855144:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2928640->2932735) req@ffff88009fed8000 x1830976126090240/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/4536 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.855150:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed8000 with x1830976126090240 ext(2928640->2932735) 00002000:00010000:2.0:1746155644.855153:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fed8000 00000100:00100000:0.0:1746155644.855335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.855591:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126090496 00000100:00100000:3.0:1746155644.855594:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126090496 00000100:00100000:3.0:1746155644.855627:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4757 00000100:00100000:3.0:1746155644.855632:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32467:x1830976126090496:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155644.855731:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32467:x1830976126090496:12345-192.168.202.51@tcp:35:cat.0 Request processed in 99us (396us total) trans 8589945356 rc 0/0 00000100:00100000:3.0:1746155644.855737:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4757 00000100:00100000:0.0:1746155644.857455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.857575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.857597:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.857819:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126090624 00000100:00100000:2.0:1746155644.857824:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126090624 00000100:00100000:2.0:1746155644.857850:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126090880 00000100:00100000:2.0:1746155644.857852:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126090880 00000100:00100000:2.0:1746155644.857868:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126090752 00000100:00100000:2.0:1746155644.857869:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126090752 00000100:00100000:2.0:1746155644.857882:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17296 00000100:00100000:2.0:1746155644.857887:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976126090624:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155644.857908:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.857921:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f26ee00/0x844e5faceb5f86cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18781 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.857939:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.857941:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.857948:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26ee00/0x844e5faceb5f86cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18781 expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.857962:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f26ee00/0x844e5faceb5f86cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18781 expref: 22 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.857970:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26ee00, rc 0) 00000100:00100000:2.0:1746155644.857998:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1963:x1830976126090624:12345-192.168.202.51@tcp:101:cat.0 Request processed in 111us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.858004:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17296 00000100:00100000:2.0:1746155644.858015:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17297 00000100:00100000:2.0:1746155644.858019:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1963:x1830976126090880:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155644.858025:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.858032:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f86d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1878f expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.858064:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125418496:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155644.858099:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.858115:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17298 00000100:00100000:2.0:1746155644.858120:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976126090752:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155644.858125:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.858131:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f86da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18788 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.858140:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.858142:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.858146:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f86da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18788 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.858154:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f86da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18788 expref: 22 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.858161:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26e200, rc 0) 00000100:00100000:2.0:1746155644.858176:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1963:x1830976126090752:12345-192.168.202.51@tcp:101:cat.0 Request processed in 56us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.858181:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17298 00000100:00100000:0.0:1746155644.858978:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.859034:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126091008 00000100:00100000:3.0:1746155644.859039:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126091008 00000100:00100000:3.0:1746155644.859072:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17299 00000100:00100000:3.0:1746155644.859077:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:32463:x1830976126091008:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155644.859085:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.859092:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18796 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.859107:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f26fa00/0x844e5faceb5f8678 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18765 expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.859114:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f86da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18788 expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.859119:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.859120:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155644.859123:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->3170303] (req 3145728->3170303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 33 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.859141:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f86da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18788 expref: 21 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.859151:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f86da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18788 expref: 21 pid: 8437 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155644.859160:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125418624:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.859211:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f26fa00/0x844e5faceb5f8678 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18765 expref: 33 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.859224:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f26fa00/0x844e5faceb5f8678 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18765 expref: 33 pid: 4461 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155644.859231:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125418752:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.859248:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f1db40 going to sleep for 11 seconds 00002000:00010000:2.0:1746155644.859664:0:18270:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime: 1746155644 -> 1746155645 00002000:00010000:2.0:1746155644.859667:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime: 1746155644 -> 1746155645 00002000:00010000:2.0:1746155644.859669:0:18270:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime: 1746155644 -> 1746155645 00000100:00100000:2.0:1746155644.859684:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125418496:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155644.859700:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f86d3 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1878f expref: 16 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.859709:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f86d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1878f expref: 16 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.859719:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26fc00, rc 0) 00000100:00100000:2.0:1746155644.859745:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1963:x1830976126090880:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1725us (2170us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155644.859751:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17297 00000100:00100000:3.0:1746155644.860900:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125418624:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.860910:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125418752:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.860928:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->3170303] (req 3145728->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 33 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.860938:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094948200, rc 0) 00000100:00100000:3.0:1746155644.860958:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:32463:x1830976126091008:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1881us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.860963:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17299 00000100:00100000:0.0:1746155644.861474:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.861560:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126091136 00000100:00100000:3.0:1746155644.861564:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126091136 00010000:00010000:3.0:1746155644.861584:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f86da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18788 expref: 22 pid: 8437 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155644.861603:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8868 00000100:00100000:3.0:1746155644.861609:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976126091136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.861619:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.861632:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f86da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18788 expref: 22 pid: 8437 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155644.861642:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f86da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18788 expref: 22 pid: 8437 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155644.861656:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f86da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18788 expref: 22 pid: 8437 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155644.861665:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.861684:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1961:x1830976126091136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 75us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.861689:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8868 00000100:00100000:0.0:1746155644.866022:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.866070:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126091264 00000100:00100000:2.0:1746155644.866078:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126091264 00010000:00010000:2.0:1746155644.866103:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26fa00/0x844e5faceb5f8678 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18765 expref: 33 pid: 4461 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155644.866136:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8869 00000100:00100000:2.0:1746155644.866142:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976126091264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.866153:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155644.866195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.866240:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126091520 00000100:00100000:3.0:1746155644.866248:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126091520 00002000:00100000:3.0:1746155644.866269:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fed8a80 x1830976126091520/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.866277:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed8a80 with x1830976126091520 ext(1048576->2097151) 00002000:00010000:3.0:1746155644.866281:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed8a80 00000100:00100000:3.0:1746155644.866297:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8209 00000100:00100000:3.0:1746155644.866301:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976126091520:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:2.0:1746155644.866336:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f26fa00/0x844e5faceb5f8678 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18765 expref: 33 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155644.866373:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f26fa00/0x844e5faceb5f8678 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18765 expref: 33 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155644.866390:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f26fa00/0x844e5faceb5f8678 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18765 expref: 33 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155644.866410:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.866411:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.866416:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 32 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.866423:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 32 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.866445:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 32 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.866455:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125418880:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155644.867591:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.871620:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125418880:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155644.871637:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155644.871672:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976126091264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5529us (5654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.871680:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8869 00000100:00100000:3.0:1746155644.872357:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976126091520:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6052us (6158us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.872365:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8209 00002000:00100000:3.0:1746155644.872373:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fed8a80 x1830976126091520/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.872381:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed8a80 with x1830976126091520 ext(1048576->2097151) 00002000:00010000:3.0:1746155644.872386:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed8a80 00000100:00100000:0.0:1746155644.872444:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.872521:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126091776 00000100:00100000:3.0:1746155644.872526:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126091776 00002000:00100000:3.0:1746155644.872549:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3166208->3170303) req@ffff88009fed9f80 x1830976126091776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.872556:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9f80 with x1830976126091776 ext(3166208->3170303) 00002000:00010000:3.0:1746155644.872559:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed9f80 00000100:00100000:3.0:1746155644.872579:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8210 00000100:00100000:3.0:1746155644.872585:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976126091776:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155644.872693:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1960:x1830976126091776:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 107us (248us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155644.872698:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8210 00002000:00100000:3.0:1746155644.872703:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3166208->3170303) req@ffff88009fed9f80 x1830976126091776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/4536 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.872710:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9f80 with x1830976126091776 ext(3166208->3170303) 00002000:00010000:3.0:1746155644.872712:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed9f80 00000100:00100000:0.0:1746155644.875293:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.875350:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126092032 00000100:00100000:1.0:1746155644.875357:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126092032 00000100:00100000:1.0:1746155644.875403:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4758 00000100:00100000:1.0:1746155644.875410:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32463:x1830976126092032:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155644.876482:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32463:x1830976126092032:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 1070us (1193us total) trans 8589945357 rc 0/0 00000100:00100000:1.0:1746155644.876489:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4758 00000100:00100000:0.0:1746155644.877228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.877438:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.877607:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126092160 00000100:00100000:3.0:1746155644.877612:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126092160 00000100:00100000:3.0:1746155644.877641:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126092288 00000100:00100000:3.0:1746155644.877643:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126092288 00000100:00100000:3.0:1746155644.877655:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17300 00000100:00100000:3.0:1746155644.877660:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976126092160:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155644.877666:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17301 00010000:00010000:3.0:1746155644.877671:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155644.877673:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1963:x1830976126092288:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155644.877681:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.877684:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094948000/0x844e5faceb5f86e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1879d expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.877689:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fed9000/0x844e5faceb5f86ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187a4 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155644.877722:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125419008:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155644.877722:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125419136:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155644.877765:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155644.877773:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155644.879531:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125419136:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155644.879552:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fed9000/0x844e5faceb5f86ef lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187a4 expref: 16 pid: 19959 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155644.879562:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125419008:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155644.879562:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fed9000/0x844e5faceb5f86ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187a4 expref: 16 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.879578:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094948000/0x844e5faceb5f86e8 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1879d expref: 22 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155644.879585:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fed9000, rc 0) 00010000:00010000:3.0:1746155644.879587:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094948000/0x844e5faceb5f86e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1879d expref: 22 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155644.879609:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094948000, rc 0) 00000100:00100000:1.0:1746155644.879612:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1963:x1830976126092288:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1939us (2173us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155644.879618:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17301 00000100:00100000:3.0:1746155644.879628:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976126092160:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1967us (2401us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155644.879633:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17300 00000100:00100000:0.0:1746155644.883574:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.883620:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126092416 00000100:00100000:3.0:1746155644.883627:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126092416 00000100:00100000:3.0:1746155644.883669:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17302 00000100:00100000:3.0:1746155644.883675:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:32467:x1830976126092416:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155644.883689:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.883703:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f86f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187ab expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.883726:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 31 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.883738:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155644.883740:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155644.883743:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f86f6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ab expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.883767:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 31 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.883777:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 31 pid: 10591 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155644.883787:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125419264:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155644.883870:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155644.886068:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125419264:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155644.886093:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f86f6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ab expref: 22 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.886106:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094949000, rc 0) 00000100:00100000:3.0:1746155644.886145:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32467:x1830976126092416:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2469us (2578us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.886153:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17302 00000100:00100000:0.0:1746155644.886957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.887026:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126092544 00000100:00100000:3.0:1746155644.887032:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126092544 00002000:00100000:3.0:1746155644.887057:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3170303) req@ffff880131497b80 x1830976126092544/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.887072:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497b80 with x1830976126092544 ext(3145728->3170303) 00010000:00010000:3.0:1746155644.887078:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 32 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155644.887087:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 32 pid: 10591 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155644.887093:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131497b80 00000100:00100000:3.0:1746155644.887106:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1435 00000100:00100000:3.0:1746155644.887112:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+32:1961:x1830976126092544:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155644.888339:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976126092544:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 1224us (1380us total) trans 17179874350 rc 0/0 00000100:00100000:3.0:1746155644.888346:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1435 00002000:00100000:3.0:1746155644.888352:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3170303) req@ffff880131497b80 x1830976126092544/t17179874350(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/448 e 0 to 0 dl 1746155655 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.888359:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497b80 with x1830976126092544 ext(3145728->3170303) 00010000:00010000:3.0:1746155644.888365:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 34 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155644.888375:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 34 pid: 10591 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155644.888380:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131497b80 00000100:00100000:0.0:1746155644.889383:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.889454:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126092672 00000100:00100000:2.0:1746155644.889460:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126092672 00010000:00010000:2.0:1746155644.889481:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 34 pid: 10591 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155644.889524:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8870 00000100:00100000:2.0:1746155644.889530:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976126092672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.889544:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.889557:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 34 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155644.889567:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 34 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155644.889585:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094948200/0x844e5faceb5f86e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3170303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18796 expref: 34 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155644.889664:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.889666:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.889672:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f86f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ab expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.889679:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f86f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ab expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.889705:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f86f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ab expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.889715:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125419392:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155644.890007:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.890967:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125419392:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155644.890978:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155644.891001:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976126092672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1471us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.891009:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8870 00000100:00100000:0.0:1746155644.893587:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.893667:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126092928 00000100:00100000:3.0:1746155644.893675:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126092928 00000100:00100000:1.0:1746155644.893770:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.893808:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.893833:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.893855:0:14230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126093056 00000100:00100000:1.0:1746155644.893858:0:14230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126093056 00000100:00100000:1.0:1746155644.893885:0:14230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 221 00000100:00100000:1.0:1746155644.893904:0:14230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a03b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06793f43-a06c-4add-b66d-476e36bacde6+15:1960:x1830976126093056:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:2.0:1746155644.893926:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126093184 00000100:00100000:2.0:1746155644.893929:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126093184 00000100:00100000:2.0:1746155644.893948:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 212 00000100:00100000:2.0:1746155644.893952:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1960:x1830976126093184:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:1.0:1746155644.893959:0:14230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a03b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06793f43-a06c-4add-b66d-476e36bacde6+15:1960:x1830976126093056:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 68us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.893964:0:14230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 221 00000100:00100000:2.0:1746155644.893976:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1960:x1830976126093184:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 24us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.893979:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 212 00000100:00100000:1.0:1746155644.893988:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126093312 00000100:00100000:1.0:1746155644.893990:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126093312 00002000:00100000:3.0:1746155644.894044:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880131496300 x1830976126092928/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.894052:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496300 with x1830976126092928 ext(2097152->3145727) 00002000:00010000:3.0:1746155644.894057:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131496300 00000100:00100000:3.0:1746155644.894077:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8211 00000100:00100000:3.0:1746155644.894082:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1963:x1830976126092928:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155644.894155:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 380 00000100:00100000:1.0:1746155644.894160:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126093312:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:1.0:1746155644.894184:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126093312:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 24us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.894188:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 380 00000100:00100000:3.0:1746155644.898796:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1963:x1830976126092928:12345-192.168.202.51@tcp:3:cat.0 Request processed in 4705us (5209us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.898806:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8211 00002000:00100000:3.0:1746155644.898816:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880131496300 x1830976126092928/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.898825:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496300 with x1830976126092928 ext(2097152->3145727) 00002000:00010000:3.0:1746155644.898830:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131496300 00000100:00100000:0.0:1746155644.901557:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.901598:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126093440 00000100:00100000:1.0:1746155644.901605:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126093440 00000100:00100000:1.0:1746155644.901646:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17303 00000100:00100000:1.0:1746155644.901652:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32467:x1830976126093440:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155644.901666:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155644.901680:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a4e3c00/0x844e5faceb5f86fd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187b2 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.901702:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.901708:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155644.901710:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155644.901713:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4e3c00/0x844e5faceb5f86fd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b2 expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.901735:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.901746:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 20 pid: 4461 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155644.901756:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125419520:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155644.901825:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b000 going to sleep for 11 seconds 00000100:00100000:1.0:1746155644.902642:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125419520:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155644.902660:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a4e3c00/0x844e5faceb5f86fd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b2 expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155644.902671:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4e3c00, rc 0) 00000100:00100000:1.0:1746155644.902692:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32467:x1830976126093440:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1040us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155644.902699:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17303 00000100:00100000:0.0:1746155644.903291:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.903337:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126093568 00000100:00100000:3.0:1746155644.903342:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126093568 00002000:00100000:3.0:1746155644.903368:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2928640->3145727) req@ffff880131497480 x1830976126093568/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.903377:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497480 with x1830976126093568 ext(2928640->3145727) 00010000:00010000:3.0:1746155644.903383:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 21 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155644.903393:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 21 pid: 4461 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155644.903404:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131497480 00000100:00100000:3.0:1746155644.903426:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1436 00000100:00100000:3.0:1746155644.903431:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976126093568:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155644.907181:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976126093568:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 3743us (3883us total) trans 21474841660 rc 0/0 00000100:00100000:3.0:1746155644.907190:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1436 00002000:00100000:3.0:1746155644.907199:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2928640->3145727) req@ffff880131497480 x1830976126093568/t21474841660(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/448 e 0 to 0 dl 1746155655 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.907207:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497480 with x1830976126093568 ext(2928640->3145727) 00010000:00010000:3.0:1746155644.907216:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 23 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155644.907227:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 23 pid: 4461 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155644.907234:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880131497480 00000100:00100000:0.0:1746155644.909134:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.909214:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126093696 00000100:00100000:2.0:1746155644.909220:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126093696 00010000:00010000:2.0:1746155644.909241:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 23 pid: 4461 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155644.909270:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8871 00000100:00100000:2.0:1746155644.909274:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126093696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155644.909283:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155644.909294:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 23 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155644.909302:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 23 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155644.909320:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f86a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2928640->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18773 expref: 23 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155644.909338:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.909339:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.909344:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a4e3c00/0x844e5faceb5f86fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b2 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.909349:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4e3c00/0x844e5faceb5f86fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b2 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.909368:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a4e3c00/0x844e5faceb5f86fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b2 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155644.909637:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125419648:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155644.909719:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155644.911653:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125419648:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155644.911672:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155644.911713:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126093696:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2436us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.911722:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8871 00000100:00100000:0.0:1746155644.915267:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.915296:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.915333:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.915439:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126094080 00000100:00100000:3.0:1746155644.915446:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126094080 00002000:00100000:3.0:1746155644.915481:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880131494700 x1830976126094080/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.915489:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494700 with x1830976126094080 ext(2097152->3145727) 00002000:00010000:3.0:1746155644.915493:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131494700 00000100:00100000:3.0:1746155644.915528:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126094208 00000100:00100000:3.0:1746155644.915532:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126094208 00002000:00100000:3.0:1746155644.915544:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff880131495f80 x1830976126094208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.915550:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495f80 with x1830976126094208 ext(3145728->4194303) 00002000:00010000:3.0:1746155644.915553:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131495f80 00000100:00100000:3.0:1746155644.915575:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126094464 00000100:00100000:3.0:1746155644.915577:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126094464 00002000:00100000:3.0:1746155644.915587:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880131495880 x1830976126094464/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.915594:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495880 with x1830976126094464 ext(3145728->4194303) 00002000:00010000:3.0:1746155644.915597:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495880 00000100:00100000:0.0:1746155644.915603:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8212 00000100:00100000:3.0:1746155644.915611:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8213 00000100:00100000:0.0:1746155644.915612:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976126094080:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155644.915616:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976126094208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.915833:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8214 00000100:00100000:2.0:1746155644.915841:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976126094464:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.925976:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976126094080:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10357us (10706us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.925987:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8212 00002000:00100000:2.0:1746155644.925997:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880131494700 x1830976126094080/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.926005:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494700 with x1830976126094080 ext(2097152->3145727) 00002000:00010000:2.0:1746155644.926011:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131494700 00000100:00100000:3.0:1746155644.929176:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1962:x1830976126094208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13552us (13871us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.929186:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8213 00002000:00100000:3.0:1746155644.929194:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff880131495f80 x1830976126094208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.929203:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495f80 with x1830976126094208 ext(3145728->4194303) 00002000:00010000:3.0:1746155644.929208:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131495f80 00000100:00100000:2.0:1746155644.933025:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976126094464:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17177us (17682us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.933035:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8214 00002000:00100000:2.0:1746155644.933043:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880131495880 x1830976126094464/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.933051:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495880 with x1830976126094464 ext(3145728->4194303) 00002000:00010000:2.0:1746155644.933056:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495880 00000100:00100000:0.0:1746155644.938592:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.938682:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126094720 00000100:00100000:2.0:1746155644.938691:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126094720 00002000:00100000:2.0:1746155644.939968:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880131496a00 x1830976126094720/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.939979:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496a00 with x1830976126094720 ext(4194304->5083135) 00002000:00010000:2.0:1746155644.939984:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131496a00 00000100:00100000:2.0:1746155644.940015:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8215 00000100:00100000:2.0:1746155644.940024:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976126094720:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155644.944155:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976126094720:12345-192.168.202.51@tcp:3:cat.0 Request processed in 4126us (5561us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746155644.944166:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8215 00002000:00100000:3.0:1746155644.944175:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff880131496a00 x1830976126094720/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.944190:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496a00 with x1830976126094720 ext(4194304->5083135) 00002000:00010000:3.0:1746155644.944194:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131496a00 00000100:00100000:0.0:1746155644.949626:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.949723:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126094976 00000100:00100000:2.0:1746155644.949730:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126094976 00000100:00100000:2.0:1746155644.949760:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11188 00000100:00100000:2.0:1746155644.949766:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32471:x1830976126094976:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155644.949785:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.949799:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f400/0x844e5faceb5f8704 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187b9 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.949880:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f870b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.949905:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f870b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.949915:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f870b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.949926:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e000/0x844e5faceb5f8712 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.949932:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e000/0x844e5faceb5f8712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.949937:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e000/0x844e5faceb5f8712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950021:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26ec00/0x844e5faceb5f8719 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950029:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26ec00/0x844e5faceb5f8719 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950034:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26ec00/0x844e5faceb5f8719 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155644.950041:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155644.950103:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f870b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950112:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f870b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950116:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f870b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950120:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26e400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.950123:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f870b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950128:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f870b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950136:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155644.950138:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155644.950141:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f870b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950145:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f870b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950164:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e000/0x844e5faceb5f8712 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950169:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e000/0x844e5faceb5f8712 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950174:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e000/0x844e5faceb5f8712 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950177:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26e000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155644.950179:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e000/0x844e5faceb5f8712 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950186:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e000/0x844e5faceb5f8712 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950191:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ae84100) 00010000:00010000:2.0:1746155644.950193:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155644.950195:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e000/0x844e5faceb5f8712 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950200:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e000/0x844e5faceb5f8712 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155644.950226:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f400/0x844e5faceb5f8704 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b9 expref: 296 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.950234:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26ec00/0x844e5faceb5f8719 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b9 expref: 295 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.950238:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155644.950239:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155644.950240:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26ec00, rc 0) 00000100:00100000:2.0:1746155644.950440:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:32471:x1830976126094976:12345-192.168.202.51@tcp:101:cat.0 Request processed in 673us (819us total) trans 8589945358 rc 0/0 00000100:00100000:2.0:1746155644.950445:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11188 00000100:00100000:0.0:1746155644.954271:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.954323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.954419:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126095360 00000100:00100000:1.0:1746155644.954426:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126095360 00000100:00100000:2.0:1746155644.954433:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126095104 00000100:00100000:2.0:1746155644.954437:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126095104 00000100:00100000:1.0:1746155644.954468:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4759 00000100:00100000:1.0:1746155644.954475:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32471:x1830976126095360:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155644.954570:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 764 00000100:00100000:3.0:1746155644.954579:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:1963:x1830976126095104:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.954588:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.954606:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26ec00/0x844e5faceb5f8719 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b9 expref: 297 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.954634:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.954638:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155644.954641:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32471:x1830976126095360:12345-192.168.202.51@tcp:35:cat.0 Request processed in 166us (376us total) trans 8589945359 rc 0/0 00000100:00100000:1.0:1746155644.954647:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4759 00000100:00100000:3.0:1746155644.954700:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1963:x1830976126095104:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 123us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.954707:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 764 00000100:00100000:1.0:1746155644.956381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.956485:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.956534:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126095488 00000100:00100000:0.0:1746155644.956539:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126095488 00000100:00100000:0.0:1746155644.956576:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126095616 00000100:00100000:0.0:1746155644.956579:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126095616 00000100:00100000:2.0:1746155644.956581:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17304 00000100:00100000:2.0:1746155644.956588:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976126095488:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155644.956592:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17305 00000100:00100000:0.0:1746155644.956596:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126095616:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155644.956600:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155644.956601:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155644.956612:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f26f000/0x844e5faceb5f872e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187c0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155644.956612:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132b81c00/0x844e5faceb5f8727 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187c7 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155644.956628:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.956628:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.956630:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155644.956630:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155644.956636:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26f000/0x844e5faceb5f872e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c0 expref: 34 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.956636:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132b81c00/0x844e5faceb5f8727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c7 expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.956647:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f26f000/0x844e5faceb5f872e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c0 expref: 34 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155644.956647:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880132b81c00/0x844e5faceb5f8727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c7 expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155644.956655:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26f000, rc 0) 00010000:00010000:0.0:1746155644.956655:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132b81c00, rc 0) 00000100:00100000:2.0:1746155644.956697:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976126095488:12345-192.168.202.51@tcp:101:cat.0 Request processed in 110us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155644.956703:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17304 00000100:00100000:0.0:1746155644.956740:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126095616:12345-192.168.202.51@tcp:101:cat.0 Request processed in 142us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155644.956744:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17305 00000100:00100000:0.0:1746155644.967785:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.967861:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126095872 00000100:00100000:3.0:1746155644.967868:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126095872 00002000:00100000:3.0:1746155644.967912:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f0db800 x1830976126095872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.967919:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0db800 with x1830976126095872 ext(2097152->3145727) 00002000:00010000:3.0:1746155644.967923:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0db800 00000100:00100000:3.0:1746155644.967946:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8216 00000100:00100000:3.0:1746155644.967951:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976126095872:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155644.968563:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.968786:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155644.969351:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126096128 00000100:00100000:2.0:1746155644.969358:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126096128 00000100:00100000:1.0:1746155644.969377:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:2.0:1746155644.969381:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f0d9f80 x1830976126096128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.969389:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d9f80 with x1830976126096128 ext(3145728->4194303) 00000100:00100000:1.0:1746155644.969392:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126096384 00002000:00010000:2.0:1746155644.969393:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d9f80 00000100:00100000:1.0:1746155644.969395:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126096384 00000100:00100000:2.0:1746155644.969411:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126096640 00000100:00100000:2.0:1746155644.969414:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126096640 00000100:00100000:1.0:1746155644.969417:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8217 00002000:00100000:2.0:1746155644.969423:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f4ff800 x1830976126096640/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155644.969423:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976126096128:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:2.0:1746155644.969429:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ff800 with x1830976126096640 ext(3145728->4194303) 00002000:00010000:2.0:1746155644.969432:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4ff800 00000100:00100000:2.0:1746155644.969452:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8218 00000100:00100000:2.0:1746155644.969457:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126096640:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:0.0:1746155644.970012:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f4fd180 x1830976126096384/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155644.970021:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd180 with x1830976126096384 ext(2097152->3145727) 00002000:00010000:0.0:1746155644.970024:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fd180 00000100:00100000:0.0:1746155644.970067:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8219 00000100:00100000:0.0:1746155644.970073:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126096384:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155644.974931:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976126095872:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6970us (7144us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155644.974941:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8216 00002000:00100000:3.0:1746155644.974951:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009f0db800 x1830976126095872/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155644.974959:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0db800 with x1830976126095872 ext(2097152->3145727) 00002000:00010000:3.0:1746155644.974963:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0db800 00000100:00100000:2.0:1746155644.977382:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126096640:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7915us (7997us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.977393:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8218 00002000:00100000:2.0:1746155644.977403:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f4ff800 x1830976126096640/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.977412:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ff800 with x1830976126096640 ext(3145728->4194303) 00002000:00010000:2.0:1746155644.977417:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4ff800 00000100:00100000:1.0:1746155644.982208:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976126096128:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12775us (13636us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155644.982219:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8217 00002000:00100000:1.0:1746155644.982229:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f0d9f80 x1830976126096128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.982239:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d9f80 with x1830976126096128 ext(3145728->4194303) 00002000:00010000:1.0:1746155644.982245:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d9f80 00000100:00100000:0.0:1746155644.983782:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155644.984059:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126096896 00000100:00100000:1.0:1746155644.984066:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126096896 00002000:00100000:1.0:1746155644.984099:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f0d8a80 x1830976126096896/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/0 e 0 to 0 dl 1746155655 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.984107:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8a80 with x1830976126096896 ext(4194304->5083135) 00002000:00010000:1.0:1746155644.984111:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d8a80 00000100:00100000:1.0:1746155644.984139:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8220 00000100:00100000:1.0:1746155644.984145:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976126096896:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155644.984981:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126096384:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14905us (16191us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155644.984989:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8219 00002000:00100000:2.0:1746155644.984995:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f4fd180 x1830976126096384/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155644.985002:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd180 with x1830976126096384 ext(2097152->3145727) 00002000:00010000:2.0:1746155644.985005:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fd180 00000100:00100000:1.0:1746155644.989602:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976126096896:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5447us (5813us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155644.989614:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8220 00002000:00100000:1.0:1746155644.989626:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009f0d8a80 x1830976126096896/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:715/0 lens 488/440 e 0 to 0 dl 1746155655 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155644.989642:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8a80 with x1830976126096896 ext(4194304->5083135) 00002000:00010000:1.0:1746155644.989647:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d8a80 00000100:00100000:0.0:1746155644.990286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.992969:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126097152 00000100:00100000:3.0:1746155644.992977:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126097152 00000100:00100000:3.0:1746155644.993039:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11189 00000100:00100000:3.0:1746155644.993046:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009cdd2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32474:x1830976126097152:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155644.993068:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155644.993082:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023a00/0x844e5faceb5f8735 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187ce expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.993164:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023c00/0x844e5faceb5f873c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993174:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023c00/0x844e5faceb5f873c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993183:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023c00/0x844e5faceb5f873c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993194:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023e00/0x844e5faceb5f8743 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993200:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023e00/0x844e5faceb5f8743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993204:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023e00/0x844e5faceb5f8743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993288:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023800/0x844e5faceb5f874a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993297:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023800/0x844e5faceb5f874a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993303:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023800/0x844e5faceb5f874a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155644.993310:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155644.993379:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023c00/0x844e5faceb5f873c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993384:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023c00/0x844e5faceb5f873c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993390:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023c00/0x844e5faceb5f873c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993394:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f023c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155644.993397:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023c00/0x844e5faceb5f873c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993403:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023c00/0x844e5faceb5f873c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993411:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155644.993414:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155644.993417:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023c00/0x844e5faceb5f873c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993422:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023c00/0x844e5faceb5f873c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993446:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023e00/0x844e5faceb5f8743 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993455:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023e00/0x844e5faceb5f8743 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993459:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023e00/0x844e5faceb5f8743 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993463:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f023e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155644.993464:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023e00/0x844e5faceb5f8743 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993468:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023e00/0x844e5faceb5f8743 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993473:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0e00) 00010000:00010000:3.0:1746155644.993475:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155644.993477:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023e00/0x844e5faceb5f8743 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993480:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023e00/0x844e5faceb5f8743 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155644.993538:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023a00/0x844e5faceb5f8735 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ce expref: 21 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.993546:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023800/0x844e5faceb5f874a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ce expref: 20 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.993552:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.993554:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155644.993556:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f023800, rc 0) 00000100:00100000:3.0:1746155644.993605:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009cdd2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32474:x1830976126097152:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 560us (3319us total) trans 8589945360 rc 0/0 00000100:00100000:3.0:1746155644.993615:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11189 00000100:00100000:0.0:1746155644.996846:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155644.996903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155644.996955:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126097536 00000100:00100000:3.0:1746155644.996962:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126097536 00000100:00100000:3.0:1746155644.997012:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 765 00000100:00100000:3.0:1746155644.997020:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976126097536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155644.997031:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155644.997050:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f023800/0x844e5faceb5f874a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ce expref: 20 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155644.997075:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155644.997078:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155644.997108:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1963:x1830976126097536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 90us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155644.997227:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 765 00000100:00100000:1.0:1746155644.997939:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126097408 00000100:00100000:1.0:1746155644.997943:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126097408 00000100:00100000:1.0:1746155644.997974:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4760 00000100:00100000:1.0:1746155644.997979:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32474:x1830976126097408:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155644.998129:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32474:x1830976126097408:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 149us (1289us total) trans 8589945361 rc 0/0 00000100:00100000:1.0:1746155644.998133:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4760 00000100:00100000:0.0:1746155645.064651:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.064707:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126097664 00000100:00100000:3.0:1746155645.064714:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126097664 00000100:00100000:3.0:1746155645.064763:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17306 00000100:00100000:3.0:1746155645.064771:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32474:x1830976126097664:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155645.064785:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155645.064798:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187d5 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.064820:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a4e3c00/0x844e5faceb5f86fd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b2 expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.064828:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132b81c00/0x844e5faceb5f8727 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c7 expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.064835:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.064837:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.064840:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3620864->4194303] (req 3620864->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.064865:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132b81c00/0x844e5faceb5f8727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c7 expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.064875:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132b81c00/0x844e5faceb5f8727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c7 expref: 22 pid: 19959 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155645.064913:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125419776:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155645.065818:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a4e3c00/0x844e5faceb5f86fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b2 expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.065828:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a4e3c00/0x844e5faceb5f86fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b2 expref: 17 pid: 10591 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.065836:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125419904:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155645.066029:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155645.069134:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125419776:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155645.069144:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125419904:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155645.069166:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3620864->4194303] (req 3620864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.069185:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f023400, rc 0) 00000100:00100000:3.0:1746155645.069319:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32474:x1830976126097664:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4547us (4672us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.069326:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17306 00000100:00100000:0.0:1746155645.070880:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.071051:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126097792 00000100:00100000:3.0:1746155645.071058:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126097792 00010000:00010000:3.0:1746155645.071085:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132b81c00/0x844e5faceb5f8727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c7 expref: 23 pid: 19959 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155645.071119:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8872 00000100:00100000:3.0:1746155645.071125:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976126097792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.071137:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155645.071155:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132b81c00/0x844e5faceb5f8727 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c7 expref: 23 pid: 19959 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.071164:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132b81c00/0x844e5faceb5f8727 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c7 expref: 23 pid: 19959 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.071182:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132b81c00/0x844e5faceb5f8727 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c7 expref: 23 pid: 19959 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.071205:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155645.071241:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976126097792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 116us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.071246:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8872 00000100:00100000:0.0:1746155645.071981:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.072003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.072028:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126098176 00000100:00100000:0.0:1746155645.072031:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126098176 00000100:00100000:0.0:1746155645.072053:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11190 00000100:00100000:0.0:1746155645.072058:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32478:x1830976126098176:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155645.072074:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155645.072084:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3e00/0x844e5faceb5f875f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187dc expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155645.072157:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126097920 00000100:00100000:3.0:1746155645.072160:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126097920 00010000:00010000:3.0:1746155645.072175:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4e3c00/0x844e5faceb5f86fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b2 expref: 17 pid: 10591 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.072192:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8873 00000100:00100000:3.0:1746155645.072197:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f821050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976126097920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.072204:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155645.072213:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a4e3c00/0x844e5faceb5f86fd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b2 expref: 17 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.072221:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a4e3c00/0x844e5faceb5f86fd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b2 expref: 17 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.072232:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a4e3c00/0x844e5faceb5f86fd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187b2 expref: 17 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.072241:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.072243:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.072248:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 16 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.072254:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 16 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.072278:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 16 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155645.072292:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125420032:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155645.072339:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece600 going to sleep for 11 seconds 00010000:00010000:1.0:1746155645.072404:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8766 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072414:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8766 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072422:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8766 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072433:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d400/0x844e5faceb5f876d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072437:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d400/0x844e5faceb5f876d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072442:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d400/0x844e5faceb5f876d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072545:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f8774 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072556:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f8774 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072562:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f8774 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:1.0:1746155645.072569:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155645.072638:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8766 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072644:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8766 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072649:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8766 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072654:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b00d200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155645.072658:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8766 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072663:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8766 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072670:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155645.072673:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155645.072675:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8766 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072679:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8766 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072940:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d400/0x844e5faceb5f876d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072949:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d400/0x844e5faceb5f876d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072953:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d400/0x844e5faceb5f876d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072956:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b00d400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155645.072959:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d400/0x844e5faceb5f876d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072963:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d400/0x844e5faceb5f876d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072970:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c200) 00010000:00010000:1.0:1746155645.072972:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155645.072974:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d400/0x844e5faceb5f876d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.072978:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d400/0x844e5faceb5f876d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.073011:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3e00/0x844e5faceb5f875f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187dc expref: 23 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.073020:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f8774 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187dc expref: 22 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.073025:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155645.073026:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155645.073028:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00d600, rc 0) 00000100:00100000:1.0:1746155645.073049:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32478:x1830976126098176:12345-192.168.202.51@tcp:101:cat.0 Request processed in 990us (1044us total) trans 8589945362 rc 0/0 00000100:00100000:1.0:1746155645.073054:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11190 00000100:00100000:3.0:1746155645.073648:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125420032:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155645.073660:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155645.073690:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f821050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126097920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1492us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.073697:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8873 00000100:00100000:2.0:1746155645.074934:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.075002:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126098432 00000100:00100000:1.0:1746155645.075006:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126098432 00000100:00100000:1.0:1746155645.075033:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4761 00000100:00100000:1.0:1746155645.075037:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32478:x1830976126098432:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:0.0:1746155645.075188:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.075225:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126098560 00000100:00100000:2.0:1746155645.075228:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126098560 00000100:00100000:1.0:1746155645.075252:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:32478:x1830976126098432:12345-192.168.202.51@tcp:35:cat.0 Request processed in 214us (318us total) trans 8589945363 rc 0/0 00000100:00100000:1.0:1746155645.075258:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4761 00000100:00100000:2.0:1746155645.075266:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 766 00000100:00100000:2.0:1746155645.075272:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976126098560:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155645.075279:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155645.075293:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f8774 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187dc expref: 23 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.075431:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.075436:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155645.075466:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976126098560:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 194us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.075476:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 766 00000100:00100000:0.0:1746155645.080291:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.080374:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126098688 00000100:00100000:3.0:1746155645.080381:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126098688 00000100:00100000:3.0:1746155645.080417:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17307 00000100:00100000:3.0:1746155645.080424:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32474:x1830976126098688:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155645.080439:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155645.080453:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187e3 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.080476:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f86f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ab expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.080483:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f26f000/0x844e5faceb5f872e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c0 expref: 33 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.080489:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.080491:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.080494:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [4194304->4341759] (req 4194304->4341759) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.080620:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f26f000/0x844e5faceb5f872e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c0 expref: 33 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.080630:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f26f000/0x844e5faceb5f872e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c0 expref: 33 pid: 10591 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155645.080641:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125420160:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155645.080720:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f86f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ab expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.080727:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f86f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ab expref: 23 pid: 10591 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.080734:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125420288:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155645.080750:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155645.082344:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125420160:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155645.082715:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125420288:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155645.082740:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [4194304->4341759] (req 4194304->4341759) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.082754:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f023c00, rc 0) 00000100:00100000:3.0:1746155645.082802:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:32474:x1830976126098688:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2377us (2517us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.082812:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17307 00000100:00100000:0.0:1746155645.084985:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.085025:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.085091:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126099072 00000100:00100000:1.0:1746155645.085097:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126099072 00002000:00100000:1.0:1746155645.085129:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3620863) req@ffff88009f0daa00 x1830976126099072/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155645.085137:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0daa00 with x1830976126099072 ext(3145728->3620863) 00002000:00010000:1.0:1746155645.085141:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0daa00 00000100:00100000:1.0:1746155645.085165:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126098944 00000100:00100000:1.0:1746155645.085168:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126098944 00002000:00100000:1.0:1746155645.085178:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f0da680 x1830976126098944/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155645.085184:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0da680 with x1830976126098944 ext(2097152->3145727) 00002000:00010000:1.0:1746155645.085186:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0da680 00000100:00100000:1.0:1746155645.085196:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8221 00000100:00100000:1.0:1746155645.085202:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976126099072:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155645.085215:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8222 00000100:00100000:2.0:1746155645.085221:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976126098944:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155645.088305:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.088416:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126099328 00000100:00100000:2.0:1746155645.088424:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126099328 00010000:00010000:2.0:1746155645.088454:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f86f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ab expref: 23 pid: 10591 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.088479:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8874 00000100:00100000:2.0:1746155645.088486:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976126099328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155645.088496:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155645.088527:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f86f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ab expref: 23 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.088536:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f86f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ab expref: 23 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.088554:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f86f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ab expref: 23 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.089305:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155645.089332:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976126099328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 846us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.089338:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8874 00000100:00100000:0.0:1746155645.092340:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.092392:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126099456 00000100:00100000:3.0:1746155645.092399:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126099456 00010000:00010000:3.0:1746155645.092425:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26f000/0x844e5faceb5f872e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c0 expref: 34 pid: 10591 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155645.092460:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8875 00000100:00100000:3.0:1746155645.092466:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976126099456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.092477:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155645.092494:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f26f000/0x844e5faceb5f872e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c0 expref: 34 pid: 10591 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.092534:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f26f000/0x844e5faceb5f872e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c0 expref: 34 pid: 10591 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.092552:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f26f000/0x844e5faceb5f872e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187c0 expref: 34 pid: 10591 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.092571:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.092573:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.092579:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.092586:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.092612:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155645.092623:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125420416:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155645.092688:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155645.093284:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976126099072:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8079us (8301us total) trans 0 rc 475136/475136 00000100:00100000:1.0:1746155645.093296:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8221 00002000:00100000:1.0:1746155645.093305:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3620863) req@ffff88009f0daa00 x1830976126099072/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 475136/475136 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155645.093313:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0daa00 with x1830976126099072 ext(3145728->3620863) 00002000:00010000:1.0:1746155645.093317:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0daa00 00000100:00100000:1.0:1746155645.098696:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.098767:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125420416:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155645.098785:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155645.098819:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976126099456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6352us (6483us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.098827:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8875 00000100:00100000:0.0:1746155645.098929:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126099712 00000100:00100000:0.0:1746155645.098935:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126099712 00002000:00100000:0.0:1746155645.098962:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4337664->4341759) req@ffff88009f4fea00 x1830976126099712/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155645.098970:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fea00 with x1830976126099712 ext(4337664->4341759) 00002000:00010000:0.0:1746155645.098974:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fea00 00000100:00100000:0.0:1746155645.098988:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8223 00000100:00100000:0.0:1746155645.098994:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976126099712:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155645.099102:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976126099712:12345-192.168.202.51@tcp:3:cat.0 Request processed in 107us (411us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155645.099108:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8223 00002000:00100000:0.0:1746155645.099113:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4337664->4341759) req@ffff88009f4fea00 x1830976126099712/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/4536 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155645.099119:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fea00 with x1830976126099712 ext(4337664->4341759) 00002000:00010000:0.0:1746155645.099122:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fea00 00000100:00100000:3.0:1746155645.099496:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1962:x1830976126098944:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14274us (14470us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155645.099519:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8222 00002000:00100000:3.0:1746155645.099524:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f0da680 x1830976126098944/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.099541:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0da680 with x1830976126098944 ext(2097152->3145727) 00002000:00010000:3.0:1746155645.099544:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0da680 00000100:00100000:0.0:1746155645.109288:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.109335:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.109370:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.109401:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126100224 00000100:00100000:0.0:1746155645.109408:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126100224 00002000:00100000:0.0:1746155645.109444:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (4341760->5083135) req@ffff88009f0d8700 x1830976126100224/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155645.109452:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8700 with x1830976126100224 ext(4341760->5083135) 00002000:00010000:0.0:1746155645.109456:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d8700 00000100:00100000:0.0:1746155645.109473:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126100608 00000100:00100000:0.0:1746155645.109475:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126100608 00002000:00100000:0.0:1746155645.109485:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f0db100 x1830976126100608/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155645.109491:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0db100 with x1830976126100608 ext(3145728->4194303) 00002000:00010000:0.0:1746155645.109493:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0db100 00000100:00100000:0.0:1746155645.109526:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8224 00000100:00100000:0.0:1746155645.109533:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1963:x1830976126100224:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155645.110614:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8225 00000100:00100000:3.0:1746155645.110622:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1963:x1830976126100608:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155645.111663:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126100096 00000100:00100000:2.0:1746155645.111668:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126100096 00000100:00100000:2.0:1746155645.111700:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11191 00000100:00100000:2.0:1746155645.111705:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:32480:x1830976126100096:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155645.111717:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155645.111731:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312faa00/0x844e5faceb5f8789 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187ea expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.111802:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f8790 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.111813:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f8790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.111822:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f8790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.111833:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa600/0x844e5faceb5f8797 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.111837:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa600/0x844e5faceb5f8797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.111842:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa600/0x844e5faceb5f8797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.111941:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa200/0x844e5faceb5f879e lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.111949:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa200/0x844e5faceb5f879e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.111954:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa200/0x844e5faceb5f879e lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155645.111962:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155645.112017:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f8790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112022:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f8790 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112026:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f8790 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112030:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312fb000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155645.112033:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f8790 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112037:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f8790 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112044:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155645.112047:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155645.112050:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f8790 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112053:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fb000/0x844e5faceb5f8790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112066:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa600/0x844e5faceb5f8797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112070:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa600/0x844e5faceb5f8797 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112074:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa600/0x844e5faceb5f8797 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112078:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801312fa600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155645.112080:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa600/0x844e5faceb5f8797 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112085:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa600/0x844e5faceb5f8797 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112090:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ae84a00) 00010000:00010000:2.0:1746155645.112092:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155645.112094:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa600/0x844e5faceb5f8797 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112098:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa600/0x844e5faceb5f8797 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.112124:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312faa00/0x844e5faceb5f8789 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ea expref: 298 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.112136:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa200/0x844e5faceb5f879e lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ea expref: 297 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.112141:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.112143:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155645.112144:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fa200, rc 0) 00000100:00100000:2.0:1746155645.112163:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:32480:x1830976126100096:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 459us (2883us total) trans 8589945364 rc 0/0 00000100:00100000:2.0:1746155645.112168:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11191 00000100:00100000:2.0:1746155645.118828:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1963:x1830976126100224:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9288us (9484us total) trans 0 rc 741376/741376 00000100:00100000:2.0:1746155645.118838:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8224 00002000:00100000:2.0:1746155645.118847:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4341760->5083135) req@ffff88009f0d8700 x1830976126100224/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 741376/741376 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155645.118855:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8700 with x1830976126100224 ext(4341760->5083135) 00002000:00010000:2.0:1746155645.118860:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0d8700 00000100:00100000:0.0:1746155645.121768:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.122153:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126100736 00000100:00100000:2.0:1746155645.122161:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126100736 00000100:00100000:2.0:1746155645.122212:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 767 00000100:00100000:2.0:1746155645.122219:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1962:x1830976126100736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155645.122229:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155645.122249:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801312fa200/0x844e5faceb5f879e lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ea expref: 297 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.122266:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.122269:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155645.122306:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:1962:x1830976126100736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 88us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.122312:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 767 00000100:00100000:3.0:1746155645.122346:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1963:x1830976126100608:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11724us (12973us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155645.122354:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8225 00002000:00100000:3.0:1746155645.122361:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f0db100 x1830976126100608/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.122368:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0db100 with x1830976126100608 ext(3145728->4194303) 00002000:00010000:3.0:1746155645.122372:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f0db100 00000100:00100000:0.0:1746155645.213543:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.213588:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126100992 00000100:00100000:1.0:1746155645.213595:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126100992 00000100:00100000:1.0:1746155645.213644:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11192 00000100:00100000:1.0:1746155645.213651:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32486:x1830976126100992:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155645.213671:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155645.213686:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00ce00/0x844e5faceb5f87ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187f1 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.213776:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00cc00/0x844e5faceb5f87b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.213786:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00cc00/0x844e5faceb5f87b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.213794:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00cc00/0x844e5faceb5f87b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.213804:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f87ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.213809:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f87ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.213817:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f87ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.213915:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c800/0x844e5faceb5f87c1 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.213924:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c800/0x844e5faceb5f87c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.213929:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c800/0x844e5faceb5f87c1 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155645.213936:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155645.214004:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00cc00/0x844e5faceb5f87b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214009:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00cc00/0x844e5faceb5f87b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214014:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00cc00/0x844e5faceb5f87b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214018:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b00cc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155645.214021:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00cc00/0x844e5faceb5f87b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214026:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00cc00/0x844e5faceb5f87b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214035:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155645.214037:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155645.214045:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00cc00/0x844e5faceb5f87b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214053:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00cc00/0x844e5faceb5f87b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214079:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f87ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214084:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f87ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214088:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f87ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214092:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b00ca00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155645.214094:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f87ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214098:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f87ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214103:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008d58c600) 00010000:00010000:1.0:1746155645.214105:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155645.214107:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f87ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214110:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f87ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155645.214142:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00ce00/0x844e5faceb5f87ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f1 expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.214151:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c800/0x844e5faceb5f87c1 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f1 expref: 298 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.214160:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155645.214161:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155645.214163:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00c800, rc 0) 00000100:00100000:1.0:1746155645.214200:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:32486:x1830976126100992:12345-192.168.202.51@tcp:101:cat.0 Request processed in 549us (698us total) trans 8589945365 rc 0/0 00000100:00100000:1.0:1746155645.214205:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11192 00000100:00100000:0.0:1746155645.218447:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.218707:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126101120 00000100:00100000:3.0:1746155645.218715:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126101120 00000100:00100000:3.0:1746155645.218758:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17308 00000100:00100000:3.0:1746155645.218765:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:32480:x1830976126101120:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155645.218779:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155645.218792:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187f8 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.218814:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.218820:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155645.218822:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155645.218825:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2871296->3145727] (req 2871296->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 34 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.218850:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 21 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.218859:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 21 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.218869:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125420544:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155645.219710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.219739:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126101376 00000100:00100000:0.0:1746155645.219743:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126101376 00000100:00100000:0.0:1746155645.219776:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4762 00000100:00100000:0.0:1746155645.219782:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:32486:x1830976126101376:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:3.0:1746155645.219869:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155645.220011:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:32486:x1830976126101376:12345-192.168.202.51@tcp:35:cat.0 Request processed in 229us (302us total) trans 8589945366 rc 0/0 00000100:00100000:0.0:1746155645.220018:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4762 00000100:00100000:0.0:1746155645.220071:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.220241:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126101504 00000100:00100000:2.0:1746155645.220245:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126101504 00000100:00100000:2.0:1746155645.220281:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 768 00000100:00100000:2.0:1746155645.220286:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1961:x1830976126101504:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155645.220294:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155645.220310:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c800/0x844e5faceb5f87c1 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f1 expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.220333:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.220336:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155645.220364:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1961:x1830976126101504:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 78us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.220369:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 768 00000100:00100000:3.0:1746155645.220934:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125420544:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155645.220952:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2871296->3145727] (req 2871296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 34 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.220963:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094949000, rc 0) 00000100:00100000:3.0:1746155645.220994:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:32480:x1830976126101120:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2230us (2554us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.221000:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17308 00000100:00100000:0.0:1746155645.221547:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.221584:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.221630:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126101760 00000100:00100000:2.0:1746155645.221633:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126101760 00000100:00100000:2.0:1746155645.221657:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17309 00000100:00100000:2.0:1746155645.221663:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976126101760:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155645.221671:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155645.221672:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155645.221681:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312fb800/0x844e5faceb5f87d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f187ff expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155645.221697:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.221719:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126101888 00000100:00100000:0.0:1746155645.221722:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126101888 00000100:00100000:2.0:1746155645.221725:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125420672:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155645.221739:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17310 00000100:00100000:0.0:1746155645.221744:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976126101888:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155645.221751:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155645.221759:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f26ec00/0x844e5faceb5f87dd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18806 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155645.221767:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155645.221780:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125420800:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155645.221798:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155645.221810:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126102144 00000100:00100000:0.0:1746155645.221813:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126102144 00000100:00100000:0.0:1746155645.221832:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11193 00000100:00100000:0.0:1746155645.221837:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32487:x1830976126102144:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155645.221847:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155645.221855:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f800/0x844e5faceb5f87e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1880d expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155645.221908:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126101632 00000100:00100000:3.0:1746155645.221911:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126101632 00002000:00100000:3.0:1746155645.221932:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->4341759) req@ffff88009ca97b80 x1830976126101632/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.221940:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97b80 with x1830976126101632 ext(4194304->4341759) 00010000:00010000:0.0:1746155645.221941:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f87eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155645.221946:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 22 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746155645.221952:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f87eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155645.221956:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 22 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746155645.221960:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f87eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00002000:00010000:3.0:1746155645.221962:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca97b80 00010000:00010000:0.0:1746155645.221970:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e200/0x844e5faceb5f87f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.221975:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e200/0x844e5faceb5f87f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.221980:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e200/0x844e5faceb5f87f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155645.221984:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1437 00000100:00100000:3.0:1746155645.221990:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976126101632:12345-192.168.202.51@tcp:4:cat.0 00010000:00010000:0.0:1746155645.222057:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f87f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222065:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f87f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222070:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f87f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155645.222077:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155645.222126:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f87eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222133:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f87eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222138:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f87eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222143:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26e800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155645.222146:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f87eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222151:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f87eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222159:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155645.222161:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155645.222164:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f87eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222169:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f87eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222177:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e200/0x844e5faceb5f87f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222180:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e200/0x844e5faceb5f87f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222185:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e200/0x844e5faceb5f87f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222228:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26e200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155645.222231:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e200/0x844e5faceb5f87f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222239:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e200/0x844e5faceb5f87f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222245:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e62d800) 00010000:00010000:0.0:1746155645.222247:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155645.222249:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e200/0x844e5faceb5f87f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222253:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e200/0x844e5faceb5f87f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.222280:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f800/0x844e5faceb5f87e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1880d expref: 25 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.222289:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f87f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1880d expref: 24 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.222294:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155645.222296:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155645.222298:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26fc00, rc 0) 00000100:00100000:0.0:1746155645.222330:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:32487:x1830976126102144:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 492us (632us total) trans 8589945367 rc 0/0 00000100:00100000:0.0:1746155645.222336:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11193 00000100:00100000:2.0:1746155645.223235:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125420672:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155645.223927:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.223949:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.223963:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126102400 00000100:00100000:0.0:1746155645.223967:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126102400 00000100:00100000:0.0:1746155645.224002:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4763 00000100:00100000:0.0:1746155645.224007:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:32487:x1830976126102400:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155645.224115:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:32487:x1830976126102400:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 107us (188us total) trans 8589945368 rc 0/0 00000100:00100000:0.0:1746155645.224120:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4763 00000100:00100000:0.0:1746155645.224135:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126102528 00000100:00100000:0.0:1746155645.224137:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126102528 00000100:00100000:0.0:1746155645.224153:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 769 00000100:00100000:0.0:1746155645.224158:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1963:x1830976126102528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155645.224166:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155645.224179:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fc00/0x844e5faceb5f87f9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1880d expref: 25 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.224190:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155645.224193:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155645.224205:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1963:x1830976126102528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 47us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.224211:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 769 00010000:00010000:2.0:1746155645.224340:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312fb800/0x844e5faceb5f87d6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ff expref: 35 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155645.224349:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312fb800/0x844e5faceb5f87d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187ff expref: 35 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155645.224357:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fb800, rc 0) 00000100:00100000:2.0:1746155645.224378:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1963:x1830976126101760:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2715us (2794us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155645.224384:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17309 00000100:00100000:1.0:1746155645.224467:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125420800:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155645.224482:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f26ec00/0x844e5faceb5f87dd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18806 expref: 23 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.224491:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ec00/0x844e5faceb5f87dd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18806 expref: 23 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.224520:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26ec00, rc 0) 00000100:00100000:1.0:1746155645.224537:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976126101888:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2792us (2866us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155645.224542:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17310 00000100:00100000:3.0:1746155645.226310:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976126101632:12345-192.168.202.51@tcp:4:cat.0 Request processed in 4315us (4759us total) trans 17179874351 rc 0/0 00000100:00100000:3.0:1746155645.226318:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1437 00002000:00100000:3.0:1746155645.226326:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->4341759) req@ffff88009ca97b80 x1830976126101632/t17179874351(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/448 e 0 to 0 dl 1746155656 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.226333:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97b80 with x1830976126101632 ext(4194304->4341759) 00010000:00010000:3.0:1746155645.226339:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.226354:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155645.226360:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca97b80 00000100:00100000:2.0:1746155645.232555:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.232629:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126102656 00000100:00100000:0.0:1746155645.232636:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126102656 00010000:00010000:0.0:1746155645.232664:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746155645.232688:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8876 00000100:00100000:0.0:1746155645.232695:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976126102656:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155645.232706:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155645.232724:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746155645.232739:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746155645.232758:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8782 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4341759) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187e3 expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746155645.232769:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155645.232770:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155645.232775:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 33 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.232781:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 33 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.232806:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 33 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155645.232816:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125420928:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155645.233250:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155645.233657:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.233681:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.234210:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126102912 00000100:00100000:1.0:1746155645.234215:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126102912 00000100:00100000:1.0:1746155645.234235:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126102784 00000100:00100000:1.0:1746155645.234237:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126102784 00000100:00100000:1.0:1746155645.234261:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17311 00000100:00100000:1.0:1746155645.234266:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126102912:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155645.234278:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155645.234289:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b00c400/0x844e5faceb5f8807 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1881b expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155645.234321:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125421056:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155645.234380:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17312 00000100:00100000:2.0:1746155645.234387:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1962:x1830976126102784:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155645.234393:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155645.234400:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312fac00/0x844e5faceb5f880e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18814 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155645.234419:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125421184:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155645.234466:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746155645.234499:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155645.235484:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.235552:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125420928:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155645.235565:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155645.235585:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976126102656:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2891us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.235591:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8876 00000100:00100000:3.0:1746155645.235750:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126103168 00000100:00100000:3.0:1746155645.235755:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126103168 00002000:00100000:3.0:1746155645.235781:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2871296->2875391) req@ffff88009ca95f80 x1830976126103168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.235788:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95f80 with x1830976126103168 ext(2871296->2875391) 00002000:00010000:3.0:1746155645.235791:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca95f80 00000100:00100000:3.0:1746155645.235803:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8226 00000100:00100000:3.0:1746155645.235808:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976126103168:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155645.236679:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976126103168:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 868us (1193us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155645.236684:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8226 00002000:00100000:3.0:1746155645.236690:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2871296->2875391) req@ffff88009ca95f80 x1830976126103168/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/4536 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.236696:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95f80 with x1830976126103168 ext(2871296->2875391) 00002000:00010000:3.0:1746155645.236699:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca95f80 00000100:00100000:0.0:1746155645.237803:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.237859:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125421056:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155645.237880:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b00c400/0x844e5faceb5f8807 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1881b expref: 23 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.237900:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c400/0x844e5faceb5f8807 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1881b expref: 23 pid: 18270 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155645.238878:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126103296 00000100:00100000:2.0:1746155645.238882:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126103296 00010000:00010000:1.0:1746155645.238977:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00c400, rc 0) 00000100:00100000:1.0:1746155645.239009:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126102912:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4742us (5352us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155645.239016:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17311 00000100:00100000:1.0:1746155645.239066:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125421184:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155645.239082:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312fac00/0x844e5faceb5f880e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18814 expref: 35 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.239091:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312fac00/0x844e5faceb5f880e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18814 expref: 35 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.239099:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fac00, rc 0) 00000100:00100000:1.0:1746155645.239114:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1962:x1830976126102784:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4728us (5432us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155645.239118:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17312 00000100:00100000:2.0:1746155645.239178:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17313 00000100:00100000:2.0:1746155645.239184:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:32487:x1830976126103296:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155645.239193:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155645.239201:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18822 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.239218:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 33 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.239224:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155645.239226:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155645.239229:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [4026368->4194303] (req 4026368->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.239249:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 33 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.239259:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 33 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.239269:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125421312:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155645.239303:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155645.241071:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125421312:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155645.241087:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [4026368->4194303] (req 4026368->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.241099:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fb400, rc 0) 00000100:00100000:2.0:1746155645.241243:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:32487:x1830976126103296:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2058us (3440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.241250:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17313 00000100:00100000:0.0:1746155645.241346:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.241797:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126103424 00000100:00100000:3.0:1746155645.241803:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126103424 00002000:00100000:3.0:1746155645.241829:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2871296->3145727) req@ffff88009ca96a00 x1830976126103424/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.241843:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96a00 with x1830976126103424 ext(2871296->3145727) 00010000:00010000:3.0:1746155645.241849:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 34 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.241858:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 34 pid: 9235 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155645.241864:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca96a00 00000100:00100000:3.0:1746155645.241899:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1438 00000100:00100000:3.0:1746155645.241906:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976126103424:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155645.242104:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.242137:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126103552 00000100:00100000:2.0:1746155645.242140:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126103552 00000100:00100000:2.0:1746155645.242167:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17314 00000100:00100000:2.0:1746155645.242172:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:32486:x1830976126103552:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155645.242179:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155645.242190:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f881c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18830 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.242204:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155645.242206:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155645.242209:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f881c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18830 expref: 36 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.242217:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f881c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18830 expref: 36 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.242223:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801312fa000, rc 0) 00000100:00100000:2.0:1746155645.242242:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:32486:x1830976126103552:12345-192.168.202.51@tcp:101:cat.0 Request processed in 70us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.242248:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17314 00000100:00100000:0.0:1746155645.242429:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.242526:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126103680 00000100:00100000:1.0:1746155645.242530:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126103680 00000100:00100000:1.0:1746155645.242547:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17315 00000100:00100000:1.0:1746155645.242551:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32480:x1830976126103680:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155645.242558:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155645.242565:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18829 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.242577:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.242583:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155645.242584:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155645.242587:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->2691071] (req 2097152->2691071) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.242605:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.242613:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 15 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.242622:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125421440:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155645.242905:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155645.245443:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125421440:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155645.245465:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->2691071] (req 2097152->2691071) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.245488:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00c600, rc 0) 00000100:00100000:1.0:1746155645.245540:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32480:x1830976126103680:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2987us (3110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.245547:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17315 00000100:00100000:0.0:1746155645.245686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.246472:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126103808 00000100:00100000:2.0:1746155645.246477:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126103808 00002000:00100000:2.0:1746155645.246519:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3620864->4194303) req@ffff88009ca95500 x1830976126103808/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155645.246530:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95500 with x1830976126103808 ext(3620864->4194303) 00010000:00010000:2.0:1746155645.246537:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 16 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.246546:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 16 pid: 9235 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746155645.246551:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca95500 00000100:00100000:2.0:1746155645.246570:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1439 00000100:00100000:2.0:1746155645.246575:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976126103808:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155645.247700:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1960:x1830976126103424:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 5792us (6356us total) trans 17179874352 rc 0/0 00000100:00100000:3.0:1746155645.247708:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1438 00002000:00100000:3.0:1746155645.247714:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2871296->3145727) req@ffff88009ca96a00 x1830976126103424/t17179874352(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/448 e 0 to 0 dl 1746155656 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.247721:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96a00 with x1830976126103424 ext(2871296->3145727) 00010000:00010000:3.0:1746155645.247727:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 37 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.247735:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 37 pid: 9235 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155645.247741:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca96a00 00000100:00100000:0.0:1746155645.251524:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.251782:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126103936 00000100:00100000:2.0:1746155645.251790:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126103936 00010000:00010000:2.0:1746155645.251818:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 37 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.251847:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8877 00000100:00100000:2.0:1746155645.251854:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976126103936:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155645.251864:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155645.251881:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 37 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.251905:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 37 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.251923:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094949000/0x844e5faceb5f87cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187f8 expref: 37 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.251947:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155645.251949:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155645.251958:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.251965:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.251973:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155645.251974:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155645.251977:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f881c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18830 expref: 36 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.251982:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f881c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18830 expref: 36 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.252006:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f881c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18830 expref: 36 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155645.252016:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125421568:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155645.252086:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155645.252094:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125421696:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155645.252109:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155645.253764:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125421568:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155645.253775:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125421696:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155645.253789:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155645.253830:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976126103936:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1975us (2328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.253838:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8877 00000100:00100000:2.0:1746155645.254901:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976126103808:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 8323us (9213us total) trans 21474841661 rc 0/0 00000100:00100000:0.0:1746155645.255981:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.256344:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1439 00002000:00100000:2.0:1746155645.256357:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3620864->4194303) req@ffff88009ca95500 x1830976126103808/t21474841661(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/448 e 0 to 0 dl 1746155656 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155645.256366:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95500 with x1830976126103808 ext(3620864->4194303) 00010000:00010000:2.0:1746155645.256374:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 18 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.256387:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 18 pid: 9235 timeout: 874 lvb_type: 0 00002000:00010000:2.0:1746155645.256393:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca95500 00000100:00100000:2.0:1746155645.256439:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126104192 00000100:00100000:2.0:1746155645.256444:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126104192 00002000:00100000:2.0:1746155645.256466:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4026368->4030463) req@ffff88009ca97100 x1830976126104192/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155645.256473:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97100 with x1830976126104192 ext(4026368->4030463) 00002000:00010000:2.0:1746155645.256476:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca97100 00000100:00100000:2.0:1746155645.256488:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8227 00000100:00100000:2.0:1746155645.256494:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976126104192:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155645.256629:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976126104192:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 134us (650us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155645.256634:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8227 00002000:00100000:2.0:1746155645.256639:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4026368->4030463) req@ffff88009ca97100 x1830976126104192/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/4536 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155645.256645:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97100 with x1830976126104192 ext(4026368->4030463) 00002000:00010000:2.0:1746155645.256647:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca97100 00000100:00100000:0.0:1746155645.256760:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.257040:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126104448 00000100:00100000:3.0:1746155645.257044:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126104448 00002000:00100000:3.0:1746155645.257061:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012cdeed80 x1830976126104448/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.257068:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeed80 with x1830976126104448 ext(2097152->3145727) 00002000:00010000:3.0:1746155645.257071:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdeed80 00000100:00100000:3.0:1746155645.257082:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8228 00000100:00100000:3.0:1746155645.257087:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1963:x1830976126104448:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155645.260586:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.260665:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126104576 00000100:00100000:3.0:1746155645.260673:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126104576 00010000:00010000:3.0:1746155645.260700:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 18 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.261404:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8878 00000100:00100000:3.0:1746155645.261412:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976126104576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.261426:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155645.261444:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 18 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.261455:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 18 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.261473:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f023400/0x844e5faceb5f8758 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3620864->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f187d5 expref: 18 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.262104:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.262106:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.262113:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.262121:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.262148:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155645.262158:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125421824:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155645.262232:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155645.263175:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.263735:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1963:x1830976126104448:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6646us (6974us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155645.263818:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126104704 00000100:00100000:1.0:1746155645.263824:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126104704 00000100:00100000:1.0:1746155645.263852:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17316 00000100:00100000:1.0:1746155645.263859:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32487:x1830976126104704:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155645.263870:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155645.263883:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18837 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.263912:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.263918:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155645.263919:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155645.263922:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->3301375] (req 3145728->3301375) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 19 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.263939:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.263948:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 22 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.263960:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125421952:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155645.263987:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746155645.264454:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8228 00002000:00100000:3.0:1746155645.264463:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012cdeed80 x1830976126104448/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.264472:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeed80 with x1830976126104448 ext(2097152->3145727) 00002000:00010000:3.0:1746155645.264476:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdeed80 00000100:00100000:3.0:1746155645.264668:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125421824:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155645.264683:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155645.264704:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976126104576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3293us (4203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.264710:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8878 00000100:00100000:0.0:1746155645.268261:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.268378:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125421952:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155645.268390:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126104960 00000100:00100000:3.0:1746155645.268396:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126104960 00010000:00010000:1.0:1746155645.268403:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->3301375] (req 3145728->3301375) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.268417:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00d200, rc 0) 00002000:00100000:3.0:1746155645.268427:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2686976->2691071) req@ffff88012cdedc00 x1830976126104960/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.268433:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdedc00 with x1830976126104960 ext(2686976->2691071) 00010000:00010000:3.0:1746155645.268442:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 23 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.268450:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 23 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.268451:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32487:x1830976126104704:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4592us (5277us total) trans 0 rc 0/0 00002000:00010000:3.0:1746155645.268454:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdedc00 00000100:00100000:1.0:1746155645.268458:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17316 00000100:00100000:3.0:1746155645.268470:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1440 00000100:00100000:3.0:1746155645.268476:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126104960:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155645.268629:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126104960:12345-192.168.202.51@tcp:3:cat.0 Request processed in 152us (373us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155645.268635:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1440 00002000:00100000:3.0:1746155645.268640:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2686976->2691071) req@ffff88012cdedc00 x1830976126104960/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/4536 e 0 to 0 dl 1746155656 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.268647:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdedc00 with x1830976126104960 ext(2686976->2691071) 00010000:00010000:3.0:1746155645.268651:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 23 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.268665:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 23 pid: 9235 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155645.268670:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdedc00 00000100:00100000:0.0:1746155645.270955:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.271040:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126105344 00000100:00100000:3.0:1746155645.271047:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126105344 00000100:00100000:3.0:1746155645.271076:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4764 00000100:00100000:3.0:1746155645.271083:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:32480:x1830976126105344:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155645.271250:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:32480:x1830976126105344:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 167us (299us total) trans 8589945369 rc 0/0 00000100:00100000:3.0:1746155645.271256:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4764 00000100:00100000:0.0:1746155645.271968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.272003:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.272043:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126105600 00000100:00100000:1.0:1746155645.272047:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126105600 00000100:00100000:3.0:1746155645.272056:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126105472 00000100:00100000:3.0:1746155645.272058:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126105472 00002000:00100000:3.0:1746155645.272068:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->2691071) req@ffff88012cdec000 x1830976126105472/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155645.272068:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2691072->3145727) req@ffff88012cdedf80 x1830976126105600/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.272075:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec000 with x1830976126105472 ext(2097152->2691071) 00002000:00100000:1.0:1746155645.272075:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdedf80 with x1830976126105600 ext(2691072->3145727) 00010000:00010000:3.0:1746155645.272082:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746155645.272082:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.272092:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746155645.272092:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155645.272098:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdec000 00002000:00010000:1.0:1746155645.272098:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdedf80 00000100:00100000:3.0:1746155645.272108:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1441 00000100:00100000:3.0:1746155645.272113:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126105472:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155645.272656:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1442 00000100:00100000:1.0:1746155645.272663:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126105600:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155645.275720:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.276203:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126105856 00000100:00100000:1.0:1746155645.276211:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126105856 00000100:00100000:1.0:1746155645.276251:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17317 00000100:00100000:1.0:1746155645.276257:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:32486:x1830976126105856:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155645.276271:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155645.276284:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8831 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1883e expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.276311:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155645.276313:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155645.276317:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8831 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1883e expref: 28 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.276327:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8831 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1883e expref: 28 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.276336:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00da00, rc 0) 00000100:00100000:1.0:1746155645.276370:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:32486:x1830976126105856:12345-192.168.202.51@tcp:101:cat.0 Request processed in 113us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.276375:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17317 00000100:00100000:1.0:1746155645.277936:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976126105600:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5269us (5963us total) trans 0 rc 454656/454656 00000100:00100000:1.0:1746155645.277944:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1442 00002000:00100000:1.0:1746155645.277953:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2691072->3145727) req@ffff88012cdedf80 x1830976126105600/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:H/200/0 rc 454656/454656 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155645.277962:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdedf80 with x1830976126105600 ext(2691072->3145727) 00010000:00010000:1.0:1746155645.277969:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 26 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746155645.277980:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 26 pid: 9235 timeout: 874 lvb_type: 0 00002000:00010000:1.0:1746155645.277985:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdedf80 00000100:00100000:3.0:1746155645.280981:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976126105472:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8860us (8969us total) trans 21474841662 rc 0/0 00000100:00100000:3.0:1746155645.280990:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1441 00002000:00100000:3.0:1746155645.280999:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->2691071) req@ffff88012cdec000 x1830976126105472/t21474841662(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/448 e 0 to 0 dl 1746155656 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.281006:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec000 with x1830976126105472 ext(2097152->2691071) 00010000:00010000:3.0:1746155645.281013:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 26 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.281025:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 26 pid: 9235 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155645.281032:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdec000 00000100:00100000:0.0:1746155645.285395:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.285452:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126105984 00000100:00100000:3.0:1746155645.285460:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126105984 00010000:00010000:3.0:1746155645.285489:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 26 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.285544:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8879 00000100:00100000:3.0:1746155645.285551:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976126105984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.285562:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155645.285580:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 26 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.285590:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 26 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.285609:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c600/0x844e5faceb5f8823 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18829 expref: 26 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.285730:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.285732:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.285738:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.285746:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.285754:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.285755:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.285758:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8831 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1883e expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.285764:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1883e expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.285789:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1883e expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155645.285799:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125422080:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155645.285872:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155645.285883:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125422208:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155645.285909:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155645.287042:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125422080:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155645.287057:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125422208:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155645.287070:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155645.287099:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976126105984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1549us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.287106:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8879 00000100:00100000:0.0:1746155645.288018:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.288068:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126106240 00000100:00100000:3.0:1746155645.288072:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126106240 00002000:00100000:3.0:1746155645.288095:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3297280->3301375) req@ffff88012cded880 x1830976126106240/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.288103:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded880 with x1830976126106240 ext(3297280->3301375) 00002000:00010000:3.0:1746155645.288107:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cded880 00000100:00100000:3.0:1746155645.288130:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8229 00000100:00100000:3.0:1746155645.288136:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126106240:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155645.288256:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126106240:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 118us (239us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155645.288262:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8229 00002000:00100000:3.0:1746155645.288266:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3297280->3301375) req@ffff88012cded880 x1830976126106240/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/4536 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.288274:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded880 with x1830976126106240 ext(3297280->3301375) 00002000:00010000:3.0:1746155645.288277:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cded880 00010000:00010000:3.0:1746155645.288700:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746155645.288718:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.288829:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126106496 00000100:00100000:3.0:1746155645.288832:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126106496 00002000:00100000:3.0:1746155645.288846:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f4ffb80 x1830976126106496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.288852:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ffb80 with x1830976126106496 ext(2097152->3145727) 00002000:00010000:3.0:1746155645.288855:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4ffb80 00000100:00100000:3.0:1746155645.288873:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8230 00000100:00100000:3.0:1746155645.288877:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126106496:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155645.294565:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126106496:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5677us (5837us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155645.294575:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8230 00002000:00100000:3.0:1746155645.294586:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f4ffb80 x1830976126106496/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.294595:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ffb80 with x1830976126106496 ext(2097152->3145727) 00002000:00010000:3.0:1746155645.294599:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4ffb80 00000100:00100000:0.0:1746155645.297045:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.297151:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126106624 00000100:00100000:1.0:1746155645.297158:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126106624 00000100:00100000:1.0:1746155645.297199:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17318 00000100:00100000:1.0:1746155645.297204:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:32486:x1830976126106624:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155645.297217:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155645.297231:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b00de00/0x844e5faceb5f8838 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18845 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.297257:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.297264:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155645.297265:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155645.297268:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00de00/0x844e5faceb5f8838 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18845 expref: 37 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.297292:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.297302:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 23 pid: 10591 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.297313:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125422336:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155645.297626:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155645.298844:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125422336:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155645.298863:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b00de00/0x844e5faceb5f8838 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18845 expref: 37 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.298874:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00de00, rc 0) 00000100:00100000:1.0:1746155645.298912:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:32486:x1830976126106624:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1707us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.298918:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17318 00000100:00100000:0.0:1746155645.299094:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.299179:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126106752 00000100:00100000:3.0:1746155645.299184:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126106752 00002000:00100000:3.0:1746155645.299210:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4026368->4194303) req@ffff88012cdef100 x1830976126106752/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.299218:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdef100 with x1830976126106752 ext(4026368->4194303) 00010000:00010000:3.0:1746155645.299223:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 24 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.299238:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 24 pid: 10591 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155645.299243:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdef100 00000100:00100000:3.0:1746155645.299255:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1443 00000100:00100000:3.0:1746155645.299261:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976126106752:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155645.301323:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976126106752:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 2056us (2223us total) trans 17179874353 rc 0/0 00000100:00100000:3.0:1746155645.301332:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1443 00002000:00100000:3.0:1746155645.301341:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4026368->4194303) req@ffff88012cdef100 x1830976126106752/t17179874353(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/448 e 0 to 0 dl 1746155656 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.301349:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdef100 with x1830976126106752 ext(4026368->4194303) 00010000:00010000:3.0:1746155645.301357:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 26 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.301369:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 26 pid: 10591 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155645.301375:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012cdef100 00000100:00100000:0.0:1746155645.304261:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.304331:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126106880 00000100:00100000:3.0:1746155645.304339:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126106880 00010000:00010000:3.0:1746155645.304367:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 26 pid: 10591 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.304408:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8880 00000100:00100000:3.0:1746155645.304416:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976126106880:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.304428:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155645.304445:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 26 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.304456:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 26 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.304475:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312fb400/0x844e5faceb5f8815 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4026368->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18822 expref: 26 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.304525:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.304527:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.304533:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b00de00/0x844e5faceb5f8838 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18845 expref: 36 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.304540:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00de00/0x844e5faceb5f8838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18845 expref: 36 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.304572:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b00de00/0x844e5faceb5f8838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18845 expref: 36 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155645.304583:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125422464:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155645.304652:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155645.306840:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125422464:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155645.306856:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155645.306904:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976126106880:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2488us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.306910:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8880 00000100:00100000:0.0:1746155645.308246:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.308318:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126107136 00000100:00100000:3.0:1746155645.308325:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126107136 00002000:00100000:3.0:1746155645.308357:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012cdefb80 x1830976126107136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.308365:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdefb80 with x1830976126107136 ext(3145728->4194303) 00002000:00010000:3.0:1746155645.308369:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdefb80 00000100:00100000:3.0:1746155645.308383:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8231 00000100:00100000:3.0:1746155645.308390:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976126107136:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155645.316604:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976126107136:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8206us (8354us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155645.316615:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8231 00002000:00100000:3.0:1746155645.316624:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012cdefb80 x1830976126107136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.316633:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdefb80 with x1830976126107136 ext(3145728->4194303) 00002000:00010000:3.0:1746155645.316638:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdefb80 00000100:00100000:0.0:1746155645.323726:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.323785:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126107264 00000100:00100000:1.0:1746155645.323793:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126107264 00000100:00100000:1.0:1746155645.323842:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17319 00000100:00100000:1.0:1746155645.323850:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32486:x1830976126107264:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155645.324095:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155645.324110:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b00d600/0x844e5faceb5f883f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1884c expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.324139:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.324146:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155645.324148:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155645.324151:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00d600/0x844e5faceb5f883f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1884c expref: 26 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.324182:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.324192:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 17 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.324203:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125422592:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155645.324544:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a534b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155645.326840:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.326904:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126107392 00000100:00100000:3.0:1746155645.326910:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126107392 00002000:00100000:3.0:1746155645.326943:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3301375) req@ffff88012cdeca80 x1830976126107392/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.326952:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeca80 with x1830976126107392 ext(3145728->3301375) 00010000:00010000:3.0:1746155645.326961:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 18 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.326972:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 18 pid: 9235 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155645.326978:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdeca80 00000100:00100000:3.0:1746155645.326995:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1444 00000100:00100000:3.0:1746155645.327001:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1961:x1830976126107392:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155645.327246:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125422592:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155645.327268:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b00d600/0x844e5faceb5f883f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1884c expref: 26 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.327280:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00d600, rc 0) 00000100:00100000:1.0:1746155645.327573:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:32486:x1830976126107264:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3724us (3854us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.327580:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17319 00000100:00100000:3.0:1746155645.331132:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976126107392:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 4124us (4289us total) trans 21474841663 rc 0/0 00000100:00100000:3.0:1746155645.331143:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1444 00002000:00100000:3.0:1746155645.331153:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->3301375) req@ffff88012cdeca80 x1830976126107392/t21474841663(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/448 e 0 to 0 dl 1746155656 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.331162:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeca80 with x1830976126107392 ext(3145728->3301375) 00010000:00010000:3.0:1746155645.331170:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 20 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.331182:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 20 pid: 9235 timeout: 874 lvb_type: 0 00002000:00010000:3.0:1746155645.331194:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cdeca80 00000100:00100000:0.0:1746155645.333910:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.333999:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126107520 00000100:00100000:3.0:1746155645.334006:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126107520 00010000:00010000:3.0:1746155645.334033:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 20 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.334068:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8881 00000100:00100000:3.0:1746155645.334075:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976126107520:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.334086:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155645.334101:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 20 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.334111:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 20 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.334128:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f882a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->3301375) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18837 expref: 20 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.334154:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.334156:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.334162:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00d600/0x844e5faceb5f883f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1884c expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.334169:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00d600/0x844e5faceb5f883f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1884c expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.334195:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00d600/0x844e5faceb5f883f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1884c expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155645.334205:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125422720:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155645.334273:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155645.336738:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125422720:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155645.336756:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155645.336798:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1963:x1830976126107520:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2722us (2894us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.336806:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8881 00000100:00100000:2.0:1746155645.337500:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.337569:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126107776 00000100:00100000:3.0:1746155645.337575:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126107776 00002000:00100000:3.0:1746155645.337602:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800936f4a80 x1830976126107776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.337610:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4a80 with x1830976126107776 ext(3145728->4194303) 00002000:00010000:3.0:1746155645.337614:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f4a80 00000100:00100000:3.0:1746155645.337640:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8232 00000100:00100000:3.0:1746155645.337647:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976126107776:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155645.344300:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976126107776:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6645us (6793us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155645.344310:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8232 00002000:00100000:3.0:1746155645.344321:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800936f4a80 x1830976126107776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.344330:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4a80 with x1830976126107776 ext(3145728->4194303) 00002000:00010000:3.0:1746155645.344335:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f4a80 00000100:00100000:0.0:1746155645.350917:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.351865:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126108032 00000100:00100000:3.0:1746155645.351873:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126108032 00002000:00100000:3.0:1746155645.351928:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012cdeea00 x1830976126108032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.351937:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeea00 with x1830976126108032 ext(4194304->5083135) 00002000:00010000:3.0:1746155645.351943:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdeea00 00000100:00100000:3.0:1746155645.352015:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8233 00000100:00100000:3.0:1746155645.352024:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976126108032:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155645.353479:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.353822:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126108288 00000100:00100000:0.0:1746155645.353828:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126108288 00000100:00100000:0.0:1746155645.353868:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11194 00000100:00100000:0.0:1746155645.353874:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:32492:x1830976126108288:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155645.353900:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155645.353919:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f8846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18853 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.354008:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f400/0x844e5faceb5f884d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354023:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f400/0x844e5faceb5f884d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354032:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f400/0x844e5faceb5f884d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354043:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f8854 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354049:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f8854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354053:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f8854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354137:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f885b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354146:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f885b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354150:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f885b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155645.354157:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155645.354216:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f400/0x844e5faceb5f884d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354222:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f400/0x844e5faceb5f884d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354229:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f400/0x844e5faceb5f884d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354234:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26f400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155645.354237:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f400/0x844e5faceb5f884d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354242:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f400/0x844e5faceb5f884d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354251:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155645.354253:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155645.354256:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f400/0x844e5faceb5f884d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.354260:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f400/0x844e5faceb5f884d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.355436:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f8854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.355444:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f8854 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.355449:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f8854 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.355454:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26e800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155645.355456:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f8854 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.355461:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f8854 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.355475:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e62d500) 00010000:00010000:0.0:1746155645.355477:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155645.355479:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f8854 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.355483:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e800/0x844e5faceb5f8854 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.355541:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e400/0x844e5faceb5f8846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18853 expref: 27 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.355552:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f885b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18853 expref: 26 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.355558:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155645.355560:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155645.355562:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26fa00, rc 0) 00000100:00100000:0.0:1746155645.355616:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:32492:x1830976126108288:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1740us (2142us total) trans 8589945370 rc 0/0 00000100:00100000:0.0:1746155645.355623:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11194 00000100:00100000:0.0:1746155645.360725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.360779:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126108544 00000100:00100000:2.0:1746155645.360787:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126108544 00000100:00100000:2.0:1746155645.360826:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 770 00000100:00100000:2.0:1746155645.360833:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1963:x1830976126108544:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155645.360844:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155645.360865:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f885b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18853 expref: 26 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.360898:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.360902:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155645.360927:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976126108032:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8903us (10015us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155645.360927:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1963:x1830976126108544:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 95us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.360933:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 770 00000100:00100000:3.0:1746155645.360934:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8233 00002000:00100000:3.0:1746155645.360941:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012cdeea00 x1830976126108032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.360949:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdeea00 with x1830976126108032 ext(4194304->5083135) 00002000:00010000:3.0:1746155645.360954:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdeea00 00000100:00100000:2.0:1746155645.361075:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.361114:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126108672 00000100:00100000:0.0:1746155645.361117:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126108672 00000100:00100000:0.0:1746155645.361146:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4765 00000100:00100000:0.0:1746155645.361152:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:32492:x1830976126108672:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:0.0:1746155645.361345:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:32492:x1830976126108672:12345-192.168.202.51@tcp:35:cat.0 Request processed in 192us (269us total) trans 8589945371 rc 0/0 00000100:00100000:0.0:1746155645.361353:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4765 00000100:00100000:0.0:1746155645.364398:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.364446:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.364447:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126108800 00000100:00100000:1.0:1746155645.364455:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126108800 00000100:00100000:1.0:1746155645.364488:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126108928 00000100:00100000:1.0:1746155645.364491:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126108928 00000100:00100000:1.0:1746155645.364523:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17320 00000100:00100000:1.0:1746155645.364531:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1963:x1830976126108800:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155645.364544:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155645.364558:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b00d800/0x844e5faceb5f8869 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1885a expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.364575:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.364577:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.364585:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00d800/0x844e5faceb5f8869 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1885a expref: 26 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.364598:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b00d800/0x844e5faceb5f8869 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1885a expref: 26 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.364607:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00d800, rc 0) 00000100:00100000:1.0:1746155645.364655:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1963:x1830976126108800:12345-192.168.202.51@tcp:101:cat.0 Request processed in 125us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.364662:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17321 00000100:00100000:0.0:1746155645.364669:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1963:x1830976126108928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155645.364676:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155645.364684:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8870 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18861 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.364694:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155645.364695:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155645.364699:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8870 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18861 expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155645.364707:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8870 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18861 expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155645.364713:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26ea00, rc 0) 00000100:00100000:0.0:1746155645.364729:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976126108928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 61us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.364756:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17320 00000100:00100000:0.0:1746155645.364759:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17321 00000100:00100000:0.0:1746155645.379465:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.380074:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126109184 00000100:00100000:3.0:1746155645.380082:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126109184 00002000:00100000:3.0:1746155645.380148:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a01d0000 x1830976126109184/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.380157:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d0000 with x1830976126109184 ext(2097152->3145727) 00002000:00010000:3.0:1746155645.380162:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d0000 00000100:00100000:3.0:1746155645.380178:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8234 00000100:00100000:3.0:1746155645.380184:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1963:x1830976126109184:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155645.380594:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.380623:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.380647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.380772:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126109440 00000100:00100000:0.0:1746155645.380776:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126109696 00000100:00100000:2.0:1746155645.380777:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126109440 00000100:00100000:0.0:1746155645.380780:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126109696 00002000:00100000:2.0:1746155645.380794:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f4fc380 x1830976126109440/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155645.380795:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f4ff100 x1830976126109696/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155645.380802:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fc380 with x1830976126109440 ext(3145728->4194303) 00002000:00010000:2.0:1746155645.380805:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fc380 00000100:00100000:1.0:1746155645.380811:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126109952 00000100:00100000:1.0:1746155645.380813:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126109952 00000100:00100000:3.0:1746155645.380818:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8235 00000100:00100000:3.0:1746155645.380823:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1963:x1830976126109440:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:1.0:1746155645.380824:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f4fd880 x1830976126109952/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155645.380831:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd880 with x1830976126109952 ext(3145728->4194303) 00002000:00010000:1.0:1746155645.380833:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fd880 00002000:00100000:0.0:1746155645.380860:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ff100 with x1830976126109696 ext(2097152->3145727) 00002000:00010000:0.0:1746155645.380862:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4ff100 00000100:00100000:1.0:1746155645.380878:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8236 00000100:00100000:1.0:1746155645.380891:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976126109952:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155645.381042:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8237 00000100:00100000:0.0:1746155645.381047:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976126109696:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155645.393652:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1963:x1830976126109696:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12596us (13018us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155645.393664:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8237 00002000:00100000:2.0:1746155645.393675:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009f4ff100 x1830976126109696/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155645.393684:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4ff100 with x1830976126109696 ext(2097152->3145727) 00002000:00010000:2.0:1746155645.393689:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4ff100 00000100:00100000:1.0:1746155645.396356:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976126109952:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15464us (15700us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155645.396369:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8236 00002000:00100000:1.0:1746155645.396379:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009f4fd880 x1830976126109952/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155645.396388:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fd880 with x1830976126109952 ext(3145728->4194303) 00002000:00010000:1.0:1746155645.396393:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f4fd880 00000100:00100000:3.0:1746155645.401863:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1963:x1830976126109440:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21031us (21260us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155645.401874:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8235 00002000:00100000:3.0:1746155645.401897:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009f4fc380 x1830976126109440/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.401906:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fc380 with x1830976126109440 ext(3145728->4194303) 00002000:00010000:3.0:1746155645.401911:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f4fc380 00000100:00100000:3.0:1746155645.403275:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1963:x1830976126109184:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23086us (23812us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155645.403283:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8234 00002000:00100000:3.0:1746155645.403290:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a01d0000 x1830976126109184/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.403298:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d0000 with x1830976126109184 ext(2097152->3145727) 00002000:00010000:3.0:1746155645.403301:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d0000 00000100:00100000:0.0:1746155645.407471:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.409666:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126110208 00000100:00100000:3.0:1746155645.409678:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126110208 00002000:00100000:3.0:1746155645.409733:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800a01d0700 x1830976126110208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/0 e 0 to 0 dl 1746155656 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155645.409744:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d0700 with x1830976126110208 ext(4194304->5083135) 00002000:00010000:3.0:1746155645.409749:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d0700 00000100:00100000:3.0:1746155645.409787:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8238 00000100:00100000:3.0:1746155645.409795:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976126110208:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155645.415864:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976126110208:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6061us (8390us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155645.415877:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8238 00002000:00100000:2.0:1746155645.415898:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800a01d0700 x1830976126110208/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:716/0 lens 488/440 e 0 to 0 dl 1746155656 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155645.415911:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a01d0700 with x1830976126110208 ext(4194304->5083135) 00002000:00010000:2.0:1746155645.415916:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a01d0700 00000100:00100000:0.0:1746155645.438609:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.438921:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126110336 00000100:00100000:2.0:1746155645.438931:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126110336 00000100:00100000:2.0:1746155645.438971:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11195 00000100:00100000:2.0:1746155645.438979:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32495:x1830976126110336:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155645.438996:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155645.439012:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f800/0x844e5faceb5f8877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18868 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.439063:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f887e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.439074:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f887e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.439083:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f887e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.439095:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8885 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.439100:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.439105:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.439197:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.439206:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18757 expref: 25 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.439212:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.439239:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18757 expref: 25 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.439249:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18757 expref: 25 pid: 20364 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.439265:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125422848:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155645.441435:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155645.443007:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.443087:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125422848:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155645.443104:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155645.443227:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126110592 00000100:00100000:1.0:1746155645.443234:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126110592 00000100:00100000:1.0:1746155645.443272:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4766 00000100:00100000:1.0:1746155645.443278:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea55850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:23568:x1830976126110592:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746155645.445920:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea55850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:23568:x1830976126110592:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 2635us (2912us total) trans 8589945372 rc 0/0 00000100:00100000:1.0:1746155645.445927:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4766 00000100:00100000:0.0:1746155645.449802:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.449873:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126110720 00000100:00100000:2.0:1746155645.449880:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126110720 00010000:00010000:2.0:1746155645.449922:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18757 expref: 27 pid: 20364 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.449956:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8882 00000100:00100000:2.0:1746155645.449963:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976126110720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155645.449976:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155645.449981:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18757 expref: 27 pid: 20364 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.449991:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18757 expref: 27 pid: 20364 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.450009:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8663 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18757 expref: 27 pid: 20364 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.450030:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.450034:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.450045:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.450050:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.450066:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155645.450076:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450083:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155645.450106:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976126110720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 143us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.450111:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8882 00000004:00200000:0.0:1746155645.450120:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:0.0:1746155645.450124:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746155645.450138:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450146:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450460:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f887e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450466:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f887e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450472:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f887e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450480:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5fa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155645.450483:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f887e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450487:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f887e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450495:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155645.450498:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155645.450532:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f887e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450537:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f887e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450559:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450563:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8885 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450567:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450571:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5fc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155645.450573:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450578:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8885 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450584:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ae84000) 00010000:00010000:0.0:1746155645.450586:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155645.450588:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8885 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450592:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8885 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.450621:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f800/0x844e5faceb5f8877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18868 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.450631:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18868 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.450636:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155645.450638:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155645.450640:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5fe00, rc 0) 00000100:00100000:0.0:1746155645.450669:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32495:x1830976126110336:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 11691us (12067us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.450675:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11195 00000100:00100000:0.0:1746155645.452831:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.452854:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.452876:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.452902:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126110976 00000100:00100000:0.0:1746155645.452902:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126110848 00000100:00100000:1.0:1746155645.452908:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126110976 00000100:00100000:0.0:1746155645.452908:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126110848 00000100:00100000:0.0:1746155645.452949:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126111104 00000100:00100000:0.0:1746155645.452951:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126111104 00000100:00100000:1.0:1746155645.453020:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17322 00000100:00100000:0.0:1746155645.453048:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17323 00000100:00100000:1.0:1746155645.453051:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126110848:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00100000:0.0:1746155645.453052:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126110976:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00100000:3.0:1746155645.453055:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17324 00000100:00100000:3.0:1746155645.453065:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126111104:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155645.453065:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155645.453070:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155645.453073:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155645.453078:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7df600/0x844e5faceb5f8893 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1886f expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.453078:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a4e2a00/0x844e5faceb5f889a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18876 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.453090:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d63400/0x844e5faceb5f88a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1887d expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.453096:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.453098:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.453106:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7df600/0x844e5faceb5f8893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1886f expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.453107:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.453109:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.453114:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d63400/0x844e5faceb5f88a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1887d expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.453122:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7df600/0x844e5faceb5f8893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1886f expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.453124:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094d63400/0x844e5faceb5f88a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1887d expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.453130:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7df600, rc 0) 00010000:00010000:3.0:1746155645.453131:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094d63400, rc 0) 00000100:00100000:3.0:1746155645.453162:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126111104:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 100us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.453162:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126110848:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 112us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.453167:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17322 00000100:00100000:3.0:1746155645.453170:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17324 00000100:00100000:1.0:1746155645.453192:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.453250:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.453260:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126111232 00000100:00100000:1.0:1746155645.453262:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126111232 00000100:00100000:1.0:1746155645.453275:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126111360 00000100:00100000:1.0:1746155645.453277:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126111360 00000100:00100000:1.0:1746155645.453288:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17325 00000100:00100000:1.0:1746155645.453292:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126111232:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155645.453297:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155645.453302:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7dee00/0x844e5faceb5f88a8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18884 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.453311:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.453313:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.453317:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7dee00/0x844e5faceb5f88a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18884 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.453325:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f7dee00/0x844e5faceb5f88a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18884 expref: 11 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.453336:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7dee00, rc 0) 00000100:00100000:1.0:1746155645.453350:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126111232:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 57us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.453354:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17325 00000100:00100000:1.0:1746155645.453364:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17326 00000100:00100000:1.0:1746155645.453369:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976126111360:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155645.453374:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155645.453379:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7df200/0x844e5faceb5f88af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1888b expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.453388:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.453389:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.453392:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7df200/0x844e5faceb5f88af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1888b expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155645.453398:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155645.453400:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.453401:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f7df200/0x844e5faceb5f88af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1888b expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155645.453404:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4e2a00/0x844e5faceb5f889a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18876 expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.453407:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7df200, rc 0) 00010000:00010000:0.0:1746155645.453413:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a4e2a00/0x844e5faceb5f889a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18876 expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155645.453419:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976126111360:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 50us (170us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155645.453419:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4e2a00, rc 0) 00000100:00100000:1.0:1746155645.453423:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17326 00000100:00100000:0.0:1746155645.453430:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976126110976:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 377us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.453435:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17323 00000100:00080000:0.0:1746155645.453447:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155645.456112:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.456157:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126111616 00000100:00100000:2.0:1746155645.456164:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126111616 00000100:00100000:2.0:1746155645.456203:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11196 00000100:00100000:2.0:1746155645.456211:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32495:x1830976126111616:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155645.456224:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155645.456238:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f88b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18892 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.456309:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f88bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.456320:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18868 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.456325:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f88bd lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.456348:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18868 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.456361:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18868 expref: 8 pid: 20364 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.456370:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125422976:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155645.456623:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155645.459337:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.459694:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125422976:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155645.459716:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f88bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155645.459749:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126111744 00000100:00100000:3.0:1746155645.459755:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126111744 00010000:00010000:3.0:1746155645.459782:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18868 expref: 9 pid: 20364 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.459810:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8883 00000100:00100000:3.0:1746155645.459817:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126111744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.459828:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155645.459833:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18868 expref: 9 pid: 20364 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.459842:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18868 expref: 9 pid: 20364 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.459863:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fe00/0x844e5faceb5f888c lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18868 expref: 9 pid: 20364 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.459896:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155645.459900:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f88bd lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155645.459908:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f88bd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155645.459913:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f88bd lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155645.459934:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155645.459965:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126111744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 149us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.459971:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8883 00010000:00010000:2.0:1746155645.460049:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f88bd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.460056:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f88bd lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155645.460071:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155645.460177:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f88b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18892 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.460207:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f88bd lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18892 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.460213:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.460216:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155645.460218:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5fa00, rc 0) 00000100:00100000:2.0:1746155645.460378:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32495:x1830976126111616:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 4166us (4272us total) trans 8589945373 rc 0/0 00000100:00100000:2.0:1746155645.460387:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11196 00000100:00100000:0.0:1746155645.462274:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.462324:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126112000 00000100:00100000:2.0:1746155645.462330:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126112000 00000100:00100000:2.0:1746155645.462358:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11197 00000100:00100000:2.0:1746155645.462364:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32495:x1830976126112000:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155645.462386:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155645.462389:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746155645.462405:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fa00/0x844e5faceb5f88bd lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18892 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.462419:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.462423:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155645.462431:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f88cb lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18899 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.462497:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f88d2 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.462536:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f88d2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.462543:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f88d2 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155645.462551:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155645.462626:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f88cb lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18899 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.462637:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f88d2 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18899 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.462643:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.462645:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155645.462646:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5f200, rc 0) 00000100:00100000:2.0:1746155645.462687:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32495:x1830976126112000:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 323us (418us total) trans 8589945374 rc 0/0 00000100:00100000:2.0:1746155645.462692:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11197 00000100:00100000:0.0:1746155645.465215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.465296:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126112128 00000100:00100000:2.0:1746155645.465304:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126112128 00000100:00100000:2.0:1746155645.465340:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11198 00000100:00100000:2.0:1746155645.465347:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32495:x1830976126112128:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155645.465364:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155645.465376:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f88e0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188a0 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.465419:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f88e0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188a0 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.465429:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f88e0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188a0 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.465443:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.465446:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155645.465448:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5f000, rc 0) 00000100:00100000:2.0:1746155645.465496:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32495:x1830976126112128:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 148us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.465537:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11198 00000100:00100000:0.0:1746155645.467798:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.467832:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.467900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.467976:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126112256 00000100:00100000:3.0:1746155645.467983:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126112256 00000100:00100000:3.0:1746155645.468016:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126112512 00000100:00100000:3.0:1746155645.468018:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126112512 00000100:00100000:3.0:1746155645.468027:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126112768 00000100:00100000:3.0:1746155645.468028:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126112768 00000100:00100000:3.0:1746155645.468040:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17327 00000100:00100000:3.0:1746155645.468046:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976126112256:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:3.0:1746155645.468078:0:10591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.468093:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f857c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186bd expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.468101:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7df600/0x844e5faceb5f8893 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1886f expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.468107:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801369b9c00/0x844e5faceb5f85bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186fc expref: 36 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.468112:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.468113:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.468116:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.468143:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801369b9c00/0x844e5faceb5f85bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186fc expref: 36 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.468153:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801369b9c00/0x844e5faceb5f85bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186fc expref: 36 pid: 4461 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155645.468163:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125423104:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155645.468233:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7df600/0x844e5faceb5f8893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1886f expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.468240:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7df600/0x844e5faceb5f8893 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1886f expref: 12 pid: 9235 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155645.468248:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125423232:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155645.468287:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f857c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186bd expref: 25 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.468294:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f857c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186bd expref: 25 pid: 4461 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.468300:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125423360:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155645.468314:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155645.468332:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17328 00000100:00100000:3.0:1746155645.468338:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976126112512:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:3.0:1746155645.468356:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.468366:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8640 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1873b expref: 19 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.468372:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a4e2a00/0x844e5faceb5f889a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18876 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.468378:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f8647 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18742 expref: 25 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.468383:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.468384:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.468385:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.468404:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f8647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18742 expref: 25 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.468411:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f8647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18742 expref: 25 pid: 9235 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155645.468419:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125423488:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155645.468442:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a4e2a00/0x844e5faceb5f889a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18876 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.468449:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a4e2a00/0x844e5faceb5f889a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18876 expref: 12 pid: 18270 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155645.468456:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125423616:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155645.468477:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8640 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1873b expref: 19 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.468484:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8640 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1873b expref: 19 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.468491:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125423744:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155645.468538:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a8f1da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155645.468584:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17329 00000100:00100000:0.0:1746155645.468590:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976126112768:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155645.468605:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.468615:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b00de00/0x844e5faceb5f8838 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18845 expref: 36 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.468621:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7dee00/0x844e5faceb5f88a8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18884 expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155645.468627:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b00d800/0x844e5faceb5f8869 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1885a expref: 25 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155645.468633:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f881c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18830 expref: 36 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.468638:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155645.468639:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155645.468641:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 7/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.468654:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f881c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18830 expref: 36 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.468741:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f881c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18830 expref: 36 pid: 10591 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746155645.468752:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125423872:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155645.468777:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b00d800/0x844e5faceb5f8869 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1885a expref: 25 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155645.468784:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b00d800/0x844e5faceb5f8869 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1885a expref: 25 pid: 9235 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746155645.468791:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125424000:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155645.468808:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f7dee00/0x844e5faceb5f88a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18884 expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155645.468814:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f7dee00/0x844e5faceb5f88a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18884 expref: 12 pid: 9235 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746155645.468820:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125424128:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155645.468833:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b00de00/0x844e5faceb5f8838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18845 expref: 36 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.468840:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b00de00/0x844e5faceb5f8838 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18845 expref: 36 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746155645.468847:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125424256:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155645.468856:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155645.469921:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.469950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.470803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.470818:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126112384 00000100:00100000:2.0:1746155645.470824:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126112384 00000100:00100000:2.0:1746155645.470853:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126112640 00000100:00100000:2.0:1746155645.470855:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126112640 00000100:00100000:2.0:1746155645.470868:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17330 00000100:00100000:2.0:1746155645.470873:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976126112384:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:2.0:1746155645.470908:0:19959:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.470921:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8800/0x844e5faceb5f8448 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18631 expref: 13 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155645.470928:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f088000/0x844e5faceb5f8575 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186b6 expref: 25 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.470935:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092872c00/0x844e5faceb5f8552 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18693 expref: 19 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155645.470940:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155645.470942:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155645.470944:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.470963:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092872c00/0x844e5faceb5f8552 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18693 expref: 19 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155645.470972:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092872c00/0x844e5faceb5f8552 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18693 expref: 19 pid: 18270 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746155645.470987:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125424384:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155645.471053:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f088000/0x844e5faceb5f8575 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186b6 expref: 25 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.471061:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f088000/0x844e5faceb5f8575 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186b6 expref: 25 pid: 19959 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.471069:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125424512:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155645.471089:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8800/0x844e5faceb5f8448 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18631 expref: 13 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155645.471096:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8800/0x844e5faceb5f8448 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18631 expref: 13 pid: 20200 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746155645.471103:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125424640:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155645.471115:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3320c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155645.471167:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17331 00000100:00100000:1.0:1746155645.471174:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976126112640:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:1.0:1746155645.471194:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.471202:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8671 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1875e expref: 36 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.471209:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d63400/0x844e5faceb5f88a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1887d expref: 13 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.471214:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f26ee00/0x844e5faceb5f86cc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18781 expref: 25 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.471219:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.471220:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.471221:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.471234:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f26ee00/0x844e5faceb5f86cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18781 expref: 25 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.471240:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f26ee00/0x844e5faceb5f86cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18781 expref: 25 pid: 18270 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746155645.471247:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125424768:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155645.471269:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094d63400/0x844e5faceb5f88a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1887d expref: 13 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.471279:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094d63400/0x844e5faceb5f88a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1887d expref: 13 pid: 10591 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746155645.471286:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125424896:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155645.471300:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8671 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1875e expref: 36 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.471305:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8671 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1875e expref: 36 pid: 4461 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.471312:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125425024:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155645.471322:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926180 going to sleep for 11 seconds 00000100:00100000:1.0:1746155645.471518:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126112896 00000100:00100000:1.0:1746155645.471522:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126112896 00000100:00100000:1.0:1746155645.471564:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17332 00000100:00100000:1.0:1746155645.471569:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976126112896:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:1.0:1746155645.471583:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.471591:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00d600/0x844e5faceb5f883f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1884c expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.471598:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7df200/0x844e5faceb5f88af lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1888b expref: 14 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.471607:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8870 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18861 expref: 19 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.471613:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8831 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1883e expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.471617:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155645.471618:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155645.471620:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 7/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.471632:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1883e expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.471638:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1883e expref: 25 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.471645:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125425152:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155645.471678:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8870 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18861 expref: 19 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.471685:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8870 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18861 expref: 19 pid: 18270 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746155645.471691:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125425280:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155645.471708:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f7df200/0x844e5faceb5f88af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1888b expref: 14 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.471714:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f7df200/0x844e5faceb5f88af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1888b expref: 14 pid: 9235 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746155645.471720:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125425408:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155645.471735:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00d600/0x844e5faceb5f883f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1884c expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.471742:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b00d600/0x844e5faceb5f883f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1884c expref: 25 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.471748:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125425536:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155645.471759:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130926780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155645.472093:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125423488:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155645.472306:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125423104:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155645.472312:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125423232:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155645.472318:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125423360:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155645.472337:0:10591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155645.473411:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.473443:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.473455:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125423744:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155645.473459:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126113280 00000100:00100000:0.0:1746155645.473467:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126113280 00010000:00010000:0.0:1746155645.473494:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f8647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18742 expref: 26 pid: 9235 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746155645.473527:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126113664 00000100:00100000:0.0:1746155645.473530:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126113664 00010000:00010000:0.0:1746155645.473539:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8640 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1873b expref: 20 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746155645.473556:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8884 00000100:00100000:0.0:1746155645.473561:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976126113280:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155645.473569:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155645.473584:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125423872:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155645.473585:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f8647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18742 expref: 26 pid: 9235 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746155645.473597:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125424000:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155645.473597:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f8647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18742 expref: 26 pid: 9235 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746155645.473603:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125424128:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155645.473608:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125424256:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155645.473613:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f8647 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18742 expref: 26 pid: 9235 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746155645.473618:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8885 00000100:00100000:2.0:1746155645.473625:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1962:x1830976126113664:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155645.473627:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.473633:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155645.473638:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155645.473643:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8640 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1873b expref: 20 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.473651:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8640 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1873b expref: 20 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.473662:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f8640 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1873b expref: 20 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746155645.473662:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976126113280:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 101us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.473669:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8884 00010000:00010000:2.0:1746155645.473670:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155645.473687:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976126113664:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 63us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.473692:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8885 00000100:00100000:1.0:1746155645.480729:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.481105:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125424384:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155645.481116:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125424512:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155645.482123:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126113152 00000100:00100000:3.0:1746155645.482130:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126113152 00000100:00100000:1.0:1746155645.482149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155645.482160:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f857c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186bd expref: 26 pid: 4461 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.482178:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.482187:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126113536 00000100:00100000:3.0:1746155645.482189:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126113536 00000100:00100000:1.0:1746155645.482192:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126113024 00000100:00100000:1.0:1746155645.482194:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126113024 00010000:00010000:3.0:1746155645.482199:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7dee00/0x844e5faceb5f88a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18884 expref: 15 pid: 9235 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.482204:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7df600/0x844e5faceb5f8893 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1886f expref: 15 pid: 9235 timeout: 874 lvb_type: 1 00000100:00100000:0.0:1746155645.482204:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8886 00000100:00100000:0.0:1746155645.482213:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1961:x1830976126113152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155645.482224:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155645.482230:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8887 00000100:00100000:1.0:1746155645.482233:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8888 00000100:00100000:3.0:1746155645.482235:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976126113536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155645.482237:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976126113024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.482241:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155645.482242:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155645.482243:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f857c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186bd expref: 26 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.482250:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7dee00/0x844e5faceb5f88a8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18884 expref: 15 pid: 9235 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.482250:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f7df600/0x844e5faceb5f8893 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1886f expref: 15 pid: 9235 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746155645.482253:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f857c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186bd expref: 26 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.482258:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7dee00/0x844e5faceb5f88a8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18884 expref: 15 pid: 9235 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.482260:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f7df600/0x844e5faceb5f8893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1886f expref: 15 pid: 9235 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746155645.482282:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f459a00/0x844e5faceb5f857c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186bd expref: 26 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746155645.482285:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7df600/0x844e5faceb5f8893 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1886f expref: 15 pid: 9235 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.482300:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155645.482300:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155645.482331:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126113024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 93us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.482337:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8888 00010000:00010000:3.0:1746155645.482381:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7dee00/0x844e5faceb5f88a8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18884 expref: 13 pid: 9235 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.482396:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155645.482452:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1961:x1830976126113152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 240us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.482457:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8886 00000100:00100000:0.0:1746155645.482538:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.482569:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.482582:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976126113536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 345us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.482587:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8887 00000100:00100000:3.0:1746155645.482596:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126113408 00000100:00100000:3.0:1746155645.482598:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126113408 00010000:00010000:3.0:1746155645.482607:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f881c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18830 expref: 37 pid: 10591 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.482626:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126113792 00000100:00100000:3.0:1746155645.482628:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126113792 00010000:00010000:3.0:1746155645.482636:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801369b9c00/0x844e5faceb5f85bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186fc expref: 38 pid: 4461 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155645.482648:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8889 00000100:00100000:3.0:1746155645.482653:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976126113408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.482659:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155645.482671:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f881c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18830 expref: 38 pid: 10591 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.482674:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8890 00010000:00010000:3.0:1746155645.482678:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f881c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18830 expref: 38 pid: 10591 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.482680:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976126113792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155645.482687:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155645.482688:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801312fa000/0x844e5faceb5f881c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18830 expref: 38 pid: 10591 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746155645.482695:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801369b9c00/0x844e5faceb5f85bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186fc expref: 37 pid: 4461 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.482697:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155645.482931:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801369b9c00/0x844e5faceb5f85bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186fc expref: 37 pid: 4461 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.482945:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801369b9c00/0x844e5faceb5f85bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186fc expref: 37 pid: 4461 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.482954:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.482955:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.482959:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.482992:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155645.483052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.483088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155645.483131:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155645.483147:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1961:x1830976126113792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 467us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.483153:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8890 00000100:00100000:1.0:1746155645.483162:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126113920 00000100:00100000:1.0:1746155645.483165:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126113920 00010000:00010000:1.0:1746155645.483175:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092872c00/0x844e5faceb5f8552 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18693 expref: 19 pid: 18270 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746155645.483197:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126114048 00000100:00100000:1.0:1746155645.483199:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126114048 00010000:00010000:1.0:1746155645.483207:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f088000/0x844e5faceb5f8575 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186b6 expref: 25 pid: 19959 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.483221:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8891 00000100:00100000:1.0:1746155645.483226:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126113920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155645.483233:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155645.483243:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092872c00/0x844e5faceb5f8552 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18693 expref: 19 pid: 18270 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.483250:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092872c00/0x844e5faceb5f8552 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18693 expref: 19 pid: 18270 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746155645.483254:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8892 00000100:00100000:2.0:1746155645.483261:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976126114048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155645.483261:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092872c00/0x844e5faceb5f8552 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18693 expref: 19 pid: 18270 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.483270:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155645.483272:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155645.483280:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f088000/0x844e5faceb5f8575 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186b6 expref: 25 pid: 19959 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.483283:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126113920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 57us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.483288:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8891 00010000:00010000:2.0:1746155645.483296:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f088000/0x844e5faceb5f8575 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186b6 expref: 25 pid: 19959 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.483298:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1961:x1830976126113408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 644us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.483303:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8889 00010000:00010000:2.0:1746155645.483307:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f088000/0x844e5faceb5f8575 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186b6 expref: 25 pid: 19959 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.483315:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155645.483333:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976126114048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 73us (244us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155645.483336:0:10591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155645.483338:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8892 00010000:00010000:1.0:1746155645.483344:0:10591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.483361:0:10591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.483442:0:10591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.483448:0:10591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.483520:0:10591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094d63a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155645.483524:0:10591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.483532:0:10591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.483540:0:10591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.483545:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d63a00/0x844e5faceb5f88e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155645.483595:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126112256:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 15547us (15802us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.483602:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17327 00000100:00100000:0.0:1746155645.483894:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.483905:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126114176 00000100:00100000:0.0:1746155645.483908:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126114176 00010000:00010000:0.0:1746155645.483920:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00de00/0x844e5faceb5f8838 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18845 expref: 35 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:0.0:1746155645.483947:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8893 00000100:00100000:0.0:1746155645.483952:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976126114176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155645.483958:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155645.483967:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b00de00/0x844e5faceb5f8838 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18845 expref: 35 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746155645.483975:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b00de00/0x844e5faceb5f8838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18845 expref: 35 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746155645.483985:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b00de00/0x844e5faceb5f8838 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18845 expref: 35 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746155645.483993:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155645.484009:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976126114176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.484013:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8893 00000100:00100000:2.0:1746155645.484082:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125424640:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155645.484098:0:19959:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155645.484147:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125425152:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155645.484154:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125425280:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155645.484159:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125425408:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155645.484172:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125424768:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155645.484178:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125424896:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155645.484183:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125425024:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155645.484196:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155645.484714:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125423616:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155645.484735:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155645.484780:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.484802:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.484834:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125425536:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155645.484853:0:20200:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155645.484874:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.484906:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.484916:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.484925:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126114304 00000100:00100000:1.0:1746155645.484928:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126114304 00010000:00010000:1.0:1746155645.484939:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8800/0x844e5faceb5f8448 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18631 expref: 15 pid: 20200 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746155645.484951:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126114432 00000100:00100000:1.0:1746155645.484952:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126114432 00010000:00010000:1.0:1746155645.484958:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094d63400/0x844e5faceb5f88a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1887d expref: 11 pid: 10591 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746155645.484965:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126114560 00000100:00100000:1.0:1746155645.484966:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126114560 00010000:00010000:1.0:1746155645.484972:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1883e expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.484978:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126114944 00000100:00100000:1.0:1746155645.484980:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126114944 00010000:00010000:1.0:1746155645.484985:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8671 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1875e expref: 34 pid: 4461 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.484990:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126114688 00000100:00100000:1.0:1746155645.484991:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126114688 00010000:00010000:1.0:1746155645.484997:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7df200/0x844e5faceb5f88af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1888b expref: 16 pid: 9235 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746155645.485004:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8894 00000100:00100000:1.0:1746155645.485008:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976126114304:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155645.485015:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155645.485023:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8800/0x844e5faceb5f8448 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18631 expref: 16 pid: 20200 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.485030:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8800/0x844e5faceb5f8448 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18631 expref: 16 pid: 20200 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.485040:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8800/0x844e5faceb5f8448 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18631 expref: 16 pid: 20200 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.485048:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.485050:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.485053:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.485058:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.485069:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155645.485084:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976126114304:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 75us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.485089:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8894 00000100:00100000:3.0:1746155645.485095:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8895 00000100:00100000:1.0:1746155645.485098:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8896 00000100:00100000:3.0:1746155645.485100:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126114432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155645.485101:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f820050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976126114560:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.485106:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155645.485106:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155645.485114:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8831 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1883e expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.485115:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094d63400/0x844e5faceb5f88a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1887d expref: 11 pid: 10591 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.485121:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094d63400/0x844e5faceb5f88a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1887d expref: 11 pid: 10591 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.485121:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8831 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1883e expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746155645.485130:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8831 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1883e expref: 24 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.485131:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094d63400/0x844e5faceb5f88a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1887d expref: 11 pid: 10591 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.485138:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155645.485138:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155645.485149:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126114432:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 50us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.485149:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f820050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1963:x1830976126114560:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 47us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.485154:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8896 00000100:00100000:3.0:1746155645.485386:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8895 00000100:00100000:0.0:1746155645.485400:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8897 00000100:00100000:0.0:1746155645.485407:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1961:x1830976126114944:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155645.485412:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8898 00010000:00010000:0.0:1746155645.485413:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155645.485416:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1962:x1830976126114688:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155645.485420:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8671 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1875e expref: 34 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.485421:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155645.485426:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f7df200/0x844e5faceb5f88af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1888b expref: 14 pid: 9235 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746155645.485427:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8671 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1875e expref: 34 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.485437:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f7df200/0x844e5faceb5f88af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1888b expref: 14 pid: 9235 timeout: 874 lvb_type: 1 00010000:00010000:0.0:1746155645.485437:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8671 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1875e expref: 34 pid: 4461 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746155645.485445:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155645.485446:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7df200/0x844e5faceb5f88af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1888b expref: 14 pid: 9235 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.485452:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155645.485456:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1961:x1830976126114944:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.485461:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1962:x1830976126114688:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 45us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.485464:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8897 00000100:00100000:3.0:1746155645.485466:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8898 00010000:00010000:2.0:1746155645.485519:0:19959:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.485529:0:19959:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.485545:0:19959:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.485551:0:19959:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.485561:0:19959:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.485567:0:19959:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5ee00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155645.485570:0:19959:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.485576:0:19959:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.485585:0:19959:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.485590:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f88fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155645.485622:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976126112384:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 14748us (15702us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.485628:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17330 00000100:00100000:2.0:1746155645.485655:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.485678:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.485702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.485773:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126114816 00000100:00100000:3.0:1746155645.485937:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126115072 00000100:00100000:3.0:1746155645.485940:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126115072 00010000:00010000:3.0:1746155645.485952:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26ee00/0x844e5faceb5f86cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18781 expref: 25 pid: 18270 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155645.485972:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126115200 00000100:00100000:3.0:1746155645.485975:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126115200 00010000:00010000:3.0:1746155645.485982:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8870 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18861 expref: 18 pid: 18270 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155645.485992:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8899 00000100:00100000:3.0:1746155645.485996:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976126115072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.486001:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155645.486007:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f26ee00/0x844e5faceb5f86cc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18781 expref: 25 pid: 18270 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.486019:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f26ee00/0x844e5faceb5f86cc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18781 expref: 25 pid: 18270 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.486030:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f26ee00/0x844e5faceb5f86cc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18781 expref: 25 pid: 18270 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.486037:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746155645.486053:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126114816 00010000:00010000:1.0:1746155645.486064:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4e2a00/0x844e5faceb5f889a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18876 expref: 12 pid: 18270 timeout: 874 lvb_type: 1 00000100:00100000:1.0:1746155645.486076:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8900 00000100:00100000:1.0:1746155645.486080:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976126115200:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155645.486085:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155645.486092:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8870 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18861 expref: 18 pid: 18270 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.486099:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8870 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18861 expref: 18 pid: 18270 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.486109:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8870 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18861 expref: 18 pid: 18270 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.486117:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155645.486135:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976126115200:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.486139:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8900 00000100:00100000:1.0:1746155645.486150:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8901 00000100:00100000:1.0:1746155645.486154:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976126114816:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155645.486159:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155645.486167:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a4e2a00/0x844e5faceb5f889a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18876 expref: 12 pid: 18270 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.486177:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.486178:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a4e2a00/0x844e5faceb5f889a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18876 expref: 12 pid: 18270 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.486180:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486186:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.486187:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a4e2a00/0x844e5faceb5f889a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18876 expref: 12 pid: 18270 timeout: 874 lvb_type: 1 00010000:00010000:1.0:1746155645.486194:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.486195:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.486197:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486201:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155645.486203:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155645.486213:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155645.486215:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976126115072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 219us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.486220:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8899 00000100:00100000:1.0:1746155645.486222:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126114816:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 68us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155645.486226:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8901 00010000:00010000:3.0:1746155645.486232:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486238:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486249:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486259:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486265:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486396:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f24c600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155645.486398:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486404:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486412:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486418:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f88ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155645.486454:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126112512:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 18116us (18620us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.486458:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.486460:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17328 00010000:00010000:3.0:1746155645.486477:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486483:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486496:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155645.486499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155645.486518:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486523:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486528:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7dec00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155645.486530:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486536:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486544:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486549:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f8903 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155645.486591:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126112640:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 15418us (16639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.486597:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17331 00000100:00100000:3.0:1746155645.486611:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126115328 00000100:00100000:3.0:1746155645.486614:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126115328 00010000:00010000:3.0:1746155645.486623:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00d800/0x844e5faceb5f8869 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1885a expref: 24 pid: 9235 timeout: 874 lvb_type: 1 00000100:00100000:3.0:1746155645.486645:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126115456 00000100:00100000:3.0:1746155645.486648:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126115456 00010000:00010000:3.0:1746155645.486655:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00d600/0x844e5faceb5f883f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1884c expref: 23 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.486667:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8902 00000100:00100000:3.0:1746155645.486672:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976126115328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.486677:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155645.486686:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b00d800/0x844e5faceb5f8869 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1885a expref: 24 pid: 9235 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.486693:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b00d800/0x844e5faceb5f8869 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1885a expref: 24 pid: 9235 timeout: 874 lvb_type: 1 00010000:00010000:3.0:1746155645.486702:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b00d800/0x844e5faceb5f8869 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1885a expref: 24 pid: 9235 timeout: 874 lvb_type: 1 00000100:00100000:2.0:1746155645.486708:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8903 00010000:00010000:3.0:1746155645.486710:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.486711:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.486713:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155645.486713:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976126115456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155645.486719:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.486719:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155645.486725:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b00d600/0x844e5faceb5f883f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1884c expref: 23 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.486733:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b00d600/0x844e5faceb5f883f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1884c expref: 23 pid: 9235 timeout: 874 lvb_type: 0 00010000:00010000:3.0:1746155645.486735:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155645.486742:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b00d600/0x844e5faceb5f883f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1884c expref: 23 pid: 9235 timeout: 874 lvb_type: 0 00000100:00100000:3.0:1746155645.486746:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976126115328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 75us (289us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155645.486748:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155645.486749:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155645.486751:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8902 00010000:00010000:2.0:1746155645.486752:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.486757:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486764:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.486768:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155645.486770:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155645.486778:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126115456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 65us (278us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155645.486781:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155645.486783:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8903 00010000:00010000:3.0:1746155645.486787:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486792:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486796:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4e3e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155645.486799:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.486802:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486804:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.486809:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486816:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.486819:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.486821:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3e00/0x844e5faceb5f88f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.486831:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.486836:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.486841:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7dfa00 already unused, calling callback (ffffffffa0879d70) 00000100:00100000:3.0:1746155645.486843:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126112768:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 18253us (18942us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155645.486843:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155645.486847:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17329 00010000:00010000:2.0:1746155645.486849:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.486856:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.486861:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f890a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155645.487120:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126112896:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 15549us (16316us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.487126:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17332 00000100:00100000:0.0:1746155645.488742:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.488808:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126115712 00000100:00100000:2.0:1746155645.488813:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126115712 00000100:00100000:2.0:1746155645.488848:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11199 00000100:00100000:2.0:1746155645.488854:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32495:x1830976126115712:12345-192.168.202.51@tcp:36:mirror_io.0 00010000:00010000:2.0:1746155645.488898:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155645.488915:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f88e0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188a0 expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.488926:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.488930:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155645.488953:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.488963:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18669 expref: 25 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.488968:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872800/0x844e5faceb5f8583 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186c4 expref: 298 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.488971:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801313f2200/0x844e5faceb5f862b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1872d expref: 25 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.488975:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f200/0x844e5faceb5f8694 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1876c expref: 298 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.488979:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094948a00/0x844e5faceb5f86be lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1877a expref: 25 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.488982:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.489001:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094948a00/0x844e5faceb5f86be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1877a expref: 25 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.489012:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094948a00/0x844e5faceb5f86be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1877a expref: 25 pid: 14234 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.489021:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125425664:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155645.489225:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f200/0x844e5faceb5f8694 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1876c expref: 298 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.489233:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f200/0x844e5faceb5f8694 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1876c expref: 298 pid: 20364 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.489240:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125425792:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155645.489377:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8801313f2200/0x844e5faceb5f862b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1872d expref: 25 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.489384:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8801313f2200/0x844e5faceb5f862b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1872d expref: 25 pid: 20364 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.489391:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125425920:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155645.489414:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092872800/0x844e5faceb5f8583 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186c4 expref: 298 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.489420:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092872800/0x844e5faceb5f8583 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186c4 expref: 298 pid: 20364 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.489427:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125426048:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155645.489449:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18669 expref: 25 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.489456:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18669 expref: 25 pid: 14234 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.489463:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125426176:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155645.489483:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155645.491392:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.491417:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.491715:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125425664:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155645.491725:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125425792:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155645.491731:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125425920:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155645.491736:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126115840 00000100:00100000:1.0:1746155645.491741:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126115840 00010000:00010000:1.0:1746155645.491765:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094948a00/0x844e5faceb5f86be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1877a expref: 26 pid: 14234 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.491785:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126115968 00000100:00100000:1.0:1746155645.491787:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126115968 00010000:00010000:1.0:1746155645.491795:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f200/0x844e5faceb5f8694 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1876c expref: 299 pid: 20364 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.491820:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8904 00000100:00100000:1.0:1746155645.491826:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1960:x1830976126115840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155645.491836:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155645.491841:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094948a00/0x844e5faceb5f86be lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1877a expref: 26 pid: 14234 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746155645.491850:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094948a00/0x844e5faceb5f86be lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1877a expref: 26 pid: 14234 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746155645.491865:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094948a00/0x844e5faceb5f86be lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1877a expref: 26 pid: 14234 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746155645.491876:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155645.491880:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.491902:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155645.491930:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976126115840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 104us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.491966:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8905 00000100:00100000:1.0:1746155645.491972:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8904 00000100:00100000:0.0:1746155645.491975:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:1961:x1830976126115968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155645.491982:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155645.491987:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f200/0x844e5faceb5f8694 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1876c expref: 299 pid: 20364 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746155645.491994:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f200/0x844e5faceb5f8694 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1876c expref: 299 pid: 20364 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746155645.492005:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f200/0x844e5faceb5f8694 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1876c expref: 299 pid: 20364 timeout: 874 lvb_type: 0 00010000:00010000:0.0:1746155645.492013:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155645.492017:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155645.492021:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155645.492034:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1961:x1830976126115968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 62us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.492039:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8905 00000100:00100000:0.0:1746155645.492095:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.492185:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126116224 00000100:00100000:1.0:1746155645.492188:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126116224 00000100:00100000:1.0:1746155645.492217:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4767 00000100:00100000:1.0:1746155645.492222:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:27129:x1830976126116224:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746155645.492362:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:27129:x1830976126116224:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 139us (266us total) trans 8589945375 rc 0/0 00000100:00100000:1.0:1746155645.492370:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4767 00000100:00100000:2.0:1746155645.492873:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125426048:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155645.492880:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125426176:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155645.492908:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155645.493445:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.494142:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.494209:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126116480 00000100:00100000:1.0:1746155645.494214:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126116480 00010000:00010000:1.0:1746155645.494233:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18669 expref: 26 pid: 14234 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.494250:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126116352 00000100:00100000:1.0:1746155645.494253:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126116352 00010000:00010000:1.0:1746155645.494260:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092872800/0x844e5faceb5f8583 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186c4 expref: 298 pid: 20364 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.494261:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8906 00000100:00100000:2.0:1746155645.494268:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1961:x1830976126116480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155645.494270:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155645.494276:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155645.494281:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18669 expref: 26 pid: 14234 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.494290:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18669 expref: 26 pid: 14234 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.494307:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fbca400/0x844e5faceb5f8505 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18669 expref: 26 pid: 14234 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.494317:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.494320:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.494325:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155645.494349:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1961:x1830976126116480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 82us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.494355:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8906 00000100:00100000:2.0:1746155645.494485:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126116608 00000100:00100000:2.0:1746155645.494488:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126116608 00010000:00010000:2.0:1746155645.494498:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801313f2200/0x844e5faceb5f862b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1872d expref: 25 pid: 20364 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.494532:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8907 00000100:00100000:2.0:1746155645.494537:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:1961:x1830976126116352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155645.494543:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155645.494547:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092872800/0x844e5faceb5f8583 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186c4 expref: 298 pid: 20364 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.494554:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092872800/0x844e5faceb5f8583 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186c4 expref: 298 pid: 20364 timeout: 874 lvb_type: 0 00010000:00010000:2.0:1746155645.494565:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872800/0x844e5faceb5f8583 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f186c4 expref: 298 pid: 20364 timeout: 874 lvb_type: 0 00000100:00100000:1.0:1746155645.494574:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8908 00010000:00010000:2.0:1746155645.494577:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.494580:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155645.494581:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1961:x1830976126116608:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155645.494584:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155645.494588:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155645.494592:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8801313f2200/0x844e5faceb5f862b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1872d expref: 25 pid: 20364 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.494601:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+297:1961:x1830976126116352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 64us (460us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155645.494601:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8801313f2200/0x844e5faceb5f862b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1872d expref: 25 pid: 20364 timeout: 874 lvb_type: 0 00000100:00100000:2.0:1746155645.494606:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8907 00010000:00010000:1.0:1746155645.494612:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801313f2200/0x844e5faceb5f862b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1872d expref: 25 pid: 20364 timeout: 874 lvb_type: 0 00010000:00010000:1.0:1746155645.494622:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155645.494625:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.494631:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.494637:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155645.494666:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155645.494681:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155645.494683:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976126116608:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 103us (412us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155645.494688:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155645.494689:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8908 00000040:00080000:2.0:1746155645.495226:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3653, 88 off308384 00000004:00080000:2.0:1746155645.495232:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774644729115ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155645.495279:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3650, 88 off308384 00000004:00080000:2.0:1746155645.495284:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774644780346ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155645.495305:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3651, 88 off308472 00000004:00080000:2.0:1746155645.495308:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774644805182ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155645.495315:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3654, 88 off308472 00000004:00080000:2.0:1746155645.495317:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774644814338ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155645.495323:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3655, 88 off308560 00000004:00080000:2.0:1746155645.495325:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774644822452ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155645.495334:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3652, 88 off308560 00000004:00080000:2.0:1746155645.495337:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774644833675ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155645.495376:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3653, 88 off308648 00000004:00080000:2.0:1746155645.495380:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774644876690ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155645.495388:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3654, 88 off308736 00000004:00080000:2.0:1746155645.495390:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774644887455ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155645.495418:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3656, 88 off308648 00000004:00080000:2.0:1746155645.495420:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774644917402ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155645.495429:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3655, 88 off308824 00000004:00080000:2.0:1746155645.495431:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774644928046ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155645.495448:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3657, 88 off308736 00000004:00080000:2.0:1746155645.495450:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774644947315ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155645.495458:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3656, 88 off308912 00000004:00080000:2.0:1746155645.495461:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774644957637ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155645.495467:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3658, 88 off308824 00000004:00080000:2.0:1746155645.495470:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774644966933ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155645.495475:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3659, 88 off308912 00000004:00080000:2.0:1746155645.495479:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774644975668ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155645.495485:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3660, 88 off309000 00000004:00080000:2.0:1746155645.495487:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774644984575ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155645.495493:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3661, 88 off309088 00000004:00080000:2.0:1746155645.495495:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 774644992406ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155645.495519:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3657, 88 off309000 00000004:00080000:2.0:1746155645.495522:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 774645019236ns, next at 716011101328ns, rc = 0 00000001:00080000:1.0:1746155645.512287:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945371 is committed 00000004:00010000:2.0:1746155645.512290:0:20364:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800a06a6d80 reply state ffff880093a32800 transno 8589945376 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155645.512299:0:20364:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1746155645.512300:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945366 is committed 00000001:00080000:1.0:1746155645.512303:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945375 is committed 00000001:00080000:1.0:1746155645.512321:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945376 is committed 00000004:00080000:1.0:1746155645.512324:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2841 committed 00000004:00080000:1.0:1746155645.512329:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2839 committed 00000004:00080000:1.0:1746155645.512333:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2838 committed 00000004:00080000:1.0:1746155645.512334:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2837 committed 00000004:00080000:1.0:1746155645.512336:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2836 committed 00000004:00080000:1.0:1746155645.512337:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2840 committed 00000004:00080000:1.0:1746155645.512338:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2835 committed 00000004:00080000:1.0:1746155645.512339:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2839 committed 00000004:00080000:1.0:1746155645.512340:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2834 committed 00000004:00080000:1.0:1746155645.512342:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2838 committed 00000004:00080000:1.0:1746155645.512343:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2837 committed 00000004:00080000:1.0:1746155645.512344:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2836 committed 00000004:00080000:1.0:1746155645.512345:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2833 committed 00000004:00080000:1.0:1746155645.512346:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2832 committed 00000004:00080000:1.0:1746155645.512347:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2835 committed 00000004:00080000:1.0:1746155645.512349:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2834 committed 00000004:00080000:1.0:1746155645.512350:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2831 committed 00000001:00080000:1.0:1746155645.512368:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945369 is committed 00010000:00080000:2.0:1746155645.512378:0:20364:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746155645.512391:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32495:x1830976126115712:12345-192.168.202.51@tcp:36:mirror_io.0 Request processed in 23533us (23648us total) trans 8589945376 rc 0/0 00000100:00100000:2.0:1746155645.512402:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11199 00010000:00010000:2.0:1746155645.512426:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.512433:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.512439:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.512443:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5e400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155645.512447:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.512452:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.512464:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.512466:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155645.512469:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155645.512474:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e400/0x844e5faceb5f8911 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155645.512582:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125426304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155645.512622:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155645.512644:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125426816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155645.512658:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155645.512670:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125427328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155645.512681:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155645.512692:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125427840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155645.512703:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155645.512713:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1746155645.512742:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125426432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155645.512762:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155645.512782:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125426944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155645.512796:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155645.512808:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125427456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155645.512819:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155645.512828:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125427968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155645.512839:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155645.512850:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1746155645.512853:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125426560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155645.512865:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155645.512874:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125427072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155645.512896:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155645.512907:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125427584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155645.512920:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155645.512929:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125428096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155645.512943:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155645.512959:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125426304 00000100:00100000:1.0:1746155645.512960:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125426816 00000100:00100000:1.0:1746155645.512964:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125426816 00000100:00100000:0.0:1746155645.512964:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125426304 00000100:00100000:0.0:1746155645.512982:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125427328 00000100:00100000:0.0:1746155645.512984:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125427328 00000100:00100000:0.0:1746155645.512991:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125427840 00000100:00100000:0.0:1746155645.512992:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125427840 00000100:00100000:1.0:1746155645.512994:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125426432 00000100:00100000:1.0:1746155645.512995:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125426432 00000100:00100000:0.0:1746155645.512998:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125426944 00000100:00100000:0.0:1746155645.512999:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125426944 00000100:00100000:1.0:1746155645.513001:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125427456 00000100:00100000:1.0:1746155645.513003:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125427456 00000100:00100000:0.0:1746155645.513004:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125427968 00000100:00100000:0.0:1746155645.513006:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125427968 00000100:00100000:1.0:1746155645.513008:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125426560 00000100:00100000:1.0:1746155645.513009:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125426560 00000100:00100000:0.0:1746155645.513010:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125427072 00000100:00100000:0.0:1746155645.513012:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125427072 00000100:00100000:1.0:1746155645.513014:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125427584 00000100:00100000:1.0:1746155645.513015:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125427584 00000100:00100000:0.0:1746155645.513017:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125428096 00000100:00100000:0.0:1746155645.513018:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125428096 00000100:00100000:1.0:1746155645.513022:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17333 00000100:00100000:3.0:1746155645.513037:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125426688:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155645.513056:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155645.513068:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125427200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155645.513082:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155645.513087:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125427712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155645.513100:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155645.513108:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125428224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155645.513118:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155645.513130:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125426688 00000100:00100000:3.0:1746155645.513132:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125426688 00000100:00100000:0.0:1746155645.513168:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125427200 00000100:00100000:0.0:1746155645.513171:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125427200 00000100:00100000:0.0:1746155645.513178:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125427712 00000100:00100000:0.0:1746155645.513180:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125427712 00000100:00100000:0.0:1746155645.513185:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125428224 00000100:00100000:0.0:1746155645.513186:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125428224 00000100:00100000:0.0:1746155645.513193:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17334 00000100:00100000:0.0:1746155645.513197:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+52:3296:x1830976125426304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155645.513257:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17335 00000100:00100000:2.0:1746155645.513262:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3296:x1830976125427328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155645.513265:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17336 00000100:00100000:3.0:1746155645.513269:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3296:x1830976125427840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155645.513304:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17337 00000100:00100000:2.0:1746155645.513309:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3297:x1830976125426432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155645.513386:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3296:x1830976125427840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (680us total) trans 17179874354 rc 0/0 00000100:00100000:2.0:1746155645.513390:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125426432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (627us total) trans 21474841664 rc 0/0 00000100:00100000:3.0:1746155645.513391:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17336 00000100:00100000:2.0:1746155645.513395:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17337 00000100:00100000:3.0:1746155645.513401:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17338 00000100:00100000:2.0:1746155645.513403:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17339 00000100:00100000:3.0:1746155645.513405:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3297:x1830976125426944:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155645.513407:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3297:x1830976125427456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155645.513473:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125426944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (676us total) trans 21474841665 rc 0/0 00000100:00100000:2.0:1746155645.513473:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976125427456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (652us total) trans 17179874355 rc 0/0 00000100:00100000:2.0:1746155645.513478:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17339 00000100:00100000:3.0:1746155645.513480:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17338 00000100:00100000:2.0:1746155645.513487:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17340 00000100:00100000:3.0:1746155645.513489:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17341 00000100:00100000:2.0:1746155645.513490:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3297:x1830976125427968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155645.513517:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+50:3296:x1830976125426816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155645.513577:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976125427968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (736us total) trans 17179874356 rc 0/0 00002000:00010000:1.0:1746155645.513581:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00000100:00100000:2.0:1746155645.513582:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17340 00002000:00010000:1.0:1746155645.513583:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155645.513585:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746155645.513587:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155645.513589:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:2.0:1746155645.513590:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17342 00000100:00100000:2.0:1746155645.513594:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125427072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155645.513604:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3296:x1830976125426816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 577us (945us total) trans 21474841666 rc 0/0 00000100:00100000:1.0:1746155645.513609:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17333 00000100:00100000:1.0:1746155645.513617:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17343 00000100:00100000:1.0:1746155645.513620:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3297:x1830976125427584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155645.513660:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125427072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (763us total) trans 21474841667 rc 0/0 00000100:00100000:2.0:1746155645.513665:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17342 00000100:00100000:2.0:1746155645.513673:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17344 00000100:00100000:2.0:1746155645.513677:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976125428096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155645.513686:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976125427584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (765us total) trans 17179874357 rc 0/0 00000100:00100000:1.0:1746155645.513690:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17343 00000100:00100000:1.0:1746155645.513698:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17345 00000100:00100000:1.0:1746155645.513701:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+52:3296:x1830976125427200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155645.513748:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+49:3297:x1830976125428096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (804us total) trans 17179874358 rc 0/0 00000100:00100000:2.0:1746155645.513753:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17344 00000100:00100000:1.0:1746155645.513759:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3296:x1830976125427200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (676us total) trans 21474841668 rc 0/0 00000100:00100000:2.0:1746155645.513761:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17346 00000100:00100000:1.0:1746155645.513764:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17345 00000100:00100000:2.0:1746155645.513765:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+48:3296:x1830976125427712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155645.513770:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17347 00000100:00100000:1.0:1746155645.513773:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+48:3296:x1830976125428224:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155645.513803:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a6680/2, rc 0, transno 21474841667 00000100:00100000:2.0:1746155645.513808:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125427072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155645.513816:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130899c00/2, rc 0, transno 17179874357 00000100:00100000:2.0:1746155645.513823:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125427584:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155645.513829:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013089bb80/2, rc 0, transno 17179874358 00000100:00100000:2.0:1746155645.513831:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125428096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155645.513833:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3297:x1830976125426560:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155645.513836:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a5c00/2, rc 0, transno 21474841664 00000100:00100000:2.0:1746155645.513838:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125426432:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155645.513843:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a4380/2, rc 0, transno 21474841665 00000100:00100000:2.0:1746155645.513845:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125426944:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155645.513849:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013089aa00/2, rc 0, transno 17179874355 00000100:00100000:2.0:1746155645.513852:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125427456:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155645.513857:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130899f80/2, rc 0, transno 17179874356 00000100:00100000:2.0:1746155645.513859:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125427968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155645.513993:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+49:3296:x1830976125428224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (873us total) trans 17179874359 rc 0/0 00000100:00100000:1.0:1746155645.513998:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17347 00000100:00100000:1.0:1746155645.514007:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17348 00000100:00100000:1.0:1746155645.514012:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3296:x1830976125426688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155645.514085:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3296:x1830976125426688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (1027us total) trans 21474841670 rc 0/0 00000100:00100000:1.0:1746155645.514090:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17348 00000100:00100000:0.0:1746155645.514231:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+54:3296:x1830976125426304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1032us (1608us total) trans 21474841671 rc 0/0 00000100:00100000:0.0:1746155645.514235:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17334 00000100:00100000:1.0:1746155645.514416:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155645.514429:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746155645.514433:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126116736 00000100:00100000:1.0:1746155645.514436:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125428352:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155645.514436:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126116736 00000100:00100000:1.0:1746155645.514453:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155645.514455:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11200 00000100:00100000:0.0:1746155645.514459:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32495:x1830976126116736:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00100000:1.0:1746155645.514470:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125428352 00010000:00010000:0.0:1746155645.514470:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155645.514473:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125428352 00010000:00010000:0.0:1746155645.514481:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8918 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188a7 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155645.514484:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17349 00000100:00100000:1.0:1746155645.514488:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3295:x1830976125428352:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746155645.514530:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8918 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188a7 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.514541:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8918 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188a7 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155645.514554:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155645.514557:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155645.514559:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd8000, rc 0) 00000100:00100000:0.0:1746155645.514580:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32495:x1830976126116736:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 120us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.514584:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11200 00000100:00100000:1.0:1746155645.514857:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3295:x1830976125428352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 367us (402us total) trans 17179874360 rc 0/0 00000100:00100000:1.0:1746155645.514862:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17349 00000004:00080000:1.0:1746155645.514909:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130898700/2, rc 0, transno 17179874360 00000100:00100000:1.0:1746155645.514912:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125428352:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155645.514945:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3296:x1830976125427328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1682us (2261us total) trans 17179874361 rc 0/0 00000100:00100000:2.0:1746155645.514960:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17335 00000100:00100000:3.0:1746155645.514964:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125426560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1471us (2098us total) trans 21474841669 rc 0/0 00000100:00100000:3.0:1746155645.514968:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17341 00000100:00100000:2.0:1746155645.515105:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+50:3296:x1830976125427712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1339us (2004us total) trans 17179874362 rc 0/0 00000100:00100000:2.0:1746155645.515110:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17346 00000004:00080000:2.0:1746155645.515131:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a7480/2, rc 0, transno 21474841669 00000100:00100000:2.0:1746155645.515135:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125426560:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155645.515691:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a7100/2, rc 0, transno 21474841670 00000100:00100000:3.0:1746155645.515695:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125426688:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155645.515810:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130898380/2, rc 0, transno 21474841668 00000100:00100000:2.0:1746155645.515815:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125427200:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155645.515822:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013089a300/2, rc 0, transno 17179874362 00000100:00100000:2.0:1746155645.515824:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125427712:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155645.515831:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013089b480/2, rc 0, transno 17179874359 00000100:00100000:2.0:1746155645.515833:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125428224:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155645.515840:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013089a680/2, rc 0, transno 17179874354 00000100:00100000:2.0:1746155645.515842:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125427840:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155645.515849:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130898a80/2, rc 0, transno 17179874361 00000100:00100000:2.0:1746155645.515851:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125427328:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155645.515859:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a4e00/2, rc 0, transno 21474841666 00000100:00100000:2.0:1746155645.515861:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125426816:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155645.515866:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a4000/2, rc 0, transno 21474841671 00000100:00100000:2.0:1746155645.515868:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125426304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155645.519736:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.519813:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126116864 00000100:00100000:2.0:1746155645.519821:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126116864 00000100:00100000:2.0:1746155645.519866:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11201 00000100:00100000:2.0:1746155645.519873:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32495:x1830976126116864:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155645.519902:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155645.519919:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f600/0x844e5faceb5f891f lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188ae expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.519982:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f8926 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155645.519993:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f8926 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155645.520003:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f8926 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155645.520025:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155645.520028:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155645.520041:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f8926 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155645.520060:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f600/0x844e5faceb5f891f lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ae expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.520072:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f8926 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ae expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155645.520079:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155645.520081:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155645.520084:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5f400, rc 0) 00000100:00100000:2.0:1746155645.520375:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32495:x1830976126116864:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 502us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.520382:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11201 00000100:00100000:1.0:1746155645.526272:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.526327:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126116992 00000100:00100000:2.0:1746155645.526334:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126116992 00000100:00100000:1.0:1746155645.526358:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155645.526366:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126117248 00000100:00100000:2.0:1746155645.526368:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126117248 00000100:00100000:2.0:1746155645.526381:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17350 00000100:00100000:2.0:1746155645.526387:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126116992:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00100000:3.0:1746155645.526388:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17351 00000100:00100000:3.0:1746155645.526397:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976126117248:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155645.526400:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155645.526407:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155645.526414:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f892d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188b5 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.526417:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f24d000/0x844e5faceb5f8934 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188c3 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155645.526433:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x6814387d, atime: 0x6814387c, ctime: 0x6814387d, blocks: 0x821 00002000:00010000:2.0:1746155645.526433:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e1:0x0] initial LVB size: 1048576, mtime: 0x6814387c, atime: 0x6814387c, ctime: 0x6814387c, blocks: 0x7e9 00010000:00010000:3.0:1746155645.526445:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155645.526445:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.526447:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155645.526447:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155645.526453:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f892d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188b5 expref: 9 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.526454:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24d000/0x844e5faceb5f8934 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188c3 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.526465:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f24d000/0x844e5faceb5f8934 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188c3 expref: 10 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155645.526465:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f892d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188b5 expref: 9 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.526473:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f24d000, rc 0) 00010000:00010000:2.0:1746155645.526473:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5ec00, rc 0) 00000100:00100000:2.0:1746155645.526521:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126116992:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 134us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.526526:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17350 00000100:00100000:3.0:1746155645.526821:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976126117248:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 421us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.526827:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17351 00000100:00100000:0.0:1746155645.527289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155645.527311:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.527328:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126117120 00000100:00100000:3.0:1746155645.527332:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126117120 00000100:00100000:0.0:1746155645.527333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.527350:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126117376 00000100:00100000:3.0:1746155645.527351:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126117376 00000100:00100000:0.0:1746155645.527356:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155645.527361:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126117632 00000100:00100000:3.0:1746155645.527363:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126117632 00000100:00100000:1.0:1746155645.527371:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126117504 00000100:00100000:1.0:1746155645.527375:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126117504 00000100:00100000:3.0:1746155645.527376:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17352 00000100:00100000:3.0:1746155645.527381:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126117120:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:3.0:1746155645.527387:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155645.527389:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17353 00010000:00010000:3.0:1746155645.527396:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f893b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188bc expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155645.527396:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17354 00000100:00100000:0.0:1746155645.527396:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126117376:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00100000:1.0:1746155645.527401:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126117632:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155645.527402:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746155645.527407:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x6814387c, atime: 0x6814387c, ctime: 0x6814387c, blocks: 0x81f 00010000:00010000:1.0:1746155645.527408:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155645.527410:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8200/0x844e5faceb5f8942 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188ca expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.527415:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.527415:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f26f400/0x844e5faceb5f8949 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188d8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155645.527416:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.527420:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f893b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188bc expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746155645.527426:0:10591:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e3:0x0] initial LVB size: 2097152, mtime: 0x6814387d, atime: 0x6814387d, ctime: 0x6814387d, blocks: 0x821 00010000:00010000:3.0:1746155645.527429:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f893b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188bc expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746155645.527430:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e2:0x0] initial LVB size: 4194304, mtime: 0x6814387d, atime: 0x6814387d, ctime: 0x6814387d, blocks: 0x1029 00010000:00010000:0.0:1746155645.527434:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.527435:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f24c200, rc 0) 00010000:00010000:0.0:1746155645.527435:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.527438:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155645.527439:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8200/0x844e5faceb5f8942 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ca expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.527440:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155645.527444:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26f400/0x844e5faceb5f8949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d8 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155645.527448:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8200/0x844e5faceb5f8942 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ca expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155645.527453:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f26f400/0x844e5faceb5f8949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d8 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155645.527454:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd8200, rc 0) 00000100:00100000:3.0:1746155645.527457:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1962:x1830976126117120:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 76us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155645.527460:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26f400, rc 0) 00000100:00100000:3.0:1746155645.527461:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17352 00000100:00100000:0.0:1746155645.527471:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126117376:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 76us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.527473:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17355 00000100:00100000:1.0:1746155645.527477:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976126117632:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 76us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.527477:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17353 00000100:00100000:3.0:1746155645.527478:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976126117504:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00100000:1.0:1746155645.527483:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17354 00010000:00010000:3.0:1746155645.527484:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155645.527490:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f24cc00/0x844e5faceb5f8950 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188d1 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155645.527520:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e4:0x0] initial LVB size: 5079552, mtime: 0x6814387d, atime: 0x6814387d, ctime: 0x6814387d, blocks: 0x1711 00010000:00010000:3.0:1746155645.527529:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.527530:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155645.527534:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f24cc00/0x844e5faceb5f8950 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d1 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.527547:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f24cc00/0x844e5faceb5f8950 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d1 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155645.527554:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f24cc00, rc 0) 00000100:00100000:3.0:1746155645.527572:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976126117504:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 94us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155645.527577:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17355 00000100:00100000:3.0:1746155645.971094:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125428480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746155645.971144:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155645.971273:0:21354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125428480 00000100:00100000:2.0:1746155645.971280:0:21354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125428480 00000100:00100000:2.0:1746155645.971320:0:21354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1746155645.971327:0:21354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3297:x1830976125428480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746155645.971359:0:21354:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 730529792 pending 30670848 free 3849322496 avail 3847225344 00000100:00100000:2.0:1746155645.971394:0:21354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3297:x1830976125428480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155645.971399:0:21354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1746155645.971815:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125428480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1746155645.971824:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746155645.971828:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125428608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746155645.971843:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155645.971889:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125428608 00000100:00100000:0.0:1746155645.971893:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125428608 00000100:00100000:0.0:1746155645.971919:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1746155645.971924:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125428608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746155645.971943:0:8440:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 682950656 pending 22151168 free 3850371072 avail 3848273920 00000100:00100000:0.0:1746155645.971983:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+53:3297:x1830976125428608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155645.971988:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1746155645.972093:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125428608:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1746155646.290832:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155646.538963:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.539003:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.539032:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.539043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.539070:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.539327:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.539401:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126118016 00000100:00100000:1.0:1746155646.539408:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126118016 00000100:00100000:2.0:1746155646.539433:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126118272 00000100:00100000:2.0:1746155646.539437:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126118272 00000100:00100000:1.0:1746155646.539453:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126118784 00000100:00100000:2.0:1746155646.539454:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126118656 00000100:00100000:1.0:1746155646.539455:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126118784 00000100:00100000:2.0:1746155646.539456:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126118656 00000100:00100000:1.0:1746155646.539471:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126118144 00000100:00100000:1.0:1746155646.539472:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126118144 00000100:00100000:2.0:1746155646.539476:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8239 00000100:00100000:2.0:1746155646.539483:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976126118016:12345-192.168.202.51@tcp:3:mirror_io.0 00000100:00100000:1.0:1746155646.539486:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8240 00000100:00100000:1.0:1746155646.539490:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976126118272:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:2.0:1746155646.539529:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e600/0x844e5faceb5f895e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.539529:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f26fc00/0x844e5faceb5f8957 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.539541:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.539541:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.539542:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.539542:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.539546:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e600/0x844e5faceb5f895e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.539546:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26fc00/0x844e5faceb5f8957 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.539556:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e600/0x844e5faceb5f895e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.539556:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f26fc00/0x844e5faceb5f8957 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155646.540782:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8241 00000100:00100000:3.0:1746155646.540791:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976126118784:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:3.0:1746155646.540810:0:31249:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f24c400/0x844e5faceb5f8965 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.540817:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155646.540819:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155646.540821:0:31249:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24c400/0x844e5faceb5f8965 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.540835:0:31249:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f24c400/0x844e5faceb5f8965 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155646.541267:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8242 00000100:00100000:1.0:1746155646.541274:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976126118656:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:1.0:1746155646.541289:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f896c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.541296:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.541297:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.541299:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f896c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.541307:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f896c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155646.543150:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126118400 00000100:00100000:2.0:1746155646.543157:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126118400 00000100:00100000:2.0:1746155646.543191:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8243 00000100:00100000:2.0:1746155646.543198:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1962:x1830976126118144:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:2.0:1746155646.543214:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8973 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.543223:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.543224:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.543227:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8973 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.543236:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8973 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155646.543374:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8244 00000100:00100000:1.0:1746155646.543380:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1962:x1830976126118400:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:1.0:1746155646.543393:0:31251:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f26e600/0x844e5faceb5f897a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.543400:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.543401:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.543405:0:31251:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26e600/0x844e5faceb5f897a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.543412:0:31251:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f26e600/0x844e5faceb5f897a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746155646.544059:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746155646.544104:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.544134:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.544147:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126119040 00000100:00100000:3.0:1746155646.544150:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126119040 00000100:00100000:3.0:1746155646.544168:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126118912 00000100:00100000:3.0:1746155646.544170:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126118912 00000100:00100000:3.0:1746155646.544182:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8245 00000100:00100000:3.0:1746155646.544187:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1962:x1830976126119040:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:3.0:1746155646.544202:0:10888:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f24dc00/0x844e5faceb5f8981 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.544210:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155646.544211:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155646.544214:0:10888:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24dc00/0x844e5faceb5f8981 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.544222:0:10888:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f24dc00/0x844e5faceb5f8981 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155646.545245:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8246 00000100:00100000:3.0:1746155646.545253:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1963:x1830976126118912:12345-192.168.202.51@tcp:3:mirror_io.0 00010000:00010000:3.0:1746155646.545268:0:31250:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8988 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.545277:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155646.545278:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155646.545281:0:31250:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8988 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.545289:0:31250:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8988 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.558212:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f26fc00/0x844e5faceb5f8957 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.558226:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26fc00/0x844e5faceb5f8957 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.558234:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f26fc00/0x844e5faceb5f8957 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.558240:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26fc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155646.558244:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f26fc00/0x844e5faceb5f8957 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.558251:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f26fc00/0x844e5faceb5f8957 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.558266:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f26fc00/0x844e5faceb5f8957 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.558272:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f26fc00/0x844e5faceb5f8957 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155646.558344:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1963:x1830976126118272:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 18848us (19335us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155646.558353:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8240 00010000:00010000:0.0:1746155646.563637:0:25394:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e600/0x844e5faceb5f895e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.563651:0:25394:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e600/0x844e5faceb5f895e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.563657:0:25394:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e600/0x844e5faceb5f895e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.563663:0:25394:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5e600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155646.563666:0:25394:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e600/0x844e5faceb5f895e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.563672:0:25394:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e600/0x844e5faceb5f895e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.563687:0:25394:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e600/0x844e5faceb5f895e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.563692:0:25394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e600/0x844e5faceb5f895e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155646.563769:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1963:x1830976126118016:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 24283us (24809us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155646.563778:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8239 00010000:00010000:3.0:1746155646.565185:0:31249:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f24c400/0x844e5faceb5f8965 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.565197:0:31249:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24c400/0x844e5faceb5f8965 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.565204:0:31249:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f24c400/0x844e5faceb5f8965 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.565210:0:31249:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f24c400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155646.565212:0:31249:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f24c400/0x844e5faceb5f8965 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.565219:0:31249:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f24c400/0x844e5faceb5f8965 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.565231:0:31249:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f24c400/0x844e5faceb5f8965 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.565236:0:31249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f24c400/0x844e5faceb5f8965 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155646.565301:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1963:x1830976126118784:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 24509us (26265us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155646.565310:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8241 00010000:00010000:1.0:1746155646.572384:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f896c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.572399:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f896c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.572406:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f896c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.572412:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26fa00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155646.572415:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f896c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.572422:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f896c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.572439:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f896c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.572445:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f26fa00/0x844e5faceb5f896c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155646.572553:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1963:x1830976126118656:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 31276us (33504us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155646.572561:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8242 00010000:00010000:1.0:1746155646.577655:0:31251:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f26e600/0x844e5faceb5f897a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.577670:0:31251:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26e600/0x844e5faceb5f897a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.577683:0:31251:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f26e600/0x844e5faceb5f897a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.577689:0:31251:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26e600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155646.577692:0:31251:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f26e600/0x844e5faceb5f897a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.577699:0:31251:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f26e600/0x844e5faceb5f897a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.577715:0:31251:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f26e600/0x844e5faceb5f897a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.577721:0:31251:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f26e600/0x844e5faceb5f897a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155646.577799:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1962:x1830976126118400:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 34415us (38467us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155646.577808:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8244 00010000:00010000:3.0:1746155646.585006:0:10888:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f24dc00/0x844e5faceb5f8981 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.585023:0:10888:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24dc00/0x844e5faceb5f8981 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.585030:0:10888:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f24dc00/0x844e5faceb5f8981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.585036:0:10888:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f24dc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155646.585040:0:10888:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f24dc00/0x844e5faceb5f8981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.585047:0:10888:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f24dc00/0x844e5faceb5f8981 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.585062:0:10888:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f24dc00/0x844e5faceb5f8981 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.585068:0:10888:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f24dc00/0x844e5faceb5f8981 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155646.585145:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1962:x1830976126119040:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 40953us (41036us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155646.585154:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8245 00010000:00010000:3.0:1746155646.586729:0:31250:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8988 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.586741:0:31250:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8988 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.586747:0:31250:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8988 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.586752:0:31250:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f24d800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155646.586756:0:31250:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8988 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.586762:0:31250:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8988 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.586772:0:31250:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8988 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.586777:0:31250:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8988 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155646.587523:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976126118912:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 42247us (43364us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155646.587855:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8246 00010000:00010000:3.0:1746155646.589628:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8973 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.589640:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8973 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.589646:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8973 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.589651:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5fc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155646.589654:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8973 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.589660:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8973 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.589674:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8973 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.589679:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5fc00/0x844e5faceb5f8973 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155646.589735:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126118144:12345-192.168.202.51@tcp:3:mirror_io.0 Request processed in 46535us (50661us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155646.589742:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8243 00000100:00100000:0.0:1746155646.595450:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.595740:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126119296 00000100:00100000:3.0:1746155646.595747:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126119296 00000100:00100000:3.0:1746155646.595805:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 771 00000100:00100000:3.0:1746155646.595813:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32495:x1830976126119296:12345-192.168.202.51@tcp:103:mirror_io.0 00010000:00010000:3.0:1746155646.595825:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155646.595843:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f88d2 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18899 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.595856:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155646.595859:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1746155646.596038:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155646.596265:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32495:x1830976126119296:12345-192.168.202.51@tcp:103:mirror_io.0 Request processed in 451us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155646.596271:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 771 00000100:00100000:0.0:1746155646.597400:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.598730:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126119552 00000100:00100000:3.0:1746155646.598737:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126119552 00000100:00100000:3.0:1746155646.598780:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4768 00000100:00100000:3.0:1746155646.598787:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32495:x1830976126119552:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:3.0:1746155646.599586:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32495:x1830976126119552:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 798us (2184us total) trans 8589945377 rc 0/0 00000100:00100000:3.0:1746155646.599593:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4768 00000100:00100000:0.0:1746155646.602791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.603345:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126119808 00000100:00100000:3.0:1746155646.603353:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126119808 00000100:00100000:3.0:1746155646.603402:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4769 00000100:00100000:3.0:1746155646.603409:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32495:x1830976126119808:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:3.0:1746155646.603732:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32495:x1830976126119808:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 321us (945us total) trans 8589945378 rc 0/0 00000100:00100000:3.0:1746155646.603739:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4769 00000100:00100000:0.0:1746155646.618221:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.620145:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126120064 00000100:00100000:2.0:1746155646.620155:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126120064 00000100:00100000:0.0:1746155646.620215:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.620221:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126120320 00000100:00100000:2.0:1746155646.620223:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126120320 00000100:00100000:0.0:1746155646.620236:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11202 00000100:00100000:0.0:1746155646.620244:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32502:x1830976126120064:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:2.0:1746155646.620251:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11203 00000100:00100000:2.0:1746155646.620257:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32504:x1830976126120320:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155646.620263:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155646.620268:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155646.620276:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d000/0x844e5faceb5f898f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188df expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.620278:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f8996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188e6 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1746155646.620389:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1746155646.621071:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c600/0x844e5faceb5f899d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621082:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c600/0x844e5faceb5f899d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621090:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c600/0x844e5faceb5f899d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621100:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f89a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621105:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f89a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621110:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f89a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621197:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00de00/0x844e5faceb5f89ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621204:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00de00/0x844e5faceb5f89ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621210:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00de00/0x844e5faceb5f89ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155646.621216:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155646.621279:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c600/0x844e5faceb5f899d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621284:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c600/0x844e5faceb5f899d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621289:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c600/0x844e5faceb5f899d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621293:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b00c600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155646.621525:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c600/0x844e5faceb5f899d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621532:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c600/0x844e5faceb5f899d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621540:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155646.621543:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155646.621546:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c600/0x844e5faceb5f899d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.621551:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00c600/0x844e5faceb5f899d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155646.621648:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621658:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621665:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621674:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f89c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621678:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f89c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621683:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f89c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621749:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f89c7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621755:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f89c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621760:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f89c7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155646.621769:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155646.621827:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621832:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621837:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621840:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5f200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155646.621842:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621846:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621852:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155646.621854:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155646.621857:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621860:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621904:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f89c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621908:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f89c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621912:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f89c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621919:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5fc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155646.621921:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f89c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621926:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f89c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621931:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e62df00) 00010000:00010000:2.0:1746155646.621933:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155646.621934:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f89c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621938:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f89c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.621979:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f8996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188e6 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.621990:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f89c7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188e6 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.621996:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155646.621998:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155646.622000:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5e200, rc 0) 00010000:00010000:0.0:1746155646.622108:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f89a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.622114:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f89a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.622122:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f89a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.622126:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b00d600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155646.622128:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f89a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.622132:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f89a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.622138:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e62df00) 00010000:00010000:0.0:1746155646.622140:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155646.622142:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f89a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.622146:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d600/0x844e5faceb5f89a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155646.622170:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d000/0x844e5faceb5f898f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188df expref: 289 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.622179:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00de00/0x844e5faceb5f89ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188df expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.622183:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155646.622185:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746155646.622186:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00de00, rc 0) 00000100:00100000:0.0:1746155646.622213:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32502:x1830976126120064:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1970us (3997us total) trans 8589945379 rc 0/0 00000100:00100000:0.0:1746155646.622219:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11202 00000100:00100000:2.0:1746155646.622422:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32504:x1830976126120320:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2162us (2209us total) trans 8589945380 rc 0/0 00000100:00100000:2.0:1746155646.623081:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11203 00000100:00100000:0.0:1746155646.629837:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.629944:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126120576 00000100:00100000:2.0:1746155646.629953:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126120576 00000100:00100000:2.0:1746155646.630003:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11204 00000100:00100000:2.0:1746155646.630010:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32508:x1830976126120576:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155646.630030:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155646.630044:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f89d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188ed expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.630112:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89dc lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.630121:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89dc lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.630128:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89dc lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155646.630134:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155646.630233:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f89d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ed expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.630263:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89dc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ed expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.630270:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155646.630272:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746155646.630274:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5f200, rc 0) 00000100:00100000:2.0:1746155646.630320:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32508:x1830976126120576:12345-192.168.202.51@tcp:101:cat.0 Request processed in 310us (490us total) trans 8589945381 rc 0/0 00000100:00100000:2.0:1746155646.630325:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11204 00000100:00100000:0.0:1746155646.632665:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.632698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.632725:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.632738:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.632761:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.632777:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126120704 00000100:00100000:0.0:1746155646.632782:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126120704 00000100:00100000:0.0:1746155646.632813:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126120832 00000100:00100000:0.0:1746155646.632816:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126120832 00000100:00100000:0.0:1746155646.632827:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126120960 00000100:00100000:0.0:1746155646.632829:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126120960 00000100:00100000:0.0:1746155646.632836:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126121088 00000100:00100000:0.0:1746155646.632838:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126121088 00000100:00100000:0.0:1746155646.632845:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126121216 00000100:00100000:0.0:1746155646.632846:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126121216 00000100:00100000:0.0:1746155646.632857:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17356 00000100:00100000:0.0:1746155646.632862:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1962:x1830976126120704:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155646.632884:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155646.632896:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b00d400/0x844e5faceb5f89ea lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188f4 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.632915:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.632916:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.632923:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00d400/0x844e5faceb5f89ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188f4 expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.632934:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b00d400/0x844e5faceb5f89ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188f4 expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.632946:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00d400, rc 0) 00000100:00100000:0.0:1746155646.632974:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1962:x1830976126120704:12345-192.168.202.51@tcp:101:cat.0 Request processed in 112us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155646.632978:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17356 00000100:00100000:0.0:1746155646.632989:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17357 00000100:00100000:0.0:1746155646.632994:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976126120832:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155646.632999:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155646.633006:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f89f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f188fb expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.633014:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.633016:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.633019:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f89f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188fb expref: 19 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.633026:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f89f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188fb expref: 19 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.633032:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00ca00, rc 0) 00000100:00100000:0.0:1746155646.633045:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a01d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976126120832:12345-192.168.202.51@tcp:101:cat.0 Request processed in 51us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155646.633049:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17357 00000100:00100000:2.0:1746155646.633056:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17358 00000100:00100000:0.0:1746155646.633060:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17359 00000100:00100000:2.0:1746155646.633063:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1962:x1830976126120960:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155646.633065:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1962:x1830976126121088:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155646.633070:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155646.633076:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f89f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18902 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.633077:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155646.633083:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f89ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18909 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.633086:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.633087:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.633091:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.633092:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f89f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18902 expref: 19 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.633092:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.633096:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f89ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18909 expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.633101:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f89f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18902 expref: 19 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.633104:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f89ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18909 expref: 26 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.633108:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5ee00, rc 0) 00010000:00010000:0.0:1746155646.633110:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00da00, rc 0) 00000100:00100000:2.0:1746155646.633123:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976126120960:12345-192.168.202.51@tcp:101:cat.0 Request processed in 62us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155646.633126:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1962:x1830976126121088:12345-192.168.202.51@tcp:101:cat.0 Request processed in 61us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.633129:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17358 00000100:00100000:0.0:1746155646.633132:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17359 00000100:00100000:2.0:1746155646.633139:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17360 00000100:00100000:2.0:1746155646.633143:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1962:x1830976126121216:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155646.633148:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155646.633154:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8a06 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18910 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.633162:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.633163:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.633167:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8a06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18910 expref: 26 pid: 19959 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155646.633174:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155646.633176:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8a06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18910 expref: 26 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.633182:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5f000, rc 0) 00000100:00100000:0.0:1746155646.633187:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126121344 00000100:00100000:0.0:1746155646.633190:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126121344 00000100:00100000:2.0:1746155646.633194:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1962:x1830976126121216:12345-192.168.202.51@tcp:101:cat.0 Request processed in 51us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.633199:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17360 00000100:00100000:0.0:1746155646.633204:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17361 00000100:00100000:0.0:1746155646.633208:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976126121344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155646.633213:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155646.633218:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b00c800/0x844e5faceb5f8a0d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18917 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.633227:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.633228:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.633232:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00c800/0x844e5faceb5f8a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18917 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.633241:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b00c800/0x844e5faceb5f8a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18917 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.633247:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00c800, rc 0) 00000100:00100000:0.0:1746155646.633260:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1962:x1830976126121344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 52us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155646.633265:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17361 00000100:00080000:3.0:1746155646.633299:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746155646.633303:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155646.640168:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.640228:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126121600 00000100:00100000:2.0:1746155646.640236:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126121600 00000100:00100000:2.0:1746155646.640281:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11205 00000100:00100000:2.0:1746155646.640287:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32504:x1830976126121600:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155646.640304:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155646.640307:0:14234:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746155646.640327:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f89dc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ed expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.640609:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f89c7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188e6 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.640620:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155646.640623:0:14234:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155646.640631:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a14 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1891e expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.640772:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.640782:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8918 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188a7 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.640792:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f8926 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ae expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.640797:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00de00/0x844e5faceb5f89ab lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188df expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.640802:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 6/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.640825:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00de00/0x844e5faceb5f89ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188df expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.640834:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00de00/0x844e5faceb5f89ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188df expref: 287 pid: 20364 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746155646.640842:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125428736:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155646.641405:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155646.641412:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f8926 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ae expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.641420:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f8926 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ae expref: 9 pid: 14234 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746155646.641427:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125428864:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155646.641453:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8918 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188a7 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.641460:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8918 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188a7 expref: 9 pid: 20364 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746155646.641467:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125428992:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155646.641482:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155646.641522:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126121728 00000100:00100000:0.0:1746155646.641526:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126121728 00000100:00100000:0.0:1746155646.641558:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17362 00000100:00100000:0.0:1746155646.641564:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+33:1960:x1830976126121728:12345-192.168.202.51@tcp:101:cat.0 00000100:00080000:2.0:1746155646.641567:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1746155646.641571:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155646.641579:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b00c200/0x844e5faceb5f8a22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18925 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.641592:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.641595:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.641601:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00c200/0x844e5faceb5f8a22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18925 expref: 34 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.641611:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b00c200/0x844e5faceb5f8a22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18925 expref: 34 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.641623:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00c200, rc 0) 00000100:00100000:0.0:1746155646.641641:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+34:1960:x1830976126121728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 78us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155646.641647:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17362 00000100:00100000:1.0:1746155646.641784:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.641849:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126121856 00000100:00100000:0.0:1746155646.641853:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126121856 00000100:00100000:0.0:1746155646.641901:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17363 00000100:00100000:0.0:1746155646.641906:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126121856:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155646.641912:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155646.641919:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b00c000/0x844e5faceb5f8a29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1892c expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.641929:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.641930:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.641934:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00c000/0x844e5faceb5f8a29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1892c expref: 23 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.641943:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b00c000/0x844e5faceb5f8a29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1892c expref: 23 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.641949:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00c000, rc 0) 00000100:00100000:0.0:1746155646.641967:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126121856:12345-192.168.202.51@tcp:101:cat.0 Request processed in 61us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155646.641972:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17363 00000100:00080000:2.0:1746155646.642060:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155646.643535:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.643564:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.643582:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.643595:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126121984 00000100:00100000:0.0:1746155646.643598:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126121984 00000100:00100000:0.0:1746155646.643616:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126122112 00000100:00100000:0.0:1746155646.643618:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126122112 00000100:00100000:0.0:1746155646.643638:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126122240 00000100:00100000:0.0:1746155646.643641:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126122240 00000100:00100000:0.0:1746155646.643653:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17364 00000100:00100000:0.0:1746155646.643658:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126121984:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155646.643667:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155646.643676:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b00dc00/0x844e5faceb5f8a30 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18933 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.643688:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.643690:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.643694:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00dc00/0x844e5faceb5f8a30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18933 expref: 24 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.643704:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b00dc00/0x844e5faceb5f8a30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18933 expref: 24 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155646.643713:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00dc00, rc 0) 00000100:00100000:0.0:1746155646.643735:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126121984:12345-192.168.202.51@tcp:101:cat.0 Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155646.643740:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17364 00000100:00100000:0.0:1746155646.643750:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17365 00000100:00100000:0.0:1746155646.643755:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+35:1960:x1830976126122112:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155646.643761:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155646.643767:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1893a expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.643776:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.643778:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155646.643782:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1893a expref: 36 pid: 10591 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155646.643783:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17366 00000100:00100000:1.0:1746155646.643790:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976126122240:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155646.643791:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1893a expref: 36 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155646.643797:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155646.643797:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00ce00, rc 0) 00010000:00010000:1.0:1746155646.643804:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8a3e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18941 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155646.643810:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976126122112:12345-192.168.202.51@tcp:101:cat.0 Request processed in 56us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155646.643815:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17365 00010000:00010000:1.0:1746155646.643818:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.643819:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.643823:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8a3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18941 expref: 36 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155646.643832:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8a3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18941 expref: 36 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155646.643839:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26f600, rc 0) 00000100:00100000:0.0:1746155646.643843:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.643855:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1960:x1830976126122240:12345-192.168.202.51@tcp:101:cat.0 Request processed in 66us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155646.643860:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17366 00000100:00100000:1.0:1746155646.643869:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126122368 00000100:00100000:1.0:1746155646.643872:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126122368 00000100:00100000:1.0:1746155646.644250:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17367 00000100:00100000:1.0:1746155646.644255:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126122368:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155646.644261:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155646.644272:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8a45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18948 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.644281:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.644282:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.644291:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18948 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155646.644304:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18948 expref: 25 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155646.644315:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26e600, rc 0) 00000100:00100000:1.0:1746155646.645599:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126122368:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1340us (1752us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155646.645605:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17367 00000100:00100000:2.0:1746155646.646032:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125428864:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155646.646266:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.646329:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125428992:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155646.646601:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.646777:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126122496 00000100:00100000:2.0:1746155646.646777:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126122624 00000100:00100000:3.0:1746155646.646781:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126122496 00000100:00100000:2.0:1746155646.646781:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126122624 00010000:00010000:3.0:1746155646.646802:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f8926 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ae expref: 11 pid: 14234 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746155646.646802:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8918 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188a7 expref: 11 pid: 20364 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746155646.646833:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8909 00000100:00100000:2.0:1746155646.646838:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8910 00000100:00100000:3.0:1746155646.646840:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126122496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155646.646843:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126122624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155646.646849:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155646.646853:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f8926 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ae expref: 11 pid: 14234 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746155646.646860:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f8926 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ae expref: 11 pid: 14234 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746155646.647068:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.647085:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126122752 00000100:00100000:0.0:1746155646.647088:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126122752 00010000:00010000:0.0:1746155646.647100:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00de00/0x844e5faceb5f89ab lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188df expref: 288 pid: 20364 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746155646.647114:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8911 00000100:00100000:0.0:1746155646.647119:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1960:x1830976126122752:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155646.647125:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155646.647129:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00de00/0x844e5faceb5f89ab lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188df expref: 288 pid: 20364 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746155646.647170:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f8926 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ae expref: 11 pid: 14234 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746155646.647236:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155646.647241:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8918 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188a7 expref: 10 pid: 20364 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746155646.647545:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00de00/0x844e5faceb5f89ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188df expref: 288 pid: 20364 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746155646.647568:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155646.647572:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155646.647579:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155646.647588:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155646.647629:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1960:x1830976126122752:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 508us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155646.647635:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8911 00010000:00010000:3.0:1746155646.647708:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155646.647712:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155646.647717:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155646.647721:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155646.647726:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8918 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188a7 expref: 10 pid: 20364 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746155646.647737:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126122496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 898us (1474us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155646.647738:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8918 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188a7 expref: 10 pid: 20364 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746155646.647742:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8909 00010000:00010000:2.0:1746155646.647748:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155646.647751:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.647757:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.647762:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155646.647773:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155646.647790:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126122624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 947us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.647796:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8910 00010000:00010000:3.0:1746155646.647797:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00de00/0x844e5faceb5f89ab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188df expref: 287 pid: 20364 timeout: 875 lvb_type: 0 00000100:00100000:0.0:1746155646.647801:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.647805:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125428736:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155646.647820:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155646.647823:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126123008 00000100:00100000:0.0:1746155646.647825:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126123008 00010000:00010000:3.0:1746155646.647826:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155646.647831:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155646.647849:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11206 00000100:00100000:0.0:1746155646.647854:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32507:x1830976126123008:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155646.647879:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155646.647888:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1894f expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.647927:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 2/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155646.647934:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.647944:0:20364:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155646.647963:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.647972:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155646.647974:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155646.647977:0:20364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.647982:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00d800, rc 0) 00000100:00100000:0.0:1746155646.648002:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32507:x1830976126123008:12345-192.168.202.51@tcp:101:cat.0 Request processed in 148us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155646.648007:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11206 00000100:00100000:0.0:1746155646.648081:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.648118:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.648136:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126123136 00000100:00100000:3.0:1746155646.648139:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126123136 00000100:00100000:0.0:1746155646.648143:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:3.0:1746155646.648159:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880131495180 x1830976126123136/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.648166:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495180 with x1830976126123136 ext(0->1048575) 00002000:00010000:3.0:1746155646.648170:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495180 00000100:00100000:3.0:1746155646.648180:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126123392 00000100:00100000:3.0:1746155646.648182:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126123392 00002000:00100000:3.0:1746155646.648193:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880131495500 x1830976126123392/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.648199:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495500 with x1830976126123392 ext(1048576->2097151) 00000100:00100000:0.0:1746155646.648213:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00010000:3.0:1746155646.648216:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131495500 00000100:00100000:3.0:1746155646.648225:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126123648 00000100:00100000:3.0:1746155646.648227:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126123648 00002000:00100000:3.0:1746155646.648236:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880131496d80 x1830976126123648/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.648247:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496d80 with x1830976126123648 ext(1048576->2097151) 00002000:00010000:3.0:1746155646.648249:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131496d80 00000100:00100000:3.0:1746155646.648257:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126123904 00000100:00100000:3.0:1746155646.648259:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126123904 00002000:00100000:3.0:1746155646.648267:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880131494e00 x1830976126123904/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.648273:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494e00 with x1830976126123904 ext(1048576->2097151) 00002000:00010000:3.0:1746155646.648275:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494e00 00000100:00100000:3.0:1746155646.648287:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8247 00000100:00100000:1.0:1746155646.648310:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8248 00000100:00100000:3.0:1746155646.648311:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1962:x1830976126123136:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155646.648318:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976126123392:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155646.648385:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8249 00000100:00100000:0.0:1746155646.648391:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976126123648:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155646.649197:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8250 00000100:00100000:1.0:1746155646.649202:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1962:x1830976126123904:12345-192.168.202.51@tcp:3:multiop.0 00000040:00080000:3.0:1746155646.651470:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3662, 88 off309176 00000004:00080000:3.0:1746155646.651480:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 775800977045ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155646.651565:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3658, 88 off309088 00000004:00080000:3.0:1746155646.651589:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 775801085869ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155646.651601:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3659, 88 off309176 00000004:00080000:3.0:1746155646.651604:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 775801101149ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155646.651610:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3663, 88 off309264 00000004:00080000:3.0:1746155646.651612:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 775801109494ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155646.651617:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3664, 88 off309352 00000004:00080000:3.0:1746155646.651619:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 775801116644ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155646.651625:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3660, 88 off309264 00000004:00080000:3.0:1746155646.651627:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 775801123967ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155646.651632:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3661, 88 off309352 00000004:00080000:3.0:1746155646.651634:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 775801131170ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155646.651640:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3662, 88 off309440 00000004:00080000:3.0:1746155646.651642:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 775801139066ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155646.651647:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3665, 88 off309440 00000004:00080000:3.0:1746155646.651649:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 775801146434ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155646.651655:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3663, 88 off309528 00000004:00080000:3.0:1746155646.651657:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 775801154396ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155646.651663:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3666, 88 off309528 00000004:00080000:3.0:1746155646.651665:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 775801161695ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155646.651670:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3664, 88 off309616 00000004:00080000:3.0:1746155646.651672:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 775801169166ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155646.651678:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3667, 88 off309616 00000004:00080000:3.0:1746155646.651680:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 775801177389ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155646.651686:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3668, 88 off309704 00000004:00080000:3.0:1746155646.651688:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 775801185397ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155646.651694:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3669, 88 off309792 00000004:00080000:3.0:1746155646.651696:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 775801193249ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155646.651701:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3670, 88 off309880 00000004:00080000:3.0:1746155646.651704:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 775801200676ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155646.651710:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3665, 88 off309704 00000004:00080000:3.0:1746155646.651712:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 775801209660ns, next at 716011101328ns, rc = 0 00000100:00100000:0.0:1746155646.659576:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976126123392:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 11251us (11449us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155646.659586:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8248 00002000:00100000:0.0:1746155646.660961:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880131495500 x1830976126123392/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155646.660971:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495500 with x1830976126123392 ext(1048576->2097151) 00002000:00010000:0.0:1746155646.660977:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131495500 00000100:00100000:2.0:1746155646.665057:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1962:x1830976126123648:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 16659us (16905us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155646.665067:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8249 00002000:00100000:2.0:1746155646.665078:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880131496d80 x1830976126123648/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155646.665087:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496d80 with x1830976126123648 ext(1048576->2097151) 00002000:00010000:2.0:1746155646.665092:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131496d80 00000100:00100000:1.0:1746155646.670130:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1962:x1830976126123904:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 20920us (21908us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155646.670139:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8250 00002000:00100000:1.0:1746155646.670148:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880131494e00 x1830976126123904/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.670156:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494e00 with x1830976126123904 ext(1048576->2097151) 00002000:00010000:1.0:1746155646.670161:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494e00 00000100:00100000:1.0:1746155646.670757:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1962:x1830976126123136:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 22446us (22697us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155646.670763:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8247 00002000:00100000:1.0:1746155646.670768:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880131495180 x1830976126123136/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.670774:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131495180 with x1830976126123136 ext(0->1048575) 00002000:00010000:1.0:1746155646.670778:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131495180 00000100:00100000:1.0:1746155646.677528:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.677612:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126124032 00000100:00100000:0.0:1746155646.677619:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126124032 00000100:00100000:0.0:1746155646.677652:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11207 00000100:00100000:0.0:1746155646.677658:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32508:x1830976126124032:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155646.677671:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155646.677685:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18956 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.677995:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18956 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.678007:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18956 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.678017:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155646.678019:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155646.678022:0:20364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155646.678027:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf0600, rc 0) 00000100:00100000:0.0:1746155646.678078:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32508:x1830976126124032:12345-192.168.202.51@tcp:101:cat.0 Request processed in 420us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155646.678084:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11207 00000001:00080000:1.0:1746155646.681803:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945379 is committed 00000001:00080000:1.0:1746155646.681814:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945381 is committed 00000001:00080000:1.0:1746155646.681819:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945382 is committed 00000004:00080000:1.0:1746155646.681822:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2849 committed 00000004:00080000:1.0:1746155646.681827:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2848 committed 00000004:00080000:1.0:1746155646.681832:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2847 committed 00000004:00080000:1.0:1746155646.681833:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2846 committed 00010000:00010000:3.0:1746155646.681834:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1891e expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746155646.681835:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2845 committed 00000004:00080000:1.0:1746155646.681836:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2848 committed 00000004:00080000:1.0:1746155646.681838:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2844 committed 00000004:00080000:1.0:1746155646.681839:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2847 committed 00000004:00080000:1.0:1746155646.681840:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2843 committed 00000004:00080000:1.0:1746155646.681841:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2846 committed 00000004:00080000:1.0:1746155646.681843:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2845 committed 00010000:00010000:3.0:1746155646.681844:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00000004:00080000:1.0:1746155646.681844:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2844 committed 00000004:00080000:1.0:1746155646.681845:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2842 committed 00010000:00010000:3.0:1746155646.681847:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:1.0:1746155646.681847:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2841 committed 00000004:00080000:1.0:1746155646.681848:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2843 committed 00000004:00080000:1.0:1746155646.681849:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2842 committed 00010000:00010000:3.0:1746155646.681850:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 286 pid: 20364 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746155646.681851:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2840 committed 00000001:00080000:1.0:1746155646.681854:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945378 is committed 00010000:00010000:3.0:1746155646.681862:0:14234:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 286 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.681868:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 286 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.681884:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18956 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.681889:0:14234:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18956 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.681894:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18956 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.681913:0:14234:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18956 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155646.681924:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125429376:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155646.681945:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125429120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155646.681975:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155646.681993:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125429760:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746155646.681996:0:14234:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 286 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155646.682003:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125430272:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155646.682005:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155646.682019:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130a406c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155646.682020:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746155646.682024:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125429248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155646.682037:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155646.682048:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125429888:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155646.682059:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155646.682068:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125429504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155646.682069:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a01d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125430400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155646.682081:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155646.682092:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125430912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155646.682102:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155646.682112:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746155646.682115:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125430528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155646.682125:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155646.682134:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125431040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155646.682146:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155646.682161:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125429120 00000100:00100000:1.0:1746155646.682163:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125429632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155646.682167:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125429120 00000100:00100000:1.0:1746155646.682177:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155646.682186:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125430144:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155646.682196:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125429760 00000100:00100000:1.0:1746155646.682197:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155646.682198:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125429760 00000100:00100000:1.0:1746155646.682205:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125430784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155646.682207:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125429248 00000100:00100000:3.0:1746155646.682209:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125429248 00000100:00100000:3.0:1746155646.682214:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125429888 00000100:00100000:1.0:1746155646.682215:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155646.682216:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125429888 00000100:00100000:1.0:1746155646.682221:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125431296:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155646.682222:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125430400 00000100:00100000:3.0:1746155646.682223:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125430400 00000100:00100000:1.0:1746155646.682230:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155646.682231:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125430912 00000100:00100000:3.0:1746155646.682233:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125430912 00000100:00100000:3.0:1746155646.682238:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125430528 00000100:00100000:3.0:1746155646.682239:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125430528 00000100:00100000:1.0:1746155646.682243:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125431040 00000100:00100000:3.0:1746155646.682244:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125429632 00000100:00100000:1.0:1746155646.682245:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125431040 00000100:00100000:3.0:1746155646.682246:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125429632 00000100:00100000:3.0:1746155646.682250:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125430144 00000100:00100000:3.0:1746155646.682251:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125430144 00000100:00100000:1.0:1746155646.682253:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125430784 00000100:00100000:1.0:1746155646.682254:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125430784 00000100:00100000:3.0:1746155646.682257:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125431296 00000100:00100000:3.0:1746155646.682258:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125431296 00000100:00100000:1.0:1746155646.682262:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17368 00000100:00100000:1.0:1746155646.682267:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+55:3295:x1830976125429120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155646.682408:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155646.682412:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155646.682413:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155646.682415:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155646.682417:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:1.0:1746155646.682443:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+56:3295:x1830976125429120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 175us (467us total) trans 17179874363 rc 0/0 00000100:00100000:3.0:1746155646.683026:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17369 00000100:00100000:3.0:1746155646.683033:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3295:x1830976125429760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155646.683460:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3295:x1830976125429760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 427us (1452us total) trans 17179874364 rc 0/0 00000100:00100000:3.0:1746155646.683466:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17369 00000100:00100000:3.0:1746155646.683479:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17370 00000100:00100000:3.0:1746155646.683483:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3295:x1830976125429248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155646.683579:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17368 00000100:00100000:0.0:1746155646.683583:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17371 00000100:00100000:0.0:1746155646.683590:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3295:x1830976125429888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155646.683591:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17372 00000100:00100000:1.0:1746155646.683595:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976125430400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155646.683670:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155646.683673:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155646.683675:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00000100:00100000:0.0:1746155646.683675:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3295:x1830976125429888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (1615us total) trans 17179874365 rc 0/0 00002000:00010000:1.0:1746155646.683677:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155644 -> 1746155644 00002000:00010000:1.0:1746155646.683679:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155646.683680:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17371 00000100:00100000:1.0:1746155646.683695:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+59:3295:x1830976125430400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (1613us total) trans 21474841672 rc 0/0 00000100:00100000:0.0:1746155646.683841:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17373 00000100:00100000:1.0:1746155646.683849:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17372 00000100:00100000:0.0:1746155646.683849:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3295:x1830976125430912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155646.683859:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17374 00000100:00100000:1.0:1746155646.683863:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976125430528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155646.683918:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17375 00000100:00100000:1.0:1746155646.683923:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3298:x1830976125429632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155646.684145:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:0.0:1746155646.684148:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155646.684150:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746155646.684151:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:0.0:1746155646.684152:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155646.684171:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3295:x1830976125430912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 324us (2068us total) trans 21474841673 rc 0/0 00000100:00100000:0.0:1746155646.684176:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17373 00000100:00100000:0.0:1746155646.684186:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17376 00000100:00100000:0.0:1746155646.684191:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3295:x1830976125431040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155646.684262:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3295:x1830976125431040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (2115us total) trans 21474841674 rc 0/0 00000100:00100000:0.0:1746155646.684267:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17376 00000100:00100000:0.0:1746155646.684276:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17377 00000100:00100000:0.0:1746155646.684281:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3298:x1830976125430144:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155646.684429:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17378 00000100:00100000:1.0:1746155646.684435:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+58:3298:x1830976125430784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155646.684440:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155646.684443:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155645 -> 1746155645 00002000:00010000:3.0:1746155646.684445:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155645 -> 1746155645 00002000:00010000:3.0:1746155646.684446:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155645 -> 1746155645 00002000:00010000:3.0:1746155646.684448:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155646.684467:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+56:3295:x1830976125429248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 983us (2428us total) trans 17179874366 rc 0/0 00000100:00100000:3.0:1746155646.684471:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17370 00000100:00100000:3.0:1746155646.684481:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17379 00000100:00100000:3.0:1746155646.684485:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3298:x1830976125431296:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1746155646.684497:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746155646.684500:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746155646.684551:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+59:3298:x1830976125430784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (2334us total) trans 21474841675 rc 0/0 00000100:00100000:1.0:1746155646.684556:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17378 00000004:00080000:1.0:1746155646.684598:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a4700/2, rc 0, transno 21474841675 00000100:00100000:1.0:1746155646.684604:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125430784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155646.684613:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a7b80/2, rc 0, transno 21474841676 00000100:00100000:2.0:1746155646.684614:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3298:x1830976125431296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 128us (2382us total) trans 21474841676 rc 0/0 00000100:00100000:1.0:1746155646.684615:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125431296:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155646.684619:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17379 00000100:00100000:3.0:1746155646.684688:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155646.684693:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3298:x1830976125429632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 770us (2515us total) trans 17179874367 rc 0/0 00000100:00100000:1.0:1746155646.684698:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17375 00000100:00100000:1.0:1746155646.684706:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125429504 00000100:00100000:1.0:1746155646.684709:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125429504 00000100:00100000:3.0:1746155646.684714:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125430016:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155646.684723:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17380 00000100:00100000:1.0:1746155646.684726:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a06a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+56:3297:x1830976125429504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155646.684735:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155646.684744:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125430656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155646.684756:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155646.684766:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a06a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125431168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155646.684776:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746155646.684789:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:1.0:1746155646.684791:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155645 -> 1746155645 00002000:00010000:1.0:1746155646.684793:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155645 -> 1746155645 00000100:00100000:3.0:1746155646.684794:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125430016 00002000:00010000:1.0:1746155646.684795:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155645 -> 1746155645 00000100:00100000:3.0:1746155646.684796:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125430016 00002000:00010000:1.0:1746155646.684797:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:3.0:1746155646.684807:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125430656 00000100:00100000:3.0:1746155646.684809:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125430656 00000100:00100000:3.0:1746155646.684815:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125431168 00000100:00100000:1.0:1746155646.684815:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a06a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+58:3297:x1830976125429504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (127us total) trans 17179874368 rc 0/0 00000100:00100000:3.0:1746155646.684816:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125431168 00000100:00100000:1.0:1746155646.684819:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17380 00000100:00100000:3.0:1746155646.684824:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17381 00000100:00100000:3.0:1746155646.684827:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+57:3297:x1830976125430016:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155646.684827:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17382 00000100:00100000:1.0:1746155646.684830:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+60:3297:x1830976125430656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155646.684902:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155646.684905:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155645 -> 1746155645 00002000:00010000:1.0:1746155646.684906:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155645 -> 1746155645 00002000:00010000:1.0:1746155646.684908:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155645 -> 1746155645 00002000:00010000:1.0:1746155646.684910:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:3.0:1746155646.684914:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+58:3297:x1830976125430016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85us (178us total) trans 17179874369 rc 0/0 00000100:00100000:3.0:1746155646.684919:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17381 00000100:00100000:1.0:1746155646.684922:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3297:x1830976125430656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 92us (166us total) trans 21474841677 rc 0/0 00000100:00100000:1.0:1746155646.684927:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17382 00000100:00100000:0.0:1746155646.685714:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+58:3298:x1830976125430144:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1432us (3515us total) trans 17179874370 rc 0/0 00000100:00100000:3.0:1746155646.685750:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17383 00000100:00100000:3.0:1746155646.685757:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3297:x1830976125431168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155646.685801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.685831:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3297:x1830976125431168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (1054us total) trans 21474841678 rc 0/0 00000100:00100000:3.0:1746155646.685836:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17383 00000100:00100000:3.0:1746155646.685849:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126124160 00000100:00100000:3.0:1746155646.685852:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126124160 00000100:00100000:3.0:1746155646.685871:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4770 00000100:00100000:1.0:1746155646.685881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.685885:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32507:x1830976126124160:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:1.0:1746155646.685895:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126124288 00000100:00100000:1.0:1746155646.685898:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126124288 00000100:00100000:1.0:1746155646.685912:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4771 00000100:00100000:1.0:1746155646.685916:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32508:x1830976126124288:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:1.0:1746155646.685945:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32508:x1830976126124288:12345-192.168.202.51@tcp:49:cat.0 Request processed in 28us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155646.685950:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4771 00000100:00100000:3.0:1746155646.686379:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32507:x1830976126124160:12345-192.168.202.51@tcp:49:cat.0 Request processed in 493us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155646.686384:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4770 00000004:00080000:3.0:1746155646.686428:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fc700/2, rc 0, transno 17179874368 00000100:00100000:3.0:1746155646.686437:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125429504:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155646.686445:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdec380/2, rc 0, transno 17179874369 00000100:00100000:3.0:1746155646.686447:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125430016:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155646.686454:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a5500/2, rc 0, transno 21474841677 00000100:00100000:3.0:1746155646.686456:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125430656:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155646.686461:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a7800/2, rc 0, transno 21474841678 00000100:00100000:3.0:1746155646.686464:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125431168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155646.686519:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746155646.686526:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125431424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155646.686549:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155646.686568:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125431424 00000100:00100000:3.0:1746155646.686571:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125431424 00000100:00100000:3.0:1746155646.686587:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17384 00000100:00100000:3.0:1746155646.686591:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+59:3296:x1830976125431424:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155646.686617:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdece00/2, rc 0, transno 17179874367 00000100:00100000:1.0:1746155646.686621:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125429632:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155646.686627:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdec700/2, rc 0, transno 17179874370 00000100:00100000:1.0:1746155646.686629:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125430144:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155646.686667:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155646.686670:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155645 -> 1746155645 00002000:00010000:1.0:1746155646.686671:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155644 -> 1746155644 00000100:00100000:3.0:1746155646.686673:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3296:x1830976125431424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (123us total) trans 17179874371 rc 0/0 00002000:00010000:1.0:1746155646.686673:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155645 -> 1746155645 00002000:00010000:1.0:1746155646.686675:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155646.686678:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17384 00000100:00100000:1.0:1746155646.686692:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+61:3295:x1830976125430528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2829us (4565us total) trans 21474841679 rc 0/0 00000004:00080000:3.0:1746155646.686694:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc52a00/2, rc 0, transno 17179874371 00000100:00100000:3.0:1746155646.686697:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125431424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155646.686697:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17374 00000100:00100000:3.0:1746155646.686714:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125429376:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155646.686722:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125430272:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155646.686896:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17377 00000004:00080000:0.0:1746155646.687003:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a5180/2, rc 0, transno 21474841679 00000100:00100000:0.0:1746155646.687006:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125430528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155646.687013:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a4a80/2, rc 0, transno 21474841674 00000100:00100000:0.0:1746155646.687016:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125431040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155646.687022:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a01d1180/2, rc 0, transno 21474841672 00000100:00100000:0.0:1746155646.687024:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a01d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125430400:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155646.687030:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a06a6300/2, rc 0, transno 21474841673 00000100:00100000:0.0:1746155646.687032:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a06a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125430912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155646.687039:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fe300/2, rc 0, transno 17179874366 00000100:00100000:0.0:1746155646.687042:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125429248:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155646.687048:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdee680/2, rc 0, transno 17179874365 00000100:00100000:0.0:1746155646.687050:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125429888:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155646.687056:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fd500/2, rc 0, transno 17179874363 00000100:00100000:0.0:1746155646.687058:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125429120:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155646.687065:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdee300/2, rc 0, transno 17179874364 00000100:00100000:0.0:1746155646.687067:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125429760:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746155646.688314:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a14 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1891e expref: 9 pid: 14234 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746155646.688334:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1891e expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.688358:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5ea00, rc 0) 00000100:00100000:3.0:1746155646.688410:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32504:x1830976126121600:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 48122us (48248us total) trans 8589945382 rc 0/0 00000100:00100000:3.0:1746155646.688416:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11205 00000100:00100000:0.0:1746155646.696697:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.696748:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126124416 00000100:00100000:2.0:1746155646.696756:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126124416 00000100:00100000:2.0:1746155646.696805:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17385 00000100:00100000:2.0:1746155646.696812:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:32504:x1830976126124416:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155646.696826:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155646.696846:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1895d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.696870:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8200/0x844e5faceb5f8942 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ca expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.696888:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1893a expref: 35 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.696894:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f89ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18909 expref: 27 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.696900:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.696901:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.696904:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1236992->1507327] (req 1236992->1507327) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.696928:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f89ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18909 expref: 27 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.696938:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f89ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18909 expref: 27 pid: 20200 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746155646.696947:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125431552:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155646.697610:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1893a expref: 35 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.697619:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1893a expref: 35 pid: 10591 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746155646.697693:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125431680:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155646.697722:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8200/0x844e5faceb5f8942 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ca expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.697730:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8200/0x844e5faceb5f8942 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ca expref: 10 pid: 10591 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746155646.697737:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125431808:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155646.697753:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155646.698149:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.698170:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.698272:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126124672 00000100:00100000:1.0:1746155646.698276:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126124672 00002000:00100000:1.0:1746155646.698298:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880131494000 x1830976126124672/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.698311:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494000 with x1830976126124672 ext(0->1048575) 00002000:00010000:1.0:1746155646.698315:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494000 00000100:00100000:1.0:1746155646.698335:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126124928 00000100:00100000:1.0:1746155646.698338:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126124928 00002000:00100000:1.0:1746155646.698349:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880131497100 x1830976126124928/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.698355:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497100 with x1830976126124928 ext(1048576->2097151) 00002000:00010000:1.0:1746155646.698358:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131497100 00000100:00100000:1.0:1746155646.698368:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8251 00000100:00100000:1.0:1746155646.698373:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1963:x1830976126124672:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155646.698376:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8252 00000100:00100000:3.0:1746155646.698385:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976126124928:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155646.702067:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.702193:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.702234:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.702303:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126125184 00000100:00100000:3.0:1746155646.702310:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126125184 00002000:00100000:3.0:1746155646.702345:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880131496680 x1830976126125184/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.702360:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496680 with x1830976126125184 ext(1048576->2097151) 00002000:00010000:3.0:1746155646.702365:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131496680 00000100:00100000:3.0:1746155646.702380:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126125440 00000100:00100000:3.0:1746155646.702382:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126125440 00002000:00100000:3.0:1746155646.702394:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880131494380 x1830976126125440/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.702400:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494380 with x1830976126125440 ext(1048576->2097151) 00010000:00010000:3.0:1746155646.702406:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1893a expref: 38 pid: 10591 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746155646.702418:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1893a expref: 38 pid: 10591 timeout: 875 lvb_type: 1 00002000:00010000:3.0:1746155646.702424:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131494380 00000100:00100000:3.0:1746155646.702458:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126125696 00000100:00100000:3.0:1746155646.702461:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126125696 00002000:00100000:3.0:1746155646.702477:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880131494a80 x1830976126125696/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.702485:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494a80 with x1830976126125696 ext(1048576->2097151) 00002000:00010000:3.0:1746155646.702488:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131494a80 00000100:00100000:3.0:1746155646.702937:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1445 00000100:00100000:1.0:1746155646.702943:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8253 00000100:00100000:3.0:1746155646.702944:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976126125440:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155646.702951:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976126125184:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155646.703941:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8254 00000100:00100000:3.0:1746155646.703948:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126125696:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155646.710695:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.710797:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125431552:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155646.710808:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125431680:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155646.710815:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125431808:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155646.710836:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1236992->1507327] (req 1236992->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.710851:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5e000, rc 0) 00000100:00100000:3.0:1746155646.710901:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:32504:x1830976126124416:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 14088us (14211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155646.710909:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17385 00000100:00100000:0.0:1746155646.711742:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.711882:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126125824 00000100:00100000:2.0:1746155646.711889:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126125824 00010000:00010000:2.0:1746155646.711913:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f89ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18909 expref: 27 pid: 20200 timeout: 875 lvb_type: 1 00000100:00100000:3.0:1746155646.711917:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126125952 00000100:00100000:3.0:1746155646.711921:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126125952 00010000:00010000:3.0:1746155646.711937:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8200/0x844e5faceb5f8942 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ca expref: 11 pid: 10591 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746155646.711944:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8912 00000100:00100000:2.0:1746155646.711950:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1962:x1830976126125824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155646.711959:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8913 00010000:00010000:2.0:1746155646.711960:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155646.711965:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126125952:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155646.711971:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155646.711975:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f89ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18909 expref: 27 pid: 20200 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746155646.711979:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8200/0x844e5faceb5f8942 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ca expref: 11 pid: 10591 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746155646.711984:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f89ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18909 expref: 27 pid: 20200 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746155646.712075:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8200/0x844e5faceb5f8942 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ca expref: 11 pid: 10591 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746155646.712096:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f89ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18909 expref: 27 pid: 20200 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746155646.712113:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8200/0x844e5faceb5f8942 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188ca expref: 11 pid: 10591 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746155646.712113:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155646.712124:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155646.712136:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1962:x1830976126125824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 185us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155646.712140:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126125952:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 176us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.712142:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8912 00000100:00100000:3.0:1746155646.712145:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8913 00000100:00100000:3.0:1746155646.712300:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976126124928:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13917us (14128us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155646.712306:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8252 00002000:00100000:3.0:1746155646.712313:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880131497100 x1830976126124928/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.712320:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131497100 with x1830976126124928 ext(1048576->2097151) 00002000:00010000:3.0:1746155646.712324:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131497100 00000100:00100000:1.0:1746155646.712423:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976126124672:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14049us (14273us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155646.712429:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8251 00002000:00100000:1.0:1746155646.712433:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880131494000 x1830976126124672/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.712440:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494000 with x1830976126124672 ext(0->1048575) 00002000:00010000:1.0:1746155646.712442:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131494000 00000100:00100000:1.0:1746155646.716474:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976126125184:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13516us (14406us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155646.716482:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8253 00002000:00100000:1.0:1746155646.716492:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880131496680 x1830976126125184/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.716499:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131496680 with x1830976126125184 ext(1048576->2097151) 00002000:00010000:1.0:1746155646.716522:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131496680 00000100:00100000:3.0:1746155646.717464:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:1963:x1830976126125440:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14519us (15268us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155646.717472:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1445 00002000:00100000:3.0:1746155646.717478:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880131494380 x1830976126125440/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.717485:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494380 with x1830976126125440 ext(1048576->2097151) 00010000:00010000:3.0:1746155646.717491:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1893a expref: 36 pid: 10591 timeout: 875 lvb_type: 1 00010000:00010000:3.0:1746155646.717525:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1893a expref: 36 pid: 10591 timeout: 875 lvb_type: 1 00002000:00010000:3.0:1746155646.717532:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880131494380 00000100:00100000:0.0:1746155646.718648:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.718713:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126126080 00000100:00100000:3.0:1746155646.718720:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126126080 00000100:00100000:3.0:1746155646.719255:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17386 00000100:00100000:3.0:1746155646.719263:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+36:32502:x1830976126126080:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155646.719277:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155646.719291:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18964 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.719309:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155646.719314:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1236992->1507327] (req 1236992->1507327) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 25 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.719320:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155646.719324:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1470464->2097151] (req 1470464->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 37 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.719351:0:8438:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1236992->1507327] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 25 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.719360:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1470464->2097151] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 37 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.719373:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff97000, rc 0) 00000100:00100000:3.0:1746155646.719404:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:32502:x1830976126126080:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 142us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155646.719409:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17386 00000100:00100000:3.0:1746155646.720470:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126125696:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 16520us (18233us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155646.720478:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8254 00002000:00100000:3.0:1746155646.720485:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880131494a80 x1830976126125696/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.720493:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131494a80 with x1830976126125696 ext(1048576->2097151) 00002000:00010000:3.0:1746155646.720497:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131494a80 00000100:00100000:0.0:1746155646.726728:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.726793:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126126208 00000100:00100000:1.0:1746155646.726801:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126126208 00000100:00100000:1.0:1746155646.726847:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17387 00000100:00100000:1.0:1746155646.726854:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:32507:x1830976126126208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155646.726869:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155646.726895:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f26ea00/0x844e5faceb5f8a68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1896b expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.726915:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.726921:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1470464->2097151] (req 1470464->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 38 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.726926:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746155646.726929:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26ea00/0x844e5faceb5f8a68 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1896b expref: 38 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.726963:0:19959:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1470464->2097151] (req 1470464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 38 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.726978:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f26ea00/0x844e5faceb5f8a68 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1896b expref: 38 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.726986:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26ea00, rc 0) 00000100:00100000:1.0:1746155646.727033:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:32507:x1830976126126208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 179us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155646.727039:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17387 00000100:00100000:0.0:1746155646.728683:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.728852:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126126464 00000100:00100000:3.0:1746155646.728856:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126126464 00002000:00100000:3.0:1746155646.728893:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88013089b800 x1830976126126464/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.728901:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089b800 with x1830976126126464 ext(1048576->2097151) 00002000:00010000:3.0:1746155646.728905:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089b800 00000100:00100000:3.0:1746155646.728919:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8255 00000100:00100000:3.0:1746155646.728923:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126126464:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155646.731982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.732067:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126126592 00000100:00100000:2.0:1746155646.732075:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126126592 00010000:00010000:2.0:1746155646.732105:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1893a expref: 38 pid: 10591 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746155646.732194:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8914 00000100:00100000:2.0:1746155646.732202:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1962:x1830976126126592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155646.732214:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155646.732233:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1893a expref: 38 pid: 10591 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746155646.732244:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1893a expref: 38 pid: 10591 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746155646.732263:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8a37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1893a expref: 38 pid: 10591 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746155646.733583:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.733586:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.733595:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 25 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.733606:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 25 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.733636:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 25 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.733647:0:9789:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 25 pid: 8438 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746155646.733656:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125432192:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155646.735394:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155646.736177:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126126464:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7248us (7490us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155646.736186:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8255 00002000:00100000:3.0:1746155646.736196:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88013089b800 x1830976126126464/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.736204:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089b800 with x1830976126126464 ext(1048576->2097151) 00002000:00010000:3.0:1746155646.736209:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089b800 00000100:00100000:0.0:1746155646.736611:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.736766:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125432192:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155646.736782:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155646.736804:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1962:x1830976126126592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4603us (4829us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.736811:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8914 00000100:00100000:3.0:1746155646.736923:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126126848 00000100:00100000:3.0:1746155646.736928:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126126848 00002000:00100000:3.0:1746155646.736951:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1236992->1241087) req@ffff88009fac4700 x1830976126126848/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.736957:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4700 with x1830976126126848 ext(1236992->1241087) 00010000:00010000:3.0:1746155646.736964:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 26 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746155646.736974:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 26 pid: 8438 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746155646.736980:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac4700 00000100:00100000:3.0:1746155646.737003:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1446 00000100:00100000:3.0:1746155646.737009:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1961:x1830976126126848:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155646.737125:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1961:x1830976126126848:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 116us (514us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155646.737130:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1446 00002000:00100000:3.0:1746155646.737134:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1236992->1241087) req@ffff88009fac4700 x1830976126126848/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/4536 e 0 to 0 dl 1746155657 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.737140:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4700 with x1830976126126848 ext(1236992->1241087) 00010000:00010000:3.0:1746155646.737144:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 26 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746155646.737152:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 26 pid: 8438 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746155646.737157:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac4700 00000100:00100000:0.0:1746155646.740180:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.740348:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126127104 00000100:00100000:3.0:1746155646.740355:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126127104 00002000:00100000:3.0:1746155646.740391:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fac6300 x1830976126127104/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 504/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.740399:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6300 with x1830976126127104 ext(1048576->2097151) 00010000:00010000:3.0:1746155646.740408:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 26 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746155646.740419:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 26 pid: 8438 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746155646.740426:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac6300 00000100:00100000:3.0:1746155646.740454:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1447 00000100:00100000:3.0:1746155646.740461:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1961:x1830976126127104:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155646.742962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.743042:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126127232 00000100:00100000:3.0:1746155646.743049:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126127232 00000100:00100000:3.0:1746155646.743084:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17388 00000100:00100000:3.0:1746155646.743091:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:32508:x1830976126127232:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155646.743103:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155646.743118:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0x844e5faceb5f8a6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18972 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.743144:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155646.743149:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0x844e5faceb5f8a6f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18972 expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.743163:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0x844e5faceb5f8a6f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18972 expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.743172:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff96a00, rc 0) 00000100:00100000:3.0:1746155646.743204:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:32508:x1830976126127232:12345-192.168.202.51@tcp:101:cat.0 Request processed in 114us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155646.743209:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17388 00000100:00100000:3.0:1746155646.747086:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976126127104:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 6617us (6905us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746155646.747096:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1447 00002000:00100000:3.0:1746155646.747106:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fac6300 x1830976126127104/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 504/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:H/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.747116:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac6300 with x1830976126127104 ext(1048576->2097151) 00010000:00010000:3.0:1746155646.747124:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 27 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746155646.747136:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 27 pid: 8438 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746155646.747143:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac6300 00000100:00100000:0.0:1746155646.752576:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.752628:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.752972:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126127744 00000100:00100000:2.0:1746155646.752980:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126127744 00000100:00100000:2.0:1746155646.753017:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4772 00000100:00100000:2.0:1746155646.753023:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32504:x1830976126127744:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155646.753147:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126127488 00000100:00100000:3.0:1746155646.753152:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126127488 00002000:00100000:3.0:1746155646.753178:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1236992->1507327) req@ffff88009fac7100 x1830976126127488/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.753187:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7100 with x1830976126127488 ext(1236992->1507327) 00010000:00010000:3.0:1746155646.753194:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 27 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746155646.753205:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 27 pid: 8438 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746155646.753211:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac7100 00000100:00100000:3.0:1746155646.753224:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1448 00000100:00100000:3.0:1746155646.753229:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976126127488:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155646.753277:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32504:x1830976126127744:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 253us (707us total) trans 8589945383 rc 0/0 00000100:00100000:2.0:1746155646.753283:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4772 00000100:00100000:3.0:1746155646.763381:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1961:x1830976126127488:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 10142us (10742us total) trans 17179874372 rc 0/0 00000100:00100000:3.0:1746155646.763392:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1448 00002000:00100000:3.0:1746155646.763402:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1236992->1507327) req@ffff88009fac7100 x1830976126127488/t17179874372(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/448 e 0 to 0 dl 1746155657 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.763411:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7100 with x1830976126127488 ext(1236992->1507327) 00010000:00010000:3.0:1746155646.763419:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 29 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746155646.763433:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 29 pid: 8438 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746155646.763443:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac7100 00000100:00100000:3.0:1746155646.770686:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.770755:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126127872 00000100:00100000:2.0:1746155646.770762:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126127872 00010000:00010000:2.0:1746155646.770788:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 29 pid: 8438 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746155646.770819:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8915 00000100:00100000:2.0:1746155646.770825:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1963:x1830976126127872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155646.770836:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746155646.770850:0:9789:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155645 -> 1746155647 00002000:00010000:2.0:1746155646.770852:0:9789:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155645 -> 1746155647 00010000:00010000:2.0:1746155646.770857:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 29 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746155646.770866:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 29 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746155646.770894:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5e000/0x844e5faceb5f8a5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1236992->1507327) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1895d expref: 29 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746155646.770917:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.770919:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.770925:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 36 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.770932:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 36 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.770957:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 36 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.770968:0:9789:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 36 pid: 8438 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746155646.770978:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125432320:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155646.771656:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e3329c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155646.773403:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125432320:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155646.773418:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155646.774030:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1963:x1830976126127872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3203us (3348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.774039:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8915 00000100:00100000:0.0:1746155646.774245:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.774326:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126128128 00000100:00100000:2.0:1746155646.774331:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126128128 00002000:00100000:2.0:1746155646.774358:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1470464->1474559) req@ffff88009fac4a80 x1830976126128128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155646.774366:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4a80 with x1830976126128128 ext(1470464->1474559) 00010000:00010000:2.0:1746155646.774373:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 37 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746155646.774384:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 37 pid: 8438 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746155646.774391:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac4a80 00000100:00100000:2.0:1746155646.774403:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1449 00000100:00100000:2.0:1746155646.774410:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976126128128:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155646.774549:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:1961:x1830976126128128:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 139us (304us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155646.774555:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1449 00002000:00100000:2.0:1746155646.774559:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1470464->1474559) req@ffff88009fac4a80 x1830976126128128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/4536 e 0 to 0 dl 1746155657 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155646.774566:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4a80 with x1830976126128128 ext(1470464->1474559) 00010000:00010000:2.0:1746155646.774570:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 37 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746155646.774579:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 37 pid: 8438 timeout: 875 lvb_type: 0 00002000:00010000:2.0:1746155646.774584:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fac4a80 00000100:00100000:0.0:1746155646.780803:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.780965:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126128384 00000100:00100000:2.0:1746155646.780974:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126128384 00000100:00100000:2.0:1746155646.781015:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17389 00000100:00100000:2.0:1746155646.781022:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+37:32502:x1830976126128384:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155646.781038:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155646.781254:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18979 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.781279:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f24cc00/0x844e5faceb5f8950 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d1 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.781285:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8a3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18941 expref: 38 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.781291:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8a06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18910 expref: 27 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.781297:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.781298:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.781301:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->2207743] (req 2097152->2207743) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 38 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.781322:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8a06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18910 expref: 27 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.781331:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8a06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18910 expref: 27 pid: 19959 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746155646.781340:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125432448:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155646.781575:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155646.781865:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8a3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18941 expref: 38 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.781883:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8a3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18941 expref: 38 pid: 1625 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746155646.781891:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125432576:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155646.782052:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126128512 00000100:00100000:1.0:1746155646.782056:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126128512 00002000:00100000:1.0:1746155646.782080:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1470464->2097151) req@ffff88009f4fc000 x1830976126128512/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.782088:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fc000 with x1830976126128512 ext(1470464->2097151) 00010000:00010000:1.0:1746155646.782094:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 39 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746155646.782103:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 39 pid: 8438 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746155646.782108:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4fc000 00010000:00010000:2.0:1746155646.782399:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f24cc00/0x844e5faceb5f8950 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d1 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155646.782410:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f24cc00/0x844e5faceb5f8950 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d1 expref: 9 pid: 18270 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746155646.782583:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125432704:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155646.782621:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155646.782863:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1450 00000100:00100000:1.0:1746155646.782870:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976126128512:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155646.783651:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.783675:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.783807:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125432448:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155646.783815:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125432576:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155646.784499:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126128768 00000100:00100000:2.0:1746155646.784520:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126128768 00010000:00010000:2.0:1746155646.784545:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8a3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18941 expref: 41 pid: 1625 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746155646.784574:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126128640 00000100:00100000:2.0:1746155646.784577:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126128640 00010000:00010000:2.0:1746155646.784587:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8a06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18910 expref: 28 pid: 19959 timeout: 875 lvb_type: 1 00000100:00100000:2.0:1746155646.784611:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8916 00000100:00100000:2.0:1746155646.784616:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1962:x1830976126128768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155646.784625:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155646.784640:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8a3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18941 expref: 41 pid: 1625 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746155646.784648:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8a3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18941 expref: 41 pid: 1625 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746155646.784665:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8a3e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18941 expref: 41 pid: 1625 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746155646.784681:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155646.784715:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1962:x1830976126128768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 99us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.784721:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8916 00000100:00100000:2.0:1746155646.784785:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8917 00000100:00100000:2.0:1746155646.784790:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976126128640:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155646.784796:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155646.784804:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8a06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18910 expref: 28 pid: 19959 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746155646.784812:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8a06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18910 expref: 28 pid: 19959 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746155646.784822:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8a06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18910 expref: 28 pid: 19959 timeout: 875 lvb_type: 1 00010000:00010000:2.0:1746155646.784830:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155646.784844:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976126128640:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.784849:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8917 00000100:00100000:0.0:1746155646.788160:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.788477:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125432704:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155646.788519:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->2207743] (req 2097152->2207743) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 39 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.788534:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f023800, rc 0) 00000100:00100000:3.0:1746155646.788568:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:32502:x1830976126128384:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7546us (7771us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155646.788575:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17389 00000100:00100000:1.0:1746155646.788647:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126128896 00000100:00100000:1.0:1746155646.788652:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126128896 00010000:00010000:1.0:1746155646.788673:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f24cc00/0x844e5faceb5f8950 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d1 expref: 10 pid: 18270 timeout: 875 lvb_type: 1 00000100:00100000:1.0:1746155646.788691:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8918 00000100:00100000:1.0:1746155646.788696:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126128896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155646.788705:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155646.788721:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f24cc00/0x844e5faceb5f8950 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d1 expref: 10 pid: 18270 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746155646.788729:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f24cc00/0x844e5faceb5f8950 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d1 expref: 10 pid: 18270 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746155646.788746:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f24cc00/0x844e5faceb5f8950 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d1 expref: 10 pid: 18270 timeout: 875 lvb_type: 1 00010000:00010000:1.0:1746155646.788758:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.788760:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.788765:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 38 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.788772:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 38 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.788795:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 38 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155646.788808:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125432832:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155646.788846:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1103c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155646.794406:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125432832:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155646.794407:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155646.794426:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155646.794468:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126128896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5771us (6313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.794476:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8918 00000100:00100000:3.0:1746155646.794545:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126129152 00000100:00100000:3.0:1746155646.794550:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126129152 00002000:00100000:3.0:1746155646.794577:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2203648->2207743) req@ffff88009ca97800 x1830976126129152/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.794586:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97800 with x1830976126129152 ext(2203648->2207743) 00002000:00010000:3.0:1746155646.794589:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca97800 00000100:00100000:3.0:1746155646.794610:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8256 00000100:00100000:3.0:1746155646.794615:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976126129152:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155646.794727:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1960:x1830976126129152:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 111us (321us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155646.794732:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8256 00002000:00100000:3.0:1746155646.794737:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2203648->2207743) req@ffff88009ca97800 x1830976126129152/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/4536 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.794749:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca97800 with x1830976126129152 ext(2203648->2207743) 00002000:00010000:3.0:1746155646.794751:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca97800 00000100:00100000:0.0:1746155646.796817:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.797279:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126129408 00000100:00100000:1.0:1746155646.797280:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976126128512:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 14409us (15704us total) trans 17179874373 rc 0/0 00000100:00100000:2.0:1746155646.797284:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126129408 00000100:00100000:1.0:1746155646.797288:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1450 00002000:00100000:1.0:1746155646.797295:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1470464->2097151) req@ffff88009f4fc000 x1830976126128512/t17179874373(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/448 e 0 to 0 dl 1746155657 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.797302:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f4fc000 with x1830976126128512 ext(1470464->2097151) 00010000:00010000:1.0:1746155646.797309:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 39 pid: 8438 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746155646.797317:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4773 00010000:00010000:1.0:1746155646.797320:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 39 pid: 8438 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746155646.797322:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32502:x1830976126129408:12345-192.168.202.51@tcp:35:multiop.0 00002000:00010000:1.0:1746155646.797326:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f4fc000 00000100:00100000:2.0:1746155646.797472:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32502:x1830976126129408:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 149us (659us total) trans 8589945384 rc 0/0 00000100:00100000:2.0:1746155646.797478:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4773 00000100:00100000:0.0:1746155646.798896:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.799024:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126129536 00000100:00100000:2.0:1746155646.799029:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126129536 00010000:00010000:2.0:1746155646.799047:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 39 pid: 8438 timeout: 875 lvb_type: 0 00000100:00100000:2.0:1746155646.800222:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8919 00000100:00100000:2.0:1746155646.800230:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1963:x1830976126129536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155646.800242:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155646.800260:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 39 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746155646.800272:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 39 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746155646.800291:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8a61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1470464->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18964 expref: 39 pid: 8438 timeout: 875 lvb_type: 0 00010000:00010000:2.0:1746155646.800304:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.800307:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.800312:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f26ea00/0x844e5faceb5f8a68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1896b expref: 38 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.800320:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26ea00/0x844e5faceb5f8a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1896b expref: 38 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.800326:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.800328:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.800331:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0x844e5faceb5f8a6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18972 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.800337:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0x844e5faceb5f8a6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18972 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.800359:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0x844e5faceb5f8a6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18972 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155646.800369:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125432960:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155646.800445:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f26ea00/0x844e5faceb5f8a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1896b expref: 38 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155646.800452:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125433088:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155646.800465:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155646.802644:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125432960:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155646.802656:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125433088:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155646.802671:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155646.802702:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1963:x1830976126129536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2473us (3809us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.802711:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8919 00000100:00100000:0.0:1746155646.806248:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.806542:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126129792 00000100:00100000:1.0:1746155646.806550:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126129792 00002000:00100000:1.0:1746155646.806593:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009ca94000 x1830976126129792/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.806603:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94000 with x1830976126129792 ext(1048576->2097151) 00002000:00010000:1.0:1746155646.806607:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca94000 00000100:00100000:1.0:1746155646.806632:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8257 00000100:00100000:1.0:1746155646.806638:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976126129792:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155646.808681:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.808820:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126130048 00000100:00100000:3.0:1746155646.809145:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126130048 00002000:00100000:3.0:1746155646.809175:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fed9180 x1830976126130048/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.809188:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9180 with x1830976126130048 ext(1048576->2097151) 00002000:00010000:3.0:1746155646.809192:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed9180 00000100:00100000:3.0:1746155646.809291:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8258 00000100:00100000:3.0:1746155646.809298:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976126130048:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155646.817200:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976126129792:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10553us (10950us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155646.817210:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8257 00002000:00100000:1.0:1746155646.817220:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009ca94000 x1830976126129792/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.817229:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94000 with x1830976126129792 ext(1048576->2097151) 00002000:00010000:1.0:1746155646.817234:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ca94000 00000100:00100000:3.0:1746155646.824964:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+38:1961:x1830976126130048:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 15658us (16281us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155646.824974:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8258 00002000:00100000:3.0:1746155646.824983:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fed9180 x1830976126130048/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.824990:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9180 with x1830976126130048 ext(1048576->2097151) 00002000:00010000:3.0:1746155646.824995:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed9180 00000100:00100000:0.0:1746155646.829257:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.834182:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126130176 00000100:00100000:3.0:1746155646.834192:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126130176 00000100:00100000:3.0:1746155646.834252:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17390 00000100:00100000:3.0:1746155646.834259:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1962:x1830976126130176:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155646.834274:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155646.834288:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012de33200/0x844e5faceb5f8a7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18980 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155646.834330:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125433216:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155646.834420:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29300 going to sleep for 11 seconds 00002000:00010000:3.0:1746155646.836298:0:19959:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155645 -> 1746155647 00002000:00010000:3.0:1746155646.836302:0:19959:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155645 -> 1746155647 00002000:00010000:3.0:1746155646.836304:0:19959:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime: 1746155645 -> 1746155647 00000100:00100000:3.0:1746155646.836321:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125433216:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155646.836343:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012de33200/0x844e5faceb5f8a7d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18980 expref: 28 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155646.836354:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012de33200/0x844e5faceb5f8a7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18980 expref: 28 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155646.836380:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012de33200, rc 0) 00000100:00100000:3.0:1746155646.836408:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1962:x1830976126130176:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2149us (7158us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155646.836414:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17390 00000100:00100000:0.0:1746155646.837959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.838026:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126130304 00000100:00100000:3.0:1746155646.838031:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126130304 00000100:00100000:3.0:1746155646.838065:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17391 00000100:00100000:3.0:1746155646.838071:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:32508:x1830976126130304:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155646.838082:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155646.838094:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012de32e00/0x844e5faceb5f8a84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18987 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.838119:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 37 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.838125:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155646.838127:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155646.838129:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012de32e00/0x844e5faceb5f8a84 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18987 expref: 28 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.838149:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 37 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.838158:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 37 pid: 19959 timeout: 875 lvb_type: 0 00000100:00100000:3.0:1746155646.838167:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125433344:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155646.838225:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155646.841259:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.841287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.841730:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126130560 00000100:00100000:0.0:1746155646.841733:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155646.841737:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126130560 00000100:00100000:0.0:1746155646.841745:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126130816 00000100:00100000:0.0:1746155646.841748:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126130816 00002000:00100000:3.0:1746155646.841769:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2207744->3256319) req@ffff88009ca95c00 x1830976126130560/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155646.841769:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3256320->4194303) req@ffff88009ca94700 x1830976126130816/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.841778:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95c00 with x1830976126130560 ext(2207744->3256319) 00002000:00100000:0.0:1746155646.841778:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94700 with x1830976126130816 ext(3256320->4194303) 00010000:00010000:3.0:1746155646.841785:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 39 pid: 19959 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746155646.841785:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 39 pid: 19959 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746155646.841796:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 39 pid: 19959 timeout: 875 lvb_type: 0 00010000:00010000:0.0:1746155646.841798:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 39 pid: 19959 timeout: 875 lvb_type: 0 00002000:00010000:3.0:1746155646.841803:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca95c00 00002000:00010000:0.0:1746155646.841804:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca94700 00000100:00100000:3.0:1746155646.841828:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126131072 00000100:00100000:3.0:1746155646.841830:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126131072 00002000:00100000:3.0:1746155646.841841:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009ca95880 x1830976126131072/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.841848:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95880 with x1830976126131072 ext(2097152->3145727) 00002000:00010000:3.0:1746155646.841851:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca95880 00000100:00100000:0.0:1746155646.841961:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1451 00000100:00100000:0.0:1746155646.841966:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976126130560:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155646.842411:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1452 00000100:00100000:1.0:1746155646.842418:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+39:1961:x1830976126130816:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155646.842560:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8259 00000100:00100000:2.0:1746155646.842567:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126131072:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155646.843276:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.843297:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126131200 00000100:00100000:0.0:1746155646.843301:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126131200 00002000:00100000:0.0:1746155646.843318:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009ca94e00 x1830976126131200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155646.843325:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94e00 with x1830976126131200 ext(3145728->4194303) 00002000:00010000:0.0:1746155646.843329:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca94e00 00000100:00100000:0.0:1746155646.843342:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8260 00000100:00100000:0.0:1746155646.843347:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976126131200:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155646.843443:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.843456:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126131456 00000100:00100000:1.0:1746155646.843459:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126131456 00002000:00100000:1.0:1746155646.843472:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->2207743) req@ffff88009fedb480 x1830976126131456/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.843479:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fedb480 with x1830976126131456 ext(2097152->2207743) 00010000:00010000:1.0:1746155646.843484:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 42 pid: 19959 timeout: 875 lvb_type: 0 00010000:00010000:1.0:1746155646.843493:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 42 pid: 19959 timeout: 875 lvb_type: 0 00002000:00010000:1.0:1746155646.843498:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fedb480 00000100:00100000:2.0:1746155646.843519:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc52300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125433344:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155646.843522:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1453 00000100:00100000:1.0:1746155646.843527:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976126131456:12345-192.168.202.51@tcp:4:cat.0 00010000:00010000:2.0:1746155646.843537:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012de32e00/0x844e5faceb5f8a84 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18987 expref: 28 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.843548:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012de32e00, rc 0) 00000100:00100000:2.0:1746155646.843570:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:32508:x1830976126130304:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5499us (5614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.843576:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17391 00000100:00100000:3.0:1746155646.851804:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1960:x1830976126131456:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8267us (8352us total) trans 17179874374 rc 0/0 00000100:00100000:3.0:1746155646.851818:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1453 00002000:00100000:3.0:1746155646.851827:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->2207743) req@ffff88009fedb480 x1830976126131456/t17179874374(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/448 e 0 to 0 dl 1746155657 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155646.851836:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fedb480 with x1830976126131456 ext(2097152->2207743) 00010000:00010000:3.0:1746155646.851843:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 44 pid: 19959 timeout: 875 lvb_type: 0 00010000:00010000:3.0:1746155646.851855:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 44 pid: 19959 timeout: 876 lvb_type: 0 00002000:00010000:3.0:1746155646.851861:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fedb480 00000100:00100000:0.0:1746155646.853152:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976126130560:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11181us (11893us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155646.853161:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1451 00002000:00100000:0.0:1746155646.853169:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (2207744->3256319) req@ffff88009ca95c00 x1830976126130560/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155646.853176:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95c00 with x1830976126130560 ext(2207744->3256319) 00010000:00010000:0.0:1746155646.853184:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 42 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155646.853196:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 42 pid: 19959 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746155646.853203:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca95c00 00000100:00100000:1.0:1746155646.858891:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976126130816:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16466us (17594us total) trans 0 rc 937984/937984 00000100:00100000:1.0:1746155646.858901:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1452 00002000:00100000:1.0:1746155646.858912:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3256320->4194303) req@ffff88009ca94700 x1830976126130816/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:H/200/0 rc 937984/937984 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.858920:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94700 with x1830976126130816 ext(3256320->4194303) 00010000:00010000:1.0:1746155646.858928:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 40 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155646.858940:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 40 pid: 19959 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746155646.858946:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ca94700 00000100:00100000:2.0:1746155646.865704:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976126131072:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23130us (23964us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155646.865714:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8259 00002000:00100000:2.0:1746155646.865723:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009ca95880 x1830976126131072/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155646.865730:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95880 with x1830976126131072 ext(2097152->3145727) 00002000:00010000:2.0:1746155646.865735:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca95880 00000100:00100000:0.0:1746155646.869255:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.870900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.871105:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126131200:12345-192.168.202.51@tcp:3:cat.0 Request processed in 27755us (27968us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155646.871115:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8260 00002000:00100000:1.0:1746155646.871124:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009ca94e00 x1830976126131200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.871132:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94e00 with x1830976126131200 ext(3145728->4194303) 00002000:00010000:1.0:1746155646.871137:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca94e00 00000100:00100000:3.0:1746155646.871221:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126131712 00000100:00100000:3.0:1746155646.871228:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126131712 00000100:00100000:3.0:1746155646.871259:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17392 00000100:00100000:3.0:1746155646.871266:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:32507:x1830976126131712:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155646.871282:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155646.871297:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012de32c00/0x844e5faceb5f8a8b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1898e expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.871321:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155646.871323:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155646.871326:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012de32c00/0x844e5faceb5f8a8b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1898e expref: 41 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.871337:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012de32c00/0x844e5faceb5f8a8b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1898e expref: 41 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155646.871767:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012de32c00, rc 0) 00000100:00100000:3.0:1746155646.871790:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:32507:x1830976126131712:12345-192.168.202.51@tcp:101:cat.0 Request processed in 525us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155646.871796:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17392 00000100:00100000:2.0:1746155646.872097:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126131584 00000100:00100000:2.0:1746155646.872102:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126131584 00010000:00010000:2.0:1746155646.872119:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 41 pid: 19959 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155646.872139:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8920 00000100:00100000:2.0:1746155646.872144:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1963:x1830976126131584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155646.872159:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155646.872174:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 41 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155646.872183:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 41 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155646.872200:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f023800/0x844e5faceb5f8a76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2207743) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18979 expref: 41 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155646.872212:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.872214:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.872219:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012de32e00/0x844e5faceb5f8a84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18987 expref: 27 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.872225:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012de32e00/0x844e5faceb5f8a84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18987 expref: 27 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.872231:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.872232:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.872235:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012de32c00/0x844e5faceb5f8a8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1898e expref: 40 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.872246:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012de32c00/0x844e5faceb5f8a8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1898e expref: 40 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.872270:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012de32c00/0x844e5faceb5f8a8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1898e expref: 40 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155646.872280:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125433472:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155646.872328:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012de32e00/0x844e5faceb5f8a84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18987 expref: 27 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155646.872336:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125433600:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155646.872353:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155646.874890:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125433472:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155646.874901:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125433600:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155646.874915:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155646.874956:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1963:x1830976126131584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2810us (5706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.874963:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8920 00000100:00100000:0.0:1746155646.876311:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.876354:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126131968 00000100:00100000:1.0:1746155646.876361:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126131968 00002000:00100000:1.0:1746155646.876395:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012cdef480 x1830976126131968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.876409:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdef480 with x1830976126131968 ext(3145728->4194303) 00002000:00010000:1.0:1746155646.876414:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdef480 00000100:00100000:1.0:1746155646.877307:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8261 00000100:00100000:1.0:1746155646.877314:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976126131968:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155646.881570:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.881602:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.881619:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.881636:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126132224 00000100:00100000:0.0:1746155646.881643:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126132224 00002000:00100000:0.0:1746155646.881674:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012cded500 x1830976126132224/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155646.881682:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded500 with x1830976126132224 ext(2097152->3145727) 00002000:00010000:0.0:1746155646.881686:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cded500 00000100:00100000:0.0:1746155646.881698:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126132352 00000100:00100000:0.0:1746155646.881701:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126132352 00002000:00100000:0.0:1746155646.881709:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009b882680 x1830976126132352/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155646.881714:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882680 with x1830976126132352 ext(3145728->4194303) 00002000:00010000:0.0:1746155646.881717:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b882680 00000100:00100000:2.0:1746155646.882369:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.883659:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126132736 00000100:00100000:1.0:1746155646.883665:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126132736 00000100:00100000:0.0:1746155646.883685:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126132864 00000100:00100000:0.0:1746155646.883688:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126132864 00002000:00100000:1.0:1746155646.883692:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009b881880 x1830976126132736/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155646.883699:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800936f5180 x1830976126132864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.883700:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881880 with x1830976126132736 ext(2097152->3145727) 00002000:00010000:1.0:1746155646.883704:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b881880 00002000:00100000:0.0:1746155646.883709:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5180 with x1830976126132864 ext(3145728->4194303) 00002000:00010000:0.0:1746155646.883711:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f5180 00000100:00100000:1.0:1746155646.883719:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8262 00000100:00100000:0.0:1746155646.883722:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8263 00000100:00100000:1.0:1746155646.883724:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976126132224:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155646.883726:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1961:x1830976126132352:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155646.884392:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8264 00000100:00100000:1.0:1746155646.884398:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126132736:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155646.886849:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8265 00000100:00100000:2.0:1746155646.886862:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976126132864:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155646.890235:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976126131968:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12914us (13919us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155646.890246:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8261 00002000:00100000:1.0:1746155646.890257:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012cdef480 x1830976126131968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.890265:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdef480 with x1830976126131968 ext(3145728->4194303) 00002000:00010000:1.0:1746155646.890270:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdef480 00000100:00100000:2.0:1746155646.895577:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1961:x1830976126132352:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11841us (13965us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155646.895589:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8263 00002000:00100000:2.0:1746155646.895599:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009b882680 x1830976126132352/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155646.895609:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882680 with x1830976126132352 ext(3145728->4194303) 00002000:00010000:2.0:1746155646.895613:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b882680 00000100:00100000:1.0:1746155646.897932:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976126132736:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13528us (16305us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155646.897942:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8264 00002000:00100000:1.0:1746155646.897951:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009b881880 x1830976126132736/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.897959:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881880 with x1830976126132736 ext(2097152->3145727) 00002000:00010000:1.0:1746155646.897964:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b881880 00000100:00100000:0.0:1746155646.898739:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.898778:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126133248 00000100:00100000:1.0:1746155646.898784:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126133248 00002000:00100000:1.0:1746155646.898811:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009b882a00 x1830976126133248/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.898818:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882a00 with x1830976126133248 ext(4194304->5083135) 00002000:00010000:1.0:1746155646.898821:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b882a00 00000100:00100000:1.0:1746155646.898844:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8266 00000100:00100000:1.0:1746155646.898849:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976126133248:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155646.899356:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3296:1830976125433728:0@lo:400:kworker.0 00000100:00100000:3.0:1746155646.899393:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155646.899435:0:14231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125433728 00000100:00100000:3.0:1746155646.899438:0:14231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125433728 00000100:00100000:3.0:1746155646.899465:0:14231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1746155646.899470:0:14231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3296:x1830976125433728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746155646.899496:0:14231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3296:x1830976125433728:12345-0@lo:400:kworker.0 Request processed in 26us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155646.899518:0:14231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1746155646.899549:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3296:1830976125433728:0@lo:400:kworker.0 00000100:00100000:2.0:1746155646.899635:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1830976125433984:0@lo:400:kworker.0 00000100:00100000:2.0:1746155646.899658:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155646.899674:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746155646.899678:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1830976125433856:0@lo:400:kworker.0 00000100:00100000:2.0:1746155646.899692:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155646.899703:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830976125434368:0@lo:400:kworker.0 00000100:00100000:2.0:1746155646.899717:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155646.899735:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125433984 00000100:00100000:2.0:1746155646.899738:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125433984 00000100:00100000:2.0:1746155646.899769:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125433856 00000100:00100000:2.0:1746155646.899772:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125433856 00000100:00100000:2.0:1746155646.899782:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125434368 00000100:00100000:2.0:1746155646.899784:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125434368 00000100:00100000:2.0:1746155646.899793:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1746155646.899797:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830976125433984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155646.899809:0:19870:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1746155646.899814:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125434112:0@lo:400:kworker.0 00000100:00100000:1.0:1746155646.899816:0:19870:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830976125433856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746155646.899821:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830976125433984:12345-0@lo:400:kworker.0 Request processed in 23us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.899826:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1746155646.899838:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1746155646.899840:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155646.899845:0:19870:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1830976125433856:12345-0@lo:400:kworker.0 Request processed in 30us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155646.899850:0:19870:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1746155646.899858:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746155646.899862:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125434240:0@lo:400:kworker.0 00000100:00100000:1.0:1746155646.899882:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125434112 00000100:00100000:1.0:1746155646.899886:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125434112 00000100:00100000:0.0:1746155646.899892:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155646.899905:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125434240 00000100:00100000:1.0:1746155646.899907:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125434240 00000100:00100000:0.0:1746155646.899915:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00080000:3.0:1746155646.899919:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155646.899920:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1746155646.899921:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3295:x1830976125434112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155646.899925:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3295:x1830976125434240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746155646.899946:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+61:3295:x1830976125434112:12345-0@lo:400:kworker.0 Request processed in 26us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155646.899951:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1746155646.899953:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+59:3295:x1830976125434240:12345-0@lo:400:kworker.0 Request processed in 28us (60us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155646.899957:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1746155646.899972:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125434240:0@lo:400:kworker.0 00000100:00100000:0.0:1746155646.899979:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125434112:0@lo:400:kworker.0 00000100:00100000:1.0:1746155646.900480:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1960:x1830976126132224:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16754us (18915us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155646.900487:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8262 00002000:00100000:1.0:1746155646.900493:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012cded500 x1830976126132224/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.900513:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cded500 with x1830976126132224 ext(2097152->3145727) 00002000:00010000:1.0:1746155646.900517:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cded500 00000100:00100000:2.0:1746155646.900891:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830976125434368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746155646.900918:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1830976125434368:12345-0@lo:400:kworker.0 Request processed in 1076us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.900924:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1746155646.900951:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1830976125433856:0@lo:400:kworker.0 00000100:00100000:2.0:1746155646.900965:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1830976125434368:0@lo:400:kworker.0 00000100:00100000:2.0:1746155646.900971:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1830976125433984:0@lo:400:kworker.0 00000100:00100000:2.0:1746155646.903183:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976126132864:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16319us (20807us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155646.903194:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8265 00002000:00100000:2.0:1746155646.903203:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800936f5180 x1830976126132864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155646.903211:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5180 with x1830976126132864 ext(3145728->4194303) 00002000:00010000:2.0:1746155646.903216:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f5180 00000100:00100000:1.0:1746155646.904734:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1960:x1830976126133248:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5879us (5991us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155646.904744:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8266 00002000:00100000:1.0:1746155646.904752:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009b882a00 x1830976126133248/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.904760:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882a00 with x1830976126133248 ext(4194304->5083135) 00002000:00010000:1.0:1746155646.904764:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b882a00 00000100:00100000:0.0:1746155646.910585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.910676:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126133504 00000100:00100000:1.0:1746155646.910684:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126133504 00002000:00100000:1.0:1746155646.910724:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009b883480 x1830976126133504/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.910732:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883480 with x1830976126133504 ext(4194304->5083135) 00002000:00010000:1.0:1746155646.910737:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b883480 00000100:00100000:1.0:1746155646.910834:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8267 00000100:00100000:1.0:1746155646.910842:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1960:x1830976126133504:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155646.916228:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1960:x1830976126133504:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5378us (5641us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155646.916239:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8267 00002000:00100000:1.0:1746155646.916248:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009b883480 x1830976126133504/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/440 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.916257:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883480 with x1830976126133504 ext(4194304->5083135) 00002000:00010000:1.0:1746155646.916263:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b883480 00000100:00100000:0.0:1746155646.919177:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.919232:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126133760 00000100:00100000:1.0:1746155646.919239:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126133760 00000100:00100000:3.0:1746155646.920054:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.920112:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11208 00000100:00100000:1.0:1746155646.920128:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32512:x1830976126133760:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155646.920147:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155646.920161:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88ba00/0x844e5faceb5f8a92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18995 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.920238:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88bc00/0x844e5faceb5f8a99 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920248:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88bc00/0x844e5faceb5f8a99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920258:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88bc00/0x844e5faceb5f8a99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920267:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a000/0x844e5faceb5f8aa0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920271:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a000/0x844e5faceb5f8aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920276:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a000/0x844e5faceb5f8aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920353:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a200/0x844e5faceb5f8aa7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920359:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a200/0x844e5faceb5f8aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920364:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a200/0x844e5faceb5f8aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155646.920370:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155646.920425:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88bc00/0x844e5faceb5f8a99 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920430:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88bc00/0x844e5faceb5f8a99 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920434:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88bc00/0x844e5faceb5f8a99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920438:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d88bc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155646.920441:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88bc00/0x844e5faceb5f8a99 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920445:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88bc00/0x844e5faceb5f8a99 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920453:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155646.920455:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155646.920457:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88bc00/0x844e5faceb5f8a99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920465:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88bc00/0x844e5faceb5f8a99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920491:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a000/0x844e5faceb5f8aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920495:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a000/0x844e5faceb5f8aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920499:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a000/0x844e5faceb5f8aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920514:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d88a000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155646.920516:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a000/0x844e5faceb5f8aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920520:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a000/0x844e5faceb5f8aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920525:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5171400) 00010000:00010000:1.0:1746155646.920526:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155646.920528:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a000/0x844e5faceb5f8aa0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920532:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a000/0x844e5faceb5f8aa0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.920557:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88ba00/0x844e5faceb5f8a92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18995 expref: 291 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.920566:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a200/0x844e5faceb5f8aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18995 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.920576:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155646.920578:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155646.920580:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d88a200, rc 0) 00000100:00100000:1.0:1746155646.920616:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32512:x1830976126133760:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 497us (1446us total) trans 8589945385 rc 0/0 00000100:00100000:1.0:1746155646.920621:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11208 00000100:00100000:2.0:1746155646.920765:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126134016 00000100:00100000:2.0:1746155646.920770:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126134016 00000100:00100000:2.0:1746155646.920793:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4774 00000100:00100000:2.0:1746155646.920798:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32508:x1830976126134016:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155646.920896:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32508:x1830976126134016:12345-192.168.202.51@tcp:35:cat.0 Request processed in 97us (842us total) trans 8589945386 rc 0/0 00000100:00100000:2.0:1746155646.920902:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4774 00000100:00100000:0.0:1746155646.975776:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.975943:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126134272 00000100:00100000:1.0:1746155646.975952:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126134272 00000100:00100000:1.0:1746155646.976023:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11209 00000100:00100000:1.0:1746155646.976033:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32517:x1830976126134272:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155646.976053:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155646.976069:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a400/0x844e5faceb5f8ab5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1899c expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.976171:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a800/0x844e5faceb5f8abc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976184:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a800/0x844e5faceb5f8abc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976194:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a800/0x844e5faceb5f8abc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976205:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a600/0x844e5faceb5f8ac3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976211:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a600/0x844e5faceb5f8ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976219:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a600/0x844e5faceb5f8ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976303:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88b600/0x844e5faceb5f8aca lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976309:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88b600/0x844e5faceb5f8aca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976315:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88b600/0x844e5faceb5f8aca lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155646.976321:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155646.976381:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a800/0x844e5faceb5f8abc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976386:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a800/0x844e5faceb5f8abc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976390:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a800/0x844e5faceb5f8abc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976395:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d88a800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155646.976398:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a800/0x844e5faceb5f8abc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976403:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a800/0x844e5faceb5f8abc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976411:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155646.976413:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155646.976416:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a800/0x844e5faceb5f8abc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976423:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a800/0x844e5faceb5f8abc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976447:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a600/0x844e5faceb5f8ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976451:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a600/0x844e5faceb5f8ac3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976455:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a600/0x844e5faceb5f8ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976459:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d88a600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155646.976461:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a600/0x844e5faceb5f8ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976465:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a600/0x844e5faceb5f8ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976471:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5171a00) 00010000:00010000:1.0:1746155646.976473:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155646.976475:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a600/0x844e5faceb5f8ac3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976478:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a600/0x844e5faceb5f8ac3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155646.976531:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a400/0x844e5faceb5f8ab5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1899c expref: 13 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.976542:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88b600/0x844e5faceb5f8aca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1899c expref: 12 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.976551:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155646.976553:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155646.976555:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d88b600, rc 0) 00000100:00100000:1.0:1746155646.976604:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32517:x1830976126134272:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 574us (836us total) trans 8589945387 rc 0/0 00000100:00100000:1.0:1746155646.976610:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11209 00000100:00100000:0.0:1746155646.982701:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.982823:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126134400 00000100:00100000:1.0:1746155646.982833:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126134400 00000100:00100000:1.0:1746155646.983239:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17393 00000100:00100000:1.0:1746155646.983249:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32517:x1830976126134400:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155646.983268:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155646.983283:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189a3 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.983312:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f24d000/0x844e5faceb5f8934 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188c3 expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155646.983320:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00dc00/0x844e5faceb5f8a30 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18933 expref: 24 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155646.983326:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f89f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18902 expref: 21 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155646.983332:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.983334:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155646.983339:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1167360->1306623] (req 1167360->1306623) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.983368:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f89f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18902 expref: 21 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155646.983379:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f89f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18902 expref: 21 pid: 19959 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155646.983391:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125434496:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155646.984886:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00dc00/0x844e5faceb5f8a30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18933 expref: 24 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155646.984898:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b00dc00/0x844e5faceb5f8a30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18933 expref: 24 pid: 10591 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155646.984909:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125434624:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155646.985666:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f24d000/0x844e5faceb5f8934 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188c3 expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155646.985676:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f24d000/0x844e5faceb5f8934 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188c3 expref: 11 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155646.985686:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125434752:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155646.986198:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155646.987841:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125434496:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155646.987849:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125434624:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155646.987853:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125434752:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155646.987884:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1167360->1306623] (req 1167360->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 21 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155646.987898:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d88b400, rc 0) 00000100:00100000:1.0:1746155646.987938:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:32517:x1830976126134400:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4690us (5245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155646.987945:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17393 00000100:00100000:0.0:1746155646.988825:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155646.988867:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.990055:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126134528 00000100:00100000:2.0:1746155646.990232:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126134528 00010000:00010000:2.0:1746155646.990265:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00dc00/0x844e5faceb5f8a30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18933 expref: 25 pid: 10591 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155646.990305:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126134656 00000100:00100000:2.0:1746155646.990308:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126134656 00010000:00010000:2.0:1746155646.990319:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24d000/0x844e5faceb5f8934 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188c3 expref: 12 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155646.990338:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8921 00000100:00100000:2.0:1746155646.990344:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126134528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155646.990356:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155646.990375:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b00dc00/0x844e5faceb5f8a30 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18933 expref: 25 pid: 10591 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155646.990384:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b00dc00/0x844e5faceb5f8a30 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18933 expref: 25 pid: 10591 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155646.990404:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8922 00000100:00100000:0.0:1746155646.990411:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976126134656:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155646.990418:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155646.990432:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b00dc00/0x844e5faceb5f8a30 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18933 expref: 25 pid: 10591 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155646.990438:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f24d000/0x844e5faceb5f8934 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188c3 expref: 12 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155646.990446:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f24d000/0x844e5faceb5f8934 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188c3 expref: 12 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155646.990459:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f24d000/0x844e5faceb5f8934 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188c3 expref: 12 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155646.990461:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155646.990470:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155646.990495:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976126134528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 151us (1671us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155646.990498:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126134656:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.990518:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8921 00000100:00100000:0.0:1746155646.990522:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8922 00000100:00100000:0.0:1746155646.991462:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155646.991529:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126134784 00000100:00100000:2.0:1746155646.991533:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126134784 00010000:00010000:2.0:1746155646.991548:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f89f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18902 expref: 21 pid: 19959 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155646.991577:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8923 00000100:00100000:2.0:1746155646.991583:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126134784:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155646.991591:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155646.991604:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f89f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18902 expref: 21 pid: 19959 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155646.991613:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f89f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18902 expref: 21 pid: 19959 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155646.991626:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ee00/0x844e5faceb5f89f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18902 expref: 21 pid: 19959 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155646.991634:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.991636:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155646.991641:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.991647:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155646.991670:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 20 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155646.991679:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125434880:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155646.991751:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155646.993561:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125434880:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155646.993576:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155646.993604:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126134784:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2020us (2143us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155646.993612:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8923 00000100:00100000:0.0:1746155646.995773:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155646.995970:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126135040 00000100:00100000:1.0:1746155646.995977:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126135040 00002000:00100000:1.0:1746155646.996013:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1167360->1171455) req@ffff88009b883b80 x1830976126135040/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/0 e 0 to 0 dl 1746155657 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.996021:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883b80 with x1830976126135040 ext(1167360->1171455) 00002000:00010000:1.0:1746155646.996025:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b883b80 00000100:00100000:1.0:1746155646.996056:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8268 00000100:00100000:1.0:1746155646.996063:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976126135040:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155646.996207:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976126135040:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 144us (440us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155646.996214:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8268 00002000:00100000:1.0:1746155646.996219:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1167360->1171455) req@ffff88009b883b80 x1830976126135040/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:717/0 lens 488/4536 e 0 to 0 dl 1746155657 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155646.996226:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883b80 with x1830976126135040 ext(1167360->1171455) 00002000:00010000:1.0:1746155646.996229:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b883b80 00000100:00100000:0.0:1746155647.001636:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.001729:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126135296 00000100:00100000:2.0:1746155647.001736:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126135296 00002000:00100000:2.0:1746155647.001768:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1302528->1306623) req@ffff88009b882300 x1830976126135296/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.001776:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882300 with x1830976126135296 ext(1302528->1306623) 00002000:00010000:2.0:1746155647.001784:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b882300 00000100:00100000:2.0:1746155647.001915:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8269 00000100:00100000:2.0:1746155647.001922:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126135296:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155647.002080:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126135296:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 158us (450us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155647.002087:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8269 00002000:00100000:2.0:1746155647.002092:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e1:0x0] (1302528->1306623) req@ffff88009b882300 x1830976126135296/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/4536 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.002098:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b882300 with x1830976126135296 ext(1302528->1306623) 00002000:00010000:2.0:1746155647.002101:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b882300 00000100:00100000:0.0:1746155647.003428:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.003787:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126135552 00000100:00100000:2.0:1746155647.003792:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126135552 00000100:00100000:2.0:1746155647.003818:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4775 00000100:00100000:2.0:1746155647.003823:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32517:x1830976126135552:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155647.003977:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32517:x1830976126135552:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 152us (550us total) trans 8589945388 rc 0/0 00000100:00100000:2.0:1746155647.003983:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4775 00000100:00100000:0.0:1746155647.034717:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.034864:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126135680 00000100:00100000:1.0:1746155647.034883:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126135680 00000100:00100000:1.0:1746155647.034932:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17394 00000100:00100000:1.0:1746155647.034939:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:32512:x1830976126135680:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155647.034954:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.034967:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189aa expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.034993:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f26ea00/0x844e5faceb5f8a68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1896b expref: 41 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.035001:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0x844e5faceb5f8a6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18972 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.035007:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.035009:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.035012:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1503232->2097151] (req 1503232->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 41 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.035037:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0x844e5faceb5f8a6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18972 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.035048:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0x844e5faceb5f8a6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18972 expref: 27 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.035057:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125435008:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.035148:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f26ea00/0x844e5faceb5f8a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1896b expref: 41 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.035157:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f26ea00/0x844e5faceb5f8a68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1896b expref: 41 pid: 19959 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.035165:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125435136:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.035185:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.044819:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.044860:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.044890:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126135808 00000100:00100000:0.0:1746155647.044896:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126135808 00010000:00010000:0.0:1746155647.044925:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0x844e5faceb5f8a6f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18972 expref: 28 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.044964:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126135936 00000100:00100000:0.0:1746155647.044966:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126135936 00010000:00010000:0.0:1746155647.044974:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26ea00/0x844e5faceb5f8a68 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1896b expref: 42 pid: 19959 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.044987:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8924 00000100:00100000:0.0:1746155647.044994:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1963:x1830976126135808:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155647.045004:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155647.045023:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0x844e5faceb5f8a6f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18972 expref: 28 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.045033:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0x844e5faceb5f8a6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18972 expref: 28 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.045139:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8925 00000100:00100000:2.0:1746155647.045146:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976126135936:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.045153:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.045162:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f26ea00/0x844e5faceb5f8a68 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1896b expref: 42 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.045169:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f26ea00/0x844e5faceb5f8a68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1896b expref: 42 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.045190:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155647.045226:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976126135936:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 80us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.045231:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8925 00000100:00100000:1.0:1746155647.045544:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125435008:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.045556:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f26ea00/0x844e5faceb5f8a68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1896b expref: 41 pid: 19959 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.045570:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125435136:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.045705:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1503232->2097151] (req 1503232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 40 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.045716:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d88ae00, rc 0) 00000100:00100000:1.0:1746155647.045754:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:32512:x1830976126135680:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 10815us (11044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.045759:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17394 00010000:00010000:0.0:1746155647.046083:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff96a00/0x844e5faceb5f8a6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18972 expref: 28 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.046097:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.046098:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.046104:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 39 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.046111:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 39 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.046145:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 39 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.046160:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125435264:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155647.046205:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c9a240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155647.047094:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125435264:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155647.047104:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155647.047124:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1963:x1830976126135808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2130us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.047129:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8924 00000100:00100000:0.0:1746155647.047919:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.047976:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126136192 00000100:00100000:2.0:1746155647.047981:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126136192 00002000:00100000:2.0:1746155647.048009:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1503232->1507327) req@ffff88009366ce00 x1830976126136192/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.048016:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366ce00 with x1830976126136192 ext(1503232->1507327) 00002000:00010000:2.0:1746155647.048020:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366ce00 00000100:00100000:2.0:1746155647.048046:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8270 00000100:00100000:2.0:1746155647.048052:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1962:x1830976126136192:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155647.048163:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1962:x1830976126136192:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 111us (245us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155647.048169:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8270 00002000:00100000:2.0:1746155647.048174:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1503232->1507327) req@ffff88009366ce00 x1830976126136192/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/4536 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.048181:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366ce00 with x1830976126136192 ext(1503232->1507327) 00002000:00010000:2.0:1746155647.048183:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366ce00 00000100:00100000:0.0:1746155647.052268:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.053241:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126136448 00000100:00100000:2.0:1746155647.053249:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126136448 00000100:00100000:2.0:1746155647.053288:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11210 00000100:00100000:2.0:1746155647.053296:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32521:x1830976126136448:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.053314:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.053328:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8200/0x844e5faceb5f8ae6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189b1 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.053402:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8aed lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155647.053415:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8aed lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155647.053424:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8aed lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:2.0:1746155647.053432:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155647.053539:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8200/0x844e5faceb5f8ae6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b1 expref: 16 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.053559:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8aed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b1 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.053566:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.053568:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746155647.053571:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd8000, rc 0) 00000100:00100000:2.0:1746155647.053611:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32521:x1830976126136448:12345-192.168.202.51@tcp:101:cat.0 Request processed in 316us (1350us total) trans 8589945389 rc 0/0 00000100:00100000:2.0:1746155647.053616:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11210 00000100:00100000:0.0:1746155647.054369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.054524:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126136576 00000100:00100000:1.0:1746155647.054528:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126136576 00000100:00100000:1.0:1746155647.054555:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17395 00000100:00100000:1.0:1746155647.054559:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:32512:x1830976126136576:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155647.054568:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.054576:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189b8 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.054592:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012de32e00/0x844e5faceb5f8a84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18987 expref: 26 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.054598:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012de32c00/0x844e5faceb5f8a8b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1898e expref: 41 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.054604:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.054606:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.054608:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->2424831] (req 2097152->2424831) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 41 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.054631:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012de32c00/0x844e5faceb5f8a8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1898e expref: 41 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.054640:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012de32c00/0x844e5faceb5f8a8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1898e expref: 41 pid: 19959 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.054655:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125435392:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.054717:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012de32e00/0x844e5faceb5f8a84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18987 expref: 26 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.054725:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012de32e00/0x844e5faceb5f8a84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18987 expref: 26 pid: 19959 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.054732:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125435520:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.054749:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.055598:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.055657:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126136704 00000100:00100000:2.0:1746155647.055661:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126136704 00000100:00100000:2.0:1746155647.055686:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17396 00000100:00100000:2.0:1746155647.055691:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976126136704:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.055699:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.055706:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdd9000/0x844e5faceb5f8b02 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189bf expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.055731:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125435648:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155647.055896:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155647.056122:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125435392:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.056130:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125435520:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.056144:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->2424831] (req 2097152->2424831) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 41 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.056154:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d88b800, rc 0) 00000100:00100000:1.0:1746155647.056183:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:32512:x1830976126136576:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 1623us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.056189:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17395 00002000:00010000:2.0:1746155647.057540:0:8438:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime: 1746155645 -> 1746155647 00000100:00100000:2.0:1746155647.057558:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125435648:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155647.057575:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdd9000/0x844e5faceb5f8b02 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189bf expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.057585:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdd9000/0x844e5faceb5f8b02 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189bf expref: 28 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.057595:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd9000, rc 0) 00000100:00100000:2.0:1746155647.057616:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976126136704:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1925us (2020us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155647.057622:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17396 00000100:00100000:0.0:1746155647.059638:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.059836:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126136832 00000100:00100000:2.0:1746155647.059842:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126136832 00010000:00010000:2.0:1746155647.059877:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012de32c00/0x844e5faceb5f8a8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1898e expref: 41 pid: 19959 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.059913:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8926 00000100:00100000:2.0:1746155647.059920:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1961:x1830976126136832:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.059930:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.059946:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012de32c00/0x844e5faceb5f8a8b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1898e expref: 41 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.059956:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012de32c00/0x844e5faceb5f8a8b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1898e expref: 41 pid: 19959 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.059969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155647.059973:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012de32c00/0x844e5faceb5f8a8b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1898e expref: 41 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.059986:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.060033:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126136960 00000100:00100000:3.0:1746155647.060037:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126136960 00010000:00010000:3.0:1746155647.060051:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012de32e00/0x844e5faceb5f8a84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18987 expref: 27 pid: 19959 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.060302:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976126136832:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 381us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.060307:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8926 00000100:00100000:2.0:1746155647.060323:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8927 00000100:00100000:2.0:1746155647.060328:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976126136960:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.060333:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.060341:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012de32e00/0x844e5faceb5f8a84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18987 expref: 27 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.060348:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012de32e00/0x844e5faceb5f8a84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18987 expref: 27 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.060358:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012de32e00/0x844e5faceb5f8a84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18987 expref: 27 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.060366:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.060367:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.060373:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 39 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.060379:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 39 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.060401:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 39 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.060411:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125435776:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155647.060463:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155647.061719:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125435776:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155647.061734:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155647.061754:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1961:x1830976126136960:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1426us (1785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.061760:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8927 00000100:00100000:0.0:1746155647.061917:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.061948:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.062016:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126137472 00000100:00100000:1.0:1746155647.062020:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126137472 00002000:00100000:1.0:1746155647.062045:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009366c380 x1830976126137472/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 504/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.062053:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366c380 with x1830976126137472 ext(1048576->2097151) 00002000:00010000:1.0:1746155647.062057:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366c380 00000100:00100000:1.0:1746155647.062067:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126137344 00000100:00100000:1.0:1746155647.062069:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126137344 00002000:00100000:1.0:1746155647.062078:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009366dc00 x1830976126137344/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.062083:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366dc00 with x1830976126137344 ext(0->1048575) 00002000:00010000:1.0:1746155647.062086:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366dc00 00000100:00100000:1.0:1746155647.062094:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8271 00000100:00100000:1.0:1746155647.062100:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976126137472:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155647.062127:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8272 00000100:00100000:3.0:1746155647.062135:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1963:x1830976126137344:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155647.064877:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.064900:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126137728 00000100:00100000:0.0:1746155647.064907:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126137728 00002000:00100000:0.0:1746155647.064939:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2420736->2424831) req@ffff88009366d180 x1830976126137728/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.064947:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d180 with x1830976126137728 ext(2420736->2424831) 00002000:00010000:0.0:1746155647.064954:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366d180 00000100:00100000:0.0:1746155647.064986:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8273 00000100:00100000:0.0:1746155647.064993:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976126137728:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155647.065105:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976126137728:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 112us (243us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155647.065110:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8273 00002000:00100000:0.0:1746155647.065115:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2420736->2424831) req@ffff88009366d180 x1830976126137728/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/4536 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.065126:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d180 with x1830976126137728 ext(2420736->2424831) 00002000:00010000:0.0:1746155647.065128:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366d180 00000100:00100000:1.0:1746155647.070651:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976126137472:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8542us (8726us total) trans 0 rc 909312/909312 00000100:00100000:1.0:1746155647.070662:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8271 00002000:00100000:1.0:1746155647.070672:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009366c380 x1830976126137472/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 504/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 909312/909312 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.070680:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366c380 with x1830976126137472 ext(1048576->2097151) 00002000:00010000:1.0:1746155647.070685:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366c380 00000100:00100000:3.0:1746155647.075558:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1963:x1830976126137344:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13417us (13601us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.075567:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8272 00002000:00100000:3.0:1746155647.075576:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009366dc00 x1830976126137344/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.075585:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366dc00 with x1830976126137344 ext(0->1048575) 00002000:00010000:3.0:1746155647.075589:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366dc00 00000100:00100000:0.0:1746155647.075864:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.076089:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126137984 00000100:00100000:1.0:1746155647.076095:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126137984 00000100:00100000:1.0:1746155647.076135:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4776 00000100:00100000:1.0:1746155647.076141:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32512:x1830976126137984:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155647.076289:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32512:x1830976126137984:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 147us (425us total) trans 8589945390 rc 0/0 00000100:00100000:1.0:1746155647.076294:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4776 00000100:00100000:0.0:1746155647.088943:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.089156:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126138112 00000100:00100000:2.0:1746155647.089163:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126138112 00000100:00100000:2.0:1746155647.089677:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17397 00000100:00100000:3.0:1746155647.089917:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:32521:x1830976126138112:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155647.089933:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.089948:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8b09 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189c6 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.089972:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 39 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.089978:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155647.089980:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155647.089983:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8b09 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189c6 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.090008:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 39 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.090018:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 39 pid: 4461 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.090028:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125435904:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155647.090096:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155647.092672:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125435904:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155647.092694:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8b09 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189c6 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.092709:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f023c00, rc 0) 00000100:00100000:3.0:1746155647.092767:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:32521:x1830976126138112:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3080us (3830us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.092774:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17397 00000100:00100000:0.0:1746155647.093184:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.093224:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126138240 00000100:00100000:3.0:1746155647.093229:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126138240 00002000:00100000:3.0:1746155647.093255:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1503232->2097151) req@ffff88012f1f0a80 x1830976126138240/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.093263:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0a80 with x1830976126138240 ext(1503232->2097151) 00010000:00010000:3.0:1746155647.093268:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 40 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.093279:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 40 pid: 4461 timeout: 876 lvb_type: 0 00002000:00010000:3.0:1746155647.093285:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1f0a80 00000100:00100000:3.0:1746155647.093311:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1454 00000100:00100000:3.0:1746155647.093318:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+40:1961:x1830976126138240:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:3.0:1746155647.101303:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976126138240:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 7977us (8110us total) trans 17179874375 rc 0/0 00000100:00100000:3.0:1746155647.101313:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1454 00002000:00100000:3.0:1746155647.101323:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1503232->2097151) req@ffff88012f1f0a80 x1830976126138240/t17179874375(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/448 e 0 to 0 dl 1746155658 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.101331:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0a80 with x1830976126138240 ext(1503232->2097151) 00010000:00010000:3.0:1746155647.101339:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 42 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.101350:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 42 pid: 4461 timeout: 876 lvb_type: 0 00002000:00010000:3.0:1746155647.101356:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1f0a80 00000100:00100000:0.0:1746155647.103268:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.104697:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126138368 00000100:00100000:2.0:1746155647.104705:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126138368 00010000:00010000:2.0:1746155647.104734:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 42 pid: 4461 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.104770:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8928 00000100:00100000:2.0:1746155647.104775:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976126138368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.104783:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.104798:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 42 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.104808:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 42 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.104824:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d88ae00/0x844e5faceb5f8adf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1503232->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189aa expref: 42 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.104849:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.104851:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.104856:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8b09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189c6 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.104867:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189c6 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.104903:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189c6 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.104918:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125436032:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155647.105001:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.110472:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.110577:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125436032:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155647.110593:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155647.110623:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1960:x1830976126138368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5848us (7360us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.110631:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8928 00000100:00100000:3.0:1746155647.110698:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126138624 00000100:00100000:3.0:1746155647.110703:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126138624 00002000:00100000:3.0:1746155647.110729:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012f1f2680 x1830976126138624/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.110737:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2680 with x1830976126138624 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.110740:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f2680 00000100:00100000:3.0:1746155647.110765:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8274 00000100:00100000:3.0:1746155647.110771:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976126138624:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155647.120592:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976126138624:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9812us (10119us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.120603:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8274 00002000:00100000:3.0:1746155647.120611:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012f1f2680 x1830976126138624/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.120619:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2680 with x1830976126138624 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.120623:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f2680 00000100:00100000:0.0:1746155647.124832:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.124927:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126138880 00000100:00100000:2.0:1746155647.124935:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126138880 00000100:00100000:2.0:1746155647.124979:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11211 00000100:00100000:2.0:1746155647.124986:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32524:x1830976126138880:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155647.125005:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.125019:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092872a00/0x844e5faceb5f8b10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189cd expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.125094:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155647.125106:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a200/0x844e5faceb5f8aa7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18995 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.125113:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88b600/0x844e5faceb5f8aca lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1899c expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.125117:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155647.125143:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88b600/0x844e5faceb5f8aca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1899c expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.125153:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88b600/0x844e5faceb5f8aca lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1899c expref: 16 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.125163:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125436160:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.125253:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a200/0x844e5faceb5f8aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18995 expref: 290 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.125259:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a200/0x844e5faceb5f8aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18995 expref: 290 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.125267:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125436288:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155647.125283:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.125954:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.126010:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126139008 00000100:00100000:3.0:1746155647.126014:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126139008 00000100:00100000:3.0:1746155647.126049:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17398 00000100:00100000:3.0:1746155647.126055:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:32521:x1830976126139008:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155647.126064:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.126073:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f023e00/0x844e5faceb5f8b1e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189d4 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.126090:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 40 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.126096:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155647.126098:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155647.126101:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f023e00/0x844e5faceb5f8b1e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189d4 expref: 28 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.126121:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 40 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.126128:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 40 pid: 4461 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.126136:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125436416:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155647.126183:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.127464:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.127486:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125436160:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155647.127495:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125436288:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.127499:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155647.127531:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155647.127559:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126139136 00000100:00100000:2.0:1746155647.127563:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126139136 00010000:00010000:2.0:1746155647.127580:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88b600/0x844e5faceb5f8aca lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1899c expref: 17 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.128003:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126139264 00000100:00100000:2.0:1746155647.128007:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126139264 00010000:00010000:2.0:1746155647.128018:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a200/0x844e5faceb5f8aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18995 expref: 291 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.128034:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8929 00000100:00100000:2.0:1746155647.128039:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976126139136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.128047:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.128052:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88b600/0x844e5faceb5f8aca lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1899c expref: 17 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.128061:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88b600/0x844e5faceb5f8aca lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1899c expref: 17 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.128075:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88b600/0x844e5faceb5f8aca lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1899c expref: 17 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.128091:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.128095:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155647.128101:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155647.128105:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8930 00010000:00010000:2.0:1746155647.128109:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155647.128113:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:1962:x1830976126139264:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155647.128119:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155647.128125:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a200/0x844e5faceb5f8aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18995 expref: 291 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.128134:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a200/0x844e5faceb5f8aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18995 expref: 291 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.128148:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1962:x1830976126139136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 108us (687us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155647.128151:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d88a200/0x844e5faceb5f8aa7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18995 expref: 291 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.128155:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8929 00010000:00010000:0.0:1746155647.128166:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155647.128169:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.128179:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.128185:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.128198:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155647.128204:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155647.128210:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155647.128214:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1962:x1830976126139264:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 102us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.128219:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8930 00000004:00200000:2.0:1746155647.128222:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155647.128323:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092872a00/0x844e5faceb5f8b10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189cd expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.128335:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189cd expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.128341:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.128343:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155647.128345:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092873600, rc 0) 00000100:00100000:2.0:1746155647.128379:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32524:x1830976126138880:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3394us (3555us total) trans 8589945391 rc 0/0 00000100:00100000:2.0:1746155647.128385:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11211 00000100:00100000:0.0:1746155647.131203:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.131350:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125436416:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155647.131372:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f023e00/0x844e5faceb5f8b1e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189d4 expref: 28 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.131386:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f023e00, rc 0) 00000100:00100000:3.0:1746155647.131431:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:32521:x1830976126139008:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5376us (5478us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.131439:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17398 00000100:00100000:2.0:1746155647.131841:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126139392 00000100:00100000:2.0:1746155647.131846:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126139392 00002000:00100000:2.0:1746155647.131884:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->2424831) req@ffff88012f1f0700 x1830976126139392/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.131892:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0700 with x1830976126139392 ext(2097152->2424831) 00010000:00010000:2.0:1746155647.131899:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 41 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.131909:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 41 pid: 4461 timeout: 876 lvb_type: 0 00002000:00010000:2.0:1746155647.131914:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1f0700 00000100:00100000:2.0:1746155647.131939:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1455 00000100:00100000:2.0:1746155647.131945:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1961:x1830976126139392:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155647.139602:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1961:x1830976126139392:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 7648us (8396us total) trans 17179874376 rc 0/0 00000100:00100000:2.0:1746155647.139613:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1455 00002000:00100000:2.0:1746155647.139622:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->2424831) req@ffff88012f1f0700 x1830976126139392/t17179874376(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/448 e 0 to 0 dl 1746155658 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.139630:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0700 with x1830976126139392 ext(2097152->2424831) 00010000:00010000:2.0:1746155647.139639:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 43 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.139653:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 43 pid: 4461 timeout: 876 lvb_type: 0 00002000:00010000:2.0:1746155647.139659:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1f0700 00000100:00100000:2.0:1746155647.141981:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.142339:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126139648 00000100:00100000:0.0:1746155647.142346:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126139648 00000100:00100000:0.0:1746155647.142392:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11212 00000100:00100000:0.0:1746155647.142398:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32527:x1830976126139648:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155647.142417:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155647.142432:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135586e00/0x844e5faceb5f8b2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189db expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.142547:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135586000/0x844e5faceb5f8b33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.142558:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135586000/0x844e5faceb5f8b33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.142567:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135586000/0x844e5faceb5f8b33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.142578:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135586200/0x844e5faceb5f8b3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.142586:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135586200/0x844e5faceb5f8b3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.142591:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135586200/0x844e5faceb5f8b3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.142822:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135586400/0x844e5faceb5f8b41 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.142831:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135586400/0x844e5faceb5f8b41 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.142999:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135586400/0x844e5faceb5f8b41 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155647.143008:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000100:00100000:2.0:1746155647.143132:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.143247:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126139776 00000100:00100000:3.0:1746155647.143251:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126139776 00010000:00010000:3.0:1746155647.143270:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 43 pid: 4461 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.143359:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8931 00000100:00100000:3.0:1746155647.143365:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1960:x1830976126139776:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.143374:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.143389:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 43 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.143399:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 43 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.143415:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d88b800/0x844e5faceb5f8afb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2424831) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b8 expref: 43 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.143430:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.143432:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.143438:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f023e00/0x844e5faceb5f8b1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189d4 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.143445:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f023e00/0x844e5faceb5f8b1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189d4 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.143469:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f023e00/0x844e5faceb5f8b1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189d4 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.143479:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125436544:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155647.144194:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29d80 going to sleep for 11 seconds 00010000:00010000:0.0:1746155647.144531:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135586000/0x844e5faceb5f8b33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144543:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135586000/0x844e5faceb5f8b33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144549:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135586000/0x844e5faceb5f8b33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144553:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135586000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155647.144556:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135586000/0x844e5faceb5f8b33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144564:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135586000/0x844e5faceb5f8b33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144573:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155647.144576:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155647.144579:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135586000/0x844e5faceb5f8b33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144583:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135586000/0x844e5faceb5f8b33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144597:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135586200/0x844e5faceb5f8b3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144602:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135586200/0x844e5faceb5f8b3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144606:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135586200/0x844e5faceb5f8b3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144609:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880135586200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155647.144612:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135586200/0x844e5faceb5f8b3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144616:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135586200/0x844e5faceb5f8b3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144621:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008e62da00) 00010000:00010000:0.0:1746155647.144623:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155647.144624:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135586200/0x844e5faceb5f8b3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144628:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135586200/0x844e5faceb5f8b3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.144661:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135586e00/0x844e5faceb5f8b2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189db expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.144674:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135586400/0x844e5faceb5f8b41 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189db expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.144679:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155647.144681:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746155647.144683:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135586400, rc 0) 00000100:00100000:0.0:1746155647.144719:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32527:x1830976126139648:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2320us (2743us total) trans 8589945392 rc 0/0 00000100:00100000:0.0:1746155647.144725:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11212 00000100:00100000:3.0:1746155647.147152:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125436544:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155647.147168:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.147251:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976126139776:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3885us (4118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.147259:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8931 00000100:00100000:0.0:1746155647.153159:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.153197:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.153239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.153312:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126140032 00000100:00100000:1.0:1746155647.153319:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126140032 00002000:00100000:1.0:1746155647.153353:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012f1f3b80 x1830976126140032/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.153363:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3b80 with x1830976126140032 ext(2097152->3145727) 00002000:00010000:1.0:1746155647.153368:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3b80 00000100:00100000:1.0:1746155647.153382:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126140160 00000100:00100000:1.0:1746155647.153383:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126140160 00002000:00100000:1.0:1746155647.153392:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012f1f0000 x1830976126140160/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.153404:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0000 with x1830976126140160 ext(3145728->4194303) 00002000:00010000:1.0:1746155647.153407:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f0000 00000100:00100000:3.0:1746155647.153469:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126140544 00000100:00100000:3.0:1746155647.153472:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126140544 00000100:00100000:3.0:1746155647.153500:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4777 00000100:00100000:3.0:1746155647.153529:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea56c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32527:x1830976126140544:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:1.0:1746155647.153630:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8275 00000100:00100000:1.0:1746155647.153636:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976126140032:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155647.154608:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8276 00000100:00100000:2.0:1746155647.154615:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1961:x1830976126140160:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155647.163314:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea56c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32527:x1830976126140544:12345-192.168.202.51@tcp:35:cat.0 Request processed in 9775us (10063us total) trans 8589945393 rc 0/0 00000100:00100000:3.0:1746155647.163327:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4777 00000100:00100000:0.0:1746155647.172730:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.173810:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.175248:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126140672 00000100:00100000:3.0:1746155647.175256:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126140672 00000100:00100000:3.0:1746155647.175296:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126140800 00000100:00100000:3.0:1746155647.175298:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126140800 00000100:00100000:3.0:1746155647.175323:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17399 00000100:00100000:3.0:1746155647.175330:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976126140672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155647.175345:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.175357:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f023800/0x844e5faceb5f8b4f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189e2 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.175398:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125436672:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155647.175454:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155647.175485:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17400 00000100:00100000:3.0:1746155647.175491:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1963:x1830976126140800:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155647.175497:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.175521:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8b56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189e9 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.175531:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.175534:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.175541:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8b56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189e9 expref: 43 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.175554:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8b56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189e9 expref: 43 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.175562:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ff97000, rc 0) 00000100:00100000:3.0:1746155647.175580:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1963:x1830976126140800:12345-192.168.202.51@tcp:101:cat.0 Request processed in 89us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.175585:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17400 00000100:00100000:0.0:1746155647.175976:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.177017:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126140928 00000100:00100000:2.0:1746155647.177022:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126140928 00000100:00100000:0.0:1746155647.177477:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1960:x1830976126140032:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23840us (24324us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155647.177485:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8275 00002000:00100000:0.0:1746155647.177493:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012f1f3b80 x1830976126140032/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746155647.177548:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17401 00000100:00100000:2.0:1746155647.177554:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1963:x1830976126140928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.177563:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.177612:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a4e2000/0x844e5faceb5f8b5d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189f0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.177626:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.177628:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.177633:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4e2000/0x844e5faceb5f8b5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f0 expref: 44 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.177644:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a4e2000/0x844e5faceb5f8b5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f0 expref: 44 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.177652:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4e2000, rc 0) 00000100:00100000:2.0:1746155647.177668:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1963:x1830976126140928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 115us (1693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.177673:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17401 00000100:00100000:1.0:1746155647.178188:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1961:x1830976126140160:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23573us (24989us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155647.178194:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8276 00002000:00100000:1.0:1746155647.178199:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012f1f0000 x1830976126140160/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.178206:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f0000 with x1830976126140160 ext(3145728->4194303) 00002000:00010000:1.0:1746155647.178210:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f0000 00002000:00100000:0.0:1746155647.178705:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3b80 with x1830976126140032 ext(2097152->3145727) 00002000:00010000:0.0:1746155647.178710:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3b80 00002000:00010000:3.0:1746155647.178927:0:8438:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime: 1746155645 -> 1746155647 00002000:00010000:3.0:1746155647.178930:0:8438:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime: 1746155644 -> 1746155647 00002000:00010000:3.0:1746155647.178932:0:8438:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime: 1746155645 -> 1746155647 00000100:00100000:3.0:1746155647.178948:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125436672:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155647.178969:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f023800/0x844e5faceb5f8b4f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189e2 expref: 25 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.178980:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f023800/0x844e5faceb5f8b4f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189e2 expref: 25 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.179001:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f023800, rc 0) 00000100:00100000:3.0:1746155647.183207:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976126140672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 7868us (10474us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155647.183217:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17399 00000100:00100000:0.0:1746155647.184614:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.184686:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126141184 00000100:00100000:2.0:1746155647.184693:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126141184 00002000:00100000:2.0:1746155647.184725:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012f1f1880 x1830976126141184/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.184735:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1880 with x1830976126141184 ext(4194304->5083135) 00002000:00010000:2.0:1746155647.184739:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f1880 00000100:00100000:2.0:1746155647.184765:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8277 00000100:00100000:2.0:1746155647.184772:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1962:x1830976126141184:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155647.194881:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.195956:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126141312 00000100:00100000:3.0:1746155647.195964:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126141312 00000100:00100000:3.0:1746155647.196011:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17402 00000100:00100000:3.0:1746155647.196018:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32527:x1830976126141312:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155647.196033:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.196045:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f8b64 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189f7 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.196068:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.196074:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155647.196075:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155647.196081:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f8b64 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f7 expref: 25 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.196104:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 19 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.196113:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 19 pid: 4461 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.196122:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125436800:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155647.196750:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155647.197788:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1962:x1830976126141184:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13010us (13172us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155647.197797:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8277 00002000:00100000:2.0:1746155647.197806:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88012f1f1880 x1830976126141184/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.197816:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1880 with x1830976126141184 ext(4194304->5083135) 00002000:00010000:2.0:1746155647.197820:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f1880 00000100:00100000:2.0:1746155647.206656:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.206736:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.206757:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126141568 00000100:00100000:2.0:1746155647.206763:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126141568 00000100:00100000:2.0:1746155647.206793:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17403 00000100:00100000:2.0:1746155647.206799:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976126141568:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.206812:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.206827:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092872a00/0x844e5faceb5f8b6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f189fe expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.206881:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125436928:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155647.206947:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155647.207106:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125436800:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155647.207125:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f8b64 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f7 expref: 25 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.207136:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d593000, rc 0) 00000100:00100000:3.0:1746155647.207173:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32527:x1830976126141312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 11155us (12310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.207179:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17402 00000100:00100000:0.0:1746155647.207412:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126141440 00000100:00100000:0.0:1746155647.207416:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126141440 00002000:00100000:0.0:1746155647.207437:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1167360->1306623) req@ffff8800936f6300 x1830976126141440/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.207445:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6300 with x1830976126141440 ext(1167360->1306623) 00010000:00010000:0.0:1746155647.207451:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 22 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.207461:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 22 pid: 4461 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746155647.207467:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936f6300 00000100:00100000:0.0:1746155647.207479:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1456 00000100:00100000:0.0:1746155647.207484:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976126141440:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155647.214672:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125436928:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155647.214698:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092872a00/0x844e5faceb5f8b6b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189fe expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.214711:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092872a00/0x844e5faceb5f8b6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189fe expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.214725:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092872a00, rc 0) 00000100:00100000:2.0:1746155647.215452:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1963:x1830976126141568:12345-192.168.202.51@tcp:101:cat.0 Request processed in 8651us (8714us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155647.215459:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17403 00000100:00100000:2.0:1746155647.219406:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976126141440:12345-192.168.202.51@tcp:4:cat.0 Request processed in 11913us (12748us total) trans 21474841680 rc 0/0 00000100:00100000:2.0:1746155647.219415:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1456 00002000:00100000:2.0:1746155647.219425:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1167360->1306623) req@ffff8800936f6300 x1830976126141440/t21474841680(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/448 e 0 to 0 dl 1746155658 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.219434:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6300 with x1830976126141440 ext(1167360->1306623) 00010000:00010000:2.0:1746155647.219442:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 22 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.219455:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 22 pid: 4461 timeout: 876 lvb_type: 0 00002000:00010000:2.0:1746155647.219462:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936f6300 00000100:00100000:0.0:1746155647.221479:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.222066:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126141696 00000100:00100000:2.0:1746155647.222073:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126141696 00000100:00100000:2.0:1746155647.222118:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17404 00000100:00100000:2.0:1746155647.222125:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976126141696:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.222138:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.222151:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012de33000/0x844e5faceb5f8b72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a05 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.222196:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125437056:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155647.222261:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.231962:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.232021:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126141824 00000100:00100000:3.0:1746155647.232029:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126141824 00010000:00010000:3.0:1746155647.232059:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 24 pid: 4461 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.232095:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8932 00000100:00100000:3.0:1746155647.232102:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1962:x1830976126141824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.232113:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.232132:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 24 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.232142:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 24 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.232161:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.232163:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.232169:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f8b64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f7 expref: 24 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.232176:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f8b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f7 expref: 24 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.232203:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f8b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f7 expref: 24 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.232217:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125437184:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155647.232258:0:19959:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.51@tcp) returned -22 from glimpse AST (req@ffff8800936f7800 x1830976125437056) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 24 pid: 4461 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.232272:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d88b400/0x844e5faceb5f8ad8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1167360->1306623) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189a3 expref: 24 pid: 4461 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.232287:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125437056:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155647.232288:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29540 going to sleep for 11 seconds 00010000:00010000:2.0:1746155647.232305:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012de33000/0x844e5faceb5f8b72 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a05 expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.232313:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012de33000/0x844e5faceb5f8b72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a05 expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.232320:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012de33000, rc 0) 00000100:00100000:2.0:1746155647.232341:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976126141696:12345-192.168.202.51@tcp:101:cat.0 Request processed in 10217us (10868us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155647.232347:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17404 00000100:00100000:3.0:1746155647.237037:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125437184:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155647.237054:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.237088:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1962:x1830976126141824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4985us (5132us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.237098:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8932 00000100:00100000:0.0:1746155647.247913:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.247962:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.247993:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126142080 00000100:00100000:3.0:1746155647.248001:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126142080 00002000:00100000:3.0:1746155647.248040:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009366f100 x1830976126142080/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.248050:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366f100 with x1830976126142080 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.248056:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366f100 00000100:00100000:3.0:1746155647.248071:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126142336 00000100:00100000:3.0:1746155647.248073:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126142336 00002000:00100000:3.0:1746155647.248085:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009366ed80 x1830976126142336/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.248092:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366ed80 with x1830976126142336 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.248095:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366ed80 00000100:00100000:3.0:1746155647.248105:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8278 00000100:00100000:3.0:1746155647.248117:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126142080:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155647.248173:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8279 00000100:00100000:2.0:1746155647.248181:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976126142336:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155647.261917:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126142080:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13797us (14003us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.261929:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8278 00002000:00100000:3.0:1746155647.261938:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009366f100 x1830976126142080/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.261947:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366f100 with x1830976126142080 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.261951:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366f100 00000100:00100000:2.0:1746155647.264205:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976126142336:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16017us (16235us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.264218:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8279 00002000:00100000:2.0:1746155647.264226:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009366ed80 x1830976126142336/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.264233:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366ed80 with x1830976126142336 ext(1048576->2097151) 00002000:00010000:2.0:1746155647.264238:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366ed80 00000100:00100000:0.0:1746155647.280960:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.281022:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126142720 00000100:00100000:2.0:1746155647.281030:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126142720 00002000:00100000:2.0:1746155647.281068:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009366ea00 x1830976126142720/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.281077:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366ea00 with x1830976126142720 ext(3145728->4194303) 00002000:00010000:2.0:1746155647.281082:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366ea00 00000100:00100000:2.0:1746155647.281112:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8280 00000100:00100000:2.0:1746155647.281120:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1962:x1830976126142720:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155647.281997:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.282041:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126142592 00000100:00100000:3.0:1746155647.282045:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126142592 00002000:00100000:3.0:1746155647.282063:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009366ca80 x1830976126142592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.282070:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366ca80 with x1830976126142592 ext(2097152->3145727) 00002000:00010000:3.0:1746155647.282073:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366ca80 00000100:00100000:3.0:1746155647.282084:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8281 00000100:00100000:3.0:1746155647.282089:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1962:x1830976126142592:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:3.0:1746155647.294610:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746155647.301413:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1962:x1830976126142720:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20285us (20451us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.301423:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8280 00002000:00100000:2.0:1746155647.301432:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009366ea00 x1830976126142720/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.301441:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366ea00 with x1830976126142720 ext(3145728->4194303) 00002000:00010000:2.0:1746155647.301446:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366ea00 00000100:00100000:3.0:1746155647.305340:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1962:x1830976126142592:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23241us (23335us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.305351:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8281 00002000:00100000:3.0:1746155647.305361:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009366ca80 x1830976126142592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.305370:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366ca80 with x1830976126142592 ext(2097152->3145727) 00002000:00010000:3.0:1746155647.305375:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366ca80 00000100:00100000:2.0:1746155647.318455:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.318476:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.318527:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126143104 00000100:00100000:1.0:1746155647.318535:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126143104 00000100:00100000:3.0:1746155647.318546:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126143232 00000100:00100000:3.0:1746155647.318550:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126143232 00000100:00100000:1.0:1746155647.318580:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11213 00000100:00100000:1.0:1746155647.318587:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32530:x1830976126143104:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:3.0:1746155647.318659:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17405 00000100:00100000:3.0:1746155647.318665:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:32524:x1830976126143232:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155647.318674:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.318688:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a13 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.318708:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8b09 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189c6 expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.318715:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8b56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189e9 expref: 43 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.318718:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.318720:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.318721:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.318723:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1265664->2097151] (req 1265664->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 29 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.318727:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d400/0x844e5faceb5f8b80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a0c expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.318746:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8b56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189e9 expref: 43 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.318756:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8b56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189e9 expref: 43 pid: 8436 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.318765:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125437312:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155647.318850:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189c6 expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.318862:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8b09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189c6 expref: 29 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.318881:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125437440:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.318896:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d600/0x844e5faceb5f8b87 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155647.318904:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29540 going to sleep for 11 seconds 00010000:00010000:1.0:1746155647.318905:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d600/0x844e5faceb5f8b87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.318913:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d600/0x844e5faceb5f8b87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.318923:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009455de00/0x844e5faceb5f8b8e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.318928:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009455de00/0x844e5faceb5f8b8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.318933:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009455de00/0x844e5faceb5f8b8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319012:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d200/0x844e5faceb5f8b95 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319019:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d200/0x844e5faceb5f8b95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319025:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d200/0x844e5faceb5f8b95 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155647.319033:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155647.319089:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d600/0x844e5faceb5f8b87 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319095:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d600/0x844e5faceb5f8b87 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319100:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d600/0x844e5faceb5f8b87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319105:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009455d600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155647.319108:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d600/0x844e5faceb5f8b87 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319113:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d600/0x844e5faceb5f8b87 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319122:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155647.319124:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155647.319128:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d600/0x844e5faceb5f8b87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319132:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d600/0x844e5faceb5f8b87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319145:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009455de00/0x844e5faceb5f8b8e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319150:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009455de00/0x844e5faceb5f8b8e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319154:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009455de00/0x844e5faceb5f8b8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319158:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009455de00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155647.319160:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009455de00/0x844e5faceb5f8b8e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319164:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009455de00/0x844e5faceb5f8b8e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319168:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5171a00) 00010000:00010000:1.0:1746155647.319170:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155647.319172:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009455de00/0x844e5faceb5f8b8e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319176:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009455de00/0x844e5faceb5f8b8e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.319201:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d400/0x844e5faceb5f8b80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a0c expref: 296 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.319210:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d200/0x844e5faceb5f8b95 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a0c expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.319216:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.319218:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746155647.319219:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009455d200, rc 0) 00000100:00100000:0.0:1746155647.319222:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.319241:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:32530:x1830976126143104:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 655us (766us total) trans 8589945394 rc 0/0 00000100:00100000:1.0:1746155647.319247:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11213 00000100:00100000:3.0:1746155647.319404:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126143488 00000100:00100000:3.0:1746155647.319408:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126143488 00002000:00100000:3.0:1746155647.319430:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009045f800 x1830976126143488/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.319439:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045f800 with x1830976126143488 ext(4194304->5083135) 00002000:00010000:3.0:1746155647.319443:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045f800 00000100:00100000:3.0:1746155647.319455:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8282 00000100:00100000:3.0:1746155647.319460:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976126143488:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155647.326604:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.326736:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126143616 00000100:00100000:1.0:1746155647.326742:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126143616 00000100:00100000:0.0:1746155647.326776:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.326787:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11214 00000100:00100000:0.0:1746155647.326790:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.326793:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32531:x1830976126143616:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:0.0:1746155647.326802:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155647.326812:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155647.326826:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.326829:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125437312:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.326832:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1a00/0x844e5faceb5f8ba3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a1a expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.326839:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125437440:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.326840:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126144128 00000100:00100000:0.0:1746155647.326843:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126144128 00010000:00010000:3.0:1746155647.326860:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1265664->2097151] (req 1265664->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 29 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.326860:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17406 00000100:00100000:0.0:1746155647.326865:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32530:x1830976126144128:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155647.326882:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.326886:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d593c00, rc 0) 00010000:00010000:1.0:1746155647.326886:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8baa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.326890:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a21 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.326895:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8baa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.326902:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f26f400/0x844e5faceb5f8949 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d8 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.326903:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8baa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.326909:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8a45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18948 expref: 26 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.326912:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8bb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.326915:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c800/0x844e5faceb5f8a0d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18917 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.326920:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155647.326921:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:32524:x1830976126143232:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8256us (8473us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155647.326921:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.326922:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.326925:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2695168->2883583] (req 2695168->2883583) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.326926:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155647.326928:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17405 00010000:00010000:0.0:1746155647.326947:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00c800/0x844e5faceb5f8a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18917 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155647.326948:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126143744 00000100:00100000:3.0:1746155647.326951:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126143744 00010000:00010000:0.0:1746155647.326955:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b00c800/0x844e5faceb5f8a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18917 expref: 20 pid: 8437 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.326964:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8b56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189e9 expref: 46 pid: 8436 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.326964:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125437568:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155647.326978:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126143872 00000100:00100000:3.0:1746155647.326980:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126143872 00010000:00010000:3.0:1746155647.326987:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8b09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189c6 expref: 29 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.326998:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126144000 00000100:00100000:3.0:1746155647.326999:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126144000 00010000:00010000:1.0:1746155647.327004:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.327010:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18948 expref: 26 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155647.327011:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8933 00010000:00010000:1.0:1746155647.327012:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189cd expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.327016:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1960:x1830976126143744:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.327017:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.327017:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8a45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18948 expref: 26 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.327023:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155647.327024:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125437696:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.327030:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189cd expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.327037:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189cd expref: 15 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.327038:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8b56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189e9 expref: 46 pid: 8436 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.327043:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125437824:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.327043:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f26f400/0x844e5faceb5f8949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d8 expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.327046:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8b56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189e9 expref: 46 pid: 8436 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.327050:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f26f400/0x844e5faceb5f8949 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d8 expref: 10 pid: 8437 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.327056:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009045df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125437952:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.327058:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110c00 going to sleep for 11 seconds 00010000:00010000:3.0:1746155647.327059:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ff97000/0x844e5faceb5f8b56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189e9 expref: 46 pid: 8436 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.327067:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c9a780 going to sleep for 11 seconds 00010000:00010000:3.0:1746155647.327071:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155647.327073:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 772 00000100:00100000:1.0:1746155647.327077:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1960:x1830976126144000:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.327084:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155647.327087:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1960:x1830976126143744:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 71us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.327092:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8933 00010000:00010000:1.0:1746155647.327093:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009455d200/0x844e5faceb5f8b95 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a0c expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.327102:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8934 00000100:00100000:3.0:1746155647.327107:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976126143872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.327107:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.327110:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.327113:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155647.327114:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.327118:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.327119:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8b09 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189c6 expref: 29 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.327122:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155647.327126:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8b09 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189c6 expref: 29 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.327135:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1960:x1830976126144000:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 57us (332us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155647.327136:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f023c00/0x844e5faceb5f8b09 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189c6 expref: 29 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.327140:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 772 00010000:00010000:3.0:1746155647.327143:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.327145:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.327149:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 28 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.327155:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 28 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.327171:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 28 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.327178:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125438080:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155647.329312:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1961:x1830976126143488:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9845us (10084us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155647.329324:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8282 00002000:00100000:2.0:1746155647.329332:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009045f800 x1830976126143488/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.329340:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009045f800 with x1830976126143488 ext(4194304->5083135) 00002000:00010000:2.0:1746155647.329344:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009045f800 00000100:00100000:3.0:1746155647.329401:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155647.333031:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125437568:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.333388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.333413:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125437952:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.333479:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9880 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125437824:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.333497:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155647.334736:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126144384 00000100:00100000:1.0:1746155647.334742:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126144384 00010000:00010000:1.0:1746155647.334767:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26f400/0x844e5faceb5f8949 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d8 expref: 11 pid: 8437 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.335349:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.335937:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.335953:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126144256 00000100:00100000:1.0:1746155647.335956:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126144256 00000100:00100000:2.0:1746155647.335964:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8935 00010000:00010000:1.0:1746155647.335969:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189cd expref: 16 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.335971:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009045f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126144384:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.335981:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155647.335984:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8936 00000100:00100000:1.0:1746155647.335988:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126144256:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.335993:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155647.335997:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189cd expref: 16 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.335998:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f26f400/0x844e5faceb5f8949 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d8 expref: 11 pid: 8437 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.336006:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f26f400/0x844e5faceb5f8949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d8 expref: 11 pid: 8437 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.336006:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189cd expref: 16 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.336023:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f26f400/0x844e5faceb5f8949 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188d8 expref: 11 pid: 8437 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.336023:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092873600/0x844e5faceb5f8b17 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189cd expref: 16 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.336036:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.336037:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155647.336040:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.336047:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.336053:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.336067:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155647.336085:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126144384:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 114us (2698us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.336085:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126144256:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 96us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.336090:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8936 00000100:00100000:3.0:1746155647.336147:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009045ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125437696:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155647.336170:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2695168->2883583] (req 2695168->2883583) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 26 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.336178:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26ee00, rc 0) 00000100:00100000:3.0:1746155647.336195:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:32530:x1830976126144128:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 9330us (9369us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.336200:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17406 00010000:00010000:3.0:1746155647.336229:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336234:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155647.336263:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155647.336267:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155647.336280:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336288:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336295:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8baa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336301:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8baa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336305:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8baa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336310:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdf1000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155647.336312:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8baa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336318:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8baa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336325:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155647.336327:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155647.336330:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8baa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336334:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8baa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336342:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336346:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8bb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336350:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336353:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdf0e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155647.336354:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336358:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336361:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a5171400) 00010000:00010000:3.0:1746155647.336363:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155647.336364:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8bb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336368:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8bb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.336391:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1a00/0x844e5faceb5f8ba3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a1a expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.336398:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a1a expref: 7 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.336403:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155647.336404:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155647.336406:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf1400, rc 0) 00000100:00100000:3.0:1746155647.336425:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32531:x1830976126143616:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 9632us (9928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.336430:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11214 00000100:00100000:2.0:1746155647.336557:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8935 00000100:00100000:2.0:1746155647.336671:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126144512 00000100:00100000:2.0:1746155647.336675:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126144512 00000100:00100000:0.0:1746155647.336678:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155647.336695:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8a45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18948 expref: 26 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155647.336707:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126144640 00000100:00100000:2.0:1746155647.336709:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126144640 00000100:00100000:0.0:1746155647.336709:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155647.336717:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00c800/0x844e5faceb5f8a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18917 expref: 21 pid: 8437 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.336723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.336734:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8937 00000100:00100000:2.0:1746155647.336739:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976126144512:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.336746:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155647.336748:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155647.336752:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8a45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18948 expref: 26 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.336760:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8a45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18948 expref: 26 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.336761:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126144896 00000100:00100000:0.0:1746155647.336764:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126144896 00010000:00010000:2.0:1746155647.336769:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f26e600/0x844e5faceb5f8a45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18948 expref: 26 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.336776:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746155647.336783:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e3:0x0] (1265664->1269759) req@ffff8800910db480 x1830976126144896/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746155647.336792:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126144512:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 53us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.336797:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8937 00002000:00100000:0.0:1746155647.336797:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910db480 with x1830976126144896 ext(1265664->1269759) 00002000:00010000:0.0:1746155647.336800:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910db480 00000100:00100000:2.0:1746155647.336808:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8938 00000100:00100000:2.0:1746155647.336812:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976126144640:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155647.336815:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8283 00010000:00010000:2.0:1746155647.336820:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155647.336820:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976126144896:12345-192.168.202.51@tcp:3:multiop.0 00010000:00010000:2.0:1746155647.336825:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b00c800/0x844e5faceb5f8a0d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18917 expref: 21 pid: 8437 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.336832:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b00c800/0x844e5faceb5f8a0d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18917 expref: 21 pid: 8437 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.336842:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c800/0x844e5faceb5f8a0d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18917 expref: 21 pid: 8437 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.336849:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.336850:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.336855:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 24 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.336860:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 24 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.336890:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 24 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.336899:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125438208:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155647.336925:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976126144896:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 105us (215us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155647.336930:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8283 00000100:00100000:2.0:1746155647.336932:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332780 going to sleep for 11 seconds 00002000:00100000:0.0:1746155647.336934:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e3:0x0] (1265664->1269759) req@ffff8800910db480 x1830976126144896/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/4536 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.336940:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910db480 with x1830976126144896 ext(1265664->1269759) 00000100:00100000:2.0:1746155647.336942:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126145024 00002000:00010000:0.0:1746155647.336943:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800910db480 00000100:00100000:2.0:1746155647.336944:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126145024 00000100:00100000:2.0:1746155647.336958:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126145152 00000100:00100000:2.0:1746155647.336960:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126145152 00000100:00100000:2.0:1746155647.336972:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17407 00000100:00100000:2.0:1746155647.336976:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1960:x1830976126145024:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155647.336982:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17408 00010000:00010000:2.0:1746155647.336983:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155647.336986:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126145152:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155647.336991:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.336992:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012de33000/0x844e5faceb5f8bc6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a28 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.336995:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f26fe00/0x844e5faceb5f8bcd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a2f expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.337013:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125438464:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155647.337013:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800910d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125438336:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155647.337030:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155647.337081:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125438080:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155647.337089:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155647.337695:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c9a780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155647.337877:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009045c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1960:x1830976126143872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10758us (11073us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.337887:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8934 00000100:00100000:0.0:1746155647.339141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.339539:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.339758:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.339894:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.339928:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126145280 00000100:00100000:2.0:1746155647.339934:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126145280 00000100:00100000:2.0:1746155647.339958:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126145408 00000100:00100000:2.0:1746155647.339959:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126145408 00000100:00100000:2.0:1746155647.339986:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126145536 00000100:00100000:2.0:1746155647.339988:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126145536 00000100:00100000:2.0:1746155647.340002:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17409 00000100:00100000:2.0:1746155647.340008:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126145280:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155647.340021:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.340033:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009455d400/0x844e5faceb5f8bd4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a36 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.340051:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.340053:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.340059:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009455d400/0x844e5faceb5f8bd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a36 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.340071:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009455d400/0x844e5faceb5f8bd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a36 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.340085:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009455d400, rc 0) 00000100:00100000:2.0:1746155647.340113:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126145280:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 105us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.340118:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17409 00000100:00100000:2.0:1746155647.340132:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17410 00000100:00100000:2.0:1746155647.340137:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126145408:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155647.340143:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.340150:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009455d200/0x844e5faceb5f8bdb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a3d expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.340179:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125438592:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155647.340216:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332900 going to sleep for 11 seconds 00000100:00100000:2.0:1746155647.340232:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17411 00000100:00100000:2.0:1746155647.340238:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976126145536:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155647.340243:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.340250:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3200/0x844e5faceb5f8be2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a44 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.340258:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.340260:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.340264:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3200/0x844e5faceb5f8be2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a44 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.340273:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3200/0x844e5faceb5f8be2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a44 expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.340280:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4e3200, rc 0) 00000100:00100000:2.0:1746155647.340292:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976126145536:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 55us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.340297:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17411 00000100:00100000:1.0:1746155647.340590:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126145664 00000100:00100000:1.0:1746155647.340594:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126145664 00000100:00100000:3.0:1746155647.340691:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17412 00000100:00100000:3.0:1746155647.340697:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126145664:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155647.340703:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.340708:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b00dc00/0x844e5faceb5f8be9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a4b expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.340727:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125438720:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155647.340756:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29900 going to sleep for 11 seconds 00000100:00080000:3.0:1746155647.340765:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155647.341973:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125438464:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155647.341993:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012de33000/0x844e5faceb5f8bc6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a28 expref: 44 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.342002:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012de33000/0x844e5faceb5f8bc6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a28 expref: 44 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.342009:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012de33000, rc 0) 00000100:00100000:2.0:1746155647.342043:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1960:x1830976126145024:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5065us (5317us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155647.342048:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17407 00002000:00010000:1.0:1746155647.342201:0:4461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime: 1746155645 -> 1746155647 00002000:00010000:1.0:1746155647.342205:0:4461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime: 1746155645 -> 1746155647 00002000:00010000:1.0:1746155647.342207:0:4461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime: 1746155645 -> 1746155647 00000100:00100000:1.0:1746155647.342217:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800910d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:4461:1830976125438336:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155647.342236:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f26fe00/0x844e5faceb5f8bcd lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a2f expref: 26 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.342245:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f26fe00/0x844e5faceb5f8bcd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a2f expref: 26 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.342253:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26fe00, rc 0) 00000100:00100000:1.0:1746155647.342271:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126145152:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5285us (5522us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155647.342277:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17408 00000100:00100000:3.0:1746155647.342352:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125438208:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155647.342361:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.342378:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1963:x1830976126144640:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5565us (5699us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.342388:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8938 00000100:00100000:0.0:1746155647.342982:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.343404:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126145920 00000100:00100000:2.0:1746155647.343408:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126145920 00002000:00100000:2.0:1746155647.343431:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (2879488->2883583) req@ffff8800910d8e00 x1830976126145920/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.343439:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8e00 with x1830976126145920 ext(2879488->2883583) 00002000:00010000:2.0:1746155647.343443:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910d8e00 00000100:00100000:2.0:1746155647.343466:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8284 00000100:00100000:2.0:1746155647.343472:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126145920:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155647.343598:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126145920:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 126us (617us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155647.343604:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8284 00002000:00100000:2.0:1746155647.343609:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (2879488->2883583) req@ffff8800910d8e00 x1830976126145920/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/4536 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.343615:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800910d8e00 with x1830976126145920 ext(2879488->2883583) 00002000:00010000:2.0:1746155647.343618:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800910d8e00 00000100:00100000:3.0:1746155647.343836:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125438592:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155647.343851:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009455d200/0x844e5faceb5f8bdb lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a3d expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.343861:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009455d200/0x844e5faceb5f8bdb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a3d expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.343880:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009455d200, rc 0) 00000100:00100000:3.0:1746155647.343910:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126145408:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3773us (4371us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155647.343916:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17410 00000100:00100000:3.0:1746155647.344194:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:19959:1830976125438720:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155647.344208:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b00dc00/0x844e5faceb5f8be9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a4b expref: 12 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.344216:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b00dc00/0x844e5faceb5f8be9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a4b expref: 12 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.344223:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00dc00, rc 0) 00000100:00100000:3.0:1746155647.344242:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126145664:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3545us (4349us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155647.344247:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17412 00000100:00100000:0.0:1746155647.346170:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.346255:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126146048 00000100:00100000:3.0:1746155647.346260:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126146048 00000100:00100000:3.0:1746155647.346410:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17413 00000100:00100000:3.0:1746155647.346418:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1960:x1830976126146048:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155647.346429:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.346442:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b00cc00/0x844e5faceb5f8bf0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a52 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.346483:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125438848:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155647.346582:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.346845:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.347030:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126146304 00000100:00100000:3.0:1746155647.347034:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126146304 00000100:00100000:3.0:1746155647.347068:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4778 00000100:00100000:3.0:1746155647.347074:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32530:x1830976126146304:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155647.347493:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:32530:x1830976126146304:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 418us (647us total) trans 8589945395 rc 0/0 00000100:00100000:3.0:1746155647.347500:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4778 00000100:00100000:0.0:1746155647.347643:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.347703:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126146560 00000100:00100000:3.0:1746155647.347706:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126146560 00000100:00100000:3.0:1746155647.347735:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11215 00000100:00100000:3.0:1746155647.347740:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32531:x1830976126146560:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155647.347747:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.347758:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593800/0x844e5faceb5f8bf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a59 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.347892:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.347911:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a1a expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.347917:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.347937:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a1a expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.347947:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a1a expref: 8 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.347955:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125438976:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155647.348003:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.348158:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.348257:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126146688 00000100:00100000:1.0:1746155647.348261:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126146688 00000100:00100000:1.0:1746155647.348289:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17414 00000100:00100000:1.0:1746155647.348295:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:32524:x1830976126146688:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155647.348302:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.348309:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a60 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.348317:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125438848:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155647.348324:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f023e00/0x844e5faceb5f8b1e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189d4 expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.348331:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3200/0x844e5faceb5f8be2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a44 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.348335:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b00cc00/0x844e5faceb5f8bf0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a52 expref: 44 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.348337:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a4e2000/0x844e5faceb5f8b5d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f0 expref: 44 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.348344:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b00cc00/0x844e5faceb5f8bf0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a52 expref: 44 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.348344:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.348345:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.348348:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [2097152->2252799] (req 2097152->2252799) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.348352:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00cc00, rc 0) 00010000:00010000:1.0:1746155647.348362:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a4e2000/0x844e5faceb5f8b5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f0 expref: 43 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.348369:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a4e2000/0x844e5faceb5f8b5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f0 expref: 43 pid: 19959 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.348372:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1960:x1830976126146048:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1955us (2205us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155647.348377:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17413 00000100:00100000:1.0:1746155647.348377:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125439104:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.348402:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3200/0x844e5faceb5f8be2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a44 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.348407:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3200/0x844e5faceb5f8be2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a44 expref: 9 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.348411:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125439232:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.348424:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f023e00/0x844e5faceb5f8b1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189d4 expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.348428:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f023e00/0x844e5faceb5f8b1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189d4 expref: 29 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.348432:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125439360:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.348439:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155647.349172:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125438976:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155647.349183:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155647.349300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.349363:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126146816 00000100:00100000:3.0:1746155647.349366:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126146816 00010000:00010000:3.0:1746155647.349380:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a1a expref: 9 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.349405:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8939 00000100:00100000:3.0:1746155647.349411:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976126146816:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.349419:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.349423:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a1a expref: 9 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.349430:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a1a expref: 9 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.349443:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8bbf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a1a expref: 9 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.349456:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155647.349459:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.349465:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.349473:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.349489:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.349538:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976126146816:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 127us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.349544:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8939 00010000:00010000:0.0:1746155647.349551:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:0.0:1746155647.349557:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:0.0:1746155647.349569:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155647.349647:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593800/0x844e5faceb5f8bf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a59 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.349675:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a59 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.349680:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155647.349682:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746155647.349684:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e3b9400, rc 0) 00000100:00100000:0.0:1746155647.349705:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32531:x1830976126146560:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1965us (2062us total) trans 8589945396 rc 0/0 00000100:00100000:0.0:1746155647.349710:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11215 00000100:00100000:1.0:1746155647.349721:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125439104:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.349728:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125439232:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.350450:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.350650:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126146944 00000100:00100000:3.0:1746155647.350653:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126146944 00010000:00010000:3.0:1746155647.350668:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3200/0x844e5faceb5f8be2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a44 expref: 10 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.350698:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8940 00000100:00100000:3.0:1746155647.350704:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126146944:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.350711:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.350724:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3200/0x844e5faceb5f8be2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a44 expref: 10 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.350732:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3200/0x844e5faceb5f8be2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a44 expref: 10 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.350744:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a4e3200/0x844e5faceb5f8be2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a44 expref: 10 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.350752:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.350770:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126146944:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 67us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.350774:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8940 00000100:00100000:1.0:1746155647.350806:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125439360:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.350821:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->2252799] (req 2097152->2252799) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 29 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.350829:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf0a00, rc 0) 00000100:00100000:1.0:1746155647.350844:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:32524:x1830976126146688:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2550us (2687us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.350849:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17414 00000100:00100000:0.0:1746155647.354038:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.354120:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.354171:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126147200 00000100:00100000:1.0:1746155647.354178:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126147200 00000100:00100000:2.0:1746155647.354190:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126147072 00000100:00100000:2.0:1746155647.354194:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126147072 00010000:00010000:2.0:1746155647.354211:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f023e00/0x844e5faceb5f8b1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189d4 expref: 29 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.354222:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11216 00000100:00100000:1.0:1746155647.354228:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32531:x1830976126147200:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:2.0:1746155647.354231:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8941 00000100:00100000:2.0:1746155647.354236:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1961:x1830976126147072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.354244:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.354245:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155647.354257:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1c00/0x844e5faceb5f8c13 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a67 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.354261:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f023e00/0x844e5faceb5f8b1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189d4 expref: 29 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.354271:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f023e00/0x844e5faceb5f8b1e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189d4 expref: 29 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.354287:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f023e00/0x844e5faceb5f8b1e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189d4 expref: 29 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.354302:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155647.354311:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1200/0x844e5faceb5f8c1a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.354322:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a59 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.354328:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1200/0x844e5faceb5f8c1a lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155647.354332:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976126147072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 96us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.354338:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8941 00010000:00010000:1.0:1746155647.354354:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a59 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.354363:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a59 expref: 9 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.354484:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125439488:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.354571:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.357199:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.357417:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126147328 00000100:00100000:3.0:1746155647.357423:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126147328 00010000:00010000:3.0:1746155647.357447:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4e2000/0x844e5faceb5f8b5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f0 expref: 43 pid: 19959 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.357485:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8942 00000100:00100000:3.0:1746155647.357492:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1960:x1830976126147328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.357500:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.357532:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a4e2000/0x844e5faceb5f8b5d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f0 expref: 43 pid: 19959 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.357541:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a4e2000/0x844e5faceb5f8b5d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f0 expref: 43 pid: 19959 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.357558:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a4e2000/0x844e5faceb5f8b5d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f0 expref: 43 pid: 19959 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.357570:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.357572:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.357578:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.357584:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.357612:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.357622:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125439616:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155647.358750:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.359834:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.359899:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125439616:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155647.359913:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.359942:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1960:x1830976126147328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2450us (2747us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.359951:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8942 00000100:00100000:3.0:1746155647.359970:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126147456 00000100:00100000:3.0:1746155647.359974:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126147456 00000100:00100000:1.0:1746155647.359985:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125439488:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155647.359987:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a59 expref: 10 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.359999:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1200/0x844e5faceb5f8c1a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155647.360003:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8943 00000100:00100000:3.0:1746155647.360008:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126147456:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.360015:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.360020:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a59 expref: 10 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.360028:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a59 expref: 10 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.360051:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e3b9400/0x844e5faceb5f8bfe lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a59 expref: 10 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.360062:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155647.360066:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1200/0x844e5faceb5f8c1a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.360074:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1200/0x844e5faceb5f8c1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.360083:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1200/0x844e5faceb5f8c1a lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155647.360104:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.360120:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126147456:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 111us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.360125:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8943 00010000:00010000:1.0:1746155647.360181:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1200/0x844e5faceb5f8c1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.360188:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1200/0x844e5faceb5f8c1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155647.360225:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155647.360229:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155647.360244:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1200/0x844e5faceb5f8c1a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.360560:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1c00/0x844e5faceb5f8c13 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a67 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.360583:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1200/0x844e5faceb5f8c1a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a67 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.360590:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.360593:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155647.360710:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf1200, rc 0) 00000100:00100000:1.0:1746155647.360747:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32531:x1830976126147200:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 6519us (6626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.360752:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11216 00000100:00100000:0.0:1746155647.362099:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.362157:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126147712 00000100:00100000:1.0:1746155647.362162:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126147712 00002000:00100000:1.0:1746155647.362188:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2248704->2252799) req@ffff88009526b100 x1830976126147712/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.362195:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526b100 with x1830976126147712 ext(2248704->2252799) 00002000:00010000:1.0:1746155647.362198:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009526b100 00000100:00100000:1.0:1746155647.362222:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8285 00000100:00100000:1.0:1746155647.362227:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976126147712:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155647.362352:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976126147712:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 124us (253us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155647.362358:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8285 00002000:00100000:1.0:1746155647.362362:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2248704->2252799) req@ffff88009526b100 x1830976126147712/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/4536 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.362369:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526b100 with x1830976126147712 ext(2248704->2252799) 00002000:00010000:1.0:1746155647.362371:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009526b100 00000100:00100000:0.0:1746155647.364647:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.364719:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.364756:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126147840 00000100:00100000:3.0:1746155647.364761:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126148096 00000100:00100000:1.0:1746155647.364762:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126147840 00000100:00100000:3.0:1746155647.364765:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126148096 00000100:00100000:3.0:1746155647.364794:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4779 00000100:00100000:3.0:1746155647.364800:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32524:x1830976126148096:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155647.364806:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17415 00000100:00100000:1.0:1746155647.364811:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126147840:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155647.364819:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.364832:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0000/0x844e5faceb5f8c21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a6e expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.364879:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125439744:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155647.364933:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110300 going to sleep for 11 seconds 00000100:00100000:3.0:1746155647.365472:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32524:x1830976126148096:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 308us (389us total) trans 8589945397 rc 0/0 00000100:00100000:3.0:1746155647.365480:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4779 00000100:00100000:1.0:1746155647.365522:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.365545:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.365795:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126148224 00000100:00100000:0.0:1746155647.365798:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126148224 00000100:00100000:0.0:1746155647.365896:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126148352 00000100:00100000:0.0:1746155647.365899:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126148352 00000100:00100000:0.0:1746155647.365974:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17416 00000100:00100000:0.0:1746155647.365981:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126148224:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155647.365988:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155647.365996:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8c28 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a75 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.366019:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125439872:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155647.366053:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c9ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155647.366098:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17417 00000100:00100000:1.0:1746155647.366104:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126148352:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155647.366111:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.366119:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1e00/0x844e5faceb5f8c2f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a7c expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.366139:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fedb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125440000:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155647.366156:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155647.366700:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8438:1830976125439744:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155647.366716:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0000/0x844e5faceb5f8c21 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a6e expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.366726:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0000/0x844e5faceb5f8c21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a6e expref: 12 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.366733:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf0000, rc 0) 00000100:00100000:1.0:1746155647.366766:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126147840:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1955us (2123us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155647.366771:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17415 00000100:00100000:2.0:1746155647.368655:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125439872:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155647.368673:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8c28 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a75 expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.368682:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f26f600/0x844e5faceb5f8c28 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a75 expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.368703:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26f600, rc 0) 00000100:00100000:2.0:1746155647.368735:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126148224:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2755us (3213us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155647.368741:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17416 00000100:00100000:2.0:1746155647.369443:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fedb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125440000:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155647.369457:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1e00/0x844e5faceb5f8c2f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a7c expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.369467:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1e00/0x844e5faceb5f8c2f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a7c expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.369473:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf1e00, rc 0) 00000100:00100000:2.0:1746155647.369491:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126148352:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3387us (3945us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155647.369496:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17417 00000100:00100000:0.0:1746155647.371500:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.371547:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126148608 00000100:00100000:1.0:1746155647.371553:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126148608 00000100:00100000:1.0:1746155647.371595:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11217 00000100:00100000:1.0:1746155647.371602:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32531:x1830976126148608:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155647.371615:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.371627:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0800/0x844e5faceb5f8c36 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a83 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.371695:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8c3d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.371706:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8c3d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155647.371715:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8c3d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:1.0:1746155647.371725:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155647.371807:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0800/0x844e5faceb5f8c36 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a83 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.371823:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8c3d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a83 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.371830:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.371832:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155647.371834:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf1400, rc 0) 00000100:00100000:1.0:1746155647.371881:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32531:x1830976126148608:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 279us (383us total) trans 8589945398 rc 0/0 00000100:00100000:1.0:1746155647.371886:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11217 00000100:00100000:0.0:1746155647.374590:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.374628:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.374637:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126148736 00000100:00100000:2.0:1746155647.374643:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126148736 00000100:00100000:2.0:1746155647.374679:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126148992 00000100:00100000:2.0:1746155647.374682:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126148992 00000100:00100000:2.0:1746155647.374705:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17418 00000100:00100000:2.0:1746155647.374712:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126148736:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155647.374737:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.374751:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f892d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188b5 expref: 9 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.374757:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b00c200/0x844e5faceb5f8a22 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18925 expref: 41 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.374764:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b00d400/0x844e5faceb5f89ea lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188f4 expref: 27 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.374769:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.374771:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.374773:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.374797:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b00d400/0x844e5faceb5f89ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188f4 expref: 27 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.374807:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b00d400/0x844e5faceb5f89ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188f4 expref: 27 pid: 20200 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155647.374817:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125440128:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.374895:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b00c200/0x844e5faceb5f8a22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18925 expref: 41 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.374903:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b00c200/0x844e5faceb5f8a22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18925 expref: 41 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155647.374911:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125440256:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.374933:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f892d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188b5 expref: 9 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.374940:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f892d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188b5 expref: 9 pid: 19959 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155647.374947:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125440384:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.374948:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17419 00000100:00100000:1.0:1746155647.374955:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126148992:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:2.0:1746155647.374960:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746155647.374972:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.374981:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f8b64 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f7 expref: 24 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.374987:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009455d400/0x844e5faceb5f8bd4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a36 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.374992:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.374993:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.374995:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.375008:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009455d400/0x844e5faceb5f8bd4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a36 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.375016:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009455d400/0x844e5faceb5f8bd4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a36 expref: 11 pid: 8438 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.375024:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125440512:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.375049:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f8b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f7 expref: 24 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.375055:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f8b64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f7 expref: 24 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.375061:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125440640:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.375074:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b110300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.375238:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.375283:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.375316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.375331:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126149248 00000100:00100000:3.0:1746155647.375335:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126149248 00000100:00100000:3.0:1746155647.375351:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126148864 00000100:00100000:3.0:1746155647.375352:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126148864 00000100:00100000:3.0:1746155647.375360:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126149120 00000100:00100000:3.0:1746155647.375362:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126149120 00000100:00100000:3.0:1746155647.375372:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17420 00000100:00100000:3.0:1746155647.375376:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126149248:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155647.375390:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.375398:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.375404:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155647.375407:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155647.375408:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155647.375410:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.375422:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 27 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.375429:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 27 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.375436:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125440768:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155647.375454:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca29900 going to sleep for 11 seconds 00000100:00100000:3.0:1746155647.375464:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126149376 00000100:00100000:3.0:1746155647.375467:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126149376 00000100:00100000:3.0:1746155647.375482:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17421 00000100:00100000:3.0:1746155647.375486:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976126148864:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:0.0:1746155647.375497:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17422 00010000:00010000:3.0:1746155647.375499:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.375522:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126149120:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155647.375525:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f893b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188bc expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.375532:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c000/0x844e5faceb5f8a29 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1892c expref: 24 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.375538:0:20796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.375541:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f89f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188fb expref: 19 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.375550:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.375551:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.375553:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.375553:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 27 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.375559:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155647.375560:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155647.375562:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.375567:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f89f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188fb expref: 19 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.375574:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f89f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188fb expref: 19 pid: 20200 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.375575:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17423 00010000:00010000:0.0:1746155647.375576:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 27 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.375581:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976126149376:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:3.0:1746155647.375582:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125440896:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.375584:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 27 pid: 19959 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.375592:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125441024:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.375595:0:29728:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.375603:0:29728:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 24 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.375607:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155647.375609:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155647.375611:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.375611:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c9a240 going to sleep for 11 seconds 00010000:00010000:3.0:1746155647.375613:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00c000/0x844e5faceb5f8a29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1892c expref: 24 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.375619:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b00c000/0x844e5faceb5f8a29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1892c expref: 24 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.375626:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125441152:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.375628:0:29728:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 24 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.375636:0:29728:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 24 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.375643:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fedaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125441280:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155647.375646:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f893b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188bc expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.375657:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f893b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188bc expref: 13 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.375662:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b1103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155647.375664:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125441408:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155647.375683:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ca293c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.378740:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.378771:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.378772:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125440128:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155647.378782:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125440256:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155647.378789:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125440384:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.378802:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155647.378806:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.378813:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.378846:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8436:1830976125440768:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.378856:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.378863:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125441024:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.378889:0:20796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.378930:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.379018:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125440896:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155647.379025:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125441152:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155647.379032:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125441408:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155647.379046:0:20200:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.379065:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126149504 00000100:00100000:3.0:1746155647.379069:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126149504 00010000:00010000:3.0:1746155647.379088:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00d400/0x844e5faceb5f89ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188f4 expref: 28 pid: 20200 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.379727:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fedaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125441280:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.379739:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126149760 00010000:00010000:0.0:1746155647.379740:0:29728:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.379743:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126149760 00010000:00010000:1.0:1746155647.379757:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f892d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188b5 expref: 12 pid: 19959 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.379757:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126150016 00000100:00100000:0.0:1746155647.379759:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126150016 00000100:00100000:1.0:1746155647.379778:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126149632 00000100:00100000:1.0:1746155647.379780:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126149632 00002000:00100000:0.0:1746155647.379783:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->2252799) req@ffff880095269500 x1830976126150016/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746155647.379789:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00c200/0x844e5faceb5f8a22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18925 expref: 42 pid: 1625 timeout: 876 lvb_type: 1 00002000:00100000:0.0:1746155647.379791:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269500 with x1830976126150016 ext(2097152->2252799) 00000100:00100000:1.0:1746155647.379797:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126149888 00010000:00010000:0.0:1746155647.379797:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 29 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.379798:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126149888 00010000:00010000:1.0:1746155647.379806:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009455d400/0x844e5faceb5f8bd4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a36 expref: 14 pid: 8438 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.379807:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 29 pid: 8438 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746155647.379813:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095269500 00000100:00100000:1.0:1746155647.379816:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8944 00000100:00100000:1.0:1746155647.379821:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1962:x1830976126149504:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.379830:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155647.379838:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8945 00000100:00100000:0.0:1746155647.379844:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976126149760:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155647.379846:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8946 00010000:00010000:1.0:1746155647.379848:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b00d400/0x844e5faceb5f89ea lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188f4 expref: 29 pid: 20200 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.379850:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155647.379852:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976126149632:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.379857:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b00d400/0x844e5faceb5f89ea lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188f4 expref: 29 pid: 20200 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.379858:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155647.379934:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8947 00000100:00100000:3.0:1746155647.379940:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126149888:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.379999:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.380010:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009455d400/0x844e5faceb5f8bd4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a36 expref: 14 pid: 8438 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.380018:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009455d400/0x844e5faceb5f8bd4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a36 expref: 14 pid: 8438 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.380035:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.380063:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126149888:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 123us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.380069:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8947 00010000:00010000:2.0:1746155647.380188:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b00c200/0x844e5faceb5f8a22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18925 expref: 42 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.380188:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f892d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188b5 expref: 12 pid: 19959 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.380194:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b00d400/0x844e5faceb5f89ea lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188f4 expref: 29 pid: 20200 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.380197:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f892d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188b5 expref: 12 pid: 19959 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.380203:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b00c200/0x844e5faceb5f8a22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18925 expref: 42 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.380215:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155647.380215:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f892d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188b5 expref: 12 pid: 19959 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.380220:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b00c200/0x844e5faceb5f8a22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18925 expref: 42 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.380228:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.380229:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746155647.380231:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1962:x1830976126149504:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 410us (1497us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155647.380232:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.380237:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8944 00010000:00010000:2.0:1746155647.380239:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.380247:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155647.380253:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155647.380262:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009455d400/0x844e5faceb5f8bd4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a36 expref: 13 pid: 8438 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.380262:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976126149760:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 418us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.380263:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1961:x1830976126149632:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 412us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.380268:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8945 00000100:00100000:2.0:1746155647.380270:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8946 00000100:00100000:1.0:1746155647.380271:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125440512:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.380278:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125440640:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.380283:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1457 00010000:00010000:2.0:1746155647.380286:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.380287:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976126150016:12345-192.168.202.51@tcp:4:multiop.0 00010000:00010000:1.0:1746155647.380288:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.380296:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.380311:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.380317:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.380323:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.380328:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012de33400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155647.380331:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.380338:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.380346:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.380352:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012de33400/0x844e5faceb5f8c4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.380379:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126148736:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 5668us (5794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.380385:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17418 00000100:00100000:0.0:1746155647.380517:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.380587:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.380600:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126150272 00000100:00100000:3.0:1746155647.380603:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126150272 00010000:00010000:3.0:1746155647.380614:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f8b64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f7 expref: 25 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.380637:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8948 00000100:00100000:3.0:1746155647.380642:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126150272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.380648:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.380656:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f8b64 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f7 expref: 25 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.380663:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f8b64 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f7 expref: 25 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.380673:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f8b64 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189f7 expref: 25 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.380698:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.380699:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.380702:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.380711:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.380713:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126150144 00000100:00100000:2.0:1746155647.380716:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126150144 00010000:00010000:3.0:1746155647.380723:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746155647.380727:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e3:0x0] (1265664->2097151) req@ffff88009526bb80 x1830976126150144/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.380732:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526bb80 with x1830976126150144 ext(1265664->2097151) 00010000:00010000:1.0:1746155647.380733:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.380736:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 29 pid: 19959 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.380739:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976126150272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 97us (152us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155647.380740:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.380742:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 29 pid: 19959 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.380745:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8948 00002000:00010000:2.0:1746155647.380745:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009526bb80 00010000:00010000:1.0:1746155647.380757:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.380758:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1458 00000100:00100000:2.0:1746155647.380761:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1961:x1830976126150144:12345-192.168.202.51@tcp:4:multiop.0 00010000:00010000:1.0:1746155647.380762:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.380768:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.380773:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdf1800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155647.380776:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.380781:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.380790:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.380796:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.380825:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976126148992:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 5870us (6196us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.380830:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17419 00000100:00100000:0.0:1746155647.381264:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.381285:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.381298:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.381327:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.381343:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126150400 00000100:00100000:3.0:1746155647.381346:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126150400 00010000:00010000:3.0:1746155647.381357:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f89f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188fb expref: 20 pid: 20200 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.381371:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126150656 00000100:00100000:3.0:1746155647.381372:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126150656 00010000:00010000:3.0:1746155647.381380:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f893b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188bc expref: 12 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.381391:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126150784 00000100:00100000:3.0:1746155647.381392:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126150784 00010000:00010000:3.0:1746155647.381400:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00c000/0x844e5faceb5f8a29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1892c expref: 24 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.381411:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8949 00000100:00100000:2.0:1746155647.381414:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126150528 00000100:00100000:3.0:1746155647.381416:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1962:x1830976126150400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155647.381417:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126150528 00010000:00010000:3.0:1746155647.381421:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.381430:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f89f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188fb expref: 20 pid: 20200 timeout: 876 lvb_type: 1 00002000:00100000:2.0:1746155647.381431:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (2695168->2883583) req@ffff8800a3fc4e00 x1830976126150528/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746155647.381438:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f89f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188fb expref: 20 pid: 20200 timeout: 876 lvb_type: 1 00002000:00100000:2.0:1746155647.381438:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc4e00 with x1830976126150528 ext(2695168->2883583) 00010000:00010000:3.0:1746155647.381449:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b00ca00/0x844e5faceb5f89f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188fb expref: 20 pid: 20200 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.381449:0:10888:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 25 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.381457:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155647.381458:0:10888:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 25 pid: 8438 timeout: 876 lvb_type: 0 00002000:00010000:2.0:1746155647.381468:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a3fc4e00 00000100:00100000:3.0:1746155647.381474:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976126150400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 58us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.381478:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8949 00000100:00100000:1.0:1746155647.381484:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8950 00000100:00100000:2.0:1746155647.381486:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1459 00000100:00100000:3.0:1746155647.381489:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8951 00000100:00100000:2.0:1746155647.381491:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126150528:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155647.381491:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976126150656:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155647.381493:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126150784:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.381498:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.381499:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155647.381521:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f893b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188bc expref: 12 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.381523:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b00c000/0x844e5faceb5f8a29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1892c expref: 25 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.381529:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f893b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188bc expref: 12 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.381538:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b00c000/0x844e5faceb5f8a29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1892c expref: 25 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.381646:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f893b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f188bc expref: 12 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.381655:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155647.381674:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b00c000/0x844e5faceb5f8a29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1892c expref: 26 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.381687:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.381688:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.381691:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.381697:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.381712:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155647.381722:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.381729:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.381741:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.381746:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.381788:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976126150656:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 296us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.381794:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8950 00010000:00010000:3.0:1746155647.381821:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.381827:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094949000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155647.381830:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.381836:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.381884:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.381891:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094949000/0x844e5faceb5f8c60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.381935:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126148864:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 6447us (6651us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.381941:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17421 00000100:00100000:3.0:1746155647.381968:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126150784:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 474us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.381973:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8951 00000100:00100000:0.0:1746155647.384226:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976126150016:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 3079us (4436us total) trans 17179874377 rc 0/0 00000100:00100000:0.0:1746155647.384235:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1457 00002000:00100000:0.0:1746155647.384244:0:8442:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->2252799) req@ffff880095269500 x1830976126150016/t17179874377(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/448 e 0 to 0 dl 1746155658 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.384252:0:8442:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269500 with x1830976126150016 ext(2097152->2252799) 00010000:00010000:0.0:1746155647.384259:0:8442:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 31 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.384269:0:8442:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 31 pid: 8438 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746155647.384279:0:8442:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880095269500 00000100:00100000:0.0:1746155647.386454:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.386547:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126150912 00000100:00100000:0.0:1746155647.386554:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126150912 00010000:00010000:0.0:1746155647.386576:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 31 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.386600:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8952 00000100:00100000:0.0:1746155647.386606:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1963:x1830976126150912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155647.386617:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155647.386632:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 31 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.386641:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 31 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.386658:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0a00/0x844e5faceb5f8c05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2252799) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a60 expref: 31 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.386670:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.386672:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.386675:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.386682:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.386705:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155647.386746:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1963:x1830976126150912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 139us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.386752:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8952 00000100:00100000:2.0:1746155647.387425:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1961:x1830976126150144:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 6660us (6906us total) trans 17179874378 rc 0/0 00000100:00100000:2.0:1746155647.387434:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1458 00002000:00100000:2.0:1746155647.387441:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e3:0x0] (1265664->2097151) req@ffff88009526bb80 x1830976126150144/t17179874378(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/448 e 0 to 0 dl 1746155658 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.387452:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526bb80 with x1830976126150144 ext(1265664->2097151) 00010000:00010000:2.0:1746155647.387458:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 30 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.387467:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 30 pid: 19959 timeout: 876 lvb_type: 0 00002000:00010000:2.0:1746155647.387473:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009526bb80 00010000:00010000:2.0:1746155647.387490:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.387497:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.387528:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.387539:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.387544:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.387548:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b00da00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155647.387550:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.387554:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.387561:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.387564:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b00da00/0x844e5faceb5f8c59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.387601:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126149248:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 12224us (12364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.387606:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17420 00000100:00100000:3.0:1746155647.387645:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126150528:12345-192.168.202.51@tcp:4:cat.0 Request processed in 6152us (6357us total) trans 21474841681 rc 0/0 00000100:00100000:3.0:1746155647.387652:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1459 00002000:00100000:3.0:1746155647.387658:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x3e2:0x0] (2695168->2883583) req@ffff8800a3fc4e00 x1830976126150528/t21474841681(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/448 e 0 to 0 dl 1746155658 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.387665:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc4e00 with x1830976126150528 ext(2695168->2883583) 00010000:00010000:3.0:1746155647.387671:0:25393:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 25 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.387679:0:25393:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 25 pid: 8438 timeout: 876 lvb_type: 0 00002000:00010000:3.0:1746155647.387689:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a3fc4e00 00000100:00100000:0.0:1746155647.389449:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.389572:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126151040 00000100:00100000:3.0:1746155647.389578:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126151040 00010000:00010000:3.0:1746155647.389598:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 30 pid: 19959 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.389625:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8953 00000100:00100000:3.0:1746155647.389635:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1960:x1830976126151040:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.389644:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.389657:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 30 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.389666:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 30 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.389681:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d593c00/0x844e5faceb5f8b79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a13 expref: 30 pid: 19959 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.389694:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.389695:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.389698:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.389704:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.389724:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155647.389731:0:20796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.389737:0:20796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.389748:0:20796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.389752:0:20796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.389756:0:20796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.389759:0:20796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26ec00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155647.389761:0:20796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.389762:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+29:1960:x1830976126151040:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 131us (316us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155647.389764:0:20796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.389767:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8953 00010000:00010000:0.0:1746155647.389774:0:20796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.389777:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f26ec00/0x844e5faceb5f8c67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.389807:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126149120:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 14305us (14491us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.389811:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17422 00000100:00100000:0.0:1746155647.390004:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.390040:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126151168 00000100:00100000:3.0:1746155647.390043:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126151168 00010000:00010000:3.0:1746155647.390055:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 25 pid: 8438 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.390070:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8954 00000100:00100000:3.0:1746155647.390074:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1963:x1830976126151168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.390080:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.390090:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 25 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.390099:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 25 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.390111:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ee00/0x844e5faceb5f8bb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2695168->2883583) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a21 expref: 25 pid: 8438 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.390119:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.390120:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.390123:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.390377:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.390398:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155647.390414:0:29728:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.390419:0:29728:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.390430:0:29728:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.390433:0:29728:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.390437:0:29728:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.390440:0:29728:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdf0400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155647.390442:0:29728:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.390446:0:29728:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.390452:0:29728:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.390455:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdf0400/0x844e5faceb5f8c6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.390492:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126149376:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 14912us (15089us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.390496:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17423 00000100:00100000:3.0:1746155647.391125:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976126151168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1048us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.391132:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8954 00000100:00100000:2.0:1746155647.391708:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.391746:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126151424 00000100:00100000:0.0:1746155647.391750:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126151424 00000100:00100000:0.0:1746155647.391777:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11218 00000100:00100000:0.0:1746155647.391782:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32531:x1830976126151424:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:0.0:1746155647.391815:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155647.391829:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1200/0x844e5faceb5f8c1a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a67 expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.391838:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155647.391842:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155647.391864:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155647.391887:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1891e expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.391892:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 294 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.391897:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18956 expref: 15 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.391902:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8aed lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b1 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.391908:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135586400/0x844e5faceb5f8b41 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189db expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.391913:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 8/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155647.391933:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880135586400/0x844e5faceb5f8b41 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189db expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.391943:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880135586400/0x844e5faceb5f8b41 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189db expref: 294 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.391952:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125441536:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.392306:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8aed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b1 expref: 15 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.392319:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8aed lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b1 expref: 15 pid: 15474 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.392326:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125441664:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.392366:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18956 expref: 15 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.392372:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18956 expref: 15 pid: 20364 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.392378:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125441792:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.392396:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 294 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.392403:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 294 pid: 20364 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.392408:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125441920:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.392428:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1891e expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.392434:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1891e expref: 15 pid: 14234 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.392440:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0da300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125442048:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.392583:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c9a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.395069:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.395094:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125441536:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.395095:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.395103:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125441664:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.395110:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125441792:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.395144:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.395165:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126151936 00000100:00100000:2.0:1746155647.395170:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126151936 00000100:00100000:2.0:1746155647.395201:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4780 00000100:00100000:2.0:1746155647.395208:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:7660:x1830976126151936:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746155647.395268:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126151552 00000100:00100000:1.0:1746155647.395272:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126151552 00010000:00010000:1.0:1746155647.395288:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135586400/0x844e5faceb5f8b41 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189db expref: 295 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.395304:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126151680 00000100:00100000:1.0:1746155647.395306:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126151680 00010000:00010000:1.0:1746155647.395313:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18956 expref: 18 pid: 20364 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.395327:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8955 00000100:00100000:1.0:1746155647.395332:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1961:x1830976126151552:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.395340:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155647.395344:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880135586400/0x844e5faceb5f8b41 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189db expref: 295 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.395353:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880135586400/0x844e5faceb5f8b41 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189db expref: 295 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.395357:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:7660:x1830976126151936:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 149us (261us total) trans 8589945399 rc 0/0 00010000:00010000:1.0:1746155647.395370:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135586400/0x844e5faceb5f8b41 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189db expref: 295 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.395383:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.395387:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.395394:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155647.395411:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1961:x1830976126151552:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 79us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.395417:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8955 00000100:00100000:1.0:1746155647.395431:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8956 00000100:00100000:1.0:1746155647.395435:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126151680:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.395440:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155647.395443:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18956 expref: 18 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.395453:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18956 expref: 18 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.395462:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0600/0x844e5faceb5f8a53 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18956 expref: 18 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.395469:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.395472:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.395476:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155647.395489:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976126151680:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.395494:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8956 00000100:00100000:2.0:1746155647.395531:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4780 00000100:00100000:1.0:1746155647.395840:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125441920:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.395974:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.395990:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0da300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125442048:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.396012:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155647.396018:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.396026:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126152064 00000100:00100000:1.0:1746155647.396029:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126152064 00010000:00010000:1.0:1746155647.396039:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1891e expref: 16 pid: 14234 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.396096:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126152192 00000100:00100000:1.0:1746155647.396099:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126152192 00010000:00010000:1.0:1746155647.396108:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 294 pid: 20364 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.396197:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8957 00000100:00100000:1.0:1746155647.396203:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976126152064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.396209:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155647.396212:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1891e expref: 16 pid: 14234 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.396219:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1891e expref: 16 pid: 14234 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.396228:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8a1b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1891e expref: 16 pid: 14234 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.396236:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.396240:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.396244:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155647.396264:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976126152064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 62us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.396269:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8957 00000100:00100000:1.0:1746155647.396296:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8958 00000100:00100000:1.0:1746155647.396301:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1963:x1830976126152192:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.396306:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155647.396309:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 294 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.396320:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 294 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.396328:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b00d800/0x844e5faceb5f8a4c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1894f expref: 294 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.396336:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.396338:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.396342:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155647.396356:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1963:x1830976126152192:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.396360:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8958 00000100:00100000:2.0:1746155647.398960:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.399021:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126152320 00000100:00100000:0.0:1746155647.399028:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126152320 00010000:00010000:0.0:1746155647.399053:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8aed lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b1 expref: 15 pid: 15474 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.399079:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8959 00000100:00100000:0.0:1746155647.399084:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976126152320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155647.399093:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155647.399097:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8aed lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b1 expref: 15 pid: 15474 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.399105:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8aed lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b1 expref: 15 pid: 15474 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.399119:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fdd8000/0x844e5faceb5f8aed lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f189b1 expref: 15 pid: 15474 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.399136:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155647.399140:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155647.399146:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155647.399152:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155647.399171:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155647.399190:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.399197:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155647.399198:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976126152320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 114us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.399203:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8959 00000040:00080000:1.0:1746155647.399628:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3671, 88 off309968 00000004:00080000:1.0:1746155647.399633:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776549130153ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.399671:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3666, 88 off309792 00000004:00080000:1.0:1746155647.399674:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776549171448ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.399688:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3667, 88 off309880 00000004:00080000:1.0:1746155647.399689:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776549186666ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.399694:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3672, 88 off310056 00000004:00080000:1.0:1746155647.399695:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776549192471ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.399699:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3673, 88 off310144 00000004:00080000:1.0:1746155647.399701:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776549197909ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.399704:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3668, 88 off309968 00000004:00080000:1.0:1746155647.399706:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776549203121ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.399710:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3669, 88 off310056 00000004:00080000:1.0:1746155647.399711:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776549208126ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.399720:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3670, 88 off310144 00000004:00080000:1.0:1746155647.399721:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776549218526ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.399725:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3674, 88 off310232 00000004:00080000:1.0:1746155647.399727:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776549224001ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.399811:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3671, 88 off310232 00000004:00080000:1.0:1746155647.399816:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776549313426ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.399978:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3675, 88 off310320 00000004:00080000:1.0:1746155647.399984:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776549481309ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.400068:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3672, 88 off310320 00000004:00080000:1.0:1746155647.400072:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776549568953ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.400085:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3676, 88 off310408 00000004:00080000:1.0:1746155647.400088:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776549584712ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.400093:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3677, 88 off310496 00000004:00080000:1.0:1746155647.400096:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776549592729ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.400101:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3678, 88 off310584 00000004:00080000:1.0:1746155647.400103:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776549599731ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.400107:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3679, 88 off310672 00000004:00080000:1.0:1746155647.400110:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776549606539ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.400115:0:15474:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3673, 88 off310408 00000004:00080000:1.0:1746155647.400117:0:15474:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776549614273ns, next at 716011101328ns, rc = 0 00000004:00010000:1.0:1746155647.421229:0:15474:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800936f6680 reply state ffff88012f5e8800 transno 8589945400 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155647.421243:0:15474:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746155647.421341:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:32531:x1830976126151424:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 29554us (29629us total) trans 8589945400 rc 0/0 00000100:00100000:1.0:1746155647.421349:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11218 00000001:00080000:1.0:1746155647.421381:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945396 is committed 00000001:00080000:1.0:1746155647.421389:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945392 is committed 00000001:00080000:1.0:1746155647.421485:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945400 is committed 00000004:00080000:1.0:1746155647.421491:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2857 committed 00000004:00080000:1.0:1746155647.421497:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2857 committed 00000004:00080000:1.0:1746155647.421517:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2856 committed 00000004:00080000:1.0:1746155647.421519:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2855 committed 00000004:00080000:1.0:1746155647.421521:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2854 committed 00000004:00080000:1.0:1746155647.421522:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2856 committed 00000004:00080000:1.0:1746155647.421524:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2853 committed 00000004:00080000:1.0:1746155647.421525:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2855 committed 00000004:00080000:1.0:1746155647.421526:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2852 committed 00000004:00080000:1.0:1746155647.421527:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2854 committed 00000004:00080000:1.0:1746155647.421529:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2853 committed 00000004:00080000:1.0:1746155647.421530:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2852 committed 00000004:00080000:1.0:1746155647.421531:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2851 committed 00000004:00080000:1.0:1746155647.421532:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2850 committed 00000004:00080000:1.0:1746155647.421533:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2851 committed 00000004:00080000:1.0:1746155647.421534:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2850 committed 00000004:00080000:1.0:1746155647.421536:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2849 committed 00000001:00080000:1.0:1746155647.421543:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945394 is committed 00000001:00080000:1.0:1746155647.421547:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945387 is committed 00000001:00080000:1.0:1746155647.421555:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945399 is committed 00000001:00080000:1.0:1746155647.421570:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945395 is committed 00000100:00100000:0.0:1746155647.421634:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125442176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155647.421667:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125442304:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.421671:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.421686:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155647.421694:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125442688:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155647.421698:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746155647.421703:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125442432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.421707:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.421715:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155647.421716:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746155647.421720:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125442560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155647.421725:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125443072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155647.421726:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125442816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.421732:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.421743:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125442176 00000100:00100000:1.0:1746155647.421749:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125442176 00000100:00100000:0.0:1746155647.421749:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125442304 00000100:00100000:0.0:1746155647.421750:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125442304 00000100:00100000:2.0:1746155647.421752:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155647.421768:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125442688 00000100:00100000:0.0:1746155647.421774:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125442688 00000100:00100000:2.0:1746155647.421778:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125442944:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.421783:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125442432 00000100:00100000:1.0:1746155647.421784:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125442560 00000100:00100000:0.0:1746155647.421785:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125442432 00000100:00100000:1.0:1746155647.421786:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125442560 00000100:00100000:2.0:1746155647.421793:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155647.421793:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125443072 00000100:00100000:0.0:1746155647.421795:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125443072 00000100:00100000:1.0:1746155647.421798:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125442944 00000100:00100000:1.0:1746155647.421799:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125442944 00000100:00100000:0.0:1746155647.421803:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17424 00000100:00100000:0.0:1746155647.421807:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3295:x1830976125442304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155647.421808:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17425 00000100:00100000:1.0:1746155647.421811:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+67:3298:x1830976125442176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155647.421812:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17426 00000100:00100000:2.0:1746155647.421819:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+67:3298:x1830976125442688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.421822:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17427 00000100:00100000:0.0:1746155647.421826:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3295:x1830976125442432:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155647.421853:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17428 00000100:00100000:2.0:1746155647.421858:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+67:3298:x1830976125442560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155647.421881:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17429 00000100:00100000:1.0:1746155647.421886:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3297:x1830976125443072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.421942:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17430 00000100:00100000:0.0:1746155647.421947:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+69:3296:x1830976125442944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155647.421972:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00000100:00100000:1.0:1746155647.421973:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+70:3297:x1830976125443072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (220us total) trans 21474841682 rc 0/0 00002000:00010000:2.0:1746155647.421975:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:2.0:1746155647.421977:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746155647.421978:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00000100:00100000:1.0:1746155647.421978:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17429 00002000:00010000:2.0:1746155647.421980:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746155647.421994:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155647.422000:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+70:3298:x1830976125442688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 182us (292us total) trans 21474841684 rc 0/0 00000100:00100000:2.0:1746155647.422005:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17426 00000100:00100000:1.0:1746155647.422012:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125442816 00000100:00100000:1.0:1746155647.422014:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125442816 00000100:00100000:0.0:1746155647.422026:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+70:3296:x1830976125442944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (232us total) trans 21474841685 rc 0/0 00000100:00100000:1.0:1746155647.422027:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17431 00000004:00080000:2.0:1746155647.422031:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca95180/2, rc 0, transno 21474841682 00000100:00100000:1.0:1746155647.422031:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+70:3295:x1830976125442816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.422031:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17430 00000100:00100000:2.0:1746155647.422036:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125443072:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155647.422049:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ca94a80/2, rc 0, transno 21474841685 00000100:00100000:2.0:1746155647.422052:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125442944:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155647.422093:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:3298:x1830976125442560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 234us (358us total) trans 21474841686 rc 0/0 00000100:00100000:2.0:1746155647.422098:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17428 00000100:00100000:1.0:1746155647.422104:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+72:3295:x1830976125442816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (108us total) trans 21474841687 rc 0/0 00000100:00100000:0.0:1746155647.422104:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+72:3295:x1830976125442304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 296us (416us total) trans 21474841688 rc 0/0 00000100:00100000:1.0:1746155647.422109:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17431 00000100:00100000:0.0:1746155647.422111:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17424 00000004:00080000:1.0:1746155647.422129:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fdc00/2, rc 0, transno 21474841687 00000100:00100000:1.0:1746155647.422133:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125442816:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155647.422139:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f5880/2, rc 0, transno 21474841688 00000100:00100000:1.0:1746155647.422141:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125442304:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746155647.422152:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155647.422160:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155647.422166:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155647.422171:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26f000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155647.422175:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155647.422184:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155647.422199:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155647.422202:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155647.422205:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155647.422209:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8c75 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155647.422303:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125443328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.422320:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.422335:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125443840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.422346:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.422355:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746155647.422358:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125443456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.422368:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155647.422373:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125443328 00000100:00100000:3.0:1746155647.422375:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125443328 00000100:00100000:1.0:1746155647.422376:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125443968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.422386:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155647.422391:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125443840 00000100:00100000:3.0:1746155647.422393:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125443840 00000100:00100000:3.0:1746155647.422400:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125443968 00000100:00100000:3.0:1746155647.422402:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125443968 00000100:00100000:3.0:1746155647.422410:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17432 00000100:00100000:3.0:1746155647.422414:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3295:x1830976125443328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155647.422528:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+62:3295:x1830976125443328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (205us total) trans 17179874379 rc 0/0 00000100:00100000:3.0:1746155647.422533:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17432 00000100:00100000:1.0:1746155647.422536:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125443456 00000100:00100000:1.0:1746155647.422540:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125443456 00000100:00100000:3.0:1746155647.422542:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17433 00000100:00100000:3.0:1746155647.422546:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+62:3295:x1830976125443840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.422552:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17434 00000100:00100000:1.0:1746155647.422556:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+62:3295:x1830976125443968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155647.422613:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+64:3295:x1830976125443840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (265us total) trans 17179874380 rc 0/0 00000100:00100000:1.0:1746155647.422616:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+64:3295:x1830976125443968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (229us total) trans 17179874381 rc 0/0 00000100:00100000:3.0:1746155647.422618:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17433 00000100:00100000:1.0:1746155647.422620:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17434 00000100:00100000:1.0:1746155647.422626:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17435 00000100:00100000:1.0:1746155647.422630:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+62:3295:x1830976125443456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.422703:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+63:3295:x1830976125443456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (333us total) trans 17179874382 rc 0/0 00000100:00100000:2.0:1746155647.422749:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125443584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155647.422770:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155647.422775:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+69:3295:x1830976125442432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 948us (1058us total) trans 21474841683 rc 0/0 00000100:00100000:2.0:1746155647.422784:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125444096:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155647.422795:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155647.422806:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746155647.422810:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125443200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155647.422824:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155647.422831:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125443712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155647.422842:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155647.423301:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125443584 00000100:00100000:3.0:1746155647.423304:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125443584 00000100:00100000:3.0:1746155647.423314:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125444096 00000100:00100000:3.0:1746155647.423315:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125444096 00000100:00100000:3.0:1746155647.423320:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125443200 00000100:00100000:3.0:1746155647.423321:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125443200 00000100:00100000:3.0:1746155647.423326:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125443712 00000100:00100000:3.0:1746155647.423328:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125443712 00000100:00100000:3.0:1746155647.423336:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17436 00000100:00100000:3.0:1746155647.423339:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3297:x1830976125443584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155647.423376:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17437 00000100:00100000:2.0:1746155647.423383:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+67:3297:x1830976125444096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155647.423395:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17438 00000100:00100000:2.0:1746155647.423398:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3297:x1830976125443200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155647.423419:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3297:x1830976125443584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (648us total) trans 17179874383 rc 0/0 00000100:00100000:3.0:1746155647.423425:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17436 00000100:00100000:3.0:1746155647.423435:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17439 00000100:00100000:3.0:1746155647.423439:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3297:x1830976125443712:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155647.423484:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc52d80/2, rc 0, transno 17179874383 00000100:00100000:3.0:1746155647.423491:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125443584:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155647.423499:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc51880/2, rc 0, transno 17179874384 00000100:00100000:2.0:1746155647.423519:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3297:x1830976125443200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (677us total) trans 17179874384 rc 0/0 00000100:00100000:2.0:1746155647.423524:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17438 00000100:00100000:3.0:1746155647.423529:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125443200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155647.423555:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746155647.423560:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125444224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155647.423577:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155647.423616:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+69:3297:x1830976125444096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 234us (818us total) trans 17179874385 rc 0/0 00000100:00100000:2.0:1746155647.423621:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17437 00000100:00100000:2.0:1746155647.423629:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125444224 00000100:00100000:2.0:1746155647.423631:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125444224 00000100:00100000:3.0:1746155647.423642:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+69:3297:x1830976125443712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 202us (798us total) trans 17179874386 rc 0/0 00000100:00100000:2.0:1746155647.423643:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17440 00000100:00100000:3.0:1746155647.423647:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17439 00000100:00100000:2.0:1746155647.423647:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+69:3297:x1830976125444224:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155647.423667:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc53800/2, rc 0, transno 17179874386 00000100:00100000:3.0:1746155647.423670:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125443712:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155647.423676:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc50a80/2, rc 0, transno 17179874385 00000100:00100000:3.0:1746155647.423678:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125444096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.423713:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17435 00000100:00100000:2.0:1746155647.423717:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+69:3297:x1830976125444224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (138us total) trans 17179874387 rc 0/0 00000100:00100000:2.0:1746155647.423722:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17440 00000004:00080000:3.0:1746155647.423733:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc52300/2, rc 0, transno 17179874387 00000100:00100000:3.0:1746155647.423736:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125444224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.423779:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+70:3298:x1830976125442176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1967us (2107us total) trans 21474841689 rc 0/0 00000100:00100000:1.0:1746155647.423783:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17425 00000004:00080000:1.0:1746155647.423799:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc51180/2, rc 0, transno 17179874382 00000100:00100000:1.0:1746155647.423801:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125443456:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155647.423806:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc51c00/2, rc 0, transno 17179874381 00000100:00100000:1.0:1746155647.423807:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125443968:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155647.423811:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc53480/2, rc 0, transno 17179874380 00000100:00100000:1.0:1746155647.423812:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125443840:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155647.423816:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc50000/2, rc 0, transno 17179874379 00000100:00100000:1.0:1746155647.423817:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125443328:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155647.423822:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f6a00/2, rc 0, transno 21474841683 00000100:00100000:1.0:1746155647.423824:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125442432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.423882:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17427 00000004:00080000:0.0:1746155647.424017:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f4380/2, rc 0, transno 21474841686 00000100:00100000:0.0:1746155647.424021:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125442560:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155647.424027:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fce00/2, rc 0, transno 21474841684 00000100:00100000:0.0:1746155647.424029:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125442688:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155647.424035:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f7480/2, rc 0, transno 21474841689 00000100:00100000:0.0:1746155647.424037:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125442176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155647.424401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.424476:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126152448 00000100:00100000:1.0:1746155647.424479:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126152448 00000100:00100000:1.0:1746155647.424523:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11219 00000100:00100000:1.0:1746155647.424528:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32531:x1830976126152448:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155647.424582:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.424596:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c7c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a8a expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.424634:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c7c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a8a expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.424644:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c7c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a8a expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.424660:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.424663:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155647.424665:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf1800, rc 0) 00000100:00100000:1.0:1746155647.424700:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32531:x1830976126152448:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 172us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.424705:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11219 00000100:00100000:0.0:1746155647.427305:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.427395:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126152576 00000100:00100000:1.0:1746155647.427402:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126152576 00000100:00100000:1.0:1746155647.427483:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11220 00000100:00100000:1.0:1746155647.427491:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32531:x1830976126152576:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155647.429938:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.429961:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8c83 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a91 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.430036:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1e00/0x844e5faceb5f8c8a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.430047:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1e00/0x844e5faceb5f8c8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.430056:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1e00/0x844e5faceb5f8c8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155647.430080:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155647.430087:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155647.430099:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1e00/0x844e5faceb5f8c8a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.430122:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8c83 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a91 expref: 10 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.430135:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1e00/0x844e5faceb5f8c8a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a91 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.430142:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.430144:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155647.430147:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf1e00, rc 0) 00000100:00100000:1.0:1746155647.430194:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32531:x1830976126152576:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2705us (2896us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.430201:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11220 00000100:00100000:0.0:1746155647.432079:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.432106:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.432153:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126152704 00000100:00100000:2.0:1746155647.432159:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126152704 00000100:00100000:0.0:1746155647.432200:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.432201:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126152832 00000100:00100000:2.0:1746155647.432203:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126152832 00000100:00100000:2.0:1746155647.432387:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126152960 00000100:00100000:2.0:1746155647.432390:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126152960 00000100:00100000:0.0:1746155647.432391:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17441 00000100:00100000:0.0:1746155647.432399:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976126152704:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:2.0:1746155647.432403:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17442 00000100:00100000:2.0:1746155647.432407:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976126152832:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155647.432412:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155647.432412:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.432425:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8c98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a9f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.432425:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009455d400/0x844e5faceb5f8c91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18a98 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155647.432443:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x6814387c, atime: 0x6814387c, ctime: 0x6814387c, blocks: 0x81f 00002000:00010000:0.0:1746155647.432443:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e1:0x0] initial LVB size: 1048576, mtime: 0x6814387c, atime: 0x6814387c, ctime: 0x6814387c, blocks: 0x7e9 00010000:00010000:2.0:1746155647.432455:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.432455:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.432457:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.432457:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.432462:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a9f expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.432462:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009455d400/0x844e5faceb5f8c91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a98 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.432473:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a9f expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.432473:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009455d400/0x844e5faceb5f8c91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a98 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.432481:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00d200, rc 0) 00010000:00010000:0.0:1746155647.432481:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009455d400, rc 0) 00000100:00100000:1.0:1746155647.432539:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17443 00000100:00100000:1.0:1746155647.432545:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126152960:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155647.432551:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.432559:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1c00/0x844e5faceb5f8c9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18aa6 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155647.432569:0:29728:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x6814387f, atime: 0x6814387f, ctime: 0x6814387f, blocks: 0x821 00010000:00010000:1.0:1746155647.432576:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.432577:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.432581:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1c00/0x844e5faceb5f8c9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aa6 expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.432590:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1c00/0x844e5faceb5f8c9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aa6 expref: 12 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.432595:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf1c00, rc 0) 00000100:00100000:2.0:1746155647.432956:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976126152832:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 547us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.432956:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976126152960:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 410us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.432962:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17443 00000100:00100000:2.0:1746155647.432967:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17442 00000100:00100000:0.0:1746155647.433003:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976126152704:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 605us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.433007:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17441 00000100:00100000:0.0:1746155647.433338:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.433362:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.433388:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.433442:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126153088 00000100:00100000:2.0:1746155647.433445:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126153088 00000100:00100000:2.0:1746155647.433458:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126153216 00000100:00100000:2.0:1746155647.433460:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126153216 00000100:00100000:2.0:1746155647.433468:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126153344 00000100:00100000:2.0:1746155647.433469:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126153344 00000100:00100000:2.0:1746155647.433479:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17444 00000100:00100000:2.0:1746155647.433488:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126153088:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155647.433495:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.433518:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b00c600/0x844e5faceb5f8ca6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18aad expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155647.433530:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e3:0x0] initial LVB size: 2097152, mtime: 0x6814387f, atime: 0x6814387f, ctime: 0x6814387f, blocks: 0x821 00010000:00010000:2.0:1746155647.433538:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.433539:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.433543:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00c600/0x844e5faceb5f8ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aad expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.433552:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b00c600/0x844e5faceb5f8ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aad expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.433558:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00c600, rc 0) 00000100:00100000:2.0:1746155647.433577:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126153088:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 88us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.433581:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17444 00000100:00100000:2.0:1746155647.433591:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17445 00000100:00100000:2.0:1746155647.433597:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1963:x1830976126153216:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155647.433601:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.433608:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8cad lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ab4 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155647.433622:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e4:0x0] initial LVB size: 5079552, mtime: 0x6814387f, atime: 0x6814387f, ctime: 0x6814387f, blocks: 0x1711 00010000:00010000:2.0:1746155647.433628:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.433630:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.433633:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8cad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ab4 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.433641:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8cad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ab4 expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.433647:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00ce00, rc 0) 00000100:00100000:2.0:1746155647.433660:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976126153216:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 64us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.433665:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17445 00000100:00100000:2.0:1746155647.433674:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17446 00000100:00100000:2.0:1746155647.433679:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1963:x1830976126153344:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155647.433684:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.433690:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8cb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18abb expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155647.433700:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e2:0x0] initial LVB size: 4194304, mtime: 0x6814387f, atime: 0x6814387f, ctime: 0x6814387f, blocks: 0x1029 00010000:00010000:2.0:1746155647.433706:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.433708:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.433712:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18abb expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.433720:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18abb expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.433727:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b00da00, rc 0) 00000100:00100000:2.0:1746155647.433740:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976126153344:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 61us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.433744:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17446 00000100:00100000:0.0:1746155647.438030:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.438094:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126153600 00000100:00100000:3.0:1746155647.438101:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126153600 00000100:00100000:3.0:1746155647.438161:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8286 00000100:00100000:3.0:1746155647.438169:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126153600:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155647.438199:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8cbb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.438211:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.438212:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.438217:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8cbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.438227:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8cbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.439575:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.439619:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126153856 00000100:00100000:3.0:1746155647.439625:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126153856 00000100:00100000:3.0:1746155647.439656:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8287 00000100:00100000:3.0:1746155647.439662:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976126153856:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155647.439684:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ec00/0x844e5faceb5f8cc2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.439693:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.439694:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.439697:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ec00/0x844e5faceb5f8cc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.439705:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ec00/0x844e5faceb5f8cc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.441140:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.441210:0:8442:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126154112 00000100:00100000:1.0:1746155647.441216:0:8442:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126154112 00000100:00100000:1.0:1746155647.441250:0:8442:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8288 00000100:00100000:1.0:1746155647.441256:0:8442:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976126154112:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155647.441282:0:8442:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1600/0x844e5faceb5f8cc9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.441293:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.441295:0:8442:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.441298:0:8442:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1600/0x844e5faceb5f8cc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.441308:0:8442:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1600/0x844e5faceb5f8cc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.444483:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.444528:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.444551:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.444570:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126154496 00000100:00100000:2.0:1746155647.444576:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126154496 00000100:00100000:2.0:1746155647.444616:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126154624 00000100:00100000:2.0:1746155647.444618:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126154624 00000100:00100000:2.0:1746155647.444633:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126154880 00000100:00100000:2.0:1746155647.444635:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126154880 00000100:00100000:2.0:1746155647.444649:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8289 00000100:00100000:2.0:1746155647.444655:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976126154496:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155647.444686:0:31249:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f8cd0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.444698:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.444700:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.444705:0:31249:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f8cd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.444721:0:31249:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f8cd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.445066:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8290 00000100:00100000:3.0:1746155647.445074:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126154624:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155647.445092:0:2798:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8cd7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.445099:0:2798:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.445100:0:2798:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.445103:0:2798:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8cd7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.445110:0:2798:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8cd7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.445169:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8291 00000100:00100000:1.0:1746155647.445177:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126154880:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155647.445191:0:31250:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8cde lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.445198:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.445200:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.445202:0:31250:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8cde lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.445210:0:31250:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8cde lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.445560:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.445572:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126154752 00000100:00100000:0.0:1746155647.445575:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126154752 00000100:00100000:0.0:1746155647.445594:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8292 00000100:00100000:0.0:1746155647.445598:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976126154752:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155647.445609:0:31252:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f8ce5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.445616:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.445617:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.445620:0:31252:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f8ce5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.445626:0:31252:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f8ce5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.446672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155647.447269:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8cbb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.447281:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8cbb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.447289:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8cbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.447296:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5f000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155647.447299:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8cbb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.447306:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8cbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.447321:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8cbb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.447331:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5f000/0x844e5faceb5f8cbb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.447377:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976126153600:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 9208us (9352us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.447385:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8286 00000100:00100000:3.0:1746155647.447403:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126155264 00000100:00100000:3.0:1746155647.447408:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126155264 00000100:00100000:3.0:1746155647.447437:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8293 00000100:00100000:3.0:1746155647.447443:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1961:x1830976126155264:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155647.447462:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f800/0x844e5faceb5f8cec lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.447471:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.447473:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.447476:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f800/0x844e5faceb5f8cec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.447485:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f800/0x844e5faceb5f8cec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.452693:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ec00/0x844e5faceb5f8cc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.452709:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ec00/0x844e5faceb5f8cc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.452720:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ec00/0x844e5faceb5f8cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.452726:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5ec00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155647.452728:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ec00/0x844e5faceb5f8cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.452733:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ec00/0x844e5faceb5f8cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.452745:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ec00/0x844e5faceb5f8cc2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.452749:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ec00/0x844e5faceb5f8cc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.452904:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1960:x1830976126153856:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 13237us (13328us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.452912:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8287 00010000:00010000:1.0:1746155647.456126:0:8442:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1600/0x844e5faceb5f8cc9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.456143:0:8442:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1600/0x844e5faceb5f8cc9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.456152:0:8442:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1600/0x844e5faceb5f8cc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.456158:0:8442:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdf1600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155647.456161:0:8442:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1600/0x844e5faceb5f8cc9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.456168:0:8442:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1600/0x844e5faceb5f8cc9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.456184:0:8442:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1600/0x844e5faceb5f8cc9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.456190:0:8442:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1600/0x844e5faceb5f8cc9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8442 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.456278:0:8442:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1960:x1830976126154112:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 15018us (15137us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155647.456288:0:8442:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8288 00000100:00100000:0.0:1746155647.460014:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.460190:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126155520 00000100:00100000:1.0:1746155647.460198:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126155520 00000100:00100000:1.0:1746155647.460235:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11221 00000100:00100000:1.0:1746155647.460243:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32537:x1830976126155520:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155647.460262:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.460275:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0200/0x844e5faceb5f8cf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ac2 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.460306:0:2798:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8cd7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.460316:0:2798:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8cd7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.460322:0:2798:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8cd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.460332:0:2798:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5ea00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155647.460335:0:2798:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8cd7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.460342:0:2798:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8cd7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.460354:0:2798:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8cd7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.460355:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8cfa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155647.460360:0:2798:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8cd7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 2798 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.460365:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460373:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460385:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8d01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460390:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460395:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:3.0:1746155647.460418:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976126154624:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 15345us (15889us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.460426:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8290 00010000:00010000:1.0:1746155647.460477:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0000/0x844e5faceb5f8d08 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460688:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0000/0x844e5faceb5f8d08 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460694:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0000/0x844e5faceb5f8d08 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155647.460705:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155647.460813:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0000/0x844e5faceb5f8d08 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460819:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0000/0x844e5faceb5f8d08 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460823:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0000/0x844e5faceb5f8d08 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460826:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdf0000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155647.460829:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0000/0x844e5faceb5f8d08 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460833:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0000/0x844e5faceb5f8d08 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460840:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.460843:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155647.460845:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0000/0x844e5faceb5f8d08 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460849:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0000/0x844e5faceb5f8d08 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460859:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8cfa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460863:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8cfa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460880:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8cfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460887:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdf0c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155647.460889:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8cfa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460894:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8cfa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460900:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155647.460902:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155647.460904:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8cfa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460908:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8cfa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460915:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8d01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460919:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8d01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460923:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8d01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460927:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdf1000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155647.460929:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8d01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460934:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8d01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460939:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008fc93100) 00010000:00010000:1.0:1746155647.460941:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155647.460943:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8d01 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460947:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8d01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.460975:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0200/0x844e5faceb5f8cf3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ac2 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.460981:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf0200/0x844e5faceb5f8cf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ac2 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.460988:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf0200, rc 0) 00000100:00100000:1.0:1746155647.461005:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32537:x1830976126155520:12345-192.168.202.51@tcp:101:cat.0 Request processed in 764us (1001us total) trans 8589945401 rc 301/301 00000100:00100000:1.0:1746155647.461010:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11221 00010000:00010000:1.0:1746155647.466903:0:31250:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8cde lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.466919:0:31250:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8cde lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.466926:0:31250:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8cde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.466932:0:31250:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cdf0e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155647.466935:0:31250:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8cde lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.466942:0:31250:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8cde lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.466959:0:31250:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8cde lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.466965:0:31250:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0e00/0x844e5faceb5f8cde lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.467028:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976126154880:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 21848us (22473us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155647.467036:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8291 00010000:00010000:2.0:1746155647.471357:0:31252:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f8ce5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.471371:0:31252:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f8ce5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.471378:0:31252:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f8ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.471383:0:31252:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f26e200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155647.471386:0:31252:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f8ce5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.471392:0:31252:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f8ce5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.471405:0:31252:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f8ce5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.471410:0:31252:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f26e200/0x844e5faceb5f8ce5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.471488:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126154752:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 25885us (25924us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.471499:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8292 00010000:00010000:2.0:1746155647.475707:0:31249:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f8cd0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.475720:0:31249:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f8cd0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.475727:0:31249:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f8cd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.475734:0:31249:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f24c200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155647.475737:0:31249:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f8cd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.475745:0:31249:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f8cd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.475760:0:31249:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f8cd0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.475766:0:31249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f24c200/0x844e5faceb5f8cd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.475834:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126154496:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 31175us (31354us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.475843:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8289 00010000:00010000:3.0:1746155647.479386:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f800/0x844e5faceb5f8cec lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.479401:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f800/0x844e5faceb5f8cec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.479408:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f800/0x844e5faceb5f8cec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.479415:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5f800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155647.479418:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f800/0x844e5faceb5f8cec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.479426:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f800/0x844e5faceb5f8cec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.479441:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f800/0x844e5faceb5f8cec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.479446:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f800/0x844e5faceb5f8cec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.479536:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976126155264:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 32089us (32862us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.479545:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8293 00000100:00100000:2.0:1746155647.480673:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.480715:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126155648 00000100:00100000:1.0:1746155647.480722:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126155648 00000100:00100000:1.0:1746155647.480761:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11222 00000100:00100000:1.0:1746155647.480767:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32537:x1830976126155648:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155647.480785:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.480799:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2c00/0x844e5faceb5f8d16 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ac9 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.480858:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x844e5faceb5f8d1d lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.480894:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x844e5faceb5f8d1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.480902:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x844e5faceb5f8d1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155647.480923:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155647.480926:0:15474:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155647.480938:0:15474:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x844e5faceb5f8d1d lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.480954:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2c00/0x844e5faceb5f8d16 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ac9 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.480981:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x844e5faceb5f8d1d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ac9 expref: 8 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.480987:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.480990:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155647.480992:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e2e00, rc 0) 00000100:00100000:1.0:1746155647.481022:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32537:x1830976126155648:12345-192.168.202.51@tcp:101:cat.0 Request processed in 255us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.481027:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11222 00000100:00100000:0.0:1746155647.482536:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.482552:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126155904 00000100:00100000:1.0:1746155647.482556:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126155904 00000100:00100000:1.0:1746155647.482581:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11223 00000100:00100000:1.0:1746155647.482586:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32544:x1830976126155904:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155647.482598:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.482606:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8d24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ad0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.482671:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3200/0x844e5faceb5f8d2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482680:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3200/0x844e5faceb5f8d2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482688:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3200/0x844e5faceb5f8d2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482697:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3400/0x844e5faceb5f8d32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482702:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3400/0x844e5faceb5f8d32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482707:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3400/0x844e5faceb5f8d32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482777:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3600/0x844e5faceb5f8d39 lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482784:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3600/0x844e5faceb5f8d39 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482789:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3600/0x844e5faceb5f8d39 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155647.482795:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155647.482853:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3600/0x844e5faceb5f8d39 lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482858:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3600/0x844e5faceb5f8d39 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482875:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3600/0x844e5faceb5f8d39 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482880:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e3600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155647.482883:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3600/0x844e5faceb5f8d39 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482889:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3600/0x844e5faceb5f8d39 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482898:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.482900:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155647.482902:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3600/0x844e5faceb5f8d39 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482906:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3600/0x844e5faceb5f8d39 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482916:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3200/0x844e5faceb5f8d2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482921:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3200/0x844e5faceb5f8d2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482925:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3200/0x844e5faceb5f8d2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482929:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e3200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155647.482931:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3200/0x844e5faceb5f8d2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482935:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3200/0x844e5faceb5f8d2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482941:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155647.482942:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155647.482944:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3200/0x844e5faceb5f8d2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482948:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3200/0x844e5faceb5f8d2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482953:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3400/0x844e5faceb5f8d32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482958:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3400/0x844e5faceb5f8d32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482961:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3400/0x844e5faceb5f8d32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482965:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e3400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155647.482967:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3400/0x844e5faceb5f8d32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482971:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3400/0x844e5faceb5f8d32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482975:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009ca89f00) 00010000:00010000:1.0:1746155647.482977:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155647.482979:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3400/0x844e5faceb5f8d32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.482984:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3400/0x844e5faceb5f8d32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.483007:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8d24 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ad0 expref: 288 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.483013:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8d24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ad0 expref: 288 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.483020:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e3000, rc 0) 00000100:00100000:1.0:1746155647.483058:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32544:x1830976126155904:12345-192.168.202.51@tcp:101:cat.0 Request processed in 471us (557us total) trans 8589945402 rc 301/301 00000100:00100000:1.0:1746155647.483067:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11223 00000100:00100000:0.0:1746155647.483377:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.483428:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126156160 00000100:00100000:1.0:1746155647.483432:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126156160 00000100:00100000:1.0:1746155647.483446:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11224 00000100:00100000:1.0:1746155647.483450:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32531:x1830976126156160:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:1.0:1746155647.483465:0:15474:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155647.483467:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155647.483474:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1e00/0x844e5faceb5f8c8a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a91 expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.483479:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126156416 00010000:00010000:1.0:1746155647.483482:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00000100:00100000:0.0:1746155647.483482:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126156416 00010000:00010000:1.0:1746155647.483484:0:15474:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155647.483497:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.483524:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x844e5faceb5f8d1d lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ac9 expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.483529:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 4/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.483548:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x844e5faceb5f8d1d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ac9 expref: 7 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.483556:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x844e5faceb5f8d1d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ac9 expref: 7 pid: 15474 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.483565:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fedb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125444352:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.483604:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155647.483684:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17447 00000100:00100000:3.0:1746155647.483695:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126156416:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155647.483703:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.483712:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb5e000/0x844e5faceb5f8d4e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ade expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.483724:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.483726:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155647.483756:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155647.483786:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5e000/0x844e5faceb5f8d4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ade expref: 20 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155647.483791:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126156672 00000100:00100000:1.0:1746155647.483795:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126156672 00010000:00010000:3.0:1746155647.483799:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5e000/0x844e5faceb5f8d4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ade expref: 20 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746155647.483805:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155647.483812:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5e000, rc 0) 00000100:00100000:1.0:1746155647.483813:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126156928 00000100:00100000:1.0:1746155647.483814:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126156928 00000100:00100000:0.0:1746155647.483820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.483825:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126156288 00000100:00100000:1.0:1746155647.483826:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126156288 00000100:00100000:3.0:1746155647.483837:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126156416:12345-192.168.202.51@tcp:101:cat.0 Request processed in 147us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.483839:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17448 00000100:00100000:3.0:1746155647.483843:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17447 00000100:00100000:1.0:1746155647.483843:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+30:1960:x1830976126156672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155647.483850:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155647.483854:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17449 00010000:00010000:1.0:1746155647.483858:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0200/0x844e5faceb5f8d55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18aec expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.483859:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126156928:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155647.483860:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155647.483875:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.483879:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.483881:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8d5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18afa expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.483881:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.483885:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0200/0x844e5faceb5f8d55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aec expref: 31 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.483890:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746155647.483891:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155647.483892:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.483894:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0200/0x844e5faceb5f8d55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aec expref: 31 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.483896:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8d5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18afa expref: 21 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.483901:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf0200, rc 0) 00010000:00010000:3.0:1746155647.483904:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8d5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18afa expref: 21 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.483910:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5ea00, rc 0) 00000100:00100000:3.0:1746155647.483927:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126156928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 67us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.483927:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976126156672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 83us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.483931:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17448 00000100:00100000:3.0:1746155647.483939:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17449 00000100:00100000:1.0:1746155647.483941:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126156544 00000100:00100000:1.0:1746155647.483943:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126156544 00000100:00100000:3.0:1746155647.483948:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126156800 00000100:00100000:3.0:1746155647.483951:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126156800 00000100:00100000:1.0:1746155647.483955:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17450 00000100:00100000:1.0:1746155647.483964:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976126156288:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155647.483966:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17451 00000100:00100000:3.0:1746155647.483971:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126156544:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155647.483971:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.483976:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.483977:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8d63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ad7 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.483985:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.483986:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.483990:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8d63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ad7 expref: 32 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.483998:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8d63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ad7 expref: 32 pid: 29728 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155647.484004:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17452 00010000:00010000:1.0:1746155647.484005:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf0c00, rc 0) 00000100:00100000:2.0:1746155647.484010:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976126156800:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.484015:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.484020:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f24da00/0x844e5faceb5f8d6a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18af3 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.484020:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976126156288:12345-192.168.202.51@tcp:101:cat.0 Request processed in 60us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.484025:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17450 00010000:00010000:2.0:1746155647.484029:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.484030:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.484034:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f24da00/0x844e5faceb5f8d6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18af3 expref: 32 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.484043:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f24da00/0x844e5faceb5f8d6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18af3 expref: 32 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.484049:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f24da00, rc 0) 00010000:00010000:3.0:1746155647.484080:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f8d71 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ae5 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.484088:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.484089:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.484092:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f8d71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ae5 expref: 22 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.484099:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f8d71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ae5 expref: 22 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.484105:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5f000, rc 0) 00000100:00100000:3.0:1746155647.484118:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976126156544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 148us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.484123:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17451 00000100:00100000:2.0:1746155647.484155:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976126156800:12345-192.168.202.51@tcp:101:cat.0 Request processed in 55us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.484160:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17452 00000100:00100000:0.0:1746155647.484703:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.484745:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126157056 00000100:00100000:2.0:1746155647.484748:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126157056 00010000:00010000:2.0:1746155647.484764:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x844e5faceb5f8d1d lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ac9 expref: 8 pid: 15474 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.484774:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fedb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125444352:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.484788:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155647.484800:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8960 00000100:00100000:2.0:1746155647.484805:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976126157056:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.485073:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.485079:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x844e5faceb5f8d1d lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ac9 expref: 8 pid: 15474 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.485088:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x844e5faceb5f8d1d lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ac9 expref: 8 pid: 15474 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.485099:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2e00/0x844e5faceb5f8d1d lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ac9 expref: 8 pid: 15474 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.485118:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.485122:0:15879:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155647.485128:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155647.485132:0:15879:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 4/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155647.485152:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155647.485170:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1962:x1830976126157056:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 365us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.485174:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8960 00010000:00010000:1.0:1746155647.485274:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155647.485281:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00010000:1.0:1746155647.485384:0:15474:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8801317c7800 reply state ffff88013141a000 transno 8589945403 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:1.0:1746155647.485394:0:15474:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746155647.485444:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32531:x1830976126156160:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 1992us (2067us total) trans 8589945403 rc 0/0 00000100:00100000:1.0:1746155647.485451:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11224 00000100:00100000:0.0:1746155647.486571:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.486622:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126157312 00000100:00100000:2.0:1746155647.486627:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126157312 00000100:00100000:2.0:1746155647.486651:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4781 00000100:00100000:2.0:1746155647.486656:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32544:x1830976126157312:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155647.486759:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32544:x1830976126157312:12345-192.168.202.51@tcp:35:cat.0 Request processed in 102us (189us total) trans 8589945404 rc 0/0 00000100:00100000:2.0:1746155647.486764:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4781 00010000:00010000:3.0:1746155647.486847:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155647.486859:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155647.486877:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155647.486930:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e3800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155647.486934:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155647.486944:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155647.486955:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155647.486958:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155647.486960:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155647.486965:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3800/0x844e5faceb5f8d47 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00000100:00100000:0.0:1746155647.487981:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.487999:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.488025:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.488052:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.488119:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126157440 00000100:00100000:2.0:1746155647.488124:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126157440 00000100:00100000:2.0:1746155647.488144:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126157696 00000100:00100000:2.0:1746155647.488146:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126157696 00000100:00100000:0.0:1746155647.488419:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.488494:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.488532:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.488544:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126158592 00000100:00100000:1.0:1746155647.488547:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126158592 00000100:00100000:1.0:1746155647.488566:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126158848 00000100:00100000:1.0:1746155647.488568:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126158848 00000100:00100000:1.0:1746155647.488585:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11225 00000100:00100000:1.0:1746155647.488590:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:32543:x1830976126158592:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155647.488601:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.488613:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8d78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b08 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.488679:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2a00/0x844e5faceb5f8d7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.488688:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2a00/0x844e5faceb5f8d7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.488696:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2a00/0x844e5faceb5f8d7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.488703:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3a00/0x844e5faceb5f8d86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.488708:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3a00/0x844e5faceb5f8d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.488716:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3a00/0x844e5faceb5f8d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155647.488890:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11226 00000100:00100000:0.0:1746155647.488897:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32540:x1830976126158848:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155647.488906:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155647.488912:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33400/0x844e5faceb5f8d8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b16 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.488943:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33800/0x844e5faceb5f8d94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.488949:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33800/0x844e5faceb5f8d94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.488954:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33800/0x844e5faceb5f8d94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.488959:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de32e00/0x844e5faceb5f8d9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155647.488964:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126157568 00000100:00100000:2.0:1746155647.488964:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126157952 00010000:00010000:0.0:1746155647.488964:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012de32e00/0x844e5faceb5f8d9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155647.488968:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126157568 00000100:00100000:2.0:1746155647.488968:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126157952 00010000:00010000:0.0:1746155647.488968:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012de32e00/0x844e5faceb5f8d9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155647.488985:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126157824 00000100:00100000:2.0:1746155647.488987:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126157824 00000100:00100000:3.0:1746155647.488992:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17453 00000100:00100000:3.0:1746155647.488997:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976126157440:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:2.0:1746155647.489033:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17454 00010000:00010000:0.0:1746155647.489036:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155647.489039:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976126157696:12345-192.168.202.51@tcp:2:lfs.0 00010000:00010000:0.0:1746155647.489052:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8c3d lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a83 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.489057:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.489081:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8c3d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a83 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.489091:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8c3d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a83 expref: 8 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.489101:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e36d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125444480:192.168.202.51@tcp:104: 00002000:00010000:3.0:1746155647.489110:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746155647.489113:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155644 -> 1746155647 00002000:00010000:3.0:1746155647.489114:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155644 -> 1746155647 00002000:00010000:3.0:1746155647.489116:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155644 -> 1746155647 00002000:00010000:3.0:1746155647.489117:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00002000:00010000:2.0:1746155647.489121:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155647.489124:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:2.0:1746155647.489125:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:2.0:1746155647.489127:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:2.0:1746155647.489129:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155647.489137:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126157440:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 140us (1159us total) trans 17179874388 rc 0/0 00000100:00100000:3.0:1746155647.489143:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17453 00000100:00100000:0.0:1746155647.489144:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a596b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155647.489148:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126157696:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 109us (1147us total) trans 21474841690 rc 0/0 00000100:00100000:3.0:1746155647.489153:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17455 00000100:00100000:3.0:1746155647.489157:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976126157952:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:0.0:1746155647.489166:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.489197:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155647.489210:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.489216:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.489221:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155647.489221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.489234:0:14232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126158208 00000100:00100000:1.0:1746155647.489236:0:14232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126158208 00002000:00010000:3.0:1746155647.489391:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:3.0:1746155647.489393:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:3.0:1746155647.489396:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:3.0:1746155647.489397:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:3.0:1746155647.489399:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:3.0:1746155647.489419:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126157952:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 261us (1393us total) trans 17179874389 rc 0/0 00000100:00100000:1.0:1746155647.489485:0:14232:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126158464 00000100:00100000:1.0:1746155647.489488:0:14232:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126158464 00000100:00100000:1.0:1746155647.489532:0:14232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11227 00000100:00100000:1.0:1746155647.489537:0:14232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32544:x1830976126158208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155647.489544:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.489557:0:14232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a000/0x844e5faceb5f8db0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b01 expref: -99 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.489588:0:14232:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a200/0x844e5faceb5f8db7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14232 initiator: MDT0 00010000:00010000:1.0:1746155647.489595:0:14232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a200/0x844e5faceb5f8db7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14232 initiator: MDT0 00010000:00010000:1.0:1746155647.489601:0:14232:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a200/0x844e5faceb5f8db7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00000004:00200000:1.0:1746155647.489612:0:14232:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155647.489616:0:14232:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155647.489625:0:14232:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a200/0x844e5faceb5f8db7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14232 initiator: MDT0 00010000:00010000:1.0:1746155647.489641:0:14232:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a000/0x844e5faceb5f8db0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b01 expref: 292 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.489652:0:14232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a200/0x844e5faceb5f8db7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b01 expref: 291 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.489658:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.489661:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155647.489663:0:14232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a013a200, rc 0) 00000100:00100000:1.0:1746155647.489683:0:14232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32544:x1830976126158208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 145us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.489688:0:14232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11227 00000100:00100000:1.0:1746155647.489700:0:14232:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11228 00000100:00100000:1.0:1746155647.489703:0:14232:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32537:x1830976126158464:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155647.489709:0:14232:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.489714:0:14232:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a400/0x844e5faceb5f8dbe lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b0f expref: -99 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.489731:0:14232:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a400/0x844e5faceb5f8dbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b0f expref: 10 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.489738:0:14232:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a400/0x844e5faceb5f8dbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b0f expref: 10 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.489747:0:14232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.489750:0:14232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155647.489752:0:14232:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a013a400, rc 0) 00000100:00100000:1.0:1746155647.489764:0:14232:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32537:x1830976126158464:12345-192.168.202.51@tcp:101:cat.0 Request processed in 61us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.489769:0:14232:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11228 00000100:00100000:1.0:1746155647.489787:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126158080 00000100:00100000:1.0:1746155647.489789:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126158080 00000100:00100000:2.0:1746155647.489896:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17454 00000100:00100000:3.0:1746155647.489911:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17455 00000100:00100000:3.0:1746155647.489922:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17456 00000100:00100000:3.0:1746155647.489929:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126157568:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155647.489985:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155647.489988:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155644 -> 1746155647 00002000:00010000:3.0:1746155647.489989:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155644 -> 1746155647 00002000:00010000:3.0:1746155647.489991:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155644 -> 1746155647 00002000:00010000:3.0:1746155647.489992:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746155647.490007:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976126157568:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 81us (1955us total) trans 21474841691 rc 0/0 00000100:00100000:3.0:1746155647.490012:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17456 00000100:00100000:3.0:1746155647.490026:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17457 00000100:00100000:3.0:1746155647.490031:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976126157824:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155647.490082:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155647.490085:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:3.0:1746155647.490086:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:3.0:1746155647.490088:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:3.0:1746155647.490089:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155647.490104:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126157824:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 72us (1685us total) trans 17179874390 rc 0/0 00000100:00100000:3.0:1746155647.490110:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17457 00000100:00100000:2.0:1746155647.490271:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17458 00000100:00100000:2.0:1746155647.490280:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126158080:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:2.0:1746155647.490342:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746155647.490345:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:2.0:1746155647.490346:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:2.0:1746155647.490348:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:2.0:1746155647.490350:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746155647.490385:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976126158080:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 106us (1216us total) trans 21474841692 rc 0/0 00000100:00100000:2.0:1746155647.490390:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17458 00000100:00100000:0.0:1746155647.492173:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.492185:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e36d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125444480:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.492203:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155647.492216:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.492233:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126159104 00000100:00100000:2.0:1746155647.492236:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126159104 00000100:00100000:2.0:1746155647.492270:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17459 00000100:00100000:2.0:1746155647.492277:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+41:1961:x1830976126159104:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.492287:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.492297:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f24dc00/0x844e5faceb5f8dc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b1d expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.492312:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.492313:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.492319:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f24dc00/0x844e5faceb5f8dc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b1d expref: 42 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155647.492329:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126158976 00010000:00010000:2.0:1746155647.492330:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f24dc00/0x844e5faceb5f8dc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b1d expref: 42 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155647.492333:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126158976 00010000:00010000:2.0:1746155647.492338:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f24dc00, rc 0) 00010000:00010000:3.0:1746155647.492349:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8c3d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a83 expref: 9 pid: 27374 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.492362:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976126159104:12345-192.168.202.51@tcp:101:cat.0 Request processed in 85us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.492367:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8961 00000100:00100000:2.0:1746155647.492367:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17459 00000100:00100000:3.0:1746155647.492372:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126158976:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.492379:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.492383:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8c3d lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a83 expref: 9 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.492392:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8c3d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a83 expref: 9 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.492405:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1400/0x844e5faceb5f8c3d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a83 expref: 9 pid: 27374 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.492416:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155647.492419:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.492426:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.492431:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.492437:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155647.492441:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155647.492445:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155647.492472:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.492489:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126158976:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 116us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.492493:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8961 00010000:00010000:1.0:1746155647.492530:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492538:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155647.492550:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155647.492618:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492624:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492629:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492633:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e3c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155647.492636:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492641:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492649:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.492651:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746155647.492654:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492658:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3c00/0x844e5faceb5f8da9 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492671:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2a00/0x844e5faceb5f8d7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492675:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2a00/0x844e5faceb5f8d7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492679:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2a00/0x844e5faceb5f8d7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492682:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e2a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155647.492684:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2a00/0x844e5faceb5f8d7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492688:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2a00/0x844e5faceb5f8d7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492693:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155647.492695:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155647.492697:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2a00/0x844e5faceb5f8d7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492701:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e2a00/0x844e5faceb5f8d7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492707:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3a00/0x844e5faceb5f8d86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492709:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3a00/0x844e5faceb5f8d86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492712:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3a00/0x844e5faceb5f8d86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492715:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f6e3a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155647.492716:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3a00/0x844e5faceb5f8d86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492719:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3a00/0x844e5faceb5f8d86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492722:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012b119400) 00010000:00010000:1.0:1746155647.492723:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155647.492724:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3a00/0x844e5faceb5f8d86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492726:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3a00/0x844e5faceb5f8d86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.492749:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8d78 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b08 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.492754:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1000/0x844e5faceb5f8d78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b08 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.492760:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cdf1000, rc 0) 00000100:00100000:1.0:1746155647.492782:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32543:x1830976126158592:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4192us (4288us total) trans 8589945405 rc 301/301 00000100:00100000:1.0:1746155647.492788:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11225 00010000:00010000:2.0:1746155647.492835:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.492841:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155647.492853:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155647.492905:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.492910:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.492915:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.492919:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012de33200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155647.492921:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.492925:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.492932:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.492934:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155647.492936:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 2/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.492941:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33200/0x844e5faceb5f8da2 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.492950:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33800/0x844e5faceb5f8d94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155647.492958:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155647.492960:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33800/0x844e5faceb5f8d94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.492964:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33800/0x844e5faceb5f8d94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.492970:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012de33800 already unused, calling callback (ffffffffa135a690) 00000100:00100000:0.0:1746155647.492971:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126159232 00010000:00010000:2.0:1746155647.492972:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33800/0x844e5faceb5f8d94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155647.492974:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126159232 00010000:00010000:2.0:1746155647.492977:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33800/0x844e5faceb5f8d94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.492983:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155647.492985:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155647.492986:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33800/0x844e5faceb5f8d94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.492990:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33800/0x844e5faceb5f8d94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.492997:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de32e00/0x844e5faceb5f8d9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155647.492999:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17460 00010000:00010000:2.0:1746155647.493002:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012de32e00/0x844e5faceb5f8d9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155647.493004:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976126159232:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.493006:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012de32e00/0x844e5faceb5f8d9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.493010:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012de32e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155647.493011:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de32e00/0x844e5faceb5f8d9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.493011:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.493016:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012de32e00/0x844e5faceb5f8d9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.493018:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009455de00/0x844e5faceb5f8dda lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b24 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.493021:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012b119400) 00010000:00010000:2.0:1746155647.493023:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155647.493025:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012de32e00/0x844e5faceb5f8d9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.493027:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.493028:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012de32e00/0x844e5faceb5f8d9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.493029:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.493033:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009455de00/0x844e5faceb5f8dda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b24 expref: 25 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.493053:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33400/0x844e5faceb5f8d8d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b16 expref: 291 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.493059:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012de33400/0x844e5faceb5f8d8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b16 expref: 291 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.493065:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012de33400, rc 0) 00000100:00100000:2.0:1746155647.493081:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32540:x1830976126158848:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4186us (4548us total) trans 8589945406 rc 301/301 00000100:00100000:2.0:1746155647.493087:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11226 00000100:00100000:1.0:1746155647.493088:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.493103:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.493116:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126159616 00000100:00100000:2.0:1746155647.493118:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126159616 00000100:00100000:2.0:1746155647.493135:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17461 00000100:00100000:2.0:1746155647.493139:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976126159616:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.493145:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.493151:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8de1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b2b expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.493161:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.493162:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.493166:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8de1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b2b expref: 27 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155647.493166:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.493174:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126159488 00010000:00010000:2.0:1746155647.493174:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8de1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b2b expref: 27 pid: 1625 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155647.493177:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126159488 00010000:00010000:2.0:1746155647.493181:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f24d800, rc 0) 00000100:00100000:3.0:1746155647.493194:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4782 00000100:00100000:2.0:1746155647.493198:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976126159616:12345-192.168.202.51@tcp:101:cat.0 Request processed in 58us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.493199:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32531:x1830976126159488:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:2.0:1746155647.493203:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17461 00000100:00100000:2.0:1746155647.493211:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126159744 00000100:00100000:2.0:1746155647.493213:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126159744 00000100:00100000:2.0:1746155647.493224:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17462 00000100:00100000:2.0:1746155647.493228:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+42:1961:x1830976126159744:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.493234:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.493240:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f24c800/0x844e5faceb5f8de8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b32 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.493248:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.493249:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.493252:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f24c800/0x844e5faceb5f8de8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b32 expref: 43 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.493260:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f24c800/0x844e5faceb5f8de8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b32 expref: 43 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.493267:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f24c800, rc 0) 00000100:00100000:2.0:1746155647.493279:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1961:x1830976126159744:12345-192.168.202.51@tcp:101:cat.0 Request processed in 51us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.493283:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17462 00000100:00100000:3.0:1746155647.493418:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32531:x1830976126159488:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 218us (328us total) trans 8589945407 rc 0/0 00000100:00100000:3.0:1746155647.493424:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4782 00010000:00010000:0.0:1746155647.493469:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009455de00/0x844e5faceb5f8dda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b24 expref: 26 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.493476:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009455de00, rc 0) 00000100:00100000:0.0:1746155647.493492:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976126159232:12345-192.168.202.51@tcp:101:cat.0 Request processed in 488us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.493496:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17460 00000100:00100000:0.0:1746155647.494106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.494279:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.494296:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126159872 00000100:00100000:1.0:1746155647.494300:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126159872 00000100:00100000:2.0:1746155647.494529:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126160000 00000100:00100000:1.0:1746155647.494532:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17463 00000100:00100000:2.0:1746155647.494533:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126160000 00000100:00100000:1.0:1746155647.494538:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1961:x1830976126159872:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155647.494546:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155647.494548:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17464 00000100:00100000:2.0:1746155647.494552:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976126160000:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155647.494554:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a013aa00/0x844e5faceb5f8def lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b39 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.494556:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.494562:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f8df6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b40 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.494565:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.494566:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.494569:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.494570:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.494571:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a013aa00/0x844e5faceb5f8def lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b39 expref: 44 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.494573:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f8df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b40 expref: 27 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.494580:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f8df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b40 expref: 27 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.494585:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a013aa00/0x844e5faceb5f8def lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b39 expref: 44 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.494587:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f24c600, rc 0) 00010000:00010000:1.0:1746155647.494590:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a013aa00, rc 0) 00000100:00100000:2.0:1746155647.494611:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976126160000:12345-192.168.202.51@tcp:101:cat.0 Request processed in 58us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.494616:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17464 00000100:00100000:1.0:1746155647.494680:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976126159872:12345-192.168.202.51@tcp:101:cat.0 Request processed in 140us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.494684:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17463 00000100:00100000:1.0:1746155647.497121:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.497287:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126160256 00000100:00100000:3.0:1746155647.497295:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126160256 00000100:00100000:3.0:1746155647.497345:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4783 00000100:00100000:3.0:1746155647.497352:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32531:x1830976126160256:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155647.497541:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32531:x1830976126160256:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 189us (425us total) trans 8589945408 rc 0/0 00000100:00100000:3.0:1746155647.497547:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4783 00000100:00100000:0.0:1746155647.501887:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.501924:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.501945:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.501968:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.502551:0:25393:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126160512 00000100:00100000:3.0:1746155647.502559:0:25393:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126160512 00002000:00100000:3.0:1746155647.502595:0:25393:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880094e36300 x1830976126160512/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.502605:0:25393:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36300 with x1830976126160512 ext(0->1048575) 00002000:00010000:3.0:1746155647.502609:0:25393:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36300 00000100:00100000:3.0:1746155647.502629:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126160768 00000100:00100000:3.0:1746155647.502632:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126160768 00002000:00100000:3.0:1746155647.502644:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880094e37100 x1830976126160768/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.502651:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37100 with x1830976126160768 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.502653:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e37100 00000100:00100000:3.0:1746155647.502662:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126161024 00000100:00100000:3.0:1746155647.502664:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126161024 00002000:00100000:3.0:1746155647.502673:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880094e37480 x1830976126161024/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.502679:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37480 with x1830976126161024 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.502681:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e37480 00000100:00100000:3.0:1746155647.502689:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126161280 00000100:00100000:3.0:1746155647.502691:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126161280 00002000:00100000:3.0:1746155647.502705:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880094e34000 x1830976126161280/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.502711:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e34000 with x1830976126161280 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.502713:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e34000 00000100:00100000:3.0:1746155647.502724:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8294 00000100:00100000:3.0:1746155647.502730:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1960:x1830976126160512:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155647.504109:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8295 00000100:00100000:3.0:1746155647.504116:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1961:x1830976126160768:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155647.504927:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8296 00000100:00100000:1.0:1746155647.504935:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976126161024:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155647.505004:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8297 00000100:00100000:3.0:1746155647.505011:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1961:x1830976126161280:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155647.513721:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.513758:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.513782:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.513800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.513816:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126161536 00000100:00100000:3.0:1746155647.513825:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126161536 00000100:00100000:0.0:1746155647.513825:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126161792 00000100:00100000:0.0:1746155647.513828:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126161792 00002000:00100000:0.0:1746155647.513857:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88008e26c700 x1830976126161792/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.513858:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880094e36d80 x1830976126161536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.513876:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36d80 with x1830976126161536 ext(0->1048575) 00002000:00100000:0.0:1746155647.513878:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26c700 with x1830976126161792 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.513880:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36d80 00002000:00010000:0.0:1746155647.513881:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26c700 00000100:00100000:0.0:1746155647.513904:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126162048 00000100:00100000:0.0:1746155647.513906:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126162048 00002000:00100000:0.0:1746155647.513918:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88008e26fb80 x1830976126162048/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.513924:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26fb80 with x1830976126162048 ext(1048576->2097151) 00002000:00010000:0.0:1746155647.513927:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26fb80 00000100:00100000:3.0:1746155647.514358:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126162304 00000100:00100000:3.0:1746155647.514362:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126162304 00000100:00100000:0.0:1746155647.514368:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8298 00002000:00100000:3.0:1746155647.514375:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88008e26dc00 x1830976126162304/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155647.514375:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976126161792:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:3.0:1746155647.514382:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26dc00 with x1830976126162304 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.514385:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26dc00 00000100:00100000:3.0:1746155647.514396:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8299 00000100:00100000:3.0:1746155647.514400:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1961:x1830976126161536:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155647.514531:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8300 00000100:00100000:1.0:1746155647.514538:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976126162048:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155647.515442:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8301 00000100:00100000:3.0:1746155647.515449:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1961:x1830976126162304:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155647.519165:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.519643:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1960:x1830976126160512:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16911us (17761us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.519653:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8294 00002000:00100000:3.0:1746155647.519662:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880094e36300 x1830976126160512/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.519677:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36300 with x1830976126160512 ext(0->1048575) 00002000:00010000:3.0:1746155647.519682:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36300 00000100:00100000:2.0:1746155647.520958:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126162560 00000100:00100000:2.0:1746155647.520966:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126162560 00000100:00100000:2.0:1746155647.521014:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11229 00000100:00100000:2.0:1746155647.521021:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32540:x1830976126162560:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155647.521037:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.521040:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746155647.521059:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a200/0x844e5faceb5f8db7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b01 expref: 290 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.521081:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.521085:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155647.521095:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24ca00/0x844e5faceb5f8dfd lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b47 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.521134:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.521145:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c7c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a8a expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.521151:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a400/0x844e5faceb5f8dbe lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b0f expref: 8 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.521157:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.521178:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a400/0x844e5faceb5f8dbe lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b0f expref: 8 pid: 14232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.521187:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a400/0x844e5faceb5f8dbe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b0f expref: 8 pid: 14232 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.521197:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125444608:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.521265:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c7c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a8a expref: 9 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.521273:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c7c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a8a expref: 9 pid: 15474 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.521281:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125444736:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155647.521299:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e332f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155647.521764:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976126160768:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17647us (19837us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.521771:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8295 00002000:00100000:3.0:1746155647.521778:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880094e37100 x1830976126160768/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.521786:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37100 with x1830976126160768 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.521789:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e37100 00000100:00100000:0.0:1746155647.524000:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.525298:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126162816 00000100:00100000:1.0:1746155647.525308:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126162816 00000100:00100000:1.0:1746155647.525436:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11230 00000100:00100000:1.0:1746155647.525545:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32543:x1830976126162816:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155647.525566:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.525568:0:14234:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746155647.525579:0:14234:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a400/0x844e5faceb5f8dbe lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b0f expref: 9 pid: 14232 timeout: 876 lvb_type: 0 00010000:00010000:1.0:1746155647.525599:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.525603:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155647.525610:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155647.525614:0:14234:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155647.525624:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e2200/0x844e5faceb5f8e0b lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b4e expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.525660:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.525667:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155647.525671:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155647.525684:0:14234:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155647.525691:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155647.525927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155647.525931:0:20364:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.51@tcp) returned -22 from blocking AST (req@ffff88009f880e00 x1830976125444608) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a400/0x844e5faceb5f8dbe lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b0f expref: 10 pid: 14232 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.525940:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013a400/0x844e5faceb5f8dbe lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b0f expref: 10 pid: 14232 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.525950:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125444608:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155647.525959:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125444736:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.525971:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.525974:0:20364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.525978:0:20364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.525982:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155647.526100:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976126161024:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21166us (24153us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155647.526105:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8296 00002000:00100000:0.0:1746155647.526112:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff880094e37480 x1830976126161024/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.526117:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37480 with x1830976126161024 ext(1048576->2097151) 00002000:00010000:0.0:1746155647.526120:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e37480 00000100:00100000:3.0:1746155647.526247:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126162944 00000100:00100000:3.0:1746155647.526252:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126162944 00010000:00010000:3.0:1746155647.526268:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c7c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a8a expref: 10 pid: 15474 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.526292:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8962 00000100:00100000:3.0:1746155647.526298:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126162944:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.526305:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.526310:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c7c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a8a expref: 10 pid: 15474 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.526318:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c7c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a8a expref: 10 pid: 15474 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.526329:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cdf1800/0x844e5faceb5f8c7c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a8a expref: 10 pid: 15474 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.526343:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155647.526346:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.526352:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.526357:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.526363:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155647.526367:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155647.526488:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155647.526489:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.526494:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155647.526533:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976126162944:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 235us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.526540:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8962 00000040:00080000:2.0:1746155647.526886:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3680, 88 off310760 00000004:00080000:2.0:1746155647.526892:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776676388673ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155647.526939:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3674, 88 off310496 00000004:00080000:2.0:1746155647.526942:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776676439474ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155647.526964:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3675, 88 off310584 00000004:00080000:2.0:1746155647.526966:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776676463159ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155647.526971:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3681, 88 off310848 00000004:00080000:2.0:1746155647.526973:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776676469784ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155647.526977:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3682, 88 off310936 00000004:00080000:2.0:1746155647.526978:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776676475341ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155647.527004:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3676, 88 off310672 00000004:00080000:2.0:1746155647.527006:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776676503116ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155647.527016:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3677, 88 off310760 00000004:00080000:2.0:1746155647.527018:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776676515659ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155647.527024:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3678, 88 off310848 00000004:00080000:2.0:1746155647.527026:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776676523569ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155647.527034:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3683, 88 off311024 00000004:00080000:2.0:1746155647.527036:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776676533179ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155647.527042:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3679, 88 off310936 00000004:00080000:2.0:1746155647.527044:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776676541294ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155647.527063:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3684, 88 off311112 00000004:00080000:2.0:1746155647.527066:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776676562804ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155647.527073:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3680, 88 off311024 00000004:00080000:2.0:1746155647.527075:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776676572031ns, next at 716011101328ns, rc = 0 00000040:00080000:2.0:1746155647.527087:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3685, 88 off311200 00000004:00080000:2.0:1746155647.527090:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776676587094ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155647.527117:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3687, 88 off311384 00000004:00080000:2.0:1746155647.527120:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776676616734ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155647.527129:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3688, 88 off311472 00000004:00080000:2.0:1746155647.527131:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776676628701ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155647.527142:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3689, 88 off311560 00000004:00080000:2.0:1746155647.527144:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776676640959ns, next at 716024381471ns, rc = 0 00000040:00080000:2.0:1746155647.527149:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3681, 88 off311112 00000004:00080000:2.0:1746155647.527150:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776676647726ns, next at 716011101328ns, rc = 0 00000100:00100000:2.0:1746155647.532336:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1961:x1830976126161280:12345-192.168.202.51@tcp:3:cat.0 Request processed in 27320us (30361us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.532347:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8297 00002000:00100000:2.0:1746155647.532357:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff880094e34000 x1830976126161280/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.532366:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e34000 with x1830976126161280 ext(1048576->2097151) 00002000:00010000:2.0:1746155647.532370:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e34000 00000100:00100000:0.0:1746155647.532752:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.532771:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126163072 00000100:00100000:2.0:1746155647.532777:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126163072 00000100:00100000:2.0:1746155647.532815:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11231 00000100:00100000:2.0:1746155647.532821:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32537:x1830976126163072:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.532834:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.532849:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b55 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.532904:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155647.532911:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.532926:0:27374:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155647.532934:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.532943:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.532946:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155647.532948:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155647.532952:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6e3000, rc 0) 00000100:00100000:2.0:1746155647.532980:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32537:x1830976126163072:12345-192.168.202.51@tcp:101:cat.0 Request processed in 159us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.532984:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11231 00000100:00100000:3.0:1746155647.533460:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1961:x1830976126161536:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19058us (19745us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.533468:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8299 00002000:00100000:3.0:1746155647.533760:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff880094e36d80 x1830976126161536/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.533770:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36d80 with x1830976126161536 ext(0->1048575) 00002000:00010000:3.0:1746155647.533774:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36d80 00000100:00100000:2.0:1746155647.539677:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976126162048:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25134us (25888us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.539687:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8300 00002000:00100000:2.0:1746155647.539696:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88008e26fb80 x1830976126162048/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.539706:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26fb80 with x1830976126162048 ext(1048576->2097151) 00002000:00010000:2.0:1746155647.539711:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26fb80 00000100:00100000:0.0:1746155647.540226:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976126161792:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25851us (26466us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155647.540234:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8298 00002000:00100000:0.0:1746155647.540239:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88008e26c700 x1830976126161792/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.540247:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26c700 with x1830976126161792 ext(1048576->2097151) 00002000:00010000:0.0:1746155647.540251:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e26c700 00000100:00100000:3.0:1746155647.543637:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976126162304:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28183us (29829us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.543646:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8301 00002000:00100000:3.0:1746155647.543655:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88008e26dc00 x1830976126162304/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.543663:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e26dc00 with x1830976126162304 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.543668:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008e26dc00 00000100:00100000:0.0:1746155647.546310:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.546333:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126163200 00000100:00100000:0.0:1746155647.546340:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126163200 00000100:00100000:0.0:1746155647.546370:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11232 00000100:00100000:0.0:1746155647.546376:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32544:x1830976126163200:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155647.546391:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155647.546405:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b5c expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.546449:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b5c expref: 293 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.546459:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b5c expref: 293 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.546469:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155647.546472:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155647.546475:0:15474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155647.546479:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a013b000, rc 0) 00000100:00100000:0.0:1746155647.546528:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32544:x1830976126163200:12345-192.168.202.51@tcp:101:cat.0 Request processed in 152us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.546533:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11232 00000001:00080000:1.0:1746155647.552146:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945405 is committed 00000001:00080000:1.0:1746155647.552158:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945403 is committed 00000001:00080000:1.0:1746155647.552162:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945402 is committed 00000001:00080000:1.0:1746155647.552174:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945409 is committed 00000004:00080000:1.0:1746155647.552177:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2865 committed 00000004:00080000:1.0:1746155647.552183:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2866 committed 00000004:00080000:1.0:1746155647.552189:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2865 committed 00000004:00080000:1.0:1746155647.552190:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2864 committed 00000004:00080000:1.0:1746155647.552192:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2863 committed 00000004:00080000:1.0:1746155647.552193:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2864 committed 00000004:00080000:1.0:1746155647.552195:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2862 committed 00000004:00080000:1.0:1746155647.552196:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2863 committed 00000004:00080000:1.0:1746155647.552198:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2861 committed 00000004:00080000:1.0:1746155647.552199:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2862 committed 00000004:00080000:1.0:1746155647.552200:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2861 committed 00000004:00080000:1.0:1746155647.552202:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2860 committed 00000004:00080000:1.0:1746155647.552203:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2860 committed 00000004:00080000:1.0:1746155647.552205:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2859 committed 00000004:00080000:1.0:1746155647.552206:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2859 committed 00000004:00080000:1.0:1746155647.552207:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2858 committed 00000004:00080000:1.0:1746155647.552209:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2858 committed 00000001:00080000:1.0:1746155647.552217:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945408 is committed 00000100:00100000:1.0:1746155647.552360:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125444864:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.552406:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.552429:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125445376:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.552440:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.552455:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746155647.552459:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125444992:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.552474:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.552484:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125445504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.552495:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.552534:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125445120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.552550:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.552559:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125445632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.552569:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.552579:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746155647.552582:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125445248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.552594:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.552602:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125445760:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.552612:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.552628:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125444864 00000100:00100000:1.0:1746155647.552634:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125444864 00000100:00100000:1.0:1746155647.552656:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125445376 00000100:00100000:1.0:1746155647.552658:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125445376 00000100:00100000:1.0:1746155647.552667:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125444992 00000100:00100000:1.0:1746155647.552669:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125444992 00000100:00100000:1.0:1746155647.552677:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125445504 00000100:00100000:1.0:1746155647.552678:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125445504 00000100:00100000:1.0:1746155647.552686:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125445120 00000100:00100000:1.0:1746155647.552687:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125445120 00000100:00100000:1.0:1746155647.552693:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125445632 00000100:00100000:1.0:1746155647.552694:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125445632 00000100:00100000:1.0:1746155647.552700:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125445248 00000100:00100000:1.0:1746155647.552702:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125445248 00000100:00100000:1.0:1746155647.552707:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125445760 00000100:00100000:1.0:1746155647.552709:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125445760 00000100:00100000:1.0:1746155647.552717:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17465 00000100:00100000:1.0:1746155647.552723:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+75:3295:x1830976125444864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155647.552853:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155647.552856:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.552858:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.552859:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.552861:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:1.0:1746155647.552896:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:3295:x1830976125444864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 173us (490us total) trans 17179874391 rc 0/0 00000100:00100000:1.0:1746155647.552901:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17465 00000100:00100000:1.0:1746155647.552912:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17466 00000100:00100000:1.0:1746155647.552916:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+75:3295:x1830976125445376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.552991:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:3295:x1830976125445376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (550us total) trans 17179874392 rc 0/0 00000100:00100000:1.0:1746155647.552996:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17466 00000100:00100000:1.0:1746155647.553003:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17467 00000100:00100000:1.0:1746155647.553007:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+75:3295:x1830976125444992:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746155647.553010:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b47 expref: 289 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.553020:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155647.553023:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746155647.553026:0:20364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155647.553033:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b47 expref: 289 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.553039:0:20364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155647.553058:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b47 expref: 289 pid: 20364 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155647.553064:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155647.553066:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00010000:00010000:3.0:1746155647.553068:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b47 expref: 289 pid: 20364 timeout: 876 lvb_type: 0 00002000:00010000:1.0:1746155647.553068:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.553069:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.553071:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:3.0:1746155647.553077:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc53100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125445888:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.553086:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:3295:x1830976125444992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (611us total) trans 17179874393 rc 0/0 00000100:00100000:1.0:1746155647.553090:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17467 00000100:00100000:3.0:1746155647.553114:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129c9ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746155647.553182:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17468 00000100:00100000:1.0:1746155647.553187:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+75:3295:x1830976125445504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.553259:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+76:3295:x1830976125445504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (761us total) trans 17179874394 rc 0/0 00000100:00100000:1.0:1746155647.553263:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17468 00000100:00100000:1.0:1746155647.553271:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17469 00000100:00100000:1.0:1746155647.553274:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+75:3297:x1830976125445120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155647.553280:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17470 00000100:00100000:2.0:1746155647.553286:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+75:3297:x1830976125445632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155647.553369:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3297:x1830976125445632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (798us total) trans 17179874395 rc 0/0 00000100:00100000:2.0:1746155647.553374:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17470 00000100:00100000:0.0:1746155647.553376:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125446400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155647.553383:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17471 00000100:00100000:2.0:1746155647.553387:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+75:3297:x1830976125445248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155647.553395:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155647.553403:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125446912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.553416:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155647.553423:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746155647.553426:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125446272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.553437:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155647.553443:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125446784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155647.553449:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3297:x1830976125445248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (854us total) trans 17179874396 rc 0/0 00000100:00100000:0.0:1746155647.553453:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155647.553454:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17471 00000100:00100000:2.0:1746155647.553461:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125446400 00000100:00100000:2.0:1746155647.553463:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125446400 00000100:00100000:2.0:1746155647.553472:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125446912 00000100:00100000:2.0:1746155647.553474:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125446912 00000100:00100000:2.0:1746155647.553478:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125446272 00000100:00100000:2.0:1746155647.553480:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125446272 00000100:00100000:2.0:1746155647.553485:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125446784 00000100:00100000:2.0:1746155647.553486:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125446784 00000100:00100000:2.0:1746155647.553492:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17472 00000100:00100000:2.0:1746155647.553495:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+75:3297:x1830976125445760:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155647.553556:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc7480/2, rc 0, transno 17179874396 00000100:00100000:0.0:1746155647.553564:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125445248:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155647.553571:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526a300/2, rc 0, transno 17179874395 00000100:00100000:0.0:1746155647.553573:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125445632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155647.553575:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3297:x1830976125445760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 79us (962us total) trans 17179874397 rc 0/0 00000004:00080000:0.0:1746155647.553579:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095269c00/2, rc 0, transno 17179874397 00000100:00100000:2.0:1746155647.553580:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17472 00000100:00100000:0.0:1746155647.553581:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125445760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155647.553588:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17473 00000100:00100000:2.0:1746155647.553598:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3298:x1830976125446400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155647.553690:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3298:x1830976125446400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (294us total) trans 21474841693 rc 0/0 00000100:00100000:2.0:1746155647.553694:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17473 00000100:00100000:2.0:1746155647.553704:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17474 00000100:00100000:2.0:1746155647.553708:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3298:x1830976125446912:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155647.553762:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26df80/2, rc 0, transno 21474841693 00000100:00100000:0.0:1746155647.553766:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125446400:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155647.553778:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3298:x1830976125446912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (361us total) trans 21474841694 rc 0/0 00000100:00100000:2.0:1746155647.553783:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17474 00000004:00080000:0.0:1746155647.553788:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26ca80/2, rc 0, transno 21474841694 00000100:00100000:2.0:1746155647.553790:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17475 00000100:00100000:0.0:1746155647.553791:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125446912:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155647.553795:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+72:3298:x1830976125446272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155647.553833:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125446144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155647.553850:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155647.553857:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125446656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155647.553878:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155647.553885:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1746155647.553888:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125446016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155647.553899:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155647.553903:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125446528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155647.553913:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155647.553919:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125447040:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155647.553929:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155647.553961:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125446144 00000100:00100000:3.0:1746155647.553964:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125446144 00000100:00100000:0.0:1746155647.553966:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125446656 00000100:00100000:0.0:1746155647.553968:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125446656 00000100:00100000:3.0:1746155647.553976:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125446016 00000100:00100000:3.0:1746155647.553977:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125446016 00000100:00100000:0.0:1746155647.553977:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125446528 00000100:00100000:0.0:1746155647.553978:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125446528 00000100:00100000:3.0:1746155647.553983:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125447040 00000100:00100000:3.0:1746155647.553984:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125447040 00000100:00100000:0.0:1746155647.553985:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17476 00000100:00100000:0.0:1746155647.553989:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3298:x1830976125446784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155647.553992:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17477 00000100:00100000:3.0:1746155647.553995:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3296:x1830976125446144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155647.554053:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155647.554055:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:3.0:1746155647.554057:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:3.0:1746155647.554059:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:3.0:1746155647.554061:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155647.554061:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+78:3298:x1830976125446784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (607us total) trans 21474841695 rc 0/0 00000100:00100000:0.0:1746155647.554066:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17476 00000100:00100000:0.0:1746155647.554075:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17478 00000100:00100000:3.0:1746155647.554077:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3296:x1830976125446144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (226us total) trans 21474841696 rc 0/0 00000100:00100000:0.0:1746155647.554079:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3296:x1830976125446656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155647.554081:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17477 00000100:00100000:0.0:1746155647.554142:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+78:3296:x1830976125446656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (263us total) trans 21474841697 rc 0/0 00000100:00100000:0.0:1746155647.554146:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17478 00000100:00100000:0.0:1746155647.554154:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17479 00000100:00100000:0.0:1746155647.554157:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3296:x1830976125446016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155647.554189:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17480 00000100:00100000:3.0:1746155647.554193:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3296:x1830976125446528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155647.554213:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155647.554215:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:0.0:1746155647.554217:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:0.0:1746155647.554219:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:0.0:1746155647.554220:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155647.554236:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3296:x1830976125446016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (336us total) trans 21474841698 rc 0/0 00000100:00100000:0.0:1746155647.554240:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17479 00000100:00100000:0.0:1746155647.554249:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17481 00002000:00010000:3.0:1746155647.554251:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00000100:00100000:0.0:1746155647.554253:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+76:3296:x1830976125447040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155647.554254:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:3.0:1746155647.554255:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746155647.554257:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:3.0:1746155647.554258:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:3.0:1746155647.554273:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3296:x1830976125446528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (359us total) trans 21474841699 rc 0/0 00000100:00100000:3.0:1746155647.554278:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17480 00000004:00080000:3.0:1746155647.554297:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26ea00/2, rc 0, transno 21474841698 00000100:00100000:3.0:1746155647.554300:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125446016:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155647.554305:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26f480/2, rc 0, transno 21474841699 00000100:00100000:3.0:1746155647.554308:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125446528:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155647.554313:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26d180/2, rc 0, transno 21474841696 00000100:00100000:3.0:1746155647.554316:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125446144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.554316:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+77:3296:x1830976125447040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (386us total) trans 17179874398 rc 0/0 00000004:00080000:3.0:1746155647.554320:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26f800/2, rc 0, transno 21474841697 00000100:00100000:0.0:1746155647.554321:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17481 00000100:00100000:3.0:1746155647.554323:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125446656:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155647.554329:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f581c00/2, rc 0, transno 17179874398 00000100:00100000:3.0:1746155647.554331:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125447040:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155647.554343:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26c380/2, rc 0, transno 21474841695 00000100:00100000:0.0:1746155647.554346:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125446784:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746155647.554414:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746155647.554416:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:2.0:1746155647.554417:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:2.0:1746155647.554419:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:2.0:1746155647.554421:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746155647.554438:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+77:3298:x1830976125446272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 643us (999us total) trans 21474841700 rc 0/0 00000100:00100000:2.0:1746155647.554442:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17475 00000004:00080000:0.0:1746155647.554450:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008e26e680/2, rc 0, transno 21474841700 00000100:00100000:0.0:1746155647.554452:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125446272:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155647.554582:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:1.0:1746155647.554584:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.554590:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.554592:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.554593:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000004:00080000:0.0:1746155647.554700:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc5f80/2, rc 0, transno 17179874399 00000100:00100000:0.0:1746155647.554704:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125445120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.554722:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+77:3297:x1830976125445120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1447us (2171us total) trans 17179874399 rc 0/0 00000100:00100000:1.0:1746155647.554727:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17469 00000004:00080000:1.0:1746155647.554757:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc7b80/2, rc 0, transno 17179874393 00000100:00100000:1.0:1746155647.554760:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125444992:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155647.554765:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc4380/2, rc 0, transno 17179874394 00000100:00100000:1.0:1746155647.554767:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125445504:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155647.554771:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc4000/2, rc 0, transno 17179874391 00000100:00100000:1.0:1746155647.554774:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125444864:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155647.554778:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc4700/2, rc 0, transno 17179874392 00000100:00100000:1.0:1746155647.554779:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125445376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155647.556075:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc53100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125445888:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155647.556103:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24ca00/0x844e5faceb5f8dfd lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b47 expref: 289 pid: 20364 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746155647.556120:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b47 expref: 288 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.556127:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b47 expref: 288 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.556149:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f24cc00, rc 0) 00000100:00100000:3.0:1746155647.556175:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32540:x1830976126162560:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 35155us (37019us total) trans 8589945409 rc 0/0 00000100:00100000:3.0:1746155647.556180:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11229 00000100:00100000:0.0:1746155647.557851:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.557969:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126163328 00000100:00100000:2.0:1746155647.557976:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126163328 00010000:00010000:2.0:1746155647.557997:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b47 expref: 288 pid: 20364 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.558016:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8963 00000100:00100000:2.0:1746155647.558022:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1963:x1830976126163328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.558031:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.558035:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b47 expref: 288 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.558043:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b47 expref: 288 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.558061:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f24cc00/0x844e5faceb5f8e04 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b47 expref: 288 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.558070:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.558074:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155647.558083:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155647.558089:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155647.558095:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 8 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.558118:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155647.558134:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155647.558139:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1963:x1830976126163328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 118us (291us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155647.558141:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155647.558144:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8963 00000040:00080000:1.0:1746155647.558703:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3690, 88 off311648 00000004:00080000:1.0:1746155647.558708:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776708204392ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.558800:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3682, 88 off311200 00000004:00080000:1.0:1746155647.558804:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776708300712ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.558914:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3684, 88 off311384 00000004:00080000:1.0:1746155647.558917:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776708414209ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.558924:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3691, 88 off311736 00000004:00080000:1.0:1746155647.558926:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776708422814ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.558932:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3692, 88 off311824 00000004:00080000:1.0:1746155647.558934:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776708431597ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.558939:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3685, 88 off311472 00000004:00080000:1.0:1746155647.558941:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776708438477ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.558946:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3686, 88 off311560 00000004:00080000:1.0:1746155647.558948:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776708445607ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.558953:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3687, 88 off311648 00000004:00080000:1.0:1746155647.558955:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776708452292ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.558960:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3693, 88 off311912 00000004:00080000:1.0:1746155647.558962:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776708458812ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.558966:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3688, 88 off311736 00000004:00080000:1.0:1746155647.558968:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776708465184ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.558973:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3694, 88 off312000 00000004:00080000:1.0:1746155647.558975:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776708471672ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.558979:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3689, 88 off311824 00000004:00080000:1.0:1746155647.558982:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776708478727ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155647.558986:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3695, 88 off312088 00000004:00080000:1.0:1746155647.558988:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776708485453ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.558993:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3696, 88 off312176 00000004:00080000:1.0:1746155647.558995:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776708492285ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.559000:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3697, 88 off312264 00000004:00080000:1.0:1746155647.559002:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776708498763ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.559006:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3698, 88 off312352 00000004:00080000:1.0:1746155647.559008:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 776708505019ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155647.559012:0:14234:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3690, 88 off311912 00000004:00080000:1.0:1746155647.559014:0:14234:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 776708511237ns, next at 716011101328ns, rc = 0 00000001:00080000:0.0:1746155647.582122:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945410 is committed 00000004:00080000:0.0:1746155647.582128:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2873 committed 00000004:00080000:0.0:1746155647.582135:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2875 committed 00000004:00080000:0.0:1746155647.582139:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2874 committed 00000004:00080000:0.0:1746155647.582140:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2873 committed 00000004:00080000:0.0:1746155647.582141:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2872 committed 00000004:00080000:0.0:1746155647.582143:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2872 committed 00000004:00080000:0.0:1746155647.582144:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2871 committed 00000004:00080000:0.0:1746155647.582146:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2871 committed 00000004:00080000:0.0:1746155647.582147:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2870 committed 00000004:00080000:0.0:1746155647.582148:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2870 committed 00000004:00080000:0.0:1746155647.582149:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2869 committed 00000004:00080000:0.0:1746155647.582151:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2868 committed 00000004:00080000:0.0:1746155647.582152:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2869 committed 00000004:00080000:0.0:1746155647.582153:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2868 committed 00000004:00080000:0.0:1746155647.582154:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2867 committed 00000004:00080000:0.0:1746155647.582156:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2866 committed 00000004:00080000:0.0:1746155647.582157:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2867 committed 00000100:00100000:1.0:1746155647.582303:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125447424:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.582347:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.582368:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125447936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.582380:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.582394:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746155647.582398:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125447296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.582408:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.582416:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125447808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.582425:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.582441:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125447424 00000100:00100000:1.0:1746155647.582446:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125447424 00000100:00100000:1.0:1746155647.582469:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125447936 00000100:00100000:1.0:1746155647.582471:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125447936 00000100:00100000:3.0:1746155647.582602:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125447168:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155647.582622:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155647.582652:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009526ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125447552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155647.582673:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125448320:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746155647.582757:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b4e expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.582768:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.582771:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746155647.582774:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.582783:0:14234:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.582790:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.582796:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b5c expref: 286 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.582802:0:14234:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b5c expref: 286 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.582808:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b5c expref: 286 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.582827:0:14234:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b5c expref: 286 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.582836:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125449216:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155647.582898:0:14234:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.582905:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125449344:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155647.582921:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746155647.583137:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125447296 00000100:00100000:1.0:1746155647.583141:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125447296 00000100:00100000:3.0:1746155647.583152:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125447680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.583153:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125447808 00000100:00100000:1.0:1746155647.583155:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125447808 00000100:00100000:1.0:1746155647.583162:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125447168 00000100:00100000:1.0:1746155647.583163:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125447168 00000100:00100000:3.0:1746155647.583168:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.583173:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125447680 00000100:00100000:1.0:1746155647.583174:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125447680 00000100:00100000:3.0:1746155647.583179:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125448192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155647.583184:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17482 00000100:00100000:1.0:1746155647.583190:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+82:3298:x1830976125447424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155647.583192:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155647.583199:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125448704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155647.583210:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155647.583228:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125448192 00000100:00100000:3.0:1746155647.583231:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125448192 00000100:00100000:3.0:1746155647.583243:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125448704 00000100:00100000:3.0:1746155647.583245:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125448704 00000100:00100000:3.0:1746155647.583252:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17483 00000100:00100000:3.0:1746155647.583256:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+82:3298:x1830976125447936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155647.583316:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:1.0:1746155647.583319:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.583320:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.583322:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.583323:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:1.0:1746155647.583348:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+84:3298:x1830976125447424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (1001us total) trans 17179874400 rc 0/0 00000100:00100000:3.0:1746155647.583350:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+84:3298:x1830976125447936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (967us total) trans 17179874401 rc 0/0 00000100:00100000:1.0:1746155647.583353:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17482 00000100:00100000:3.0:1746155647.583357:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17483 00000100:00100000:1.0:1746155647.583365:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17484 00000100:00100000:3.0:1746155647.583369:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17485 00000100:00100000:1.0:1746155647.583370:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+82:3298:x1830976125447296:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155647.583373:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+82:3298:x1830976125447808:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.583399:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17486 00000100:00100000:1.0:1746155647.583403:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+82:3296:x1830976125447168:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155647.583423:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17487 00000100:00100000:2.0:1746155647.583429:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+82:3296:x1830976125447680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155647.583462:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155647.583465:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.583466:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.583468:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.583469:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:0.0:1746155647.583482:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17488 00000100:00100000:1.0:1746155647.583488:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+83:3296:x1830976125447168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (865us total) trans 17179874402 rc 0/0 00000100:00100000:0.0:1746155647.583488:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+78:3296:x1830976125448192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155647.583494:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17486 00000100:00100000:1.0:1746155647.583514:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17489 00000100:00100000:1.0:1746155647.583518:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+78:3296:x1830976125448704:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155647.583596:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155647.583599:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:0.0:1746155647.583601:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:0.0:1746155647.583603:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:0.0:1746155647.583605:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155647.583625:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+80:3296:x1830976125448192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 138us (432us total) trans 21474841701 rc 0/0 00000100:00100000:0.0:1746155647.583630:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17488 00000100:00100000:0.0:1746155647.583653:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155647.583665:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125448832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155647.583676:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125448320 00000100:00100000:0.0:1746155647.583678:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.583680:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125448320 00000100:00100000:0.0:1746155647.583687:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746155647.583691:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125448448:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155647.583693:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125448832 00000100:00100000:1.0:1746155647.583695:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125448832 00000100:00100000:0.0:1746155647.583701:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.583702:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17490 00000100:00100000:1.0:1746155647.583706:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+81:3297:x1830976125448320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.583709:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125448960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.583719:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155647.583732:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125448448 00000100:00100000:0.0:1746155647.583734:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125448448 00000100:00100000:0.0:1746155647.583744:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125448960 00000100:00100000:0.0:1746155647.583746:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125448960 00000100:00100000:0.0:1746155647.583753:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17491 00000100:00100000:0.0:1746155647.583756:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+84:3297:x1830976125448832:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155647.583771:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155647.583773:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.583775:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.583776:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.583777:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155647.583800:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+84:3297:x1830976125448320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (145us total) trans 21474841703 rc 0/0 00000100:00100000:1.0:1746155647.583805:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17490 00000100:00100000:1.0:1746155647.583814:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17492 00000100:00100000:1.0:1746155647.583818:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+84:3297:x1830976125448448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.583828:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+84:3297:x1830976125448832:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (148us total) trans 21474841704 rc 0/0 00000100:00100000:0.0:1746155647.583833:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17491 00000100:00100000:0.0:1746155647.583842:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17493 00000100:00100000:0.0:1746155647.583846:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+83:3297:x1830976125448960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155647.583900:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746155647.583903:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.583904:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.583906:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.583908:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:1.0:1746155647.583927:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+85:3297:x1830976125448448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (224us total) trans 21474841705 rc 0/0 00000100:00100000:0.0:1746155647.583930:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+85:3297:x1830976125448960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 83us (209us total) trans 21474841706 rc 0/0 00000100:00100000:1.0:1746155647.583932:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17492 00000100:00100000:0.0:1746155647.583935:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17493 00000004:00080000:0.0:1746155647.583961:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c7b80/2, rc 0, transno 21474841705 00002000:00010000:1.0:1746155647.583965:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00000100:00100000:0.0:1746155647.583965:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125448448:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155647.583967:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155647.583969:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746155647.583970:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00000004:00080000:0.0:1746155647.583970:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c5f80/2, rc 0, transno 21474841706 00002000:00010000:1.0:1746155647.583972:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:0.0:1746155647.583973:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125448960:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155647.583978:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fc53100/2, rc 0, transno 21474841703 00000100:00100000:0.0:1746155647.583981:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125448320:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155647.583986:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c4000/2, rc 0, transno 21474841704 00000100:00100000:0.0:1746155647.583988:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125448832:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155647.583989:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+83:3296:x1830976125448704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 471us (777us total) trans 21474841702 rc 0/0 00000100:00100000:1.0:1746155647.583994:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17489 00000100:00100000:0.0:1746155647.583997:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.584123:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125447552 00000100:00100000:1.0:1746155647.584126:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125447552 00000100:00100000:2.0:1746155647.584130:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+84:3296:x1830976125447680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 702us (961us total) trans 17179874403 rc 0/0 00000100:00100000:2.0:1746155647.584136:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17487 00000100:00100000:1.0:1746155647.584141:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17494 00000100:00100000:1.0:1746155647.584145:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+83:3295:x1830976125447552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.584216:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+84:3295:x1830976125447552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (217us total) trans 17179874404 rc 0/0 00000100:00100000:1.0:1746155647.584221:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17494 00000004:00080000:3.0:1746155647.584244:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526aa00/2, rc 0, transno 17179874400 00000100:00100000:3.0:1746155647.584251:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125447424:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155647.584257:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013089b100/2, rc 0, transno 17179874401 00000100:00100000:3.0:1746155647.584260:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013089b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125447936:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155647.584272:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526a680/2, rc 0, transno 17179874402 00000100:00100000:3.0:1746155647.584274:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125447168:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155647.584279:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095268380/2, rc 0, transno 17179874403 00000100:00100000:3.0:1746155647.584281:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125447680:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155647.584287:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0d9880/2, rc 0, transno 21474841701 00000100:00100000:3.0:1746155647.584289:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125448192:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155647.584294:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c4380/2, rc 0, transno 21474841702 00000100:00100000:3.0:1746155647.584297:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125448704:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155647.584433:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009526ad80/2, rc 0, transno 17179874404 00000100:00100000:0.0:1746155647.584437:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009526ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125447552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155647.584441:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125448064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155647.584456:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746155647.584569:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155647.584571:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.584573:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.584574:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155647 -> 1746155647 00002000:00010000:1.0:1746155647.584576:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155647.584607:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+84:3298:x1830976125447296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1236us (2197us total) trans 17179874405 rc 0/0 00000100:00100000:1.0:1746155647.584613:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17484 00000004:00080000:3.0:1746155647.584643:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880095269f80/2, rc 0, transno 17179874405 00000100:00100000:3.0:1746155647.584648:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125447296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155647.585173:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125448576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.585189:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.585223:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125448064 00000100:00100000:1.0:1746155647.585226:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125448064 00000100:00100000:1.0:1746155647.585243:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17495 00000100:00100000:1.0:1746155647.585247:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+84:3295:x1830976125448064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.585325:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3295:x1830976125448064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (867us total) trans 17179874406 rc 0/0 00000100:00100000:1.0:1746155647.585330:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17495 00000100:00100000:1.0:1746155647.585452:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+85:3298:x1830976125447808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2079us (3025us total) trans 17179874407 rc 0/0 00000100:00100000:1.0:1746155647.585458:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17485 00000004:00080000:2.0:1746155647.585480:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131497800/2, rc 0, transno 17179874407 00000100:00100000:2.0:1746155647.585484:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125447808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155647.585561:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125449088:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155647.585578:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155647.585595:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880130899880/2, rc 0, transno 17179874406 00000100:00100000:0.0:1746155647.585598:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125448064:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155647.585602:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746155647.585606:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125449472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155647.585620:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155647.586040:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125448576 00000100:00100000:1.0:1746155647.586044:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125448576 00000100:00100000:1.0:1746155647.586071:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125449088 00000100:00100000:1.0:1746155647.586073:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125449088 00000100:00100000:1.0:1746155647.586091:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125449472 00000100:00100000:1.0:1746155647.586093:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125449472 00000100:00100000:2.0:1746155647.586098:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17496 00000100:00100000:2.0:1746155647.586105:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:3295:x1830976125448576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155647.586151:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17497 00000100:00100000:1.0:1746155647.586157:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+84:3295:x1830976125449088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155647.586213:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3295:x1830976125448576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (1022us total) trans 21474841707 rc 0/0 00000100:00100000:2.0:1746155647.586219:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17496 00000100:00100000:2.0:1746155647.586229:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17498 00000100:00100000:2.0:1746155647.586233:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3295:x1830976125449472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155647.586245:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3295:x1830976125449088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (666us total) trans 21474841708 rc 0/0 00000100:00100000:1.0:1746155647.586251:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17497 00000100:00100000:0.0:1746155647.586495:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.586541:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.586693:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126163456 00000100:00100000:3.0:1746155647.586697:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126163456 00000100:00100000:3.0:1746155647.586717:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126163584 00000100:00100000:3.0:1746155647.586719:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126163584 00000100:00100000:1.0:1746155647.586730:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4784 00000100:00100000:1.0:1746155647.586736:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32537:x1830976126163456:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:2.0:1746155647.586789:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+86:3295:x1830976125449472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 555us (1167us total) trans 17179874408 rc 0/0 00000100:00100000:2.0:1746155647.586794:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17498 00000100:00100000:1.0:1746155647.586806:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32537:x1830976126163456:12345-192.168.202.51@tcp:49:cat.0 Request processed in 70us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.586834:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4785 00000100:00100000:3.0:1746155647.586841:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32544:x1830976126163584:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:1.0:1746155647.586885:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4784 00000100:00100000:3.0:1746155647.586892:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32544:x1830976126163584:12345-192.168.202.51@tcp:49:cat.0 Request processed in 51us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.586897:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4785 00000004:00080000:1.0:1746155647.586917:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a3fc6d80/2, rc 0, transno 17179874408 00000100:00100000:1.0:1746155647.586921:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125449472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155647.586922:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125449216:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155647.586929:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125449344:192.168.202.51@tcp:105: 00000004:00080000:1.0:1746155647.586931:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c5c00/2, rc 0, transno 21474841707 00000100:00100000:1.0:1746155647.586935:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125448576:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155647.586940:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c6300/2, rc 0, transno 21474841708 00000100:00100000:1.0:1746155647.586942:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125449088:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746155647.586951:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e2200/0x844e5faceb5f8e0b lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b4e expref: 9 pid: 14234 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746155647.586964:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b4e expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.586978:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4e3000, rc 0) 00000100:00100000:3.0:1746155647.586991:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32543:x1830976126162816:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 61550us (62999us total) trans 8589945410 rc 0/0 00000100:00100000:3.0:1746155647.586996:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11230 00000100:00100000:0.0:1746155647.587178:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.587411:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126163712 00000100:00100000:3.0:1746155647.587414:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126163712 00000100:00100000:3.0:1746155647.587433:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11233 00000100:00100000:3.0:1746155647.587438:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32540:x1830976126163712:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155647.587445:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.587455:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008e804a00/0x844e5faceb5f8e27 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b63 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.587482:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008e804a00/0x844e5faceb5f8e27 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b63 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.587497:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008e804a00/0x844e5faceb5f8e27 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b63 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.587527:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155647.587530:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155647.587532:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008e804a00, rc 0) 00000100:00100000:3.0:1746155647.587549:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32540:x1830976126163712:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 110us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.587554:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11233 00000100:00100000:0.0:1746155647.593137:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.593207:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126163840 00000100:00100000:1.0:1746155647.593215:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126163840 00000100:00100000:1.0:1746155647.593264:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 773 00000100:00100000:1.0:1746155647.593271:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1960:x1830976126163840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.593282:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155647.593302:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008e804a00/0x844e5faceb5f8e27 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b63 expref: 288 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.593555:0:15879:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155647.593560:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155647.593602:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1960:x1830976126163840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 332us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.593608:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 773 00000100:00100000:0.0:1746155647.598952:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.598997:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.599075:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126163968 00000100:00100000:2.0:1746155647.599082:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126163968 00000100:00100000:2.0:1746155647.599130:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126164096 00000100:00100000:2.0:1746155647.599133:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126164096 00000100:00100000:2.0:1746155647.599148:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17499 00000100:00100000:2.0:1746155647.599154:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:32540:x1830976126163968:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155647.599167:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.599180:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b6a expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.599202:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8cad lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ab4 expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.599209:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a013aa00/0x844e5faceb5f8def lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b39 expref: 45 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.599216:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f24da00/0x844e5faceb5f8d6a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18af3 expref: 31 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.599221:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.599222:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.599225:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3661824->4042751] (req 3661824->4042751) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 45 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.599245:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f24da00/0x844e5faceb5f8d6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18af3 expref: 31 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.599254:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f24da00/0x844e5faceb5f8d6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18af3 expref: 31 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155647.599262:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f880e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125449600:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.599319:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a013aa00/0x844e5faceb5f8def lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b39 expref: 45 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.599326:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a013aa00/0x844e5faceb5f8def lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b39 expref: 45 pid: 19959 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155647.599333:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125449728:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.599348:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8cad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ab4 expref: 13 pid: 18270 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746155647.599353:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17500 00010000:00010000:2.0:1746155647.599359:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8cad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ab4 expref: 13 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.599361:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32543:x1830976126164096:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:2.0:1746155647.599365:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125449856:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.599369:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155647.599375:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746155647.599378:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b71 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.599394:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1c00/0x844e5faceb5f8c9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aa6 expref: 14 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.599406:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8de1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b2b expref: 26 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.599413:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f8d71 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ae5 expref: 23 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.599417:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.599419:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.599421:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 23 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.599436:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f8d71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ae5 expref: 23 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.599443:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f8d71 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ae5 expref: 23 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.599452:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a3fc5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125449984:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.599480:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8de1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b2b expref: 26 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.599489:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8de1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b2b expref: 26 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.599496:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125450112:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.599651:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1c00/0x844e5faceb5f8c9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aa6 expref: 14 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.599659:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1c00/0x844e5faceb5f8c9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aa6 expref: 14 pid: 29728 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.599667:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125450240:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.599682:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501780 going to sleep for 11 seconds 00000100:00100000:2.0:1746155647.601087:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.601732:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126164352 00000100:00100000:3.0:1746155647.601738:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126164352 00000100:00100000:2.0:1746155647.601764:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:3.0:1746155647.601769:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f881f80 x1830976126164352/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.601807:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881f80 with x1830976126164352 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.601812:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f881f80 00000100:00100000:3.0:1746155647.601825:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126164608 00000100:00100000:3.0:1746155647.601827:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126164608 00002000:00100000:3.0:1746155647.601841:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009ca94380 x1830976126164608/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.601847:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94380 with x1830976126164608 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.601850:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca94380 00000100:00100000:3.0:1746155647.601860:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8302 00000100:00100000:3.0:1746155647.601875:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976126164352:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155647.602173:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8303 00000100:00100000:2.0:1746155647.602180:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1963:x1830976126164608:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155647.603537:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f880e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125449600:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155647.603548:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125449728:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155647.603556:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125449856:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.603572:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155647.603580:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3661824->4042751] (req 3661824->4042751) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 45 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.603585:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155647.603593:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6cd600, rc 0) 00000100:00100000:1.0:1746155647.603595:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.603606:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.603620:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:32540:x1830976126163968:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4465us (4674us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.603626:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17499 00000100:00100000:1.0:1746155647.603629:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.603649:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126164736 00000100:00100000:2.0:1746155647.603652:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126164736 00000100:00100000:1.0:1746155647.603665:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126164992 00010000:00010000:2.0:1746155647.603666:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f24da00/0x844e5faceb5f8d6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18af3 expref: 32 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.603668:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126164992 00010000:00010000:1.0:1746155647.603680:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8cad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ab4 expref: 14 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155647.603687:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126165248 00000100:00100000:2.0:1746155647.603689:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126165248 00000100:00100000:1.0:1746155647.603691:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126164864 00000100:00100000:1.0:1746155647.603693:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126164864 00010000:00010000:2.0:1746155647.603697:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8de1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b2b expref: 29 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.603700:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a013aa00/0x844e5faceb5f8def lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b39 expref: 45 pid: 19959 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155647.603706:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126165120 00000100:00100000:2.0:1746155647.603708:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126165120 00000100:00100000:1.0:1746155647.603710:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8964 00010000:00010000:2.0:1746155647.603714:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f8d71 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ae5 expref: 26 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.603716:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1962:x1830976126164736:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155647.603724:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8965 00010000:00010000:1.0:1746155647.603724:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155647.603729:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1962:x1830976126164992:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.603735:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155647.603737:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f24da00/0x844e5faceb5f8d6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18af3 expref: 32 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.603743:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8cad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ab4 expref: 14 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.603747:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f24da00/0x844e5faceb5f8d6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18af3 expref: 32 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.603863:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8966 00000100:00100000:3.0:1746155647.603881:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976126165248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.603888:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.603898:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8de1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b2b expref: 29 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.603906:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8de1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b2b expref: 29 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.603921:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.603940:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1962:x1830976126165248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 61us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.603945:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8966 00000100:00100000:3.0:1746155647.603955:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8967 00000100:00100000:3.0:1746155647.603960:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1962:x1830976126164864:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.603965:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.604722:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8cad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ab4 expref: 14 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.604740:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f24da00/0x844e5faceb5f8d6a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18af3 expref: 32 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.604744:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b00ce00/0x844e5faceb5f8cad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ab4 expref: 14 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.604756:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155647.604757:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155647.604774:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1962:x1830976126164992:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1044us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.604778:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1962:x1830976126164736:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1061us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.604779:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8965 00000100:00100000:1.0:1746155647.604783:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8964 00000100:00100000:2.0:1746155647.604793:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8968 00000100:00100000:2.0:1746155647.604798:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1962:x1830976126165120:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.604804:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.604813:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f8d71 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ae5 expref: 26 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.604819:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a3fc5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125449984:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.604820:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f8d71 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ae5 expref: 26 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.604829:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f24d800/0x844e5faceb5f8de1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b2b expref: 28 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.604831:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f000/0x844e5faceb5f8d71 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ae5 expref: 26 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.604838:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125450112:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.604839:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155647.604852:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1962:x1830976126165120:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.604857:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8968 00010000:00010000:3.0:1746155647.605119:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a013aa00/0x844e5faceb5f8def lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b39 expref: 45 pid: 19959 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.605127:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a013aa00/0x844e5faceb5f8def lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b39 expref: 45 pid: 19959 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.605137:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a013aa00/0x844e5faceb5f8def lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b39 expref: 45 pid: 19959 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.605145:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.605147:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.605153:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 44 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.605160:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 44 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.605182:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 44 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.605192:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fedad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125450368:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155647.605263:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.607698:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.607778:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125450240:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.607808:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1990656->2097151] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.607822:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26ea00, rc 0) 00000100:00100000:2.0:1746155647.607923:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126165376 00000100:00100000:2.0:1746155647.607928:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126165376 00010000:00010000:2.0:1746155647.607950:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1c00/0x844e5faceb5f8c9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aa6 expref: 15 pid: 29728 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155647.607972:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8969 00000100:00100000:2.0:1746155647.607978:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976126165376:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.607988:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.608004:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1c00/0x844e5faceb5f8c9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aa6 expref: 15 pid: 29728 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.608017:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1c00/0x844e5faceb5f8c9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aa6 expref: 15 pid: 29728 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.608041:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cdf1c00/0x844e5faceb5f8c9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aa6 expref: 15 pid: 29728 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.608051:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.608052:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.608057:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.608064:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.608086:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.608095:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca96d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125450496:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155647.608138:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:32543:x1830976126164096:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8778us (9141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.608145:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17500 00000100:00100000:2.0:1746155647.608704:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155647.610706:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976126164608:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8522us (8937us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.610715:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8303 00002000:00100000:2.0:1746155647.610724:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009ca94380 x1830976126164608/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.610731:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca94380 with x1830976126164608 ext(1048576->2097151) 00002000:00010000:2.0:1746155647.610737:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca94380 00000100:00100000:0.0:1746155647.614210:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.614279:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fedad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125450368:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155647.614295:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.614339:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1962:x1830976126164864:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10378us (10730us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.614348:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8967 00000100:00100000:0.0:1746155647.614488:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.614522:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126165632 00000100:00100000:0.0:1746155647.614527:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126165632 00002000:00100000:0.0:1746155647.614554:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3661824->3665919) req@ffff88009c28f800 x1830976126165632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.614563:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28f800 with x1830976126165632 ext(3661824->3665919) 00002000:00010000:0.0:1746155647.614567:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28f800 00000100:00100000:0.0:1746155647.614577:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126165888 00000100:00100000:0.0:1746155647.614579:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126165888 00002000:00100000:0.0:1746155647.614589:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1990656->1994751) req@ffff88009c28d500 x1830976126165888/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.614595:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28d500 with x1830976126165888 ext(1990656->1994751) 00002000:00010000:0.0:1746155647.614598:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28d500 00000100:00100000:3.0:1746155647.614993:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca96d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7062:1830976125450496:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155647.615004:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.615026:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1960:x1830976126165376:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7047us (7333us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.615032:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8969 00000100:00100000:3.0:1746155647.615208:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1960:x1830976126164352:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13342us (14124us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.615214:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8302 00002000:00100000:3.0:1746155647.615220:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f881f80 x1830976126164352/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.615237:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881f80 with x1830976126164352 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.615240:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f881f80 00000100:00100000:3.0:1746155647.615256:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8304 00000100:00100000:3.0:1746155647.615262:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976126165632:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155647.615372:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976126165632:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 110us (1169us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155647.615377:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8304 00002000:00100000:3.0:1746155647.615381:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3661824->3665919) req@ffff88009c28f800 x1830976126165632/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/4536 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.615387:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28f800 with x1830976126165632 ext(3661824->3665919) 00002000:00010000:3.0:1746155647.615390:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28f800 00000100:00100000:3.0:1746155647.615401:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8305 00000100:00100000:3.0:1746155647.615412:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976126165888:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155647.615469:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976126165888:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 57us (981us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155647.615474:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8305 00002000:00100000:3.0:1746155647.615479:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1990656->1994751) req@ffff88009c28d500 x1830976126165888/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/4536 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.615485:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28d500 with x1830976126165888 ext(1990656->1994751) 00002000:00010000:3.0:1746155647.615487:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28d500 00000100:00100000:3.0:1746155647.615745:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.615844:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126166016 00000100:00100000:1.0:1746155647.615848:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126166016 00000100:00100000:1.0:1746155647.615886:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17501 00000100:00100000:1.0:1746155647.615892:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:32544:x1830976126166016:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155647.615900:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.615912:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8e3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b78 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.615930:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.615936:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155647.615937:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155647.615940:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8e3c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b78 expref: 27 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.615960:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 21 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.615970:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 21 pid: 18270 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.615979:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125450624:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.616034:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155647.618849:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125450624:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.618882:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8e3c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b78 expref: 27 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.618901:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26f000, rc 0) 00000100:00100000:1.0:1746155647.619307:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:32544:x1830976126166016:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3413us (3560us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.619315:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17501 00000100:00100000:0.0:1746155647.619427:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.619729:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126166400 00000100:00100000:1.0:1746155647.619735:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126166400 00000100:00100000:1.0:1746155647.619769:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17502 00000100:00100000:1.0:1746155647.619774:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:32543:x1830976126166400:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155647.619787:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.619798:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b7f expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.619815:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b00c600/0x844e5faceb5f8ca6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aad expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.619823:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f24c800/0x844e5faceb5f8de8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b32 expref: 43 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.619828:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0200/0x844e5faceb5f8d55 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aec expref: 32 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.619833:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.619834:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.619837:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1048576->1286143] (req 1048576->1286143) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.619860:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0200/0x844e5faceb5f8d55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aec expref: 32 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.619877:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0200/0x844e5faceb5f8d55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aec expref: 32 pid: 29728 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.619887:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125450752:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.620412:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f24c800/0x844e5faceb5f8de8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b32 expref: 43 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.620420:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f24c800/0x844e5faceb5f8de8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b32 expref: 43 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.620428:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125450880:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155647.620484:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.620967:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126166272 00000100:00100000:0.0:1746155647.620972:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126166272 00002000:00100000:0.0:1746155647.620996:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1990656->2097151) req@ffff88009ca96d80 x1830976126166272/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.621004:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96d80 with x1830976126166272 ext(1990656->2097151) 00010000:00010000:0.0:1746155647.621010:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 22 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.621023:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 22 pid: 18270 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746155647.621028:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca96d80 00010000:00010000:1.0:1746155647.621130:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b00c600/0x844e5faceb5f8ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aad expref: 12 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.621138:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b00c600/0x844e5faceb5f8ca6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aad expref: 12 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:1.0:1746155647.621146:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094e35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125451008:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.621161:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.621671:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1460 00000100:00100000:0.0:1746155647.621677:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1963:x1830976126166272:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:1.0:1746155647.622075:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.622135:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e36a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125450752:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155647.622193:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126166656 00000100:00100000:3.0:1746155647.622198:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126166656 00002000:00100000:3.0:1746155647.622214:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (4038656->4042751) req@ffff880094e34e00 x1830976126166656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.622222:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e34e00 with x1830976126166656 ext(4038656->4042751) 00002000:00010000:3.0:1746155647.622224:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e34e00 00000100:00100000:3.0:1746155647.622242:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8306 00000100:00100000:3.0:1746155647.622247:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976126166656:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155647.622339:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1961:x1830976126166656:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 91us (263us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155647.622344:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8306 00002000:00100000:3.0:1746155647.622348:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (4038656->4042751) req@ffff880094e34e00 x1830976126166656/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/4536 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.622354:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e34e00 with x1830976126166656 ext(4038656->4042751) 00002000:00010000:3.0:1746155647.622356:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e34e00 00000100:00100000:2.0:1746155647.623235:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.623324:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125450880:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.623333:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094e35880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125451008:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155647.623356:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1048576->1286143] (req 1048576->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 32 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.623369:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f26f200, rc 0) 00000100:00100000:1.0:1746155647.623402:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:32543:x1830976126166400:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3627us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.623407:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17502 00000100:00100000:2.0:1746155647.623493:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.623679:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.624022:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126166912 00000100:00100000:3.0:1746155647.624027:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126166912 00010000:00010000:3.0:1746155647.624044:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f24c800/0x844e5faceb5f8de8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b32 expref: 44 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.624066:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126167040 00000100:00100000:3.0:1746155647.624067:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126167040 00010000:00010000:3.0:1746155647.624076:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b00c600/0x844e5faceb5f8ca6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aad expref: 13 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.624087:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126166784 00000100:00100000:3.0:1746155647.624089:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126166784 00010000:00010000:3.0:1746155647.624095:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0200/0x844e5faceb5f8d55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aec expref: 32 pid: 29728 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.624106:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8970 00000100:00100000:3.0:1746155647.624111:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1963:x1830976126166912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.624119:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.624133:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f24c800/0x844e5faceb5f8de8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b32 expref: 44 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.624140:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f24c800/0x844e5faceb5f8de8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b32 expref: 44 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.624155:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f24c800/0x844e5faceb5f8de8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b32 expref: 44 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.624171:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.624187:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1963:x1830976126166912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 76us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.624192:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8970 00000100:00100000:3.0:1746155647.624222:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8971 00000100:00100000:3.0:1746155647.624226:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1962:x1830976126167040:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.624231:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.624237:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b00c600/0x844e5faceb5f8ca6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aad expref: 13 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.624244:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b00c600/0x844e5faceb5f8ca6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aad expref: 13 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.624255:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b00c600/0x844e5faceb5f8ca6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aad expref: 13 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.624261:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.624273:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976126167040:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 47us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.624277:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8971 00000100:00100000:3.0:1746155647.624285:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8972 00000100:00100000:3.0:1746155647.624289:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1960:x1830976126166784:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.624293:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.624299:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0200/0x844e5faceb5f8d55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aec expref: 32 pid: 29728 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.624305:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0200/0x844e5faceb5f8d55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aec expref: 32 pid: 29728 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.624314:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0200/0x844e5faceb5f8d55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18aec expref: 32 pid: 29728 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.624320:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.624322:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.624326:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 31 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.624333:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 31 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.624352:0:7062:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 31 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.624360:0:7062:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fedaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125451136:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155647.624393:0:7062:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c64e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.627192:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1963:x1830976126166272:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 5507us (6700us total) trans 21474841709 rc 0/0 00000100:00100000:0.0:1746155647.627201:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1460 00002000:00100000:0.0:1746155647.627209:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1990656->2097151) req@ffff88009ca96d80 x1830976126166272/t21474841709(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/448 e 0 to 0 dl 1746155658 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.627217:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca96d80 with x1830976126166272 ext(1990656->2097151) 00010000:00010000:0.0:1746155647.627225:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 24 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.627236:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 24 pid: 18270 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746155647.627242:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ca96d80 00000100:00100000:2.0:1746155647.627343:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.627538:0:7062:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fedaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7062:1830976125451136:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155647.627552:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.627577:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976126166784:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3287us (3898us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.627583:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8972 00000100:00100000:0.0:1746155647.627812:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126167296 00000100:00100000:0.0:1746155647.627818:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126167296 00000100:00100000:0.0:1746155647.627852:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4786 00000100:00100000:0.0:1746155647.627857:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32540:x1830976126167296:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155647.628089:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32540:x1830976126167296:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 230us (744us total) trans 8589945411 rc 0/0 00000100:00100000:0.0:1746155647.628094:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4786 00000100:00100000:0.0:1746155647.630144:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.631012:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.631048:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126167552 00000100:00100000:1.0:1746155647.631059:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126167552 00002000:00100000:1.0:1746155647.631092:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1282048->1286143) req@ffff88009c28f480 x1830976126167552/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.631101:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28f480 with x1830976126167552 ext(1282048->1286143) 00000100:00100000:2.0:1746155647.631102:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126167808 00002000:00010000:1.0:1746155647.631105:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28f480 00000100:00100000:2.0:1746155647.631106:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126167808 00002000:00100000:2.0:1746155647.631123:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1990655) req@ffff88009c28ca80 x1830976126167808/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.631131:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28ca80 with x1830976126167808 ext(1048576->1990655) 00000100:00100000:1.0:1746155647.631133:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8307 00010000:00010000:2.0:1746155647.631138:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 24 pid: 18270 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.631139:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976126167552:12345-192.168.202.51@tcp:3:multiop.0 00010000:00010000:2.0:1746155647.631150:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 24 pid: 18270 timeout: 876 lvb_type: 0 00002000:00010000:2.0:1746155647.631156:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c28ca80 00000100:00100000:2.0:1746155647.631173:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1461 00000100:00100000:2.0:1746155647.631178:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976126167808:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155647.631267:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976126167552:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 127us (1127us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155647.631273:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8307 00002000:00100000:1.0:1746155647.631278:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1282048->1286143) req@ffff88009c28f480 x1830976126167552/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/4536 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.631285:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28f480 with x1830976126167552 ext(1282048->1286143) 00002000:00010000:1.0:1746155647.631288:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28f480 00000100:00100000:0.0:1746155647.633573:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.634565:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126168064 00000100:00100000:3.0:1746155647.634574:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126168064 00002000:00100000:3.0:1746155647.634607:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1286144->2097151) req@ffff88009c28ed80 x1830976126168064/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.634616:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28ed80 with x1830976126168064 ext(1286144->2097151) 00002000:00010000:3.0:1746155647.634622:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28ed80 00000100:00100000:3.0:1746155647.634644:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8308 00000100:00100000:3.0:1746155647.634650:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976126168064:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155647.635677:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.636201:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.637284:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126168320 00000100:00100000:3.0:1746155647.637291:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126168320 00000100:00100000:3.0:1746155647.637332:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4787 00000100:00100000:3.0:1746155647.637338:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32543:x1830976126168320:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:3.0:1746155647.637540:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32543:x1830976126168320:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 201us (1863us total) trans 8589945412 rc 0/0 00000100:00100000:3.0:1746155647.637547:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4787 00000100:00100000:1.0:1746155647.638142:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126168448 00000100:00100000:1.0:1746155647.638147:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126168448 00000100:00100000:1.0:1746155647.638170:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17503 00000100:00100000:1.0:1746155647.638175:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:32537:x1830976126168448:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155647.638184:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.638197:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f8e4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b86 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.638215:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155647.638220:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f8e4a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b86 expref: 27 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.638230:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f8e4a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b86 expref: 27 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.638238:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a82a00, rc 0) 00000100:00100000:1.0:1746155647.638259:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:32537:x1830976126168448:12345-192.168.202.51@tcp:101:cat.0 Request processed in 84us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.638264:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17503 00000100:00100000:3.0:1746155647.638637:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976126167808:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 7457us (7624us total) trans 0 rc 942080/942080 00000100:00100000:3.0:1746155647.638645:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1461 00002000:00100000:3.0:1746155647.638652:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1990655) req@ffff88009c28ca80 x1830976126167808/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:H/200/0 rc 942080/942080 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.638660:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28ca80 with x1830976126167808 ext(1048576->1990655) 00010000:00010000:3.0:1746155647.638665:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 25 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.638675:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 25 pid: 18270 timeout: 876 lvb_type: 0 00002000:00010000:3.0:1746155647.638681:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c28ca80 00000100:00100000:3.0:1746155647.641441:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1960:x1830976126168064:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 6785us (7868us total) trans 0 rc 811008/811008 00000100:00100000:3.0:1746155647.641450:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8308 00002000:00100000:3.0:1746155647.641459:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1286144->2097151) req@ffff88009c28ed80 x1830976126168064/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 811008/811008 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.641466:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28ed80 with x1830976126168064 ext(1286144->2097151) 00002000:00010000:3.0:1746155647.641471:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28ed80 00000100:00100000:0.0:1746155647.654329:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.654460:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126168576 00000100:00100000:3.0:1746155647.654468:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126168576 00010000:00010000:3.0:1746155647.654496:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 25 pid: 18270 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.654540:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8973 00000100:00100000:3.0:1746155647.654547:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1963:x1830976126168576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.654558:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746155647.654573:0:22680:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155647 -> 1746155648 00002000:00010000:3.0:1746155647.654576:0:22680:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155647 -> 1746155648 00010000:00010000:3.0:1746155647.654581:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 25 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.654591:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 25 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.654609:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f26ea00/0x844e5faceb5f8e35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1990656->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b71 expref: 25 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.654624:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.654626:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.654632:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8e3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b78 expref: 26 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.654640:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8e3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b78 expref: 26 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.654647:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.654648:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.654650:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f8e4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b86 expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.654660:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f8e4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b86 expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.654684:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f8e4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b86 expref: 24 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.654694:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fedaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125451264:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155647.654760:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8e3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b78 expref: 26 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.654768:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fedb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125451392:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155647.654785:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.660305:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.660402:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fedaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125451264:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155647.660411:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fedb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125451392:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155647.660427:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155647.660460:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1963:x1830976126168576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5914us (6138us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.660467:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8973 00000100:00100000:0.0:1746155647.660572:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126168832 00000100:00100000:0.0:1746155647.660577:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126168832 00002000:00100000:0.0:1746155647.660604:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009c28d880 x1830976126168832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.660612:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28d880 with x1830976126168832 ext(1048576->2097151) 00002000:00010000:0.0:1746155647.660616:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28d880 00000100:00100000:0.0:1746155647.660628:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8309 00000100:00100000:0.0:1746155647.660633:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976126168832:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155647.675773:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.675852:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126169088 00000100:00100000:2.0:1746155647.675859:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126169088 00002000:00100000:2.0:1746155647.675923:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009b883800 x1830976126169088/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.675932:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883800 with x1830976126169088 ext(1048576->2097151) 00002000:00010000:2.0:1746155647.675937:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b883800 00000100:00100000:2.0:1746155647.675955:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8310 00000100:00100000:2.0:1746155647.675962:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976126169088:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155647.678295:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976126168832:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 17655us (17988us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155647.678305:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8309 00002000:00100000:0.0:1746155647.678312:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009c28d880 x1830976126168832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.678320:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28d880 with x1830976126168832 ext(1048576->2097151) 00002000:00010000:0.0:1746155647.678325:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c28d880 00000100:00100000:2.0:1746155647.687449:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1960:x1830976126169088:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 11482us (11678us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.687459:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8310 00002000:00100000:2.0:1746155647.687468:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009b883800 x1830976126169088/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.687478:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b883800 with x1830976126169088 ext(1048576->2097151) 00002000:00010000:2.0:1746155647.687482:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b883800 00000100:00100000:1.0:1746155647.692806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.692839:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126169216 00000100:00100000:2.0:1746155647.692847:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126169216 00000100:00100000:2.0:1746155647.692887:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17504 00000100:00100000:2.0:1746155647.692894:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:32544:x1830976126169216:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.692907:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.692921:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6ccc00/0x844e5faceb5f8e51 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b8d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.692943:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 30 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.692950:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155647.692951:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155647.692954:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6ccc00/0x844e5faceb5f8e51 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b8d expref: 44 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.692980:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 30 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.692990:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 30 pid: 18270 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.692999:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125451520:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155647.693052:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155647.696084:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125451520:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.696107:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6ccc00/0x844e5faceb5f8e51 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b8d expref: 44 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.696121:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6ccc00, rc 0) 00000100:00100000:2.0:1746155647.696154:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099c88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:32544:x1830976126169216:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3260us (3352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.696162:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17504 00000100:00100000:0.0:1746155647.697828:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.697847:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126169344 00000100:00100000:0.0:1746155647.697853:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126169344 00002000:00100000:0.0:1746155647.697893:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1286143) req@ffff88009c28e300 x1830976126169344/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.697901:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28e300 with x1830976126169344 ext(1048576->1286143) 00010000:00010000:0.0:1746155647.697909:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 31 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.697921:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 31 pid: 18270 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746155647.697927:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c28e300 00000100:00100000:0.0:1746155647.697939:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1462 00000100:00100000:0.0:1746155647.697946:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1961:x1830976126169344:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155647.701529:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.701551:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126169472 00000100:00100000:2.0:1746155647.701556:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126169472 00000100:00100000:2.0:1746155647.701584:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17505 00000100:00100000:2.0:1746155647.701591:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1962:x1830976126169472:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.701602:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.701614:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f8e58 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b94 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.701655:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125451648:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155647.701712:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155647.701767:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.701788:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126169600 00000100:00100000:2.0:1746155647.701792:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126169600 00000100:00100000:2.0:1746155647.701809:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17506 00000100:00100000:2.0:1746155647.701814:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1962:x1830976126169600:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.701819:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.701826:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd000/0x844e5faceb5f8e5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18b9b expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.701847:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125451776:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155647.701875:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.701896:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+37:1961:x1830976126169344:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 3949us (4069us total) trans 17179874409 rc 0/0 00000100:00100000:0.0:1746155647.701907:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1462 00002000:00100000:0.0:1746155647.701914:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1286143) req@ffff88009c28e300 x1830976126169344/t17179874409(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/448 e 0 to 0 dl 1746155658 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.701922:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28e300 with x1830976126169344 ext(1048576->1286143) 00010000:00010000:0.0:1746155647.701928:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 37 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.701938:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 37 pid: 18270 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746155647.701944:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c28e300 00002000:00010000:2.0:1746155647.703055:0:18270:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155647 -> 1746155648 00002000:00010000:2.0:1746155647.703058:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155647 -> 1746155648 00002000:00010000:2.0:1746155647.703060:0:18270:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime: 1746155647 -> 1746155648 00000100:00100000:2.0:1746155647.703071:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125451776:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155647.703087:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd000/0x844e5faceb5f8e5f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b9b expref: 36 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.703097:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd000/0x844e5faceb5f8e5f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b9b expref: 36 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.703104:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6cd000, rc 0) 00000100:00100000:2.0:1746155647.703122:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1962:x1830976126169600:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1308us (1356us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155647.703127:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17506 00002000:00010000:2.0:1746155647.703180:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime: 1746155647 -> 1746155648 00002000:00010000:2.0:1746155647.703182:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime: 1746155647 -> 1746155648 00002000:00010000:2.0:1746155647.703184:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime: 1746155647 -> 1746155648 00000100:00100000:2.0:1746155647.703189:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b881f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125451648:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155647.703199:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f8e58 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b94 expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.703206:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cdc00/0x844e5faceb5f8e58 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b94 expref: 34 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155647.703212:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6cdc00, rc 0) 00000100:00100000:2.0:1746155647.703226:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1962:x1830976126169472:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1637us (2506us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155647.703230:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17505 00000100:00100000:2.0:1746155647.705972:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.705993:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126169728 00000100:00100000:2.0:1746155647.705998:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126169728 00010000:00010000:2.0:1746155647.706017:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 33 pid: 18270 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.706034:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8974 00000100:00100000:2.0:1746155647.706039:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1962:x1830976126169728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.706048:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.706060:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 33 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.706077:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 33 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.706092:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f26f200/0x844e5faceb5f8e43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1286143) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b7f expref: 33 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.706102:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.706104:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.706108:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6ccc00/0x844e5faceb5f8e51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b8d expref: 43 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.706115:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6ccc00/0x844e5faceb5f8e51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b8d expref: 43 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.706135:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6ccc00/0x844e5faceb5f8e51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b8d expref: 43 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.706145:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b881f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125451904:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155647.706195:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.707954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.708151:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126169856 00000100:00100000:2.0:1746155647.708157:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126169856 00000100:00100000:2.0:1746155647.708189:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17507 00000100:00100000:2.0:1746155647.708196:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:32537:x1830976126169856:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155647.708208:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.708220:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f6cca00/0x844e5faceb5f8e66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ba2 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.708240:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 43 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.708246:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155647.708247:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155647.708250:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cca00/0x844e5faceb5f8e66 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba2 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.708269:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 43 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.708278:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 43 pid: 8437 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.708287:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125452032:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155647.708351:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746155647.710823:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125452032:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.710843:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cca00/0x844e5faceb5f8e66 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba2 expref: 34 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.710855:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f6cca00, rc 0) 00000100:00100000:2.0:1746155647.712018:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:32537:x1830976126169856:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3819us (4065us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.712026:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17507 00000100:00100000:3.0:1746155647.712936:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b881f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125451904:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155647.712948:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.712973:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1962:x1830976126169728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6933us (7005us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.712981:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8974 00000100:00100000:3.0:1746155647.713517:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.713536:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126169984 00000100:00100000:0.0:1746155647.713542:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126169984 00000100:00100000:3.0:1746155647.713546:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:0.0:1746155647.713583:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3661824->4042751) req@ffff88009fed9880 x1830976126169984/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.713592:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9880 with x1830976126169984 ext(3661824->4042751) 00010000:00010000:0.0:1746155647.713598:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 44 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.713609:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 44 pid: 8437 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746155647.713615:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fed9880 00000100:00100000:0.0:1746155647.713627:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126170240 00000100:00100000:0.0:1746155647.713630:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126170240 00002000:00100000:0.0:1746155647.713641:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fed9c00 x1830976126170240/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.713653:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9c00 with x1830976126170240 ext(1048576->2097151) 00002000:00010000:0.0:1746155647.713657:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed9c00 00000100:00100000:0.0:1746155647.713669:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1463 00000100:00100000:0.0:1746155647.713675:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1961:x1830976126169984:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155647.713996:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8311 00000100:00100000:0.0:1746155647.714001:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1960:x1830976126170240:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155647.720828:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+48:1961:x1830976126169984:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 7147us (7322us total) trans 17179874410 rc 0/0 00000100:00100000:0.0:1746155647.720836:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1463 00002000:00100000:0.0:1746155647.720846:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3661824->4042751) req@ffff88009fed9880 x1830976126169984/t17179874410(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/448 e 0 to 0 dl 1746155658 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.720854:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9880 with x1830976126169984 ext(3661824->4042751) 00010000:00010000:0.0:1746155647.720871:0:31252:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 48 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:0.0:1746155647.720885:0:31252:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 48 pid: 8437 timeout: 876 lvb_type: 0 00002000:00010000:0.0:1746155647.720891:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009fed9880 00000100:00100000:2.0:1746155647.723093:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1960:x1830976126170240:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9086us (9541us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.723103:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8311 00002000:00100000:2.0:1746155647.723109:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fed9c00 x1830976126170240/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.723117:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fed9c00 with x1830976126170240 ext(1048576->2097151) 00002000:00010000:2.0:1746155647.723121:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fed9c00 00000100:00100000:2.0:1746155647.723337:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.723356:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126170368 00000100:00100000:2.0:1746155647.723361:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126170368 00010000:00010000:2.0:1746155647.723380:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 46 pid: 8437 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.723399:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8975 00000100:00100000:2.0:1746155647.723406:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1960:x1830976126170368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.723416:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.723429:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 46 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.723444:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 46 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.723462:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cd600/0x844e5faceb5f8e2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3661824->4042751) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b6a expref: 46 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.723472:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.723474:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155647.723480:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cca00/0x844e5faceb5f8e66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba2 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.723487:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cca00/0x844e5faceb5f8e66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba2 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.723526:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6cca00/0x844e5faceb5f8e66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba2 expref: 32 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.723541:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc50e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125452160:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155647.723585:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155647.727592:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc50e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125452160:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155647.727608:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155647.727642:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1960:x1830976126170368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4236us (4304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.727651:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8975 00000100:00100000:2.0:1746155647.730146:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.730440:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126170496 00000100:00100000:3.0:1746155647.730447:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126170496 00000100:00100000:3.0:1746155647.730475:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17508 00000100:00100000:3.0:1746155647.730481:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1961:x1830976126170496:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155647.730494:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.730525:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdd9200/0x844e5faceb5f8e6d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ba9 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.730544:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.730546:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.730553:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdd9200/0x844e5faceb5f8e6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba9 expref: 46 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.730566:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdd9200/0x844e5faceb5f8e6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba9 expref: 46 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.730576:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd9200, rc 0) 00000100:00100000:3.0:1746155647.730612:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1961:x1830976126170496:12345-192.168.202.51@tcp:101:cat.0 Request processed in 130us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.730618:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17508 00000100:00100000:1.0:1746155647.735054:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.735083:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.735095:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.735117:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.735183:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126170880 00000100:00100000:0.0:1746155647.735190:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126170880 00002000:00100000:0.0:1746155647.735221:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880094e35880 x1830976126170880/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.735230:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35880 with x1830976126170880 ext(2097152->3145727) 00002000:00010000:0.0:1746155647.735235:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35880 00000100:00100000:0.0:1746155647.735258:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126171008 00000100:00100000:0.0:1746155647.735260:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126171008 00002000:00100000:0.0:1746155647.735270:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880094e35500 x1830976126171008/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.735276:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35500 with x1830976126171008 ext(3145728->4194303) 00002000:00010000:0.0:1746155647.735278:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35500 00000100:00100000:0.0:1746155647.735286:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126171264 00000100:00100000:0.0:1746155647.735288:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126171264 00002000:00100000:0.0:1746155647.735297:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880094e36a00 x1830976126171264/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.735302:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36a00 with x1830976126171264 ext(2097152->3145727) 00002000:00010000:0.0:1746155647.735305:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e36a00 00000100:00100000:0.0:1746155647.735311:0:31252:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126171392 00000100:00100000:0.0:1746155647.735313:0:31252:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126171392 00002000:00100000:0.0:1746155647.735320:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff880094e37b80 x1830976126171392/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.735326:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37b80 with x1830976126171392 ext(3145728->4194303) 00002000:00010000:0.0:1746155647.735328:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e37b80 00000100:00100000:0.0:1746155647.735337:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8312 00000100:00100000:0.0:1746155647.735342:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1963:x1830976126170880:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155647.736248:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8313 00000100:00100000:2.0:1746155647.736255:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1963:x1830976126171008:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155647.737172:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8314 00000100:00100000:3.0:1746155647.737192:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8315 00000100:00100000:3.0:1746155647.737989:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1962:x1830976126171392:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155647.739669:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1963:x1830976126171264:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155647.746751:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.747107:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126172032 00000100:00100000:2.0:1746155647.747114:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126172032 00002000:00100000:2.0:1746155647.747149:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880094e35180 x1830976126172032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.747158:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35180 with x1830976126172032 ext(2097152->3145727) 00002000:00010000:2.0:1746155647.747163:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35180 00000100:00100000:2.0:1746155647.747193:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8316 00000100:00100000:2.0:1746155647.747201:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1960:x1830976126172032:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155647.747499:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.747541:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.747551:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.747579:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126171904 00000100:00100000:1.0:1746155647.747582:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126171904 00002000:00100000:1.0:1746155647.747596:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880094e37800 x1830976126171904/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.747602:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37800 with x1830976126171904 ext(2097152->3145727) 00002000:00010000:1.0:1746155647.747604:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e37800 00000100:00100000:1.0:1746155647.747612:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126172160 00000100:00100000:1.0:1746155647.747614:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126172160 00002000:00100000:1.0:1746155647.747620:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff880094e35c00 x1830976126172160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.747625:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35c00 with x1830976126172160 ext(3145728->4194303) 00002000:00010000:1.0:1746155647.747627:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e35c00 00000100:00100000:1.0:1746155647.747633:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126172416 00000100:00100000:1.0:1746155647.747634:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126172416 00002000:00100000:1.0:1746155647.747640:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880094e36680 x1830976126172416/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.747645:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36680 with x1830976126172416 ext(3145728->4194303) 00002000:00010000:1.0:1746155647.747647:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36680 00000100:00100000:1.0:1746155647.747655:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8317 00000100:00100000:1.0:1746155647.747659:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976126171904:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155647.748317:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8318 00000100:00100000:0.0:1746155647.748325:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1961:x1830976126172160:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155647.748536:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8319 00000100:00100000:3.0:1746155647.748548:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+47:1961:x1830976126172416:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155647.751608:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+35:1963:x1830976126170880:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16258us (16551us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.751618:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8312 00002000:00100000:2.0:1746155647.751626:0:31252:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880094e35880 x1830976126170880/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.751634:0:31252:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35880 with x1830976126170880 ext(2097152->3145727) 00002000:00010000:2.0:1746155647.751638:0:31252:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35880 00000100:00100000:3.0:1746155647.752789:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:1962:x1830976126171392:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14805us (17669us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.752797:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8315 00002000:00100000:3.0:1746155647.752802:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff880094e37b80 x1830976126171392/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.752815:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37b80 with x1830976126171392 ext(3145728->4194303) 00002000:00010000:3.0:1746155647.752817:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e37b80 00000001:00080000:1.0:1746155647.759012:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841709 is committed 00000001:00080000:1.0:1746155647.759023:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841706 is committed 00000001:00080000:1.0:1746155647.759059:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841708 is committed 00000001:00080000:1.0:1746155647.759106:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841692 is committed 00000001:00080000:1.0:1746155647.759122:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841659 is committed 00000001:00080000:1.0:1746155647.759153:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841681 is committed 00000100:00100000:2.0:1746155647.760606:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1963:x1830976126171008:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24346us (25516us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.760616:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8313 00002000:00100000:2.0:1746155647.760626:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880094e35500 x1830976126171008/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.760635:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35500 with x1830976126171008 ext(3145728->4194303) 00002000:00010000:2.0:1746155647.760639:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35500 00000100:00100000:0.0:1746155647.761832:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1963:x1830976126171264:12345-192.168.202.51@tcp:3:cat.0 Request processed in 22215us (26731us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155647.761840:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8314 00002000:00100000:0.0:1746155647.761846:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880094e36a00 x1830976126171264/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.761853:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36a00 with x1830976126171264 ext(2097152->3145727) 00002000:00010000:0.0:1746155647.761857:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e36a00 00000100:00100000:2.0:1746155647.766456:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976126171904:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18789us (18949us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.766466:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8317 00002000:00100000:2.0:1746155647.766560:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff880094e37800 x1830976126171904/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.766570:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e37800 with x1830976126171904 ext(2097152->3145727) 00002000:00010000:2.0:1746155647.766574:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e37800 00000100:00100000:2.0:1746155647.768967:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+48:1960:x1830976126172032:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21759us (22215us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.768976:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8316 00002000:00100000:2.0:1746155647.768982:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff880094e35180 x1830976126172032/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.768990:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35180 with x1830976126172032 ext(2097152->3145727) 00002000:00010000:2.0:1746155647.768993:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e35180 00000100:00100000:0.0:1746155647.774739:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.774832:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126172672 00000100:00100000:3.0:1746155647.774839:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126172672 00000100:00100000:3.0:1746155647.774879:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17509 00000100:00100000:3.0:1746155647.774886:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1961:x1830976126172672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155647.774900:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.774912:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8400/0x844e5faceb5f8e74 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18bb0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.774927:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.774928:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.774934:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8400/0x844e5faceb5f8e74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb0 expref: 34 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.774942:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8400/0x844e5faceb5f8e74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb0 expref: 34 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.774949:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fdd8400, rc 0) 00000100:00100000:3.0:1746155647.775119:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1961:x1830976126172672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 232us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.775125:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17509 00000100:00100000:3.0:1746155647.775463:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1961:x1830976126172416:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26920us (27909us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.775470:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8319 00002000:00100000:3.0:1746155647.775477:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff880094e36680 x1830976126172416/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.775485:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e36680 with x1830976126172416 ext(3145728->4194303) 00002000:00010000:3.0:1746155647.775489:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880094e36680 00000100:00100000:0.0:1746155647.776404:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976126172160:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28079us (28861us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155647.776411:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8318 00002000:00100000:0.0:1746155647.776416:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff880094e35c00 x1830976126172160/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.776423:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880094e35c00 with x1830976126172160 ext(3145728->4194303) 00002000:00010000:0.0:1746155647.776426:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880094e35c00 00000100:00100000:0.0:1746155647.783023:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.783084:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.783102:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126172928 00000100:00100000:0.0:1746155647.783108:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126172928 00000100:00100000:3.0:1746155647.783112:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126173184 00000100:00100000:3.0:1746155647.783116:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126173184 00002000:00100000:3.0:1746155647.783136:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009c28df80 x1830976126173184/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.783136:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009c28d180 x1830976126172928/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.783144:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28df80 with x1830976126173184 ext(4194304->5083135) 00002000:00100000:0.0:1746155647.783144:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28d180 with x1830976126172928 ext(4194304->5083135) 00002000:00010000:3.0:1746155647.783148:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28df80 00002000:00010000:0.0:1746155647.783157:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28d180 00000100:00100000:3.0:1746155647.783176:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8320 00000100:00100000:0.0:1746155647.783180:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8321 00000100:00100000:3.0:1746155647.783183:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1961:x1830976126173184:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155647.783185:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1963:x1830976126172928:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155647.793274:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1963:x1830976126172928:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10081us (10407us total) trans 0 rc 888832/888832 00000100:00100000:0.0:1746155647.793283:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8321 00002000:00100000:0.0:1746155647.793292:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009c28d180 x1830976126172928/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.793300:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28d180 with x1830976126172928 ext(4194304->5083135) 00002000:00010000:0.0:1746155647.793304:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28d180 00000100:00100000:0.0:1746155647.793422:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1961:x1830976126173184:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10240us (10338us total) trans 0 rc 888832/888832 00000100:00100000:0.0:1746155647.793427:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8320 00002000:00100000:0.0:1746155647.793431:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009c28df80 x1830976126173184/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.793437:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c28df80 with x1830976126173184 ext(4194304->5083135) 00002000:00010000:0.0:1746155647.793440:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c28df80 00000100:00100000:0.0:1746155647.800323:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.800351:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126173440 00000100:00100000:0.0:1746155647.800360:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126173440 00000100:00100000:0.0:1746155647.800497:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4788 00000100:00100000:0.0:1746155647.800525:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32537:x1830976126173440:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:0.0:1746155647.802778:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea55050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32537:x1830976126173440:12345-192.168.202.51@tcp:35:cat.0 Request processed in 2082us (2287us total) trans 8589945413 rc 0/0 00000100:00100000:0.0:1746155647.802795:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4788 00000100:00100000:1.0:1746155647.821004:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.821023:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126173568 00000100:00100000:2.0:1746155647.821030:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126173568 00000100:00100000:2.0:1746155647.821063:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11234 00000100:00100000:2.0:1746155647.821070:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32550:x1830976126173568:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155647.821087:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.821102:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013136a000/0x844e5faceb5f8e7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18bb7 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.821147:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013136a800/0x844e5faceb5f8e82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821157:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013136a800/0x844e5faceb5f8e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821166:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013136a800/0x844e5faceb5f8e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821176:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74fc00/0x844e5faceb5f8e89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821181:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74fc00/0x844e5faceb5f8e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821186:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74fc00/0x844e5faceb5f8e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821359:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d200/0x844e5faceb5f8e90 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821366:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d200/0x844e5faceb5f8e90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821372:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d200/0x844e5faceb5f8e90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155647.821396:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155647.821399:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155647.821424:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d200/0x844e5faceb5f8e90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821432:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d200/0x844e5faceb5f8e90 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821438:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013136a800/0x844e5faceb5f8e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821443:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013136a800/0x844e5faceb5f8e82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821448:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013136a800/0x844e5faceb5f8e82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821453:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013136a800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155647.821456:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013136a800/0x844e5faceb5f8e82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821462:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013136a800/0x844e5faceb5f8e82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821471:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155647.821474:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155647.821477:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013136a800/0x844e5faceb5f8e82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821481:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013136a800/0x844e5faceb5f8e82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821489:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74fc00/0x844e5faceb5f8e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821494:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74fc00/0x844e5faceb5f8e89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821498:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74fc00/0x844e5faceb5f8e89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821534:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a74fc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155647.821536:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74fc00/0x844e5faceb5f8e89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821541:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74fc00/0x844e5faceb5f8e89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821548:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51900) 00010000:00010000:2.0:1746155647.821550:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155647.821552:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74fc00/0x844e5faceb5f8e89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821556:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74fc00/0x844e5faceb5f8e89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.821577:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013136a000/0x844e5faceb5f8e7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb7 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.821591:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d200/0x844e5faceb5f8e90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb7 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.821596:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.821598:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155647.821600:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e86d200, rc 0) 00000100:00100000:2.0:1746155647.821652:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32550:x1830976126173568:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 582us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.821658:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11234 00000100:00100000:1.0:1746155647.826345:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.826364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.826383:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.826399:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126173696 00000100:00100000:1.0:1746155647.826406:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126173696 00000100:00100000:1.0:1746155647.826437:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126173952 00000100:00100000:1.0:1746155647.826439:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126173952 00000100:00100000:1.0:1746155647.826447:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126173824 00000100:00100000:1.0:1746155647.826449:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126173824 00000100:00100000:1.0:1746155647.826460:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17510 00000100:00100000:1.0:1746155647.826470:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976126173696:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155647.826482:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.826495:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f8e97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18bbe expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.826527:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.826529:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.826536:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f8e97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bbe expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.826548:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f8e97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bbe expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.826557:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29400, rc 0) 00000100:00100000:1.0:1746155647.826590:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976126173696:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 124us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.826599:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17510 00000100:00100000:1.0:1746155647.826611:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17511 00000100:00100000:1.0:1746155647.826616:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976126173952:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155647.826621:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.826629:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd28a00/0x844e5faceb5f8e9e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18bcc expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.826638:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.826639:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.826643:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd28a00/0x844e5faceb5f8e9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bcc expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.826651:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd28a00/0x844e5faceb5f8e9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bcc expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.826658:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28a00, rc 0) 00000100:00100000:1.0:1746155647.826670:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1963:x1830976126173952:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 55us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.826675:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17511 00000100:00100000:1.0:1746155647.826683:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17512 00000100:00100000:1.0:1746155647.826687:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1963:x1830976126173824:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:1.0:1746155647.826692:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.826696:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f8ea5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18bc5 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.826704:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.826706:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.826709:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f8ea5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bc5 expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.826717:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f8ea5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bc5 expref: 14 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.826723:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29000, rc 0) 00000100:00100000:1.0:1746155647.826734:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1963:x1830976126173824:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 47us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.826739:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17512 00000100:00100000:2.0:1746155647.829994:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.830249:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126174208 00000100:00100000:2.0:1746155647.830255:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126174208 00000100:00100000:2.0:1746155647.830286:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11235 00000100:00100000:2.0:1746155647.830292:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32550:x1830976126174208:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155647.830305:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.830317:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d000/0x844e5faceb5f8eac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18bd3 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.830381:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86cc00/0x844e5faceb5f8eb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.830392:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d200/0x844e5faceb5f8e90 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb7 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.830398:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86cc00/0x844e5faceb5f8eb3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.830419:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d200/0x844e5faceb5f8e90 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb7 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.830430:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d200/0x844e5faceb5f8e90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb7 expref: 8 pid: 20364 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.830439:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125452288:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155647.830486:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77480 going to sleep for 11 seconds 00000100:00100000:1.0:1746155647.833335:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.833727:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126174336 00000100:00100000:2.0:1746155647.833733:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126174336 00010000:00010000:2.0:1746155647.833757:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d200/0x844e5faceb5f8e90 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb7 expref: 9 pid: 20364 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.833778:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8976 00000100:00100000:2.0:1746155647.833785:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126174336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.833793:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.833798:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d200/0x844e5faceb5f8e90 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb7 expref: 9 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.833808:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d200/0x844e5faceb5f8e90 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb7 expref: 9 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:2.0:1746155647.833824:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.833829:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86cc00/0x844e5faceb5f8eb3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.833837:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86cc00/0x844e5faceb5f8eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.833842:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86cc00/0x844e5faceb5f8eb3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.833856:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155647.833898:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126174336:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 113us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.833904:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8976 00010000:00010000:2.0:1746155647.834036:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d200/0x844e5faceb5f8e90 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb7 expref: 8 pid: 20364 timeout: 876 lvb_type: 0 00000100:00100000:2.0:1746155647.834047:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880095268700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125452288:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.834060:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86cc00/0x844e5faceb5f8eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.834066:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86cc00/0x844e5faceb5f8eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.834071:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86cc00/0x844e5faceb5f8eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155647.834085:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155647.834171:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86d000/0x844e5faceb5f8eac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bd3 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.834182:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86cc00/0x844e5faceb5f8eb3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bd3 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.834188:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.834190:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155647.834192:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e86cc00, rc 0) 00000100:00100000:2.0:1746155647.835322:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32550:x1830976126174208:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 5027us (5330us total) trans 8589945414 rc 0/0 00000100:00100000:2.0:1746155647.835332:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11235 00000100:00100000:1.0:1746155647.838458:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.839039:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126174592 00000100:00100000:2.0:1746155647.839045:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126174592 00000100:00100000:2.0:1746155647.839076:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11236 00000100:00100000:2.0:1746155647.839083:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32550:x1830976126174592:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155647.839100:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155647.839103:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746155647.839123:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e86cc00/0x844e5faceb5f8eb3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bd3 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.839134:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.839137:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155647.839145:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f846800/0x844e5faceb5f8ec1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18bda expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.839207:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8ec8 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.839216:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.839224:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155647.839232:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155647.839304:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f846800/0x844e5faceb5f8ec1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bda expref: 10 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.839315:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8ec8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bda expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.839321:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155647.839323:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155647.839325:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f847a00, rc 0) 00000100:00100000:2.0:1746155647.839371:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32550:x1830976126174592:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 288us (916us total) trans 8589945415 rc 0/0 00000100:00100000:2.0:1746155647.839377:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11236 00000100:00100000:0.0:1746155647.843678:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.843702:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126174720 00000100:00100000:0.0:1746155647.843708:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126174720 00000100:00100000:0.0:1746155647.843737:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11237 00000100:00100000:0.0:1746155647.843743:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32550:x1830976126174720:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155647.843767:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155647.843780:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d58a400/0x844e5faceb5f8ed6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18be1 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.843823:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d58a400/0x844e5faceb5f8ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18be1 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.843834:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d58a400/0x844e5faceb5f8ed6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18be1 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.843848:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155647.843851:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155647.843853:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d58a400, rc 0) 00000100:00100000:0.0:1746155647.843901:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32550:x1830976126174720:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 157us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.843907:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11237 00000100:00100000:0.0:1746155647.846784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.846801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.846879:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.846897:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.846927:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.846954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.846983:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126174848 00000100:00100000:0.0:1746155647.846989:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126174848 00000100:00100000:0.0:1746155647.847032:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126175104 00000100:00100000:0.0:1746155647.847034:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126175104 00000100:00100000:0.0:1746155647.847044:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126175360 00000100:00100000:0.0:1746155647.847045:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126175360 00000100:00100000:0.0:1746155647.847064:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126174976 00000100:00100000:0.0:1746155647.847066:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126174976 00000100:00100000:0.0:1746155647.847074:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126175232 00000100:00100000:0.0:1746155647.847076:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126175232 00000100:00100000:0.0:1746155647.847097:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126175488 00000100:00100000:0.0:1746155647.847099:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126175488 00000100:00100000:0.0:1746155647.847110:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17513 00000100:00100000:0.0:1746155647.847116:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1962:x1830976126174848:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155647.847166:0:1625:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.847180:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009455d400/0x844e5faceb5f8c91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a98 expref: 16 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.847188:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f24dc00/0x844e5faceb5f8dc5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b1d expref: 45 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.847195:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8d63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ad7 expref: 33 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.847200:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.847202:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.847204:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.847227:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8d63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ad7 expref: 33 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.847239:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8d63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ad7 expref: 33 pid: 29728 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.847250:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125452416:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.847306:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f24dc00/0x844e5faceb5f8dc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b1d expref: 45 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.847313:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f24dc00/0x844e5faceb5f8dc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b1d expref: 45 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.847321:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125452544:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.847340:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009455d400/0x844e5faceb5f8c91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a98 expref: 16 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.847347:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009455d400/0x844e5faceb5f8c91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a98 expref: 16 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.847354:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125452672:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.847366:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c649c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.847380:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17514 00000100:00100000:0.0:1746155647.847386:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126175104:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155647.847402:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.847410:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8e3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b78 expref: 12 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.847417:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f8e97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bbe expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.847423:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f8e4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b86 expref: 7 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.847428:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.847429:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.847431:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.847445:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f8e4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b86 expref: 7 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.847452:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f8e4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b86 expref: 7 pid: 18270 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.847459:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125452800:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.847480:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f8e97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bbe expref: 11 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.847492:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f8e97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bbe expref: 11 pid: 8438 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.847499:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125452928:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.847546:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8e3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b78 expref: 12 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.847554:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8e3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b78 expref: 12 pid: 18270 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.847561:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125453056:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.847575:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff880094c64e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.847616:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17515 00000100:00100000:0.0:1746155647.847622:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1962:x1830976126175360:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155647.847636:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.847655:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cca00/0x844e5faceb5f8e66 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba2 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.847662:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd28a00/0x844e5faceb5f8e9e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bcc expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.847668:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdd9200/0x844e5faceb5f8e6d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba9 expref: 45 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.847685:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.847686:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.847688:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.847703:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdd9200/0x844e5faceb5f8e6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba9 expref: 45 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.847724:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdd9200/0x844e5faceb5f8e6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba9 expref: 45 pid: 8437 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.847840:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125453184:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.847883:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd28a00/0x844e5faceb5f8e9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bcc expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.847891:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd28a00/0x844e5faceb5f8e9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bcc expref: 16 pid: 8438 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.847911:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125453312:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.847933:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6cca00/0x844e5faceb5f8e66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba2 expref: 33 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.847966:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6cca00/0x844e5faceb5f8e66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba2 expref: 33 pid: 8437 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.847978:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125453440:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.847999:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.848023:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17516 00000100:00100000:0.0:1746155647.848029:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126174976:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155647.848060:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.848069:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8c98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a9f expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848094:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009455de00/0x844e5faceb5f8dda lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b24 expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848102:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5e000/0x844e5faceb5f8d4e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ade expref: 7 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848108:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.848109:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.848111:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.848134:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb5e000/0x844e5faceb5f8d4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ade expref: 7 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848142:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5e000/0x844e5faceb5f8d4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ade expref: 7 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.848161:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125453568:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.848180:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009455de00/0x844e5faceb5f8dda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b24 expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848201:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009455de00/0x844e5faceb5f8dda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b24 expref: 12 pid: 9235 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.848217:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125453696:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.848232:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a9f expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848240:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8c98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a9f expref: 11 pid: 8436 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.848247:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125453824:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.848284:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4d8d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.848308:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17517 00000100:00100000:0.0:1746155647.848314:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1962:x1830976126175232:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155647.848341:0:10591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.848350:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f6ccc00/0x844e5faceb5f8e51 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b8d expref: 45 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.848369:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f8ea5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bc5 expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848376:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8400/0x844e5faceb5f8e74 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb0 expref: 33 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848381:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.848383:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.848395:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.848410:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8400/0x844e5faceb5f8e74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb0 expref: 33 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848417:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8400/0x844e5faceb5f8e74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb0 expref: 33 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.848433:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094443480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125453952:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.848451:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f8ea5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bc5 expref: 16 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848471:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f8ea5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bc5 expref: 16 pid: 8438 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.848478:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094443800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125454080:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.848566:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009f6ccc00/0x844e5faceb5f8e51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b8d expref: 45 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.848589:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009f6ccc00/0x844e5faceb5f8e51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b8d expref: 45 pid: 8437 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.848597:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125454208:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.848628:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.848642:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17518 00000100:00100000:0.0:1746155647.848679:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126175488:12345-192.168.202.51@tcp:1:mirror_io.0 00010000:00010000:0.0:1746155647.848714:0:20796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.848763:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8cb4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18abb expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848770:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f8df6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b40 expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848777:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8d5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18afa expref: 7 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848782:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.848783:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.848796:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 6/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.848825:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8d5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18afa expref: 7 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848833:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8d5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18afa expref: 7 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.848841:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125454336:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.848859:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f8df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b40 expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848878:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f8df6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b40 expref: 12 pid: 9235 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.848888:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125454464:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.848905:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18abb expref: 11 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155647.848912:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8cb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18abb expref: 11 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.848918:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125454592:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.848928:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4034840 going to sleep for 11 seconds 00000100:00100000:0.0:1746155647.849016:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.849144:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126175744 00000100:00100000:0.0:1746155647.849148:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126175744 00000100:00100000:0.0:1746155647.849172:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11238 00000100:00100000:0.0:1746155647.849177:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32552:x1830976126175744:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155647.849188:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155647.849198:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd600/0x844e5faceb5f8f07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18be8 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.849266:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f8f0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.849275:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f8f0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.849283:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f8f0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.850047:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc800/0x844e5faceb5f8f15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.850055:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc800/0x844e5faceb5f8f15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.850061:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc800/0x844e5faceb5f8f15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.850394:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.850403:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8ec8 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bda expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.850409:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.850430:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8ec8 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bda expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.850439:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8ec8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bda expref: 9 pid: 20364 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.850447:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ff68380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125454720:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155647.853653:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.853672:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126175872 00000100:00100000:2.0:1746155647.853678:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126175872 00010000:00010000:2.0:1746155647.853704:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8d63 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ad7 expref: 34 pid: 29728 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155647.853728:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8977 00000100:00100000:2.0:1746155647.853734:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1961:x1830976126175872:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155647.853744:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.853760:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8d63 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ad7 expref: 34 pid: 29728 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.853770:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8d63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ad7 expref: 34 pid: 29728 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.853789:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155647.854364:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.854408:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.854479:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126176128 00000100:00100000:0.0:1746155647.854482:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126176128 00010000:00010000:0.0:1746155647.854494:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009455d400/0x844e5faceb5f8c91 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a98 expref: 17 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.854526:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126176000 00000100:00100000:0.0:1746155647.854529:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126176000 00010000:00010000:0.0:1746155647.854537:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f24dc00/0x844e5faceb5f8dc5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b1d expref: 46 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.854550:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8978 00000100:00100000:0.0:1746155647.854555:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1963:x1830976126176128:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155647.854561:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155647.854569:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009455d400/0x844e5faceb5f8c91 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a98 expref: 17 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.854577:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009455d400/0x844e5faceb5f8c91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a98 expref: 17 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.854589:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155647.854604:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1963:x1830976126176128:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 50us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.854610:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8978 00000100:00100000:0.0:1746155647.854622:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8979 00000100:00100000:0.0:1746155647.854627:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1963:x1830976126176000:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155647.854632:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155647.854638:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009f24dc00/0x844e5faceb5f8dc5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b1d expref: 46 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.854645:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f24dc00/0x844e5faceb5f8dc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b1d expref: 46 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.854655:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.854657:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.854660:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.854668:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.854682:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155647.854694:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+46:1963:x1830976126176000:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 67us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.854699:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8979 00000100:00100000:0.0:1746155647.854730:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125452800:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.854738:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125452928:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.854744:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125453056:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.854760:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.854777:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125453568:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.854832:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012cdf0c00/0x844e5faceb5f8d63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ad7 expref: 34 pid: 29728 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.854842:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125452416:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.854849:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f24dc00/0x844e5faceb5f8dc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b1d expref: 45 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.854856:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125452544:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.854873:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009455d400/0x844e5faceb5f8c91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a98 expref: 16 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.854881:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125452672:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.854892:0:1625:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.854899:0:1625:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155647.855135:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+34:1961:x1830976126175872:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 607us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.855143:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8977 00010000:00010000:0.0:1746155647.855987:0:1625:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.856006:0:1625:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.856014:0:1625:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.856020:0:1625:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.856026:0:1625:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d58b400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155647.856029:0:1625:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.856036:0:1625:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.856045:0:1625:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.856146:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d58b400/0x844e5faceb5f8edd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.856184:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1962:x1830976126174848:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 9068us (9404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.856191:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17513 00000100:00100000:0.0:1746155647.856215:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125453184:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.856222:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125453312:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.856228:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125453440:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.856242:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.856536:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012c29a600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155647.864703:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.864717:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.864728:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.864738:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.864753:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.864766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.864780:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.864789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.864791:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125453824:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155647.864797:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.864806:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.864809:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094443480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125453952:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.864816:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094443800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125454080:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.864823:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125454208:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.864844:0:10591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.864853:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.864878:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125454336:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155647.864880:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126176256 00000100:00100000:3.0:1746155647.864885:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126176256 00000100:00100000:0.0:1746155647.864885:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125454464:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155647.864892:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125454592:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155647.864906:0:20796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.864909:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f8e97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bbe expref: 12 pid: 8438 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.864927:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126176640 00000100:00100000:3.0:1746155647.864928:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126176896 00000100:00100000:3.0:1746155647.864930:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126176896 00000100:00100000:0.0:1746155647.864930:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126176640 00010000:00010000:3.0:1746155647.864938:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8400/0x844e5faceb5f8e74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb0 expref: 33 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.864943:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8e3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b78 expref: 13 pid: 18270 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.864946:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126177152 00000100:00100000:3.0:1746155647.864948:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126177152 00010000:00010000:3.0:1746155647.864955:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6ccc00/0x844e5faceb5f8e51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b8d expref: 45 pid: 8437 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.864955:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126177408 00000100:00100000:0.0:1746155647.864957:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126177408 00000100:00100000:3.0:1746155647.864963:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126176512 00010000:00010000:0.0:1746155647.864964:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f8df6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b40 expref: 14 pid: 9235 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.864965:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126176512 00010000:00010000:3.0:1746155647.864972:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd28a00/0x844e5faceb5f8e9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bcc expref: 15 pid: 8438 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.864973:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126176768 00000100:00100000:0.0:1746155647.864974:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126176768 00000100:00100000:3.0:1746155647.864980:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126177024 00000100:00100000:3.0:1746155647.864981:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126177024 00010000:00010000:0.0:1746155647.864982:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8c98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a9f expref: 13 pid: 8436 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.864988:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f8ea5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bc5 expref: 16 pid: 8438 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.864990:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126177280 00000100:00100000:0.0:1746155647.864992:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126177280 00000100:00100000:3.0:1746155647.864996:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126177536 00000100:00100000:3.0:1746155647.864997:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126177536 00010000:00010000:0.0:1746155647.865001:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8d5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18afa expref: 8 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865003:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8cb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18abb expref: 14 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.865009:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126177664 00000100:00100000:0.0:1746155647.865010:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126177664 00000100:00100000:3.0:1746155647.865014:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8980 00000100:00100000:3.0:1746155647.865019:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1962:x1830976126176256:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155647.865019:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8ec8 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bda expref: 10 pid: 20364 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.865029:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8981 00010000:00010000:3.0:1746155647.865030:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155647.865035:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+33:1962:x1830976126176896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155647.865045:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.865047:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f8e97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bbe expref: 14 pid: 8438 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865056:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f8e97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bbe expref: 14 pid: 8438 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865073:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29400/0x844e5faceb5f8e97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bbe expref: 14 pid: 8438 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865086:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.865114:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1962:x1830976126176256:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 95us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.865120:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8980 00000100:00100000:3.0:1746155647.865133:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8982 00000100:00100000:3.0:1746155647.865137:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1962:x1830976126176640:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.865143:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.865150:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8e3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b78 expref: 14 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.865157:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8e3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b78 expref: 14 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.865167:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f26f000/0x844e5faceb5f8e3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b78 expref: 14 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.865180:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.865191:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1962:x1830976126176640:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 54us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.865196:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8982 00000100:00100000:3.0:1746155647.865206:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8983 00000100:00100000:3.0:1746155647.865210:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+45:1962:x1830976126177152:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.865215:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.865222:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009f6ccc00/0x844e5faceb5f8e51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b8d expref: 45 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.865229:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6ccc00/0x844e5faceb5f8e51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b8d expref: 45 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.865239:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6ccc00/0x844e5faceb5f8e51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b8d expref: 45 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.865246:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.865256:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1962:x1830976126177152:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 46us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.865261:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8983 00000100:00100000:3.0:1746155647.865274:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8984 00000100:00100000:3.0:1746155647.865279:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1962:x1830976126177408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.865284:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.865292:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f8df6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b40 expref: 12 pid: 9235 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865300:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f8df6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b40 expref: 12 pid: 9235 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865308:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f24c600/0x844e5faceb5f8df6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b40 expref: 12 pid: 9235 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865315:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.865325:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+11:1962:x1830976126177408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 46us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.865327:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8985 00000100:00100000:3.0:1746155647.865331:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8984 00000100:00100000:2.0:1746155647.865334:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1962:x1830976126176512:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155647.865340:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8986 00010000:00010000:2.0:1746155647.865341:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155647.865344:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976126176768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.865349:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.865352:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009fd28a00/0x844e5faceb5f8e9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bcc expref: 16 pid: 8438 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865357:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8c98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a9f expref: 12 pid: 8436 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.865361:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd28a00/0x844e5faceb5f8e9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bcc expref: 16 pid: 8438 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865364:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a9f expref: 12 pid: 8436 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.865372:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd28a00/0x844e5faceb5f8e9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bcc expref: 16 pid: 8438 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865373:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b00d200/0x844e5faceb5f8c98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18a9f expref: 12 pid: 8436 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865379:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155647.865381:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.865390:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126176768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 46us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.865396:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1962:x1830976126176512:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 63us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.865398:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8986 00000100:00100000:2.0:1746155647.865401:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8985 00000100:00100000:3.0:1746155647.865407:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8987 00000100:00100000:3.0:1746155647.865411:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1962:x1830976126177024:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155647.865413:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8988 00010000:00010000:3.0:1746155647.865416:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155647.865418:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976126177280:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.865423:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f8ea5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bc5 expref: 14 pid: 8438 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.865424:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.865430:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f8ea5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bc5 expref: 14 pid: 8438 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.865431:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8d5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18afa expref: 8 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865439:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29000/0x844e5faceb5f8ea5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bc5 expref: 14 pid: 8438 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.865439:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8d5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18afa expref: 8 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865445:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155647.865449:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f8d5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18afa expref: 8 pid: 1625 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.865456:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1962:x1830976126177024:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 45us (666us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155647.865457:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155647.865457:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8400/0x844e5faceb5f8e74 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb0 expref: 33 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.865461:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8987 00010000:00010000:0.0:1746155647.865465:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8400/0x844e5faceb5f8e74 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb0 expref: 33 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.865469:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8989 00000100:00100000:2.0:1746155647.865471:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1962:x1830976126177280:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 53us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.865473:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126177536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155647.865476:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8988 00010000:00010000:0.0:1746155647.865477:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdd8400/0x844e5faceb5f8e74 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bb0 expref: 33 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.865478:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.865484:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8cb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18abb expref: 10 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.865485:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.865486:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746155647.865487:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8990 00010000:00010000:0.0:1746155647.865489:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.865491:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8cb4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18abb expref: 10 pid: 18270 timeout: 876 lvb_type: 1 00000100:00100000:2.0:1746155647.865492:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126177664:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155647.865497:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.865498:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155647.865518:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8ec8 lrc: 5/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bda expref: 10 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.865523:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b00da00/0x844e5faceb5f8cb4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18abb expref: 10 pid: 18270 timeout: 876 lvb_type: 1 00010000:00010000:2.0:1746155647.865526:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8ec8 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bda expref: 10 pid: 20364 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.865529:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.865531:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.865533:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.865538:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155647.865540:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155647.865542:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.865553:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.865563:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976126177536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 90us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.865568:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8989 00010000:00010000:3.0:1746155647.865659:0:20796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.865664:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155647.865666:0:20796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.865679:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1962:x1830976126176896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 643us (949us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155647.865681:0:20796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.865684:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8981 00010000:00010000:3.0:1746155647.865688:0:20796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.865699:0:20796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.865705:0:20796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009469f000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155647.865709:0:20796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.865710:0:10591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.865715:0:20796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.865717:0:10591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.865724:0:20796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.865729:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009469f000/0x844e5faceb5f8f00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.865734:0:10591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.865740:0:10591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.865745:0:10591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.865750:0:10591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5c4d000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155647.865753:0:10591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.865757:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976126175488:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 17079us (18802us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155647.865759:0:10591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.865763:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17518 00010000:00010000:0.0:1746155647.865767:0:10591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.865773:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5c4d000/0x844e5faceb5f8ef9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.865799:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1962:x1830976126175232:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 17485us (18871us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.865806:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17517 00010000:00010000:0.0:1746155647.865829:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8ec8 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bda expref: 10 pid: 20364 timeout: 876 lvb_type: 0 00000100:00100000:0.0:1746155647.865838:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ff68380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125454720:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155647.865883:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.865889:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.865897:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155647.865900:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155647.865903:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.865907:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155647.865912:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1962:x1830976126177664:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 419us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155647.865917:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8990 00000004:00200000:0.0:1746155647.865919:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155647.865991:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.865996:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866001:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866004:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca59600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155647.866007:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866011:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866172:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155647.866176:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155647.866178:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 2/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866186:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59600/0x844e5faceb5f8f1c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866197:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f8f0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866202:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f8f0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866205:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f8f0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866208:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801373dde00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155647.866211:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f8f0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866214:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f8f0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866220:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155647.866221:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155647.866223:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f8f0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866227:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dde00/0x844e5faceb5f8f0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866233:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc800/0x844e5faceb5f8f15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866236:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc800/0x844e5faceb5f8f15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866240:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc800/0x844e5faceb5f8f15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866244:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801373dc800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155647.866246:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc800/0x844e5faceb5f8f15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866250:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc800/0x844e5faceb5f8f15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866254:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fcfa200) 00010000:00010000:0.0:1746155647.866255:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155647.866257:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc800/0x844e5faceb5f8f15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866261:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dc800/0x844e5faceb5f8f15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.866289:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd600/0x844e5faceb5f8f07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18be8 expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.866296:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801373dd600/0x844e5faceb5f8f07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18be8 expref: 290 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.866301:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373dd600, rc 0) 00000100:00100000:0.0:1746155647.866319:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32552:x1830976126175744:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 17142us (17304us total) trans 8589945416 rc 301/301 00000100:00100000:0.0:1746155647.866325:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11238 00000100:00100000:0.0:1746155647.867884:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.867952:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.867967:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.867997:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.868049:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125453696:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155647.868170:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126176384 00000100:00100000:1.0:1746155647.868174:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126176384 00010000:00010000:1.0:1746155647.868208:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f8e4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b86 expref: 7 pid: 18270 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.868240:0:15879:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126177792 00000100:00100000:1.0:1746155647.868256:0:15879:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126177792 00000100:00100000:3.0:1746155647.868257:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126177920 00000100:00100000:3.0:1746155647.868260:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126177920 00010000:00010000:1.0:1746155647.868267:0:15879:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5e000/0x844e5faceb5f8d4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ade expref: 8 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.868273:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009455de00/0x844e5faceb5f8dda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b24 expref: 11 pid: 9235 timeout: 876 lvb_type: 1 00000100:00100000:3.0:1746155647.868286:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126178048 00000100:00100000:3.0:1746155647.868288:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126178048 00000100:00100000:1.0:1746155647.868290:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8991 00010000:00010000:3.0:1746155647.868295:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009f6cca00/0x844e5faceb5f8e66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba2 expref: 32 pid: 8437 timeout: 876 lvb_type: 0 00000100:00100000:1.0:1746155647.868296:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976126176384:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155647.868306:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8992 00000100:00100000:3.0:1746155647.868311:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+11:1960:x1830976126177920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155647.868312:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.868317:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155647.868325:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f8e4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b86 expref: 8 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.868326:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009455de00/0x844e5faceb5f8dda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b24 expref: 11 pid: 9235 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.868334:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009455de00/0x844e5faceb5f8dda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b24 expref: 11 pid: 9235 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.868346:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009455de00/0x844e5faceb5f8dda lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b24 expref: 11 pid: 9235 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.868348:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f8e4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b86 expref: 8 pid: 18270 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.868356:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155647.868360:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f8e4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b86 expref: 8 pid: 18270 timeout: 876 lvb_type: 0 00000100:00100000:3.0:1746155647.868376:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+10:1960:x1830976126177920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 65us (408us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155647.868377:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.868378:0:15879:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155647.868381:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8992 00010000:00010000:1.0:1746155647.868381:0:15879:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.868388:0:15879:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155647.868391:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8993 00000100:00100000:3.0:1746155647.868395:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976126177792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.868401:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.868407:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009cb5e000/0x844e5faceb5f8d4e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ade expref: 7 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:1.0:1746155647.868413:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155647.868414:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb5e000/0x844e5faceb5f8d4e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ade expref: 7 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.868423:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5e000/0x844e5faceb5f8d4e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ade expref: 7 pid: 1625 timeout: 876 lvb_type: 1 00010000:00010000:3.0:1746155647.868430:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.868431:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.868434:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.868439:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1961:x1830976126176384:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 143us (577us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155647.868440:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155647.868445:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8991 00010000:00010000:3.0:1746155647.868449:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.868462:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+5:1961:x1830976126177792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 66us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.868468:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8993 00000100:00100000:3.0:1746155647.868477:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8994 00000100:00100000:3.0:1746155647.868481:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+32:1963:x1830976126178048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155647.868488:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.868496:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009f6cca00/0x844e5faceb5f8e66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba2 expref: 32 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.868521:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009f6cca00/0x844e5faceb5f8e66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba2 expref: 32 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.868531:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f6cca00/0x844e5faceb5f8e66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba2 expref: 32 pid: 8437 timeout: 876 lvb_type: 0 00010000:00010000:3.0:1746155647.868544:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.868555:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+31:1963:x1830976126178048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 74us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.868560:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8994 00010000:00010000:0.0:1746155647.870531:0:20200:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870557:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870563:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870582:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870588:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870594:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870599:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3d14c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155647.870601:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870607:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870616:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870622:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14c00/0x844e5faceb5f8ef2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.870665:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126174976:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 22635us (23765us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.870671:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17516 00010000:00010000:0.0:1746155647.870694:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870700:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870711:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870716:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870721:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870725:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d58a000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155647.870727:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870731:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870738:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.870748:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d58a000/0x844e5faceb5f8ee4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.870769:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1962:x1830976126175104:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 23384us (23967us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.870774:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17514 00000100:00100000:2.0:1746155647.870976:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.871210:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126178176 00000100:00100000:0.0:1746155647.871215:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126178176 00010000:00010000:0.0:1746155647.871230:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fdd9200/0x844e5faceb5f8e6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba9 expref: 44 pid: 8437 timeout: 876 lvb_type: 1 00000100:00100000:0.0:1746155647.871245:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8995 00000100:00100000:0.0:1746155647.871250:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+44:1960:x1830976126178176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155647.871258:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155647.871268:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88009fdd9200/0x844e5faceb5f8e6d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba9 expref: 44 pid: 8437 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.871276:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fdd9200/0x844e5faceb5f8e6d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba9 expref: 44 pid: 8437 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.871286:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fdd9200/0x844e5faceb5f8e6d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ba9 expref: 44 pid: 8437 timeout: 876 lvb_type: 1 00010000:00010000:0.0:1746155647.871298:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.871300:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155647.871303:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.871308:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.871321:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155647.871337:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+43:1960:x1830976126178176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 87us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.871342:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8995 00010000:00010000:0.0:1746155647.871357:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.871364:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.871375:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.871380:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.871385:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.871394:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136ab3600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155647.871396:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.871401:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.871410:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.871415:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f8eeb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155647.871455:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1962:x1830976126175360:12345-192.168.202.51@tcp:1:mirror_io.0 Request processed in 23832us (24595us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155647.871460:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17515 00000100:00100000:2.0:1746155647.877165:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.877190:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126178432 00000100:00100000:0.0:1746155647.877197:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126178432 00000100:00100000:0.0:1746155647.878139:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11239 00000100:00100000:0.0:1746155647.878146:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32554:x1830976126178432:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155647.878163:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155647.878178:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f8f2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18bef expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.878248:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5f8f31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878262:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5f8f31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878270:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5f8f31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878279:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5f8f38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878283:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5f8f38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878287:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5f8f38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878356:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5f8f3f lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878362:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5f8f3f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878366:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5f8f3f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:0.0:1746155647.878372:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:0.0:1746155647.878418:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5f8f3f lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878423:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5f8f3f lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878428:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5f8f3f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878435:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca58600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155647.878439:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5f8f3f lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878444:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5f8f3f lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878451:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155647.878453:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155647.878456:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5f8f3f lrc: 2/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878460:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58600/0x844e5faceb5f8f3f lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878831:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5f8f31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878836:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5f8f31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878841:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5f8f31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878844:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca59400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155647.878846:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5f8f31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878850:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5f8f31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878856:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:0.0:1746155647.878857:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155647.878860:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5f8f31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878874:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59400/0x844e5faceb5f8f31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878879:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5f8f38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878883:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5f8f38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878888:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5f8f38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878891:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ca59a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155647.878892:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5f8f38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878896:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5f8f38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878900:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fca6b00) 00010000:00010000:0.0:1746155647.878902:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746155647.878904:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5f8f38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878907:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca59a00/0x844e5faceb5f8f38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155647.878930:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f8f2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bef expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.878936:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58e00/0x844e5faceb5f8f2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bef expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155647.878942:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca58e00, rc 0) 00000100:00100000:0.0:1746155647.878979:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32554:x1830976126178432:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 833us (1818us total) trans 8589945417 rc 301/301 00000100:00100000:0.0:1746155647.878984:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11239 00000100:00100000:2.0:1746155647.885099:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.885345:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126178688 00000100:00100000:3.0:1746155647.885352:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126178688 00000100:00100000:3.0:1746155647.885397:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11240 00000100:00100000:3.0:1746155647.885404:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32550:x1830976126178688:12345-192.168.202.51@tcp:36:mirror_io.0 00010000:00010000:3.0:1746155647.885437:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155647.885457:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d58a400/0x844e5faceb5f8ed6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18be1 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.885470:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155647.885473:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155647.885549:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32550:x1830976126178688:12345-192.168.202.51@tcp:36:mirror_io.0 Request processed in 145us (455us total) trans 0 rc -116/-116 00000100:00100000:3.0:1746155647.885555:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11240 00000100:00100000:0.0:1746155647.887791:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.888028:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126178944 00000100:00100000:2.0:1746155647.888035:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126178944 00000100:00100000:2.0:1746155647.888067:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4789 00000100:00100000:2.0:1746155647.888073:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32550:x1830976126178944:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:2.0:1746155647.888227:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32550:x1830976126178944:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 153us (451us total) trans 8589945418 rc 0/0 00000100:00100000:2.0:1746155647.888234:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4789 00000001:00080000:3.0:1746155647.888993:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874410 is committed 00000001:00080000:3.0:1746155647.889003:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874409 is committed 00000001:00080000:3.0:1746155647.889008:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874398 is committed 00000001:00080000:3.0:1746155647.889038:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874407 is committed 00000001:00080000:3.0:1746155647.889099:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874408 is committed 00000001:00080000:3.0:1746155647.889133:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874325 is committed 00000001:00080000:3.0:1746155647.889154:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874390 is committed 00000100:00100000:0.0:1746155647.896128:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.897049:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126179200 00000100:00100000:2.0:1746155647.897068:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126179200 00000100:00100000:2.0:1746155647.897123:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4790 00000100:00100000:2.0:1746155647.897133:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32550:x1830976126179200:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:2.0:1746155647.897534:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32550:x1830976126179200:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 370us (1383us total) trans 8589945419 rc 0/0 00000100:00100000:2.0:1746155647.897540:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4790 00000100:00100000:0.0:1746155647.931789:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155647.931985:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126179456 00000100:00100000:3.0:1746155647.931992:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126179456 00000100:00100000:3.0:1746155647.932052:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11241 00000100:00100000:3.0:1746155647.932060:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32558:x1830976126179456:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155647.932080:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.932096:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047400/0x844e5faceb5f8f4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18bf6 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.932184:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046200/0x844e5faceb5f8f54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932194:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046200/0x844e5faceb5f8f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932202:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046200/0x844e5faceb5f8f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932213:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f8f5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932218:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f8f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932223:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f8f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932313:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f8f62 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932319:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f8f62 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932323:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f8f62 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155647.932330:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155647.932397:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046200/0x844e5faceb5f8f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932403:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046200/0x844e5faceb5f8f54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932408:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046200/0x844e5faceb5f8f54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932412:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c046200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155647.932415:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046200/0x844e5faceb5f8f54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932420:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046200/0x844e5faceb5f8f54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932428:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155647.932431:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155647.932434:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046200/0x844e5faceb5f8f54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932437:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c046200/0x844e5faceb5f8f54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932449:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f8f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932453:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f8f5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932456:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f8f5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932459:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c047a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155647.932461:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f8f5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932466:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f8f5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932470:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0700) 00010000:00010000:3.0:1746155647.932472:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155647.932473:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f8f5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932478:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047a00/0x844e5faceb5f8f5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155647.932528:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047400/0x844e5faceb5f8f4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bf6 expref: 292 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.932539:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f8f62 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bf6 expref: 291 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155647.932544:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155647.932546:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155647.932548:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c047000, rc 0) 00000100:00100000:3.0:1746155647.932599:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32558:x1830976126179456:12345-192.168.202.51@tcp:101:cat.0 Request processed in 540us (816us total) trans 8589945420 rc 0/0 00000100:00100000:3.0:1746155647.932604:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11241 00000100:00100000:2.0:1746155647.933554:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.933644:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126179584 00000100:00100000:1.0:1746155647.933649:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126179584 00000100:00100000:1.0:1746155647.933674:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17519 00000100:00100000:1.0:1746155647.933679:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+10:32552:x1830976126179584:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155647.933688:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.933699:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18bfd expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155647.934188:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e2:0x0] initial LVB size: 4194304, mtime: 0x6814387f, atime: 0x6814387f, ctime: 0x6814387f, blocks: 0x1029 00010000:00010000:1.0:1746155647.934206:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.934207:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.934213:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.934225:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.934231:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29600, rc 0) 00000100:00100000:1.0:1746155647.934256:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+11:32552:x1830976126179584:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 577us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.934261:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17519 00000100:00100000:0.0:1746155647.935221:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.935313:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126179840 00000100:00100000:2.0:1746155647.935318:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126179840 00000100:00100000:2.0:1746155647.935342:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4791 00000100:00100000:2.0:1746155647.935347:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32558:x1830976126179840:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155647.936091:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32558:x1830976126179840:12345-192.168.202.51@tcp:35:cat.0 Request processed in 742us (873us total) trans 8589945421 rc 0/0 00000100:00100000:2.0:1746155647.936097:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4791 00000100:00100000:1.0:1746155647.937139:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.937174:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126180096 00000100:00100000:0.0:1746155647.937179:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126180096 00002000:00100000:0.0:1746155647.937205:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3268608->3272703) req@ffff88009f0d8000 x1830976126180096/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.937214:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8000 with x1830976126180096 ext(3268608->3272703) 00002000:00010000:0.0:1746155647.937219:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0d8000 00000100:00100000:0.0:1746155647.937246:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8322 00000100:00100000:0.0:1746155647.937252:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+11:1961:x1830976126180096:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155647.937390:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+11:1961:x1830976126180096:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 137us (253us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155647.937396:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8322 00002000:00100000:0.0:1746155647.937401:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3268608->3272703) req@ffff88009f0d8000 x1830976126180096/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/4536 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.937408:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8000 with x1830976126180096 ext(3268608->3272703) 00002000:00010000:0.0:1746155647.937411:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0d8000 00000100:00100000:0.0:1746155647.940734:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.940769:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.940796:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.940810:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.940874:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.940897:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126180224 00000100:00100000:3.0:1746155647.940898:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126180352 00000100:00100000:3.0:1746155647.940903:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126180352 00000100:00100000:0.0:1746155647.940903:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126180224 00000100:00100000:3.0:1746155647.941106:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126180480 00000100:00100000:1.0:1746155647.941107:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126180608 00000100:00100000:3.0:1746155647.941109:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126180480 00000100:00100000:1.0:1746155647.941111:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126180608 00000100:00100000:3.0:1746155647.941122:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126180736 00000100:00100000:3.0:1746155647.941124:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126180736 00000100:00100000:1.0:1746155647.941133:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17520 00000100:00100000:3.0:1746155647.941139:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17521 00000100:00100000:1.0:1746155647.941140:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976126180224:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155647.941145:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1963:x1830976126180352:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155647.941153:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155647.941153:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.941167:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c047800/0x844e5faceb5f8f7e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c0b expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.941167:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd29c00/0x844e5faceb5f8f77 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c04 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155647.941185:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e1:0x0] initial LVB size: 1048576, mtime: 0x6814387f, atime: 0x6814387f, ctime: 0x6814387f, blocks: 0x7e9 00002000:00010000:3.0:1746155647.941186:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x6814387f, atime: 0x6814387f, ctime: 0x6814387f, blocks: 0x81f 00010000:00010000:3.0:1746155647.941199:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.941199:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.941201:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.941201:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.941208:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c047800/0x844e5faceb5f8f7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c0b expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.941208:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29c00/0x844e5faceb5f8f77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c04 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.941220:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c047800/0x844e5faceb5f8f7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c0b expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.941220:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29c00/0x844e5faceb5f8f77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c04 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.941228:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c047800, rc 0) 00010000:00010000:1.0:1746155647.941228:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd29c00, rc 0) 00000100:00100000:3.0:1746155647.941261:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1963:x1830976126180352:12345-192.168.202.51@tcp:101:cat.0 Request processed in 116us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155647.941262:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126180224:12345-192.168.202.51@tcp:101:cat.0 Request processed in 122us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.941267:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17521 00000100:00100000:1.0:1746155647.941270:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17520 00000100:00100000:3.0:1746155647.941280:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17522 00000100:00100000:1.0:1746155647.941284:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17523 00000100:00100000:3.0:1746155647.941285:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1963:x1830976126180480:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155647.941290:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155647.941290:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976126180608:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155647.941295:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.941296:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c046e00/0x844e5faceb5f8f85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c12 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155647.941303:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f8f8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c19 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155647.941306:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x68143880, atime: 0x6814387f, ctime: 0x68143880, blocks: 0x81f 00010000:00010000:3.0:1746155647.941312:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746155647.941313:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e3:0x0] initial LVB size: 2097152, mtime: 0x68143880, atime: 0x68143880, ctime: 0x68143880, blocks: 0x821 00010000:00010000:3.0:1746155647.941314:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.941317:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c046e00/0x844e5faceb5f8f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c12 expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.941319:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155647.941321:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.941325:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c046e00/0x844e5faceb5f8f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c12 expref: 13 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.941325:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f8f8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c19 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.941331:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c046e00, rc 0) 00010000:00010000:1.0:1746155647.941333:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f8f8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c19 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155647.941339:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fd28400, rc 0) 00000100:00100000:3.0:1746155647.941344:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1963:x1830976126180480:12345-192.168.202.51@tcp:101:cat.0 Request processed in 59us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.941348:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17522 00000100:00100000:1.0:1746155647.941355:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126180608:12345-192.168.202.51@tcp:101:cat.0 Request processed in 65us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.941357:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17524 00000100:00100000:1.0:1746155647.941360:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17523 00000100:00100000:3.0:1746155647.941361:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126180736:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155647.941366:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155647.941372:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f8f93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c20 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155647.941382:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e4:0x0] initial LVB size: 5079552, mtime: 0x68143880, atime: 0x6814387f, ctime: 0x68143880, blocks: 0x1711 00010000:00010000:3.0:1746155647.941388:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.941389:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155647.941393:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f8f93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c20 expref: 20 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.941400:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f8f93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c20 expref: 20 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155647.941406:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c046800, rc 0) 00000100:00100000:3.0:1746155647.941418:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126180736:12345-192.168.202.51@tcp:101:cat.0 Request processed in 57us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155647.941422:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17524 00000100:00100000:2.0:1746155647.945471:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155647.945737:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126180992 00000100:00100000:0.0:1746155647.945745:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126180992 00002000:00100000:0.0:1746155647.945780:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3899392->3903487) req@ffff88009f881880 x1830976126180992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.945788:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881880 with x1830976126180992 ext(3899392->3903487) 00002000:00010000:0.0:1746155647.945793:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f881880 00000100:00100000:0.0:1746155647.945825:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8323 00000100:00100000:0.0:1746155647.945831:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976126180992:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155647.946004:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976126180992:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 172us (541us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155647.946011:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8323 00002000:00100000:0.0:1746155647.946016:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3899392->3903487) req@ffff88009f881880 x1830976126180992/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/4536 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155647.946022:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881880 with x1830976126180992 ext(3899392->3903487) 00002000:00010000:0.0:1746155647.946025:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f881880 00000100:00100000:0.0:1746155647.950239:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.952729:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126181248 00000100:00100000:2.0:1746155647.952738:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126181248 00000100:00100000:2.0:1746155647.952786:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4792 00000100:00100000:2.0:1746155647.952793:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32552:x1830976126181248:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155647.953002:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32552:x1830976126181248:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 209us (2768us total) trans 8589945422 rc 0/0 00000100:00100000:2.0:1746155647.953007:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4792 00000100:00100000:0.0:1746155647.957304:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155647.957369:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126181504 00000100:00100000:2.0:1746155647.957375:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126181504 00002000:00100000:2.0:1746155647.957426:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009ff6b100 x1830976126181504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.957435:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6b100 with x1830976126181504 ext(0->1048575) 00002000:00010000:2.0:1746155647.957439:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6b100 00000100:00100000:2.0:1746155647.957644:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8324 00000100:00100000:2.0:1746155647.957651:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976126181504:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155647.959617:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.959637:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.959708:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155647.959737:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126181760 00000100:00100000:1.0:1746155647.959742:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126181760 00002000:00100000:1.0:1746155647.959767:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f0d8380 x1830976126181760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.959775:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8380 with x1830976126181760 ext(1048576->2097151) 00002000:00010000:1.0:1746155647.959779:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0d8380 00000100:00100000:1.0:1746155647.959792:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126181888 00000100:00100000:1.0:1746155647.959794:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126181888 00002000:00100000:1.0:1746155647.959805:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009f0dad80 x1830976126181888/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.959810:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0dad80 with x1830976126181888 ext(1048576->2097151) 00002000:00010000:1.0:1746155647.959813:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0dad80 00000100:00100000:1.0:1746155647.959821:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126182272 00000100:00100000:1.0:1746155647.959824:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126182272 00002000:00100000:1.0:1746155647.959832:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009b881f80 x1830976126182272/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/0 e 0 to 0 dl 1746155658 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.959838:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881f80 with x1830976126182272 ext(1048576->2097151) 00002000:00010000:1.0:1746155647.959840:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881f80 00000100:00100000:1.0:1746155647.959852:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8325 00000100:00100000:1.0:1746155647.959857:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1962:x1830976126181760:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155647.959901:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8326 00000100:00100000:3.0:1746155647.959910:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1963:x1830976126181888:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155647.960006:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8327 00000100:00100000:0.0:1746155647.960014:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976126182272:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155647.973198:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126182272:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13176us (13480us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.973209:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8327 00002000:00100000:2.0:1746155647.973219:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009b881f80 x1830976126182272/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.973228:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b881f80 with x1830976126182272 ext(1048576->2097151) 00002000:00010000:2.0:1746155647.973232:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b881f80 00000100:00100000:3.0:1746155647.986005:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1963:x1830976126181888:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26087us (26356us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155647.986017:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8326 00002000:00100000:3.0:1746155647.986026:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009f0dad80 x1830976126181888/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155647.986035:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0dad80 with x1830976126181888 ext(1048576->2097151) 00002000:00010000:3.0:1746155647.986040:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0dad80 00000100:00100000:1.0:1746155647.986341:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1962:x1830976126181760:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26482us (26726us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155647.986349:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8325 00002000:00100000:1.0:1746155647.986354:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f0d8380 x1830976126181760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155647.986362:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0d8380 with x1830976126181760 ext(1048576->2097151) 00002000:00010000:1.0:1746155647.986365:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0d8380 00000100:00100000:2.0:1746155647.990578:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976126181504:12345-192.168.202.51@tcp:3:cat.0 Request processed in 32918us (33271us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155647.990592:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8324 00002000:00100000:2.0:1746155647.990602:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009ff6b100 x1830976126181504/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:718/0 lens 488/440 e 0 to 0 dl 1746155658 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155647.990610:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6b100 with x1830976126181504 ext(0->1048575) 00002000:00010000:2.0:1746155647.990615:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6b100 00000100:00100000:0.0:1746155648.008176:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.009698:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126182528 00000100:00100000:2.0:1746155648.009706:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126182528 00002000:00100000:2.0:1746155648.009760:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009ff6b480 x1830976126182528/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.009768:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6b480 with x1830976126182528 ext(2097152->3145727) 00002000:00010000:2.0:1746155648.009773:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6b480 00000100:00100000:2.0:1746155648.009798:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8328 00000100:00100000:2.0:1746155648.009805:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126182528:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155648.012694:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.012714:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:3.0:1746155648.012730:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746155648.012773:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.012882:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126183040 00000100:00100000:0.0:1746155648.012890:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126183040 00002000:00100000:0.0:1746155648.012929:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a3fc5880 x1830976126183040/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 504/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155648.012937:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5880 with x1830976126183040 ext(3145728->4194303) 00002000:00010000:0.0:1746155648.012942:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a3fc5880 00000100:00100000:0.0:1746155648.012964:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126182912 00000100:00100000:0.0:1746155648.012967:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126182912 00002000:00100000:0.0:1746155648.012978:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009366fb80 x1830976126182912/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155648.012984:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366fb80 with x1830976126182912 ext(2097152->3145727) 00002000:00010000:0.0:1746155648.012987:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009366fb80 00000100:00100000:0.0:1746155648.012995:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126183296 00000100:00100000:0.0:1746155648.012997:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126183296 00002000:00100000:0.0:1746155648.013008:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009366d880 x1830976126183296/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155648.013014:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d880 with x1830976126183296 ext(3145728->4194303) 00002000:00010000:0.0:1746155648.013017:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366d880 00000100:00100000:0.0:1746155648.013027:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8329 00000100:00100000:0.0:1746155648.013033:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1962:x1830976126183040:12345-192.168.202.51@tcp:3:cat.0 00000100:00080000:3.0:1746155648.013189:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746155648.013204:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8330 00000100:00100000:3.0:1746155648.013212:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1962:x1830976126182912:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155648.013245:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8331 00000100:00100000:0.0:1746155648.013251:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126183296:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155648.023774:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.024252:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976126182528:12345-192.168.202.51@tcp:3:cat.0 Request processed in 14445us (16082us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155648.024261:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8328 00002000:00100000:0.0:1746155648.024271:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009ff6b480 x1830976126182528/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155648.024280:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ff6b480 with x1830976126182528 ext(2097152->3145727) 00002000:00010000:0.0:1746155648.024285:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ff6b480 00000100:00100000:2.0:1746155648.024359:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126183424 00000100:00100000:2.0:1746155648.024365:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126183424 00000100:00100000:2.0:1746155648.024406:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11242 00000100:00100000:2.0:1746155648.024413:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32560:x1830976126183424:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155648.024429:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.024443:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f800/0x844e5faceb5f8f9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c27 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.024490:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fa00/0x844e5faceb5f8fa1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024518:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fa00/0x844e5faceb5f8fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024529:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fa00/0x844e5faceb5f8fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024539:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f8fa8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024544:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f8fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024549:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f8fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024632:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f8faf lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024640:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f8faf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024646:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f8faf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155648.024678:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155648.024682:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155648.024697:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f8faf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024704:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f8faf lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024710:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fa00/0x844e5faceb5f8fa1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024714:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fa00/0x844e5faceb5f8fa1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024721:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fa00/0x844e5faceb5f8fa1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024726:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa1fa00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155648.024728:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fa00/0x844e5faceb5f8fa1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024733:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fa00/0x844e5faceb5f8fa1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024741:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155648.024743:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155648.024746:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fa00/0x844e5faceb5f8fa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024750:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fa00/0x844e5faceb5f8fa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024762:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f8fa8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024767:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f8fa8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024771:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f8fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024775:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fa1fe00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155648.024777:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f8fa8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024781:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f8fa8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024789:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51900) 00010000:00010000:2.0:1746155648.024791:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155648.024793:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f8fa8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024797:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f8fa8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.024817:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f800/0x844e5faceb5f8f9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c27 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.024826:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f8faf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c27 expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.024831:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155648.024832:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155648.024834:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1e400, rc 0) 00000100:00100000:2.0:1746155648.024856:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:32560:x1830976126183424:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 444us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.024870:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11242 00000100:00080000:1.0:1746155648.025037:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155648.026369:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976126183296:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13115us (13592us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155648.026377:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8331 00002000:00100000:0.0:1746155648.026384:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009366d880 x1830976126183296/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155648.026391:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366d880 with x1830976126183296 ext(3145728->4194303) 00002000:00010000:0.0:1746155648.026395:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009366d880 00000100:00100000:1.0:1746155648.028810:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.028887:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126183552 00000100:00100000:2.0:1746155648.028894:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126183552 00000100:00100000:2.0:1746155648.029105:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17525 00000100:00100000:2.0:1746155648.029113:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+5:32554:x1830976126183552:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155648.029127:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.029140:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c2e expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.029167:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.029173:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.029174:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.029177:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3067904->3145727] (req 3067904->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 6 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.029200:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 16 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.029210:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 16 pid: 8437 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.029221:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125454848:192.168.202.51@tcp:104: 00000100:00080000:3.0:1746155648.029318:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746155648.029425:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fb540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155648.033572:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976126183040:12345-192.168.202.51@tcp:3:cat.0 Request processed in 20530us (20876us total) trans 0 rc 413696/413696 00000100:00100000:1.0:1746155648.033581:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8329 00002000:00100000:1.0:1746155648.033591:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a3fc5880 x1830976126183040/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 504/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 413696/413696 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.033600:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc5880 with x1830976126183040 ext(3145728->4194303) 00010000:00010000:1.0:1746155648.033608:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 15 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.033621:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 15 pid: 8437 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746155648.033627:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a3fc5880 00000100:00100000:2.0:1746155648.036049:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.036049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.036100:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126183936 00000100:00100000:2.0:1746155648.036107:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126183936 00000100:00100000:2.0:1746155648.036216:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17526 00000100:00100000:2.0:1746155648.036223:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+5:1961:x1830976126183936:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155648.036242:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155648.036300:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.036310:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126184064 00000100:00100000:0.0:1746155648.036313:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126184064 00000100:00080000:3.0:1746155648.036568:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155648.036607:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17527 00000100:00100000:0.0:1746155648.036612:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976126184064:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155648.036619:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155648.036630:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f846600/0x844e5faceb5f8fbd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c43 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.036648:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155648.036650:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155648.036658:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f846600/0x844e5faceb5f8fbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c43 expref: 7 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155648.036669:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f846600/0x844e5faceb5f8fbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c43 expref: 7 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155648.036678:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f846600, rc 0) 00000100:00100000:0.0:1746155648.036713:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126184064:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 100us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155648.036718:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17527 00000100:00100000:0.0:1746155648.036745:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.036755:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126184192 00000100:00100000:0.0:1746155648.036758:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126184192 00000100:00100000:0.0:1746155648.036771:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17528 00000100:00100000:0.0:1746155648.036775:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126184192:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155648.036781:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155648.036787:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8fc4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c4a expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.036819:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f400/0x844e5faceb5f8fcb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c3c expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.036831:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.036833:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.036841:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f400/0x844e5faceb5f8fcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c3c expref: 6 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.036851:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f400/0x844e5faceb5f8fcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c3c expref: 6 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.036858:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1f400, rc 0) 00000100:00100000:2.0:1746155648.036881:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976126183936:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 659us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.036886:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17526 00000100:00100000:3.0:1746155648.036889:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.036899:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126184320 00000100:00100000:3.0:1746155648.036900:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.036901:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126184320 00000100:00100000:3.0:1746155648.036912:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.036912:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17529 00000100:00100000:2.0:1746155648.036917:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976126184320:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155648.036922:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.036929:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fa1e000/0x844e5faceb5f8fd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c51 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.036938:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.036939:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.036942:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa1e000/0x844e5faceb5f8fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c51 expref: 7 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.036950:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fa1e000/0x844e5faceb5f8fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c51 expref: 7 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.036955:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1e000, rc 0) 00000100:00100000:2.0:1746155648.036968:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126184320:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 51us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.036972:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17529 00000100:00100000:2.0:1746155648.036980:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126184448 00000100:00100000:2.0:1746155648.036982:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126184448 00000100:00100000:2.0:1746155648.036992:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126184576 00000100:00100000:2.0:1746155648.036993:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126184576 00000100:00100000:3.0:1746155648.036997:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17530 00000100:00100000:3.0:1746155648.037003:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126184448:12345-192.168.202.51@tcp:101:mirror_io.0 00000100:00100000:2.0:1746155648.037004:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17531 00010000:00010000:3.0:1746155648.037008:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155648.037008:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126184576:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155648.037012:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.037015:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f8fd9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c58 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.037017:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f800/0x844e5faceb5f8fe0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c5f expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.037025:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.037026:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.037030:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f8fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c58 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.037038:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f8fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c58 expref: 8 pid: 20796 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155648.037043:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125454976:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155648.037044:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c046400, rc 0) 00000100:00100000:3.0:1746155648.037056:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126184448:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 55us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.037060:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17530 00000100:00100000:2.0:1746155648.037082:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155648.037113:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125454848:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.037128:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3067904->3145727] (req 3067904->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 6 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.037135:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1ea00, rc 0) 00000100:00100000:2.0:1746155648.037146:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32554:x1830976126183552:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8035us (8345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.037151:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17525 00000100:00100000:1.0:1746155648.037332:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126183808 00000100:00100000:1.0:1746155648.037336:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126183808 00000100:00100000:1.0:1746155648.037366:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11243 00000100:00100000:1.0:1746155648.037371:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32563:x1830976126183808:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155648.037381:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155648.037389:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9b400/0x844e5faceb5f8fe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c35 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.037458:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9b000/0x844e5faceb5f8fee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037467:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9b000/0x844e5faceb5f8fee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037475:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9b000/0x844e5faceb5f8fee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037485:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5318a00/0x844e5faceb5f8ff5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037490:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5318a00/0x844e5faceb5f8ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037495:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5318a00/0x844e5faceb5f8ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155648.037544:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155648.037546:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155648.037550:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8fc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c4a expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155648.037564:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8fc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c4a expref: 10 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155648.037574:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f847a00, rc 0) 00000100:00100000:0.0:1746155648.037589:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126184192:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 813us (843us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155648.037590:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a4e00/0x844e5faceb5f8ffc lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155648.037593:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17528 00010000:00010000:1.0:1746155648.037597:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a4e00/0x844e5faceb5f8ffc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037603:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a4e00/0x844e5faceb5f8ffc lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155648.037610:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155648.037669:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9b000/0x844e5faceb5f8fee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037675:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9b000/0x844e5faceb5f8fee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037680:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9b000/0x844e5faceb5f8fee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037685:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f9b000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155648.037688:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9b000/0x844e5faceb5f8fee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037694:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9b000/0x844e5faceb5f8fee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037702:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155648.037704:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155648.037707:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9b000/0x844e5faceb5f8fee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00000100:00080000:3.0:1746155648.037708:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746155648.037712:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9b000/0x844e5faceb5f8fee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037733:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5318a00/0x844e5faceb5f8ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037738:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5318a00/0x844e5faceb5f8ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037742:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5318a00/0x844e5faceb5f8ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037746:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b5318a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155648.037747:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5318a00/0x844e5faceb5f8ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037752:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5318a00/0x844e5faceb5f8ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037757:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c823300) 00010000:00010000:1.0:1746155648.037759:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155648.037761:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5318a00/0x844e5faceb5f8ff5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037765:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b5318a00/0x844e5faceb5f8ff5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.037954:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9b400/0x844e5faceb5f8fe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c35 expref: 14 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.037963:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a4e00/0x844e5faceb5f8ffc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c35 expref: 13 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.037968:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155648.037969:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155648.037971:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a62a4e00, rc 0) 00000100:00100000:1.0:1746155648.038003:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32563:x1830976126183808:12345-192.168.202.51@tcp:101:cat.0 Request processed in 632us (1957us total) trans 8589945423 rc 0/0 00000100:00100000:1.0:1746155648.038008:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11243 00000100:00100000:0.0:1746155648.038938:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.039212:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1962:x1830976126182912:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26001us (26496us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155648.039220:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8330 00000100:00100000:1.0:1746155648.039384:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126184704 00000100:00100000:1.0:1746155648.039388:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126184704 00002000:00100000:1.0:1746155648.039409:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3268608->3903487) req@ffff88009fedaa00 x1830976126184704/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.039416:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fedaa00 with x1830976126184704 ext(3268608->3903487) 00010000:00010000:1.0:1746155648.039422:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 14 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.039432:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 14 pid: 8437 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746155648.039437:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fedaa00 00000100:00100000:1.0:1746155648.039455:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1464 00000100:00100000:1.0:1746155648.039461:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976126184704:12345-192.168.202.51@tcp:4:cat.0 00002000:00100000:3.0:1746155648.039555:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009366fb80 x1830976126182912/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.039562:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009366fb80 with x1830976126182912 ext(2097152->3145727) 00010000:00010000:3.0:1746155648.039567:0:31251:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 14 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.039575:0:31251:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 14 pid: 8437 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746155648.039583:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009366fb80 00002000:00010000:3.0:1746155648.039658:0:18270:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime: 1746155647 -> 1746155648 00002000:00010000:3.0:1746155648.039661:0:18270:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime: 1746155647 -> 1746155648 00002000:00010000:3.0:1746155648.039662:0:18270:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime: 1746155647 -> 1746155648 00000100:00100000:3.0:1746155648.039670:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125454976:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155648.039687:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f800/0x844e5faceb5f8fe0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c5f expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.039695:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f800/0x844e5faceb5f8fe0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c5f expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.039705:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1f800, rc 0) 00000100:00100000:3.0:1746155648.039723:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126184576:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 2714us (2810us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155648.039729:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17531 00000100:00100000:0.0:1746155648.043049:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.043228:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126184832 00000100:00100000:3.0:1746155648.043236:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126184832 00000100:00100000:3.0:1746155648.043291:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17532 00000100:00080000:0.0:1746155648.043296:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746155648.043298:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+5:1961:x1830976126184832:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155648.043310:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.043322:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c046200/0x844e5faceb5f900a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c66 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.043339:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.043341:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.043348:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c046200/0x844e5faceb5f900a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c66 expref: 6 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.043359:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c046200/0x844e5faceb5f900a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c66 expref: 6 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.043368:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c046200, rc 0) 00000100:00100000:3.0:1746155648.043408:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1961:x1830976126184832:12345-192.168.202.51@tcp:101:cat.0 Request processed in 111us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.043413:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17532 00000100:00100000:0.0:1746155648.043774:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.043801:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.044046:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126185216 00000100:00100000:3.0:1746155648.044049:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126185216 00000100:00100000:0.0:1746155648.044059:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.044261:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126185344 00000100:00100000:3.0:1746155648.044264:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126185344 00000100:00100000:2.0:1746155648.044271:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126185472 00000100:00100000:2.0:1746155648.044274:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126185472 00000100:00100000:0.0:1746155648.044276:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.044277:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17533 00000100:00100000:3.0:1746155648.044281:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1961:x1830976126185216:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155648.044287:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126185600 00000100:00100000:2.0:1746155648.044288:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126185600 00010000:00010000:3.0:1746155648.044289:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155648.044294:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155648.044297:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c046000/0x844e5faceb5f9011 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c74 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155648.044303:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126185728 00000100:00100000:2.0:1746155648.044305:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126185728 00010000:00010000:3.0:1746155648.044308:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.044310:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.044314:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c046000/0x844e5faceb5f9011 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c74 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155648.044316:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17534 00000100:00100000:2.0:1746155648.044320:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976126185344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155648.044324:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c046000/0x844e5faceb5f9011 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c74 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.044325:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.044330:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f9018 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c7b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.044331:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c046000, rc 0) 00000100:00100000:1.0:1746155648.044331:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17535 00010000:00010000:2.0:1746155648.044338:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.044339:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746155648.044339:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1960:x1830976126185472:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.044343:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f9018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c7b expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155648.044346:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155648.044350:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126185216:12345-192.168.202.51@tcp:101:cat.0 Request processed in 68us (578us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155648.044351:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f9018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c7b expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155648.044354:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17533 00010000:00010000:1.0:1746155648.044354:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a62a5800/0x844e5faceb5f901f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c82 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.044358:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1f600, rc 0) 00000100:00100000:3.0:1746155648.044364:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17536 00010000:00010000:1.0:1746155648.044364:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.044365:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155648.044368:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976126185600:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155648.044370:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976126185344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 50us (569us total) trans 0 rc 0/0 00010000:00010000:1.0:1746155648.044370:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a62a5800/0x844e5faceb5f901f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c82 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.044373:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155648.044374:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17534 00010000:00010000:3.0:1746155648.044378:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c047a00/0x844e5faceb5f9026 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c89 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.044379:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a62a5800/0x844e5faceb5f901f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c82 expref: 8 pid: 8436 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155648.044382:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17537 00000100:00100000:2.0:1746155648.044385:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976126185728:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155648.044385:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a62a5800, rc 0) 00010000:00010000:3.0:1746155648.044386:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.044387:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.044389:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.044390:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c047a00/0x844e5faceb5f9026 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c89 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.044394:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f902d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c90 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.044397:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c047a00/0x844e5faceb5f9026 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c89 expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.044403:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c047a00, rc 0) 00000100:00100000:1.0:1746155648.044409:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976126185472:12345-192.168.202.51@tcp:101:cat.0 Request processed in 67us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.044414:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976126185600:12345-192.168.202.51@tcp:101:cat.0 Request processed in 47us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.044414:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17535 00000100:00100000:3.0:1746155648.044419:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17536 00000100:00100000:2.0:1746155648.044422:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e26d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125455104:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155648.044458:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.045733:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.046913:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126185088 00000100:00100000:2.0:1746155648.046920:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126185088 00000100:00100000:2.0:1746155648.046962:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11244 00000100:00100000:0.0:1746155648.046964:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.046969:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:32560:x1830976126185088:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:2.0:1746155648.046983:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.046997:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f9034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c6d expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.047066:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.047078:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f8f62 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bf6 expref: 292 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.047084:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f8faf lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c27 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.047090:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a4e00/0x844e5faceb5f8ffc lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c35 expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.047096:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.047117:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a4e00/0x844e5faceb5f8ffc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c35 expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.047126:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a4e00/0x844e5faceb5f8ffc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c35 expref: 12 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.047140:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125455232:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.047827:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f8faf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c27 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.047835:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f8faf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c27 expref: 12 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.047843:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fc51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125455360:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.047886:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f8f62 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bf6 expref: 292 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.047893:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f8f62 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bf6 expref: 292 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.047900:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125455488:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.047916:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746155648.047930:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126185856 00000100:00100000:2.0:1746155648.047933:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126185856 00000100:00100000:2.0:1746155648.047954:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17538 00000100:00100000:2.0:1746155648.047959:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32558:x1830976126185856:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155648.047965:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976126184704:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8502us (9027us total) trans 21474841710 rc 0/0 00010000:00010000:2.0:1746155648.047966:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.047974:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a74f800/0x844e5faceb5f9042 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c97 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155648.047974:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1464 00002000:00100000:1.0:1746155648.047982:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3268608->3903487) req@ffff88009fedaa00 x1830976126184704/t21474841710(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/448 e 0 to 0 dl 1746155659 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746155648.047990:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00002000:00100000:1.0:1746155648.047990:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fedaa00 with x1830976126184704 ext(3268608->3903487) 00010000:00010000:2.0:1746155648.047993:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.047996:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a74f800/0x844e5faceb5f9042 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c97 expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.047996:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 17 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.048004:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a74f800/0x844e5faceb5f9042 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c97 expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.048005:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 17 pid: 8437 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746155648.048010:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fedaa00 00010000:00010000:2.0:1746155648.048012:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a74f800, rc 0) 00000100:00100000:2.0:1746155648.048031:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32558:x1830976126185856:12345-192.168.202.51@tcp:101:cat.0 Request processed in 72us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.048034:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e26d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125455104:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155648.048036:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17538 00010000:00010000:3.0:1746155648.048054:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f902d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c90 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.048062:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f200/0x844e5faceb5f902d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c90 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.048072:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1f200, rc 0) 00000100:00100000:3.0:1746155648.048290:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1961:x1830976126185728:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3902us (3993us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155648.048295:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17537 00000100:00100000:3.0:1746155648.048995:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f881500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125455232:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155648.049492:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.049539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.049551:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126186112 00000100:00100000:1.0:1746155648.049556:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126186112 00000100:00100000:3.0:1746155648.049570:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fc51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125455360:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155648.049575:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f8faf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c27 expref: 13 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.049578:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125455488:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155648.049604:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155648.049606:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126185984 00000100:00100000:1.0:1746155648.049609:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126185984 00010000:00010000:1.0:1746155648.049618:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a4e00/0x844e5faceb5f8ffc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c35 expref: 13 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746155648.049687:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8996 00000100:00100000:0.0:1746155648.049687:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.049693:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094443800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976126186112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155648.049702:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155648.049757:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f8faf lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c27 expref: 13 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.049767:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f8faf lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c27 expref: 13 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.049781:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1e400/0x844e5faceb5f8faf lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c27 expref: 13 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.049792:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155648.049795:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.049801:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.049805:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155648.049824:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126186240 00000100:00100000:2.0:1746155648.049827:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126186240 00000100:00100000:3.0:1746155648.049831:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8997 00000100:00100000:3.0:1746155648.049838:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094443480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126185984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155648.049845:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:0.0:1746155648.049845:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746155648.049849:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a4e00/0x844e5faceb5f8ffc lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c35 expref: 13 pid: 14234 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.049851:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f8f62 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bf6 expref: 293 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.049857:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a4e00/0x844e5faceb5f8ffc lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c35 expref: 13 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.049877:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8998 00010000:00010000:3.0:1746155648.049879:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a62a4e00/0x844e5faceb5f8ffc lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c35 expref: 13 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.049883:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1960:x1830976126186240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155648.049888:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155648.049890:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155648.049891:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.049896:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.049897:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f8f62 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bf6 expref: 293 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.049899:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155648.049904:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f8f62 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bf6 expref: 293 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.049915:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c047000/0x844e5faceb5f8f62 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bf6 expref: 293 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.049925:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094443480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126185984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 88us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.049926:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094443800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976126186112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 232us (433us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155648.049928:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00000100:00100000:3.0:1746155648.049930:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8997 00010000:00010000:2.0:1746155648.049931:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155648.049933:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8996 00010000:00010000:2.0:1746155648.049937:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.049942:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.049953:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155648.049957:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.049962:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155648.049968:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:1960:x1830976126186240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.049972:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8998 00000004:00200000:3.0:1746155648.049975:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155648.050070:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1f000/0x844e5faceb5f9034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c6d expref: 13 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.050080:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c6d expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.050085:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155648.050087:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155648.050089:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fa1fe00, rc 0) 00000100:00100000:3.0:1746155648.050122:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32560:x1830976126185088:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 3152us (4390us total) trans 8589945424 rc 0/0 00000100:00100000:3.0:1746155648.050127:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11244 00000100:00100000:0.0:1746155648.053407:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.053486:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.053540:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126186624 00000100:00100000:0.0:1746155648.053547:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126186624 00000100:00100000:0.0:1746155648.053582:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11245 00000100:00100000:0.0:1746155648.053589:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32560:x1830976126186624:12345-192.168.202.51@tcp:101:mirror_io.0 00010000:00010000:0.0:1746155648.053607:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155648.053610:0:14234:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746155648.053631:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fa1fe00/0x844e5faceb5f903b lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c6d expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.053663:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155648.053667:0:14234:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155648.053676:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c000/0x844e5faceb5f9050 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18c9e expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.053748:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9057 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155648.053758:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9057 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155648.053765:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9057 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155648.053774:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9057 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155648.053780:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9057 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155648.053784:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9057 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155648.053789:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009374cc00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:0.0:1746155648.053792:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9057 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155648.053797:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9057 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155648.053810:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155648.053812:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746155648.053814:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9057 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155648.053818:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9057 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:0.0:1746155648.053838:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c000/0x844e5faceb5f9050 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c9e expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.053844:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c000/0x844e5faceb5f9050 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c9e expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.053850:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374c000, rc 0) 00000100:00100000:0.0:1746155648.053892:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:32560:x1830976126186624:12345-192.168.202.51@tcp:101:mirror_io.0 Request processed in 303us (406us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155648.053898:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11245 00000100:00100000:3.0:1746155648.054120:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126186368 00000100:00100000:3.0:1746155648.054124:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126186368 00010000:00010000:3.0:1746155648.054142:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 16 pid: 8437 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.054163:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8999 00000100:00100000:3.0:1746155648.054168:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094443480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976126186368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155648.054175:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155648.054187:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 16 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.054195:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 16 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.054207:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fd29600/0x844e5faceb5f8f70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3268608->3903487) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18bfd expref: 16 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.054216:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.054218:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.054223:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 7 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.054230:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 7 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.054237:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.054238:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.054241:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a74f800/0x844e5faceb5f9042 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c97 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.054246:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a74f800/0x844e5faceb5f9042 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c97 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.054269:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a74f800/0x844e5faceb5f9042 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c97 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155648.054286:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125455616:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155648.054356:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 7 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155648.054364:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125455744:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155648.054380:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155648.057225:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125455616:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155648.057833:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125455744:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155648.057849:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155648.057897:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094443480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976126186368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3726us (4494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.057906:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8999 00000100:00100000:0.0:1746155648.061252:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.061407:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126186880 00000100:00100000:1.0:1746155648.061415:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126186880 00002000:00100000:1.0:1746155648.061451:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3067904->3071999) req@ffff8800936f7800 x1830976126186880/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.061460:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f7800 with x1830976126186880 ext(3067904->3071999) 00002000:00010000:1.0:1746155648.061464:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f7800 00000100:00100000:1.0:1746155648.061649:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8332 00000100:00100000:1.0:1746155648.061657:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976126186880:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155648.061794:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976126186880:12345-192.168.202.51@tcp:3:cat.0 Request processed in 138us (548us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155648.061800:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8332 00002000:00100000:1.0:1746155648.061805:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (3067904->3071999) req@ffff8800936f7800 x1830976126186880/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/4536 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.061811:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f7800 with x1830976126186880 ext(3067904->3071999) 00002000:00010000:1.0:1746155648.061813:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f7800 00000100:00100000:0.0:1746155648.062061:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.062299:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126187136 00000100:00100000:3.0:1746155648.062303:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126187136 00002000:00100000:3.0:1746155648.062322:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800936f5f80 x1830976126187136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.062329:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5f80 with x1830976126187136 ext(3145728->4194303) 00002000:00010000:3.0:1746155648.062333:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f5f80 00000100:00100000:3.0:1746155648.062354:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8333 00000100:00100000:3.0:1746155648.062360:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976126187136:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155648.063890:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.063914:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126187392 00000100:00100000:0.0:1746155648.063918:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126187392 00000100:00100000:0.0:1746155648.063944:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4793 00000100:00100000:0.0:1746155648.063950:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:32560:x1830976126187392:12345-192.168.202.51@tcp:35:mirror_io.0 00000100:00100000:0.0:1746155648.064082:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32560:x1830976126187392:12345-192.168.202.51@tcp:35:mirror_io.0 Request processed in 132us (195us total) trans 8589945425 rc 0/0 00000100:00100000:0.0:1746155648.064091:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4793 00000100:00100000:0.0:1746155648.066316:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.067734:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.067791:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.067807:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126187776 00000100:00100000:0.0:1746155648.067814:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126187776 00002000:00100000:0.0:1746155648.067848:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88012f1f2d80 x1830976126187776/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155648.067857:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2d80 with x1830976126187776 ext(0->1048575) 00002000:00010000:0.0:1746155648.067871:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f2d80 00000100:00100000:0.0:1746155648.067885:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126188032 00000100:00100000:0.0:1746155648.067887:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126188032 00002000:00100000:0.0:1746155648.067897:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88012f1f3480 x1830976126188032/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155648.067903:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3480 with x1830976126188032 ext(1048576->2097151) 00002000:00010000:0.0:1746155648.067906:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3480 00000100:00100000:3.0:1746155648.068197:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126187648 00000100:00100000:3.0:1746155648.068202:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126187648 00000100:00100000:3.0:1746155648.068901:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17539 00000100:00100000:3.0:1746155648.068909:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32554:x1830976126187648:12345-192.168.202.51@tcp:101:multiop.0 00000100:00100000:1.0:1746155648.068913:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8334 00000100:00100000:1.0:1746155648.068920:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976126187776:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:3.0:1746155648.068923:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.068937:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ca5 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.068959:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f8f93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c20 expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.068966:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c047a00/0x844e5faceb5f9026 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c89 expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.068972:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f8fd9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c58 expref: 7 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.068977:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.068978:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.068981:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [3145728->4005887] (req 3145728->4005887) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155648.069253:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8335 00000100:00100000:0.0:1746155648.069259:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976126188032:12345-192.168.202.51@tcp:3:cat.0 00010000:00010000:3.0:1746155648.069557:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f8fd9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c58 expref: 7 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.069568:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f8fd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c58 expref: 7 pid: 20796 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746155648.069584:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125455872:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155648.069647:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c047a00/0x844e5faceb5f9026 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c89 expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.069654:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c047a00/0x844e5faceb5f9026 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c89 expref: 10 pid: 18270 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746155648.069661:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125456000:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155648.069680:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f8f93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c20 expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.069687:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f8f93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c20 expref: 19 pid: 20796 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746155648.069693:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125456128:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155648.069706:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.069822:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.069874:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.070341:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126188288 00000100:00100000:3.0:1746155648.070346:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126188288 00002000:00100000:3.0:1746155648.070364:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88012f1f1180 x1830976126188288/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.070372:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1180 with x1830976126188288 ext(1048576->2097151) 00002000:00010000:3.0:1746155648.070376:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f1180 00000100:00100000:3.0:1746155648.070391:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126188544 00000100:00100000:3.0:1746155648.070394:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126188544 00000100:00100000:1.0:1746155648.070399:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8336 00002000:00100000:3.0:1746155648.070403:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012f1f3100 x1830976126188544/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155648.070406:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976126188288:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:3.0:1746155648.070409:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3100 with x1830976126188544 ext(1048576->2097151) 00002000:00010000:3.0:1746155648.070411:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3100 00000100:00100000:3.0:1746155648.070420:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8337 00000100:00100000:3.0:1746155648.070424:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976126188544:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155648.074796:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1962:x1830976126187136:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12426us (12726us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155648.074807:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8333 00002000:00100000:2.0:1746155648.074817:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800936f5f80 x1830976126187136/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.074826:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f5f80 with x1830976126187136 ext(3145728->4194303) 00002000:00010000:2.0:1746155648.074830:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f5f80 00000100:00100000:1.0:1746155648.075067:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.075092:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.075107:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126188672 00000100:00100000:1.0:1746155648.075112:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126188672 00010000:00010000:1.0:1746155648.075134:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f8fd9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c58 expref: 8 pid: 20796 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746155648.075153:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126188800 00000100:00100000:1.0:1746155648.075156:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126188800 00010000:00010000:1.0:1746155648.075164:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c047a00/0x844e5faceb5f9026 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c89 expref: 14 pid: 18270 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746155648.075177:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9000 00000100:00100000:1.0:1746155648.075183:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976126188672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155648.075193:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155648.075211:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f8fd9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c58 expref: 8 pid: 20796 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746155648.075220:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f8fd9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c58 expref: 8 pid: 20796 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746155648.075239:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155648.075256:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1963:x1830976126188672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 73us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.075261:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9000 00000100:00100000:1.0:1746155648.075272:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9001 00000100:00100000:1.0:1746155648.075276:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1963:x1830976126188800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155648.075283:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155648.075289:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c047a00/0x844e5faceb5f9026 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c89 expref: 14 pid: 18270 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746155648.075297:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c047a00/0x844e5faceb5f9026 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c89 expref: 14 pid: 18270 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746155648.075305:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155648.075318:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1963:x1830976126188800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.075323:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9001 00010000:00010000:3.0:1746155648.075435:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f8fd9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c58 expref: 7 pid: 20796 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746155648.075450:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125455872:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155648.075459:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c047a00/0x844e5faceb5f9026 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c89 expref: 13 pid: 18270 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746155648.075528:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125456000:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155648.075539:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125456128:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155648.075558:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4005887] (req 3145728->4005887) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.075567:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013136a000, rc 0) 00000100:00100000:3.0:1746155648.075585:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32554:x1830976126187648:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 6677us (9275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.075590:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17539 00000100:00100000:1.0:1746155648.077721:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.078401:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126188928 00000100:00100000:2.0:1746155648.078409:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126188928 00010000:00010000:2.0:1746155648.078438:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f8f93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c20 expref: 20 pid: 20796 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746155648.078477:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9002 00000100:00100000:2.0:1746155648.078485:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976126188928:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155648.078498:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155648.078537:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f8f93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c20 expref: 20 pid: 20796 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746155648.078548:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f8f93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c20 expref: 20 pid: 20796 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746155648.078567:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f8f93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c20 expref: 20 pid: 20796 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746155648.078585:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.078587:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.078593:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.078601:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.078628:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155648.078639:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125456256:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155648.078704:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a52fb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.081766:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.081801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.081823:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126189056 00000100:00100000:3.0:1746155648.081831:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126189056 00000100:00100000:2.0:1746155648.081870:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126189184 00000100:00100000:2.0:1746155648.081873:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126189184 00000100:00100000:3.0:1746155648.081875:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17540 00000100:00100000:3.0:1746155648.081882:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126189056:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155648.081891:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17541 00000100:00100000:2.0:1746155648.081894:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976126189184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155648.081896:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.081900:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.081910:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a76e400/0x844e5faceb5f906c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18cac expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.081910:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c046600/0x844e5faceb5f9065 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18cb3 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.081933:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c046600/0x844e5faceb5f9065 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cb3 expref: 16 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.081941:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c046600/0x844e5faceb5f9065 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cb3 expref: 16 pid: 9235 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746155648.081947:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125456384:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155648.081950:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c046600, rc 0) 00000100:00100000:2.0:1746155648.081981:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976126189184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 86us (180us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155648.081987:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17541 00000100:00100000:3.0:1746155648.082001:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155648.082767:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125456256:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155648.082781:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155648.082800:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976126188928:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4316us (5085us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.082807:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9002 00000100:00100000:1.0:1746155648.086621:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976126188288:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16208us (16802us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155648.086631:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8336 00002000:00100000:1.0:1746155648.086642:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88012f1f1180 x1830976126188288/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.086650:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f1180 with x1830976126188288 ext(1048576->2097151) 00002000:00010000:1.0:1746155648.086655:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f1180 00002000:00010000:3.0:1746155648.086739:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155647 -> 1746155648 00000100:00100000:3.0:1746155648.086758:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125456384:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155648.086782:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a76e400/0x844e5faceb5f906c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cac expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.086794:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a76e400/0x844e5faceb5f906c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cac expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.086818:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a76e400, rc 0) 00000100:00100000:3.0:1746155648.086836:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976126189056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4954us (5075us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155648.086841:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17540 00000100:00100000:2.0:1746155648.093222:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976126188032:12345-192.168.202.51@tcp:3:cat.0 Request processed in 23955us (25422us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155648.093233:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8335 00002000:00100000:2.0:1746155648.093242:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88012f1f3480 x1830976126188032/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.093250:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3480 with x1830976126188032 ext(1048576->2097151) 00002000:00010000:2.0:1746155648.093255:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1f3480 00000100:00100000:0.0:1746155648.095247:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.096165:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.096713:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126189568 00000100:00100000:2.0:1746155648.096721:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126189568 00002000:00100000:2.0:1746155648.096755:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (4001792->4005887) req@ffff8800a0918700 x1830976126189568/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.096764:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918700 with x1830976126189568 ext(4001792->4005887) 00002000:00010000:2.0:1746155648.096768:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0918700 00000100:00100000:2.0:1746155648.096796:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8338 00000100:00100000:2.0:1746155648.096803:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126189568:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155648.096941:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126189568:12345-192.168.202.51@tcp:3:cat.0 Request processed in 137us (776us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155648.096947:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8338 00002000:00100000:2.0:1746155648.096952:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (4001792->4005887) req@ffff8800a0918700 x1830976126189568/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/4536 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.096958:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918700 with x1830976126189568 ext(4001792->4005887) 00002000:00010000:2.0:1746155648.096961:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0918700 00000100:00100000:3.0:1746155648.097015:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126189312 00000100:00100000:3.0:1746155648.097019:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126189312 00000100:00100000:3.0:1746155648.097042:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17542 00000100:00100000:3.0:1746155648.097046:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32558:x1830976126189312:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155648.097054:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.097068:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a76e800/0x844e5faceb5f9073 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18cba expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.097088:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.097096:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155648.097097:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155648.097101:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a76e800/0x844e5faceb5f9073 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [4194304->5083135] (req 4194304->5083135) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cba expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.097124:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.097133:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 11 pid: 8437 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.097142:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125456512:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155648.097181:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155648.097223:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1963:x1830976126188544:12345-192.168.202.51@tcp:3:cat.0 Request processed in 26796us (27346us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155648.097231:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8337 00002000:00100000:1.0:1746155648.097236:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88012f1f3100 x1830976126188544/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.097244:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f3100 with x1830976126188544 ext(1048576->2097151) 00002000:00010000:1.0:1746155648.097247:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f3100 00000100:00100000:3.0:1746155648.098042:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1962:x1830976126187776:12345-192.168.202.51@tcp:3:cat.0 Request processed in 29122us (30309us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155648.098048:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8334 00002000:00100000:3.0:1746155648.098053:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88012f1f2d80 x1830976126187776/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.098060:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1f2d80 with x1830976126187776 ext(0->1048575) 00002000:00010000:3.0:1746155648.098063:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1f2d80 00000100:00100000:2.0:1746155648.099982:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125456512:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.100003:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a76e800/0x844e5faceb5f9073 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [4194304->5083135] (req 4194304->5083135) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cba expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.100017:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a76e800, rc 0) 00000100:00100000:2.0:1746155648.100751:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:32558:x1830976126189312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3702us (5507us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.100758:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17542 00000100:00100000:1.0:1746155648.100890:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.100952:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126189824 00000100:00100000:3.0:1746155648.100958:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126189824 00002000:00100000:3.0:1746155648.100987:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4005887) req@ffff88012bdf7b80 x1830976126189824/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.100995:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7b80 with x1830976126189824 ext(3145728->4005887) 00010000:00010000:3.0:1746155648.101001:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 8 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.101011:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 8 pid: 8437 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746155648.101017:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bdf7b80 00000100:00100000:3.0:1746155648.101031:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1465 00000100:00100000:3.0:1746155648.101037:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1960:x1830976126189824:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155648.101497:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.101574:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126190080 00000100:00100000:2.0:1746155648.101578:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126190080 00000100:00100000:2.0:1746155648.101610:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4794 00000100:00100000:2.0:1746155648.101615:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea56850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32554:x1830976126190080:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155648.102143:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea56850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32554:x1830976126190080:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 526us (645us total) trans 8589945426 rc 0/0 00000100:00100000:2.0:1746155648.102149:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4794 00000100:00100000:0.0:1746155648.111360:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.111464:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126190208 00000100:00100000:2.0:1746155648.111471:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126190208 00000100:00100000:2.0:1746155648.111521:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17543 00000100:00100000:2.0:1746155648.111528:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32563:x1830976126190208:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.111542:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.111557:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f907a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18cc1 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.111579:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.111581:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.111585:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f907a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc1 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.111596:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f907a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc1 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.111606:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c046800, rc 0) 00000100:00100000:2.0:1746155648.111732:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32563:x1830976126190208:12345-192.168.202.51@tcp:101:cat.0 Request processed in 204us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.111738:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17543 00000100:00100000:3.0:1746155648.115843:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126189824:12345-192.168.202.51@tcp:4:cat.0 Request processed in 14795us (14943us total) trans 17179874411 rc 0/0 00000100:00100000:3.0:1746155648.115854:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1465 00002000:00100000:3.0:1746155648.115876:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4005887) req@ffff88012bdf7b80 x1830976126189824/t17179874411(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/448 e 0 to 0 dl 1746155659 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.115885:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7b80 with x1830976126189824 ext(3145728->4005887) 00010000:00010000:3.0:1746155648.115894:0:31250:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 11 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.115909:0:31250:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 11 pid: 8437 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746155648.115915:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012bdf7b80 00000100:00100000:0.0:1746155648.118589:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.118712:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126190336 00000100:00100000:2.0:1746155648.118719:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126190336 00010000:00010000:2.0:1746155648.118747:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 11 pid: 8437 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.118785:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9003 00000100:00100000:2.0:1746155648.118793:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976126190336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155648.118804:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155648.118821:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 11 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.118832:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 11 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.118899:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013136a000/0x844e5faceb5f905e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4005887) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ca5 expref: 11 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.119049:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.119051:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.119058:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a76e800/0x844e5faceb5f9073 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cba expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.119066:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a76e800/0x844e5faceb5f9073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cba expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.119073:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.119075:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.119077:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f907a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc1 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.119083:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f907a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc1 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.119385:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f907a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc1 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155648.119397:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125456640:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155648.119690:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a76e800/0x844e5faceb5f9073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cba expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155648.119698:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125456768:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155648.119716:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.125140:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.125239:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125456640:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155648.125250:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125456768:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155648.125269:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155648.125307:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1963:x1830976126190336:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6515us (6723us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.125315:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126190592 00000100:00100000:2.0:1746155648.125316:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9003 00000100:00100000:3.0:1746155648.125321:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126190592 00002000:00100000:3.0:1746155648.125357:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800a0919180 x1830976126190592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.125366:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919180 with x1830976126190592 ext(4194304->5083135) 00002000:00010000:3.0:1746155648.125370:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0919180 00000100:00100000:3.0:1746155648.125396:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8339 00000100:00100000:3.0:1746155648.125401:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126190592:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155648.130256:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.130872:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.130907:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.131021:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126190976 00000100:00100000:3.0:1746155648.131027:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126190976 00002000:00100000:3.0:1746155648.131060:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a0919500 x1830976126190976/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.131075:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919500 with x1830976126190976 ext(2097152->3145727) 00002000:00010000:3.0:1746155648.131079:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0919500 00000100:00100000:2.0:1746155648.131922:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126191104 00000100:00100000:2.0:1746155648.131926:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126191104 00002000:00100000:2.0:1746155648.131949:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a0919880 x1830976126191104/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.131957:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919880 with x1830976126191104 ext(3145728->4194303) 00002000:00010000:2.0:1746155648.131961:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0919880 00000100:00100000:2.0:1746155648.131982:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126191360 00000100:00100000:2.0:1746155648.131985:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126191360 00002000:00100000:2.0:1746155648.131997:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3067903) req@ffff8800a0919c00 x1830976126191360/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746155648.132002:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8340 00002000:00100000:2.0:1746155648.132004:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919c00 with x1830976126191360 ext(2097152->3067903) 00002000:00010000:2.0:1746155648.132007:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0919c00 00000100:00100000:0.0:1746155648.132010:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976126190976:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155648.132019:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8341 00000100:00100000:2.0:1746155648.132024:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976126191104:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155648.132162:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8342 00000100:00100000:1.0:1746155648.132170:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1963:x1830976126191360:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155648.138029:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0919180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126190592:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12619us (12889us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155648.138040:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8339 00002000:00100000:1.0:1746155648.138049:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800a0919180 x1830976126190592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.138058:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919180 with x1830976126190592 ext(4194304->5083135) 00002000:00010000:1.0:1746155648.138062:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0919180 00000100:00100000:1.0:1746155648.150172:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0919c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:1963:x1830976126191360:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17995us (19256us total) trans 0 rc 970752/970752 00000100:00100000:1.0:1746155648.150185:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8342 00002000:00100000:1.0:1746155648.150195:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3067903) req@ffff8800a0919c00 x1830976126191360/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 970752/970752 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.150204:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919c00 with x1830976126191360 ext(2097152->3067903) 00002000:00010000:1.0:1746155648.150209:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0919c00 00000100:00100000:2.0:1746155648.150801:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1963:x1830976126191104:12345-192.168.202.51@tcp:3:cat.0 Request processed in 18775us (19939us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155648.150808:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8341 00002000:00100000:2.0:1746155648.150814:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a0919880 x1830976126191104/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.150822:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919880 with x1830976126191104 ext(3145728->4194303) 00002000:00010000:2.0:1746155648.150826:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0919880 00000100:00100000:0.0:1746155648.154137:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.155531:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126191488 00000100:00100000:2.0:1746155648.155539:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126191488 00000100:00100000:0.0:1746155648.156142:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1963:x1830976126190976:12345-192.168.202.51@tcp:3:cat.0 Request processed in 24130us (25888us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155648.156150:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8340 00000100:00100000:3.0:1746155648.157021:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17544 00000100:00100000:3.0:1746155648.157029:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976126191488:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155648.157042:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.157055:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013121f800/0x844e5faceb5f9081 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18cc8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.157078:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013121f800/0x844e5faceb5f9081 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc8 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.157087:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013121f800/0x844e5faceb5f9081 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc8 expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.157111:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013121f800, rc 0) 00000100:00100000:3.0:1746155648.157131:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976126191488:12345-192.168.202.51@tcp:101:cat.0 Request processed in 104us (3000us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155648.157135:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17544 00002000:00100000:0.0:1746155648.157191:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a0919500 x1830976126190976/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155648.157200:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0919500 with x1830976126190976 ext(2097152->3145727) 00002000:00010000:0.0:1746155648.157204:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0919500 00000100:00100000:0.0:1746155648.165981:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.167389:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126191616 00000100:00100000:3.0:1746155648.167398:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126191616 00000100:00100000:3.0:1746155648.167436:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17545 00000100:00100000:3.0:1746155648.167442:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976126191616:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155648.167457:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.167471:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013121e200/0x844e5faceb5f9088 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ccf expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155648.167488:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155648.167498:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013121e200/0x844e5faceb5f9088 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ccf expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.167526:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013121e200/0x844e5faceb5f9088 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ccf expref: 16 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.167539:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013121e200, rc 0) 00000100:00100000:2.0:1746155648.167539:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126191744 00000100:00100000:2.0:1746155648.167542:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126191744 00000100:00100000:2.0:1746155648.167562:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17546 00000100:00100000:2.0:1746155648.167567:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32563:x1830976126191744:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.167573:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.167579:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450de00/0x844e5faceb5f908f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18cd6 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155648.167584:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976126191616:12345-192.168.202.51@tcp:101:cat.0 Request processed in 141us (1613us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155648.167590:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17545 00010000:00010000:2.0:1746155648.167591:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.167593:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.167599:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450de00/0x844e5faceb5f908f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cd6 expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.167611:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009450de00/0x844e5faceb5f908f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cd6 expref: 9 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.167618:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450de00, rc 0) 00000100:00100000:2.0:1746155648.167633:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32563:x1830976126191744:12345-192.168.202.51@tcp:101:cat.0 Request processed in 66us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.167637:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17546 00000100:00100000:0.0:1746155648.170873:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.171448:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126192000 00000100:00100000:1.0:1746155648.171455:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126192000 00002000:00100000:1.0:1746155648.171487:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a091a680 x1830976126192000/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.171496:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091a680 with x1830976126192000 ext(3145728->4194303) 00002000:00010000:1.0:1746155648.171523:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a091a680 00000100:00100000:1.0:1746155648.171801:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8343 00000100:00100000:1.0:1746155648.171808:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976126192000:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155648.179965:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1962:x1830976126192000:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8149us (9101us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155648.179975:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8343 00002000:00100000:1.0:1746155648.179984:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a091a680 x1830976126192000/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.179993:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091a680 with x1830976126192000 ext(3145728->4194303) 00002000:00010000:1.0:1746155648.179998:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a091a680 00000100:00100000:0.0:1746155648.180232:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.180666:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126192256 00000100:00100000:3.0:1746155648.180673:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126192256 00000100:00100000:3.0:1746155648.180704:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11246 00000100:00100000:3.0:1746155648.180711:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32567:x1830976126192256:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155648.180726:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.180740:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e400/0x844e5faceb5f9096 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18cdd expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.180832:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f909d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.180844:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f909d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.180853:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f909d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.180872:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f90a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.180877:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f90a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.180882:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f90a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.180964:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f90ab lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.180972:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f90ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.180977:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f90ab lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155648.180984:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155648.181048:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f909d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181054:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f909d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181058:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f909d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181063:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013121e200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155648.181066:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f909d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181071:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f909d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181079:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155648.181082:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155648.181084:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f909d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181088:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f909d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181114:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f90a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181119:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f90a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181123:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f90a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181127:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013121f400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155648.181129:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f90a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181136:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f90a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181141:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0c00) 00010000:00010000:3.0:1746155648.181143:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155648.181145:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f90a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181149:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f90a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.181178:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e400/0x844e5faceb5f9096 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cdd expref: 295 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.181187:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f90ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cdd expref: 294 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.181192:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155648.181193:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155648.181195:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc7f400, rc 0) 00000100:00100000:3.0:1746155648.181227:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32567:x1830976126192256:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 516us (995us total) trans 8589945427 rc 0/0 00000100:00100000:3.0:1746155648.181232:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11246 00000100:00100000:0.0:1746155648.184613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.184665:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126192384 00000100:00100000:2.0:1746155648.184672:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126192384 00000100:00100000:2.0:1746155648.184717:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17547 00000100:00100000:2.0:1746155648.184724:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976126192384:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.184738:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.184750:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450d800/0x844e5faceb5f90b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ce4 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.184774:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009450d800/0x844e5faceb5f90b9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ce4 expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.184783:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450d800/0x844e5faceb5f90b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ce4 expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.184800:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450d800, rc 0) 00000100:00100000:2.0:1746155648.184851:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976126192384:12345-192.168.202.51@tcp:101:cat.0 Request processed in 127us (242us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155648.184856:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17547 00000100:00100000:0.0:1746155648.191333:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.191534:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126192640 00000100:00100000:1.0:1746155648.191541:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126192640 00002000:00100000:1.0:1746155648.191576:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800a091b100 x1830976126192640/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.191585:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091b100 with x1830976126192640 ext(4194304->5083135) 00002000:00010000:1.0:1746155648.191590:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091b100 00000100:00100000:1.0:1746155648.191617:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8344 00000100:00100000:1.0:1746155648.191623:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126192640:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155648.201303:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126192640:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9671us (9969us total) trans 0 rc 888832/888832 00000100:00100000:1.0:1746155648.201312:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8344 00002000:00100000:1.0:1746155648.201322:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800a091b100 x1830976126192640/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.201330:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091b100 with x1830976126192640 ext(4194304->5083135) 00002000:00010000:1.0:1746155648.201334:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a091b100 00000100:00100000:1.0:1746155648.204963:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.205039:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126192768 00000100:00100000:2.0:1746155648.205046:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126192768 00000100:00100000:2.0:1746155648.205172:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17548 00000100:00100000:2.0:1746155648.205180:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976126192768:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.205195:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.205209:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450c000/0x844e5faceb5f90c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ceb expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.205234:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009450c000/0x844e5faceb5f90c0 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ceb expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.205243:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450c000/0x844e5faceb5f90c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ceb expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.205282:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450c000, rc 0) 00000100:00100000:2.0:1746155648.205326:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976126192768:12345-192.168.202.51@tcp:101:cat.0 Request processed in 146us (369us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155648.205332:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17548 00000100:00100000:0.0:1746155648.207189:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.207293:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126192896 00000100:00100000:2.0:1746155648.207299:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126192896 00000100:00100000:2.0:1746155648.207329:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17549 00000100:00100000:2.0:1746155648.207334:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976126192896:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.207346:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.207359:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450d200/0x844e5faceb5f90c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18cf2 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.207378:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009450d200/0x844e5faceb5f90c7 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cf2 expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.207387:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450d200/0x844e5faceb5f90c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cf2 expref: 10 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.207397:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450d200, rc 0) 00000100:00100000:2.0:1746155648.207857:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a387c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976126192896:12345-192.168.202.51@tcp:101:cat.0 Request processed in 521us (671us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155648.207874:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17549 00000100:00100000:0.0:1746155648.212581:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.212712:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126193152 00000100:00100000:2.0:1746155648.212719:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126193152 00000100:00100000:2.0:1746155648.212752:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4795 00000100:00100000:2.0:1746155648.212758:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32563:x1830976126193152:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155648.212927:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32563:x1830976126193152:12345-192.168.202.51@tcp:35:cat.0 Request processed in 168us (351us total) trans 8589945428 rc 0/0 00000100:00100000:2.0:1746155648.212933:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4795 00010000:00010000:3.0:1746155648.294687:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155648.327407:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.327538:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126193408 00000100:00100000:3.0:1746155648.327545:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126193408 00000100:00100000:3.0:1746155648.327584:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11247 00000100:00100000:3.0:1746155648.327591:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32572:x1830976126193408:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155648.327615:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.327629:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7e600/0x844e5faceb5f90ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18cf9 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.327715:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f200/0x844e5faceb5f90d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.327725:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f200/0x844e5faceb5f90d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.327733:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f200/0x844e5faceb5f90d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.327743:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f90dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.327747:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f90dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.327752:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f90dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.327840:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f90e3 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.327847:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f90e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.327853:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f90e3 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155648.327888:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155648.327961:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f200/0x844e5faceb5f90d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.327971:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f200/0x844e5faceb5f90d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.327976:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f200/0x844e5faceb5f90d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.327981:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc7f200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155648.327984:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f200/0x844e5faceb5f90d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.327990:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f200/0x844e5faceb5f90d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.327999:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155648.328002:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155648.328005:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f200/0x844e5faceb5f90d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.328009:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f200/0x844e5faceb5f90d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.328038:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f90dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.328043:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f90dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.328047:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f90dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.328051:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc7e200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155648.328053:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f90dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.328060:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f90dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.328067:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0100) 00010000:00010000:3.0:1746155648.328068:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155648.328070:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f90dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.328075:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7e200/0x844e5faceb5f90dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.328105:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7e600/0x844e5faceb5f90ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cf9 expref: 17 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.328122:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f90e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cf9 expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.328127:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155648.328129:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155648.328131:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc7ec00, rc 0) 00000100:00100000:3.0:1746155648.328170:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32572:x1830976126193408:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 579us (770us total) trans 8589945429 rc 0/0 00000100:00100000:3.0:1746155648.328176:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11247 00000100:00100000:0.0:1746155648.332916:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.333333:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126193536 00000100:00100000:2.0:1746155648.333341:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126193536 00000100:00100000:2.0:1746155648.333387:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17550 00000100:00100000:2.0:1746155648.333394:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:32567:x1830976126193536:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155648.333409:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.333423:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d00 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.333445:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 8 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.333457:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.333458:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.333461:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.333484:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 8 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.333495:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 8 pid: 8438 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.333524:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125456896:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.335679:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00000100:00100000:3.0:1746155648.335908:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.336208:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125456896:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.336226:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.336238:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450ce00, rc 0) 00000100:00100000:2.0:1746155648.336336:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32567:x1830976126193536:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2941us (3435us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.336343:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17550 00000100:00100000:2.0:1746155648.336364:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126193664 00000100:00100000:2.0:1746155648.336368:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126193664 00000100:00100000:2.0:1746155648.338271:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17551 00000100:00100000:2.0:1746155648.338282:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32572:x1830976126193664:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155648.338296:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.338309:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d07 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.338329:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a76e800/0x844e5faceb5f9073 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cba expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.338336:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f907a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc1 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.338341:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.338342:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.338345:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2326528->2535423] (req 2326528->2535423) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.338364:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f907a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc1 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.338373:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f907a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc1 expref: 11 pid: 8437 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.338382:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125457024:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.338440:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a76e800/0x844e5faceb5f9073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cba expref: 19 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.338447:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a76e800/0x844e5faceb5f9073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cba expref: 19 pid: 8437 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.338458:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125457152:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.338470:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00000100:00100000:3.0:1746155648.339125:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.339179:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126193792 00000100:00100000:1.0:1746155648.339184:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126193792 00002000:00100000:1.0:1746155648.339211:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3067904->3145727) req@ffff88009f580700 x1830976126193792/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.339219:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580700 with x1830976126193792 ext(3067904->3145727) 00010000:00010000:1.0:1746155648.339225:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 9 pid: 8438 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.339234:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 9 pid: 8438 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746155648.339243:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f580700 00000100:00100000:1.0:1746155648.339258:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1466 00000100:00100000:1.0:1746155648.339263:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976126193792:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155648.340409:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125457024:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.340417:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125457152:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.340435:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2326528->2535423] (req 2326528->2535423) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.340445:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450c400, rc 0) 00000100:00100000:2.0:1746155648.340617:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32572:x1830976126193664:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2336us (4709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.340623:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17551 00000100:00100000:1.0:1746155648.341691:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126193792:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 2425us (2565us total) trans 21474841711 rc 0/0 00000100:00100000:1.0:1746155648.341698:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1466 00002000:00100000:1.0:1746155648.341705:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3067904->3145727) req@ffff88009f580700 x1830976126193792/t21474841711(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/448 e 0 to 0 dl 1746155659 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.341712:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580700 with x1830976126193792 ext(3067904->3145727) 00010000:00010000:1.0:1746155648.341718:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 11 pid: 8438 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.341727:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 11 pid: 8438 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746155648.341732:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009f580700 00000100:00100000:0.0:1746155648.346361:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.346410:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.347301:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.347320:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126193920 00000100:00100000:2.0:1746155648.347327:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126193920 00010000:00010000:2.0:1746155648.347357:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f907a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc1 expref: 11 pid: 8437 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.347385:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126194176 00000100:00100000:2.0:1746155648.347387:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126194176 00010000:00010000:2.0:1746155648.347398:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 11 pid: 8438 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.347414:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9004 00000100:00100000:2.0:1746155648.347420:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126193920:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155648.347431:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155648.347449:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f907a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc1 expref: 11 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.347458:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f907a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc1 expref: 11 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.347476:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c046800/0x844e5faceb5f907a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cc1 expref: 11 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.347499:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155648.347569:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126193920:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 148us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.347575:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9004 00000100:00100000:2.0:1746155648.347592:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9005 00000100:00100000:2.0:1746155648.347597:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e33c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126194176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155648.347604:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155648.347615:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 11 pid: 8438 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.347621:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 11 pid: 8438 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.347638:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1ea00/0x844e5faceb5f8fb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->3145727] (req 3067904->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c2e expref: 11 pid: 8438 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.347646:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.347648:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.347653:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.347660:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.347685:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155648.347695:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125457280:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155648.347740:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00000100:00100000:1.0:1746155648.349789:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126194048 00000100:00100000:1.0:1746155648.349797:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126194048 00010000:00010000:1.0:1746155648.349819:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a76e800/0x844e5faceb5f9073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cba expref: 20 pid: 8437 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746155648.350342:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9006 00000100:00100000:1.0:1746155648.350349:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1962:x1830976126194048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155648.350360:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155648.350496:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a76e800/0x844e5faceb5f9073 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cba expref: 20 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.350536:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a76e800/0x844e5faceb5f9073 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cba expref: 20 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.350555:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a76e800/0x844e5faceb5f9073 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5083135) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cba expref: 20 pid: 8437 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.350572:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.350574:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.350579:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.350585:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.350608:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155648.350617:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125457408:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155648.350688:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.351365:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125457280:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155648.351378:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155648.351389:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.351427:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e33c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126194176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3828us (5015us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.351434:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126194432 00000100:00100000:0.0:1746155648.351435:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9005 00000100:00100000:1.0:1746155648.351437:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126194432 00002000:00100000:1.0:1746155648.351459:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3043328->3047423) req@ffff88009f581500 x1830976126194432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.351467:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f581500 with x1830976126194432 ext(3043328->3047423) 00002000:00010000:1.0:1746155648.351471:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f581500 00000100:00100000:1.0:1746155648.351483:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8345 00000100:00100000:1.0:1746155648.351488:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976126194432:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155648.351695:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976126194432:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 206us (305us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155648.351701:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8345 00002000:00100000:1.0:1746155648.351706:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3043328->3047423) req@ffff88009f581500 x1830976126194432/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/4536 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.351713:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f581500 with x1830976126194432 ext(3043328->3047423) 00002000:00010000:1.0:1746155648.351716:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f581500 00000100:00100000:1.0:1746155648.352325:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125457408:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155648.352334:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155648.352362:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976126194048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2013us (5061us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.352367:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9006 00000100:00100000:0.0:1746155648.353020:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.353073:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126194688 00000100:00100000:1.0:1746155648.353077:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126194688 00002000:00100000:1.0:1746155648.353091:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2326528->2330623) req@ffff8800a0918e00 x1830976126194688/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.353098:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918e00 with x1830976126194688 ext(2326528->2330623) 00002000:00010000:1.0:1746155648.353101:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0918e00 00000100:00100000:1.0:1746155648.353120:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8346 00000100:00100000:1.0:1746155648.353126:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126194688:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155648.353211:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126194688:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 84us (191us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155648.353218:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8346 00002000:00100000:1.0:1746155648.353222:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2326528->2330623) req@ffff8800a0918e00 x1830976126194688/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/4536 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.353229:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918e00 with x1830976126194688 ext(2326528->2330623) 00002000:00010000:1.0:1746155648.353231:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0918e00 00000100:00100000:0.0:1746155648.355387:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.355470:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126194816 00000100:00100000:2.0:1746155648.355475:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126194816 00000100:00100000:2.0:1746155648.355519:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17552 00000100:00100000:2.0:1746155648.355527:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32567:x1830976126194816:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155648.355538:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.355550:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d0e expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.355570:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.355577:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.355578:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.355581:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->3997695] (req 3145728->3997695) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.355600:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.355611:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 9 pid: 10591 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.355620:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125457536:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.355854:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1eced80 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.357485:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125457536:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155648.357535:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->3997695] (req 3145728->3997695) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.357547:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450d600, rc 0) 00000100:00100000:0.0:1746155648.357574:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:32567:x1830976126194816:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2048us (2191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155648.357580:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17552 00000100:00100000:0.0:1746155648.358383:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.358443:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126195072 00000100:00100000:2.0:1746155648.358447:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126195072 00002000:00100000:2.0:1746155648.358471:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2531328->2535423) req@ffff8800a0918a80 x1830976126195072/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.358480:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918a80 with x1830976126195072 ext(2531328->2535423) 00010000:00010000:2.0:1746155648.358486:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 10 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.358496:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 10 pid: 10591 timeout: 877 lvb_type: 0 00002000:00010000:2.0:1746155648.358520:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918a80 00000100:00100000:2.0:1746155648.358545:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1467 00000100:00100000:2.0:1746155648.358551:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126195072:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155648.358894:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126195072:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 342us (517us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155648.358900:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1467 00002000:00100000:2.0:1746155648.358906:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2531328->2535423) req@ffff8800a0918a80 x1830976126195072/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/4536 e 0 to 0 dl 1746155659 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.358918:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0918a80 with x1830976126195072 ext(2531328->2535423) 00010000:00010000:2.0:1746155648.358922:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 10 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.358931:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 10 pid: 10591 timeout: 877 lvb_type: 0 00002000:00010000:2.0:1746155648.358936:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0918a80 00000100:00100000:0.0:1746155648.361341:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.361426:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.361532:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126195456 00000100:00100000:2.0:1746155648.361538:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126195456 00000100:00100000:2.0:1746155648.361583:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4796 00000100:00100000:2.0:1746155648.361590:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32572:x1830976126195456:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155648.361930:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126195584 00000100:00100000:1.0:1746155648.361934:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126195584 00002000:00100000:1.0:1746155648.361953:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2326528->2535423) req@ffff8800a091a300 x1830976126195584/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.361961:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091a300 with x1830976126195584 ext(2326528->2535423) 00010000:00010000:1.0:1746155648.361968:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 10 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.361979:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 10 pid: 10591 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746155648.361984:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091a300 00000100:00100000:1.0:1746155648.362004:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1468 00000100:00100000:1.0:1746155648.362009:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1963:x1830976126195584:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155648.362362:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0919f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32572:x1830976126195456:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 771us (1027us total) trans 8589945430 rc 0/0 00000100:00100000:2.0:1746155648.362368:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4796 00000100:00100000:1.0:1746155648.368150:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1963:x1830976126195584:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 6132us (6715us total) trans 17179874412 rc 0/0 00000100:00100000:1.0:1746155648.368160:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1468 00002000:00100000:1.0:1746155648.368170:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2326528->2535423) req@ffff8800a091a300 x1830976126195584/t17179874412(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/448 e 0 to 0 dl 1746155659 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.368183:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a091a300 with x1830976126195584 ext(2326528->2535423) 00010000:00010000:1.0:1746155648.368192:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 12 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.368204:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 12 pid: 10591 timeout: 877 lvb_type: 0 00002000:00010000:1.0:1746155648.368210:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a091a300 00000100:00100000:0.0:1746155648.370868:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.370945:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126195712 00000100:00100000:1.0:1746155648.370952:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126195712 00010000:00010000:1.0:1746155648.370979:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 12 pid: 10591 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746155648.370997:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9007 00000100:00100000:1.0:1746155648.371003:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126195712:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155648.371012:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155648.371029:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 12 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.371039:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 12 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.371058:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009450c400/0x844e5faceb5f90f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2326528->2535423) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d07 expref: 12 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.371090:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.371092:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.371098:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 19 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.371105:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 19 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.371131:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 19 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155648.371141:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125457664:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155648.371626:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155648.375393:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125457664:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155648.375410:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155648.375456:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126195712:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4452us (4602us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.375465:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9007 00000100:00100000:0.0:1746155648.377874:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.378250:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126195968 00000100:00100000:1.0:1746155648.378257:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126195968 00002000:00100000:1.0:1746155648.378289:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3993600->3997695) req@ffff88012de0c000 x1830976126195968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.378298:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0c000 with x1830976126195968 ext(3993600->3997695) 00002000:00010000:1.0:1746155648.378302:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de0c000 00000100:00100000:1.0:1746155648.378849:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8347 00000100:00100000:1.0:1746155648.378866:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126195968:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155648.379005:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126195968:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 149us (1147us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155648.379011:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8347 00002000:00100000:1.0:1746155648.379016:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3993600->3997695) req@ffff88012de0c000 x1830976126195968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/4536 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.379022:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0c000 with x1830976126195968 ext(3993600->3997695) 00002000:00010000:1.0:1746155648.379025:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de0c000 00000100:00100000:0.0:1746155648.381359:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.381531:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126196224 00000100:00100000:2.0:1746155648.381538:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126196224 00000100:00100000:2.0:1746155648.381574:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4797 00000100:00100000:2.0:1746155648.381578:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32567:x1830976126196224:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155648.381724:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:32567:x1830976126196224:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 145us (369us total) trans 8589945431 rc 0/0 00000100:00100000:2.0:1746155648.381728:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4797 00000100:00100000:0.0:1746155648.387228:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.387314:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126196352 00000100:00100000:2.0:1746155648.387321:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126196352 00000100:00100000:2.0:1746155648.387359:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17553 00000100:00100000:2.0:1746155648.387365:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976126196352:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.387379:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.387394:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x844e5faceb5f9106 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d15 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.387419:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x844e5faceb5f9106 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d15 expref: 17 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.387428:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x844e5faceb5f9106 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d15 expref: 17 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.387453:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450cc00, rc 0) 00000100:00100000:2.0:1746155648.387490:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976126196352:12345-192.168.202.51@tcp:101:cat.0 Request processed in 125us (269us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155648.387496:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17553 00000100:00100000:0.0:1746155648.401053:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.402212:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126196608 00000100:00100000:3.0:1746155648.402220:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126196608 00002000:00100000:3.0:1746155648.402259:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012de0ca80 x1830976126196608/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.402269:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0ca80 with x1830976126196608 ext(2097152->3145727) 00002000:00010000:3.0:1746155648.402274:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de0ca80 00000100:00100000:3.0:1746155648.402425:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8348 00000100:00100000:3.0:1746155648.402433:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126196608:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155648.413188:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126196608:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10748us (12134us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155648.413198:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8348 00002000:00100000:3.0:1746155648.413208:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012de0ca80 x1830976126196608/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.413217:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0ca80 with x1830976126196608 ext(2097152->3145727) 00002000:00010000:3.0:1746155648.413222:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de0ca80 00000100:00100000:0.0:1746155648.421258:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.421893:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126196736 00000100:00100000:2.0:1746155648.421900:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126196736 00000100:00100000:2.0:1746155648.421932:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17554 00000100:00100000:2.0:1746155648.421938:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32576:x1830976126196736:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.421953:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.421965:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450da00/0x844e5faceb5f910d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d1c expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.421990:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.422002:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.422003:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.422007:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450da00/0x844e5faceb5f910d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d1c expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.422031:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.422041:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 17 pid: 10591 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.422052:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125457792:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.422135:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155648.425022:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125457792:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.425049:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009450da00/0x844e5faceb5f910d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d1c expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.425063:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450da00, rc 0) 00000100:00100000:2.0:1746155648.426875:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:32576:x1830976126196736:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4928us (5616us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.426883:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17554 00000100:00100000:0.0:1746155648.428802:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.429111:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126196864 00000100:00100000:3.0:1746155648.429118:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126196864 00002000:00100000:3.0:1746155648.429149:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (3043328->3145727) req@ffff88012de0d180 x1830976126196864/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.429158:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0d180 with x1830976126196864 ext(3043328->3145727) 00010000:00010000:3.0:1746155648.429165:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 17 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.429176:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 17 pid: 10591 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746155648.429182:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012de0d180 00000100:00100000:3.0:1746155648.429197:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1469 00000100:00100000:3.0:1746155648.429203:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976126196864:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155648.435171:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.437406:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126196864:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8197us (8601us total) trans 21474841712 rc 0/0 00000100:00100000:3.0:1746155648.437416:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1469 00002000:00100000:3.0:1746155648.437425:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (3043328->3145727) req@ffff88012de0d180 x1830976126196864/t21474841712(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/448 e 0 to 0 dl 1746155659 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.437433:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0d180 with x1830976126196864 ext(3043328->3145727) 00010000:00010000:3.0:1746155648.437441:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 19 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.437451:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 19 pid: 10591 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746155648.437457:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012de0d180 00000100:00100000:2.0:1746155648.437644:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126197120 00000100:00100000:2.0:1746155648.437651:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126197120 00000100:00100000:2.0:1746155648.437678:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11248 00000100:00100000:2.0:1746155648.437683:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32580:x1830976126197120:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.437698:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.437711:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c000/0x844e5faceb5f9114 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d23 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.437777:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x844e5faceb5f911b lrc: 3/1,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.437788:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x844e5faceb5f911b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.437797:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x844e5faceb5f911b lrc: 3/1,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155648.437804:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155648.437886:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450c000/0x844e5faceb5f9114 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d23 expref: 20 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.437910:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x844e5faceb5f911b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d23 expref: 19 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.437917:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155648.437919:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746155648.437922:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450d800, rc 0) 00000100:00100000:2.0:1746155648.437944:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32580:x1830976126197120:12345-192.168.202.51@tcp:101:cat.0 Request processed in 261us (2781us total) trans 8589945432 rc 0/0 00000100:00100000:2.0:1746155648.437950:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11248 00000100:00100000:0.0:1746155648.440734:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.441433:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.441593:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126197248 00000100:00100000:1.0:1746155648.441600:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126197248 00010000:00010000:1.0:1746155648.441628:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 19 pid: 10591 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.441644:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126197376 00000100:00100000:2.0:1746155648.441649:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126197376 00000100:00100000:1.0:1746155648.441651:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9008 00000100:00100000:1.0:1746155648.441657:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976126197248:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155648.441666:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746155648.441670:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17555 00000100:00100000:2.0:1746155648.441675:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126197376:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155648.441682:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 19 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.441687:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155648.441693:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 19 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.441698:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009450c600/0x844e5faceb5f9129 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d2a expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.441709:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450ce00/0x844e5faceb5f90f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3043328->3145727] (req 3043328->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d00 expref: 19 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.441729:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.441731:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.441736:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009450da00/0x844e5faceb5f910d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d1c expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155648.441743:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125457920:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155648.441743:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450da00/0x844e5faceb5f910d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d1c expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.441763:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009450da00/0x844e5faceb5f910d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d1c expref: 18 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155648.441770:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125458048:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155648.441813:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155648.442360:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501780 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.442753:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.442959:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126197504 00000100:00100000:2.0:1746155648.442962:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126197504 00000100:00100000:2.0:1746155648.443574:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17556 00000100:00100000:2.0:1746155648.443581:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126197504:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.443591:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.443601:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x844e5faceb5f9130 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d31 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.443618:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.443620:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.443624:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x844e5faceb5f9130 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d31 expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.443635:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x844e5faceb5f9130 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d31 expref: 11 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.443642:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450cc00, rc 0) 00000100:00100000:2.0:1746155648.443669:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126197504:12345-192.168.202.51@tcp:101:cat.0 Request processed in 88us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.443678:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17556 00000100:00100000:2.0:1746155648.443931:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125457920:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155648.443951:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009450c600/0x844e5faceb5f9129 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d2a expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.443960:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009450c600/0x844e5faceb5f9129 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d2a expref: 12 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.443968:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450c600, rc 0) 00000100:00100000:2.0:1746155648.443987:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126197376:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2312us (2555us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155648.443992:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17555 00000100:00100000:1.0:1746155648.444149:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125458048:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155648.444158:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155648.444188:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976126197248:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2531us (3460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.444195:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9008 00000100:00100000:0.0:1746155648.447499:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.447596:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126197888 00000100:00100000:3.0:1746155648.447604:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126197888 00002000:00100000:3.0:1746155648.447644:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012de0e300 x1830976126197888/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.447654:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0e300 with x1830976126197888 ext(2097152->3145727) 00002000:00010000:3.0:1746155648.447659:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de0e300 00000100:00100000:3.0:1746155648.447680:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8349 00000100:00100000:3.0:1746155648.447687:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976126197888:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155648.447801:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.447855:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126198016 00000100:00100000:1.0:1746155648.447868:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126198016 00002000:00100000:1.0:1746155648.447884:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3997696->4194303) req@ffff88012de0e680 x1830976126198016/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.447891:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0e680 with x1830976126198016 ext(3997696->4194303) 00002000:00010000:1.0:1746155648.447893:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de0e680 00000100:00100000:1.0:1746155648.447913:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8350 00000100:00100000:1.0:1746155648.447919:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976126198016:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155648.453578:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976126198016:12345-192.168.202.51@tcp:3:cat.0 Request processed in 5649us (5767us total) trans 0 rc 196608/196608 00000100:00100000:1.0:1746155648.453590:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8350 00002000:00100000:1.0:1746155648.453599:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3997696->4194303) req@ffff88012de0e680 x1830976126198016/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 196608/196608 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.453608:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0e680 with x1830976126198016 ext(3997696->4194303) 00002000:00010000:1.0:1746155648.453613:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de0e680 00000100:00100000:0.0:1746155648.454586:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.454915:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126198144 00000100:00100000:2.0:1746155648.454922:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126198144 00000100:00100000:2.0:1746155648.454953:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17557 00000100:00100000:2.0:1746155648.454959:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32580:x1830976126198144:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.454973:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.454987:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009450c200/0x844e5faceb5f9137 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d38 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.455009:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 19 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.455016:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.455018:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.455020:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450c200/0x844e5faceb5f9137 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d38 expref: 12 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.455042:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 19 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.455052:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 19 pid: 10591 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.455061:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125458176:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.455200:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155648.455915:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976126197888:12345-192.168.202.51@tcp:3:cat.0 Request processed in 8227us (8420us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155648.455927:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8349 00002000:00100000:3.0:1746155648.455933:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012de0e300 x1830976126197888/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.455941:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0e300 with x1830976126197888 ext(2097152->3145727) 00002000:00010000:3.0:1746155648.455945:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012de0e300 00000100:00100000:2.0:1746155648.456843:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b882d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125458176:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.456873:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009450c200/0x844e5faceb5f9137 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d38 expref: 12 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.456884:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009450c200, rc 0) 00000100:00100000:2.0:1746155648.456905:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32580:x1830976126198144:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1946us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.456910:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17557 00000100:00100000:0.0:1746155648.457601:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.457759:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126198272 00000100:00100000:3.0:1746155648.457765:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126198272 00002000:00100000:3.0:1746155648.457791:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3997695) req@ffff88012de0ed80 x1830976126198272/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.457798:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0ed80 with x1830976126198272 ext(3145728->3997695) 00010000:00010000:3.0:1746155648.457804:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 20 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.457814:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 20 pid: 10591 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746155648.457820:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012de0ed80 00000100:00100000:3.0:1746155648.457848:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1470 00000100:00100000:3.0:1746155648.457854:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126198272:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155648.462324:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.462516:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126198400 00000100:00100000:3.0:1746155648.462524:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126198400 00000100:00100000:3.0:1746155648.463141:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17558 00000100:00100000:3.0:1746155648.463150:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32576:x1830976126198400:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155648.463165:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.463182:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f913e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d3f expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.463204:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155648.463206:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155648.463210:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f913e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d3f expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.463220:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f913e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d3f expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.463228:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013121e400, rc 0) 00000100:00100000:3.0:1746155648.463267:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32576:x1830976126198400:12345-192.168.202.51@tcp:101:cat.0 Request processed in 118us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.463272:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17558 00000100:00100000:3.0:1746155648.466329:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126198272:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8468us (8722us total) trans 17179874413 rc 0/0 00000100:00100000:3.0:1746155648.466339:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1470 00002000:00100000:3.0:1746155648.466348:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->3997695) req@ffff88012de0ed80 x1830976126198272/t17179874413(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/448 e 0 to 0 dl 1746155659 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.466356:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0ed80 with x1830976126198272 ext(3145728->3997695) 00010000:00010000:3.0:1746155648.466363:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 23 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.466376:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 23 pid: 10591 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746155648.466387:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012de0ed80 00000100:00100000:0.0:1746155648.469723:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.469986:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126198528 00000100:00100000:1.0:1746155648.469993:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126198528 00010000:00010000:1.0:1746155648.470020:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 23 pid: 10591 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746155648.470055:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9009 00000100:00100000:1.0:1746155648.470061:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126198528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155648.470073:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155648.470090:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 23 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.470100:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 23 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.470119:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009450d600/0x844e5faceb5f90ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3997695) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d0e expref: 23 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.470147:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.470149:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.470154:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450c200/0x844e5faceb5f9137 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d38 expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.470161:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009450c200/0x844e5faceb5f9137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d38 expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.470168:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.470169:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.470172:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f913e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d3f expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.470177:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f913e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d3f expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.470200:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f913e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d3f expref: 22 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155648.470210:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125458304:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155648.470294:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009450c200/0x844e5faceb5f9137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d38 expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155648.470302:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125458432:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155648.470320:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501780 going to sleep for 11 seconds 00000100:00100000:1.0:1746155648.471791:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125458304:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155648.471799:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:22680:1830976125458432:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155648.471813:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155648.471847:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126198528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1785us (2131us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.471854:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9009 00000100:00100000:0.0:1746155648.474635:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.474896:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126198784 00000100:00100000:3.0:1746155648.474904:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126198784 00002000:00100000:3.0:1746155648.474939:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012de0f480 x1830976126198784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.474948:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0f480 with x1830976126198784 ext(3145728->4194303) 00002000:00010000:3.0:1746155648.474952:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de0f480 00000100:00100000:3.0:1746155648.475128:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8351 00000100:00100000:3.0:1746155648.475135:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126198784:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155648.480043:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.480086:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.480109:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126199040 00000100:00100000:1.0:1746155648.480117:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126199040 00002000:00100000:1.0:1746155648.480152:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012de0f800 x1830976126199040/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.480160:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0f800 with x1830976126199040 ext(2097152->3145727) 00002000:00010000:1.0:1746155648.480165:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de0f800 00000100:00100000:1.0:1746155648.480185:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126199296 00000100:00100000:1.0:1746155648.480188:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126199296 00002000:00100000:1.0:1746155648.480205:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012de0fb80 x1830976126199296/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.480211:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0fb80 with x1830976126199296 ext(3145728->4194303) 00002000:00010000:1.0:1746155648.480214:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de0fb80 00000100:00100000:1.0:1746155648.480233:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8352 00000100:00100000:1.0:1746155648.480240:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126199040:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155648.480275:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8353 00000100:00100000:2.0:1746155648.480282:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012de0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126199296:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155648.482763:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.483035:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126198784:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7898us (8403us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155648.483044:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8351 00002000:00100000:1.0:1746155648.483052:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012de0f480 x1830976126198784/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.483061:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0f480 with x1830976126198784 ext(3145728->4194303) 00002000:00010000:1.0:1746155648.483065:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de0f480 00000100:00100000:1.0:1746155648.483081:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126199552 00000100:00100000:1.0:1746155648.483085:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126199552 00002000:00100000:1.0:1746155648.483984:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012bdf5f80 x1830976126199552/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.483991:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5f80 with x1830976126199552 ext(2097152->3145727) 00002000:00010000:1.0:1746155648.483995:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf5f80 00000100:00100000:1.0:1746155648.484020:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8354 00000100:00100000:1.0:1746155648.484028:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126199552:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155648.484943:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.485160:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126199808 00000100:00100000:3.0:1746155648.485165:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126199808 00000100:00100000:3.0:1746155648.485199:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11249 00000100:00100000:3.0:1746155648.485204:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32582:x1830976126199808:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155648.485218:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.485232:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f800/0x844e5faceb5f9145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d46 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.485300:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.485311:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f90ab lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cdd expref: 294 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.485317:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f90e3 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cf9 expref: 20 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.485326:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.485350:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f90e3 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cf9 expref: 20 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.485358:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f90e3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cf9 expref: 20 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.485368:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125458560:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155648.485437:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f90ab lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cdd expref: 294 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.485443:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f90ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cdd expref: 294 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.485450:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125458688:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155648.485464:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.491058:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.491093:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.491111:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126200064 00000100:00100000:0.0:1746155648.491117:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126200064 00010000:00010000:0.0:1746155648.491142:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f90ab lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cdd expref: 295 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746155648.491160:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126199936 00000100:00100000:0.0:1746155648.491161:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126199936 00010000:00010000:0.0:1746155648.491168:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f90e3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cf9 expref: 21 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746155648.491178:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9010 00000100:00100000:0.0:1746155648.491183:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+295:1960:x1830976126200064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155648.491195:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155648.491199:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f90ab lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cdd expref: 295 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746155648.491207:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f90ab lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cdd expref: 295 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746155648.491223:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155648.491226:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155648.491232:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155648.491236:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155648.491532:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9011 00000100:00100000:1.0:1746155648.491540:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126199936:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155648.491548:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155648.491552:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f90e3 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cf9 expref: 21 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.491562:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f90e3 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cf9 expref: 21 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.491573:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155648.491577:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155648.491580:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126199296:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11297us (11492us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746155648.491583:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155648.491589:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8353 00010000:00010000:1.0:1746155648.491593:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00002000:00100000:2.0:1746155648.491597:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88012de0fb80 x1830976126199296/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.491605:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0fb80 with x1830976126199296 ext(3145728->4194303) 00010000:00010000:1.0:1746155648.491605:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1746155648.491610:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de0fb80 00000100:00100000:1.0:1746155648.491623:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126199936:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 85us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.491630:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9011 00010000:00010000:3.0:1746155648.491804:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f90e3 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cf9 expref: 20 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.491828:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125458560:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155648.491840:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f90ab lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cdd expref: 295 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.491848:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125458688:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155648.491875:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.491883:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.491888:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155648.492182:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155648.492292:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f800/0x844e5faceb5f9145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d46 expref: 21 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.492304:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d46 expref: 20 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.492310:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155648.492312:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155648.492314:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013121f400, rc 0) 00000100:00100000:0.0:1746155648.492585:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1960:x1830976126200064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1400us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155648.492592:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9010 00000100:00100000:3.0:1746155648.492708:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32582:x1830976126199808:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7503us (7765us total) trans 8589945433 rc 0/0 00000100:00100000:3.0:1746155648.492777:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11249 00000100:00100000:1.0:1746155648.495643:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012de0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126199040:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15395us (15601us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155648.495653:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8352 00002000:00100000:1.0:1746155648.495663:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88012de0f800 x1830976126199040/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.495671:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012de0f800 with x1830976126199040 ext(2097152->3145727) 00002000:00010000:1.0:1746155648.495676:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012de0f800 00000100:00100000:1.0:1746155648.497198:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126199552:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13167us (14436us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155648.497206:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8354 00002000:00100000:1.0:1746155648.497213:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012bdf5f80 x1830976126199552/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.497220:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf5f80 with x1830976126199552 ext(2097152->3145727) 00002000:00010000:1.0:1746155648.497224:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf5f80 00000100:00100000:0.0:1746155648.499706:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.499776:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126200320 00000100:00100000:1.0:1746155648.499783:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126200320 00002000:00100000:1.0:1746155648.499815:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800a0d70a80 x1830976126200320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.499828:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d70a80 with x1830976126200320 ext(4194304->5083135) 00002000:00010000:1.0:1746155648.499832:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d70a80 00000100:00100000:1.0:1746155648.499870:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8355 00000100:00100000:1.0:1746155648.499877:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976126200320:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155648.503090:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.503273:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126200576 00000100:00100000:2.0:1746155648.503281:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126200576 00002000:00100000:2.0:1746155648.503317:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800a0d70e00 x1830976126200576/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.503326:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d70e00 with x1830976126200576 ext(4194304->5083135) 00002000:00010000:2.0:1746155648.503331:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d70e00 00000100:00100000:2.0:1746155648.503348:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8356 00000100:00100000:2.0:1746155648.503355:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126200576:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155648.505465:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.505531:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126200832 00000100:00100000:3.0:1746155648.505537:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126200832 00000100:00100000:3.0:1746155648.505570:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11250 00000100:00100000:3.0:1746155648.505575:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32584:x1830976126200832:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155648.505592:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.505605:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5f915a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d4d expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.505680:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f9161 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.505690:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f9161 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.505697:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f9161 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.505706:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f9168 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.505711:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f9168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.505715:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f9168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.505824:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f916f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.505830:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f916f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.505834:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f916f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155648.505840:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155648.506009:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f9161 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506015:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f9161 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506024:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f9161 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506029:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013121e200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155648.506032:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f9161 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506038:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f9161 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506048:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155648.506051:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155648.506054:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f9161 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506059:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121e200/0x844e5faceb5f9161 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506067:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f9168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506072:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f9168 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506076:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f9168 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506080:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009fc7f400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155648.506082:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f9168 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506086:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f9168 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506095:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0c00) 00010000:00010000:3.0:1746155648.506097:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155648.506099:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f9168 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506103:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f400/0x844e5faceb5f9168 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.506133:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5f915a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d4d expref: 297 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.506144:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f916f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d4d expref: 296 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.506149:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155648.506150:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155648.506152:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc7ec00, rc 0) 00000100:00100000:3.0:1746155648.506193:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32584:x1830976126200832:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 615us (732us total) trans 8589945434 rc 0/0 00000100:00100000:3.0:1746155648.506199:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11250 00000100:00100000:2.0:1746155648.507057:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976126200320:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7179us (7356us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155648.507065:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8355 00002000:00100000:2.0:1746155648.507072:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800a0d70a80 x1830976126200320/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.507080:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d70a80 with x1830976126200320 ext(4194304->5083135) 00002000:00010000:2.0:1746155648.507084:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d70a80 00000100:00100000:2.0:1746155648.510184:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126200576:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6821us (7093us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155648.510193:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8356 00002000:00100000:2.0:1746155648.510202:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff8800a0d70e00 x1830976126200576/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.510211:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d70e00 with x1830976126200576 ext(4194304->5083135) 00002000:00010000:2.0:1746155648.510216:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d70e00 00000100:00100000:0.0:1746155648.513169:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.513294:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126200960 00000100:00100000:2.0:1746155648.513302:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126200960 00000100:00100000:2.0:1746155648.513351:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17559 00000100:00100000:2.0:1746155648.513357:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32582:x1830976126200960:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155648.513371:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.513384:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d54 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.513409:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009450da00/0x844e5faceb5f910d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d1c expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.513416:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x844e5faceb5f9130 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d31 expref: 12 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.513423:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.513424:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.513428:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2297856->2629631] (req 2297856->2629631) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.513451:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x844e5faceb5f9130 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d31 expref: 12 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.513462:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x844e5faceb5f9130 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d31 expref: 12 pid: 10591 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746155648.513472:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125458816:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.513576:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009450da00/0x844e5faceb5f910d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d1c expref: 17 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.513588:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009450da00/0x844e5faceb5f910d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d1c expref: 17 pid: 9235 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.513596:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125458944:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.513612:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.517437:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.517551:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125458944:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155648.517757:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126201088 00000100:00100000:1.0:1746155648.517764:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126201088 00010000:00010000:1.0:1746155648.517791:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009450da00/0x844e5faceb5f910d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d1c expref: 18 pid: 9235 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.517924:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125458816:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.517946:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2297856->2629631] (req 2297856->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.517959:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a83e00, rc 0) 00000100:00100000:2.0:1746155648.517997:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32582:x1830976126200960:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4640us (4834us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.518004:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17559 00000100:00100000:1.0:1746155648.518060:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9012 00000100:00100000:1.0:1746155648.518067:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d759850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976126201088:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155648.518078:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155648.518095:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009450da00/0x844e5faceb5f910d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d1c expref: 18 pid: 9235 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.518104:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009450da00/0x844e5faceb5f910d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d1c expref: 18 pid: 9235 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.518123:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450da00/0x844e5faceb5f910d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d1c expref: 18 pid: 9235 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.518135:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155648.518152:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d759850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976126201088:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 86us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.518157:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9012 00000100:00100000:0.0:1746155648.520559:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.520605:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.520743:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126201216 00000100:00100000:2.0:1746155648.520750:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126201216 00000100:00100000:3.0:1746155648.521122:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126201344 00000100:00100000:3.0:1746155648.521126:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126201344 00010000:00010000:3.0:1746155648.521146:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x844e5faceb5f9130 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d31 expref: 13 pid: 10591 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746155648.521272:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17560 00000100:00100000:2.0:1746155648.521279:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126201216:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.521292:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.521303:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83c00/0x844e5faceb5f9184 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d5b expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.521320:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.521328:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83c00/0x844e5faceb5f9184 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d5b expref: 14 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.521336:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83c00/0x844e5faceb5f9184 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d5b expref: 14 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.521358:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a83c00, rc 0) 00000100:00100000:2.0:1746155648.521388:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126201216:12345-192.168.202.51@tcp:101:cat.0 Request processed in 109us (836us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155648.521393:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17560 00000100:00100000:3.0:1746155648.521888:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9013 00000100:00100000:3.0:1746155648.521895:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1963:x1830976126201344:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155648.521904:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155648.521922:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x844e5faceb5f9130 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d31 expref: 12 pid: 10591 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746155648.521932:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x844e5faceb5f9130 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d31 expref: 12 pid: 10591 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746155648.521946:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450cc00/0x844e5faceb5f9130 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d31 expref: 12 pid: 10591 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746155648.521958:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.521960:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.521966:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.521973:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.521997:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 11 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155648.522007:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125459072:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155648.522057:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.525624:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.525712:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126201472 00000100:00100000:3.0:1746155648.525720:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126201472 00000100:00100000:3.0:1746155648.525760:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17561 00000100:00100000:3.0:1746155648.525766:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126201472:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155648.525780:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.525796:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f918b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d62 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.525819:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f918b lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d62 expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.525827:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f918b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d62 expref: 13 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.525836:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc67a00, rc 0) 00000100:00100000:3.0:1746155648.526331:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126201472:12345-192.168.202.51@tcp:101:cat.0 Request processed in 564us (713us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155648.526336:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17561 00000100:00100000:3.0:1746155648.531173:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125459072:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155648.531192:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155648.531240:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976126201344:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 9345us (10634us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.531248:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9013 00000100:00100000:0.0:1746155648.531312:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.531356:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126201728 00000100:00100000:2.0:1746155648.531362:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126201728 00002000:00100000:2.0:1746155648.531394:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2297856->2301951) req@ffff8800a0d72300 x1830976126201728/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.531402:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d72300 with x1830976126201728 ext(2297856->2301951) 00002000:00010000:2.0:1746155648.531406:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d72300 00000100:00100000:2.0:1746155648.531431:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8357 00000100:00100000:2.0:1746155648.531480:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126201728:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155648.532282:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126201728:12345-192.168.202.51@tcp:3:cat.0 Request processed in 802us (969us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155648.532288:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8357 00002000:00100000:2.0:1746155648.532294:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2297856->2301951) req@ffff8800a0d72300 x1830976126201728/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/4536 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.532301:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d72300 with x1830976126201728 ext(2297856->2301951) 00002000:00010000:2.0:1746155648.532304:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d72300 00000100:00100000:0.0:1746155648.542124:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.542256:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126201984 00000100:00100000:2.0:1746155648.542266:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126201984 00002000:00100000:2.0:1746155648.542313:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2625536->2629631) req@ffff8800a0d72680 x1830976126201984/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.542322:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d72680 with x1830976126201984 ext(2625536->2629631) 00002000:00010000:2.0:1746155648.542327:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d72680 00000100:00100000:2.0:1746155648.542373:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8358 00000100:00100000:2.0:1746155648.542382:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126201984:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155648.542645:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126201984:12345-192.168.202.51@tcp:3:cat.0 Request processed in 262us (528us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155648.542653:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8358 00002000:00100000:2.0:1746155648.542660:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2625536->2629631) req@ffff8800a0d72680 x1830976126201984/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/4536 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.542666:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d72680 with x1830976126201984 ext(2625536->2629631) 00002000:00010000:2.0:1746155648.542669:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d72680 00000100:00100000:0.0:1746155648.585109:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.586615:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126202112 00000100:00100000:3.0:1746155648.586624:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126202112 00000100:00100000:3.0:1746155648.586677:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11251 00000100:00100000:3.0:1746155648.586684:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:32588:x1830976126202112:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155648.586704:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.586719:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67200/0x844e5faceb5f9192 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d69 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.586764:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f9199 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.586774:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f9199 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.586782:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f9199 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.586792:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f91a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.586801:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f91a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.586805:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f91a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.586903:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.586912:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d46 expref: 19 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.586919:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.586943:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d46 expref: 19 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.586953:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d46 expref: 19 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.586962:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125459200:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155648.587043:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155648.590313:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125459200:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155648.590339:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155648.591195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.591543:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126202368 00000100:00100000:3.0:1746155648.591551:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126202368 00000100:00100000:3.0:1746155648.592007:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4798 00000100:00100000:3.0:1746155648.592018:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:27129:x1830976126202368:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746155648.592598:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:27129:x1830976126202368:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 579us (1403us total) trans 8589945435 rc 0/0 00000100:00100000:3.0:1746155648.592605:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4798 00000100:00100000:2.0:1746155648.595157:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.595454:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126202496 00000100:00100000:3.0:1746155648.595462:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126202496 00010000:00010000:3.0:1746155648.595495:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d46 expref: 21 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.595572:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9014 00000100:00100000:3.0:1746155648.595581:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126202496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155648.595594:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155648.595600:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d46 expref: 21 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.595611:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d46 expref: 21 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.595630:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013121f400/0x844e5faceb5f914c lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d46 expref: 21 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.595663:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155648.595669:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.595677:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.595683:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.595725:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155648.595769:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126202496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 187us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.595775:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9014 00010000:00010000:2.0:1746155648.596184:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596191:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155648.596223:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155648.596227:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155648.596243:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596251:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596266:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f9199 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596272:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f9199 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596277:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f9199 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596282:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc67400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155648.596331:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f9199 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596338:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f9199 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596346:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155648.596348:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155648.596351:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f9199 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596355:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67400/0x844e5faceb5f9199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596492:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f91a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596499:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f91a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596525:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f91a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596529:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc66400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155648.596531:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f91a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596535:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f91a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596541:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0400) 00010000:00010000:2.0:1746155648.596543:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155648.596544:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f91a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596548:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f91a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.596579:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67200/0x844e5faceb5f9192 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d69 expref: 14 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.596589:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d69 expref: 13 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.596594:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155648.596596:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155648.596598:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc67a00, rc 0) 00000100:00100000:2.0:1746155648.596627:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:32588:x1830976126202112:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 9944us (11528us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.596633:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11251 00000100:00100000:0.0:1746155648.599427:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.599469:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.599536:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126202752 00000100:00100000:3.0:1746155648.599543:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126202752 00000100:00100000:3.0:1746155648.599585:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126202624 00000100:00100000:3.0:1746155648.599588:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126202624 00000100:00100000:3.0:1746155648.599604:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17562 00000100:00100000:3.0:1746155648.599610:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126202752:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155648.599624:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.599638:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e000/0x844e5faceb5f91ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d77 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.599662:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e000/0x844e5faceb5f91ae lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d77 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.599672:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fc7e000/0x844e5faceb5f91ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d77 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.599694:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc7e000, rc 0) 00000100:00100000:3.0:1746155648.599726:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126202752:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 116us (305us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155648.599732:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17562 00000100:00100000:3.0:1746155648.599745:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17563 00000100:00100000:3.0:1746155648.599750:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126202624:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155648.599757:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.599765:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f000/0x844e5faceb5f91b5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d70 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.599777:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.599779:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.599785:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f000/0x844e5faceb5f91b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d70 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.599797:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f000/0x844e5faceb5f91b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d70 expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.599808:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc7f000, rc 0) 00000100:00100000:3.0:1746155648.599824:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126202624:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 74us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.599829:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17563 00000100:00100000:0.0:1746155648.609368:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.609439:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126203008 00000100:00100000:2.0:1746155648.609446:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126203008 00000100:00100000:2.0:1746155648.609625:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11252 00000100:00100000:2.0:1746155648.609634:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:32588:x1830976126203008:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155648.609652:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.609666:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f91bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d7e expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.609743:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.609755:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d69 expref: 14 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.609761:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.609786:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d69 expref: 14 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.609795:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d69 expref: 14 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.609804:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125459328:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.610359:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155648.611765:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125459328:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.611781:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:0.0:1746155648.614204:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.614258:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126203136 00000100:00100000:1.0:1746155648.614265:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126203136 00010000:00010000:1.0:1746155648.614292:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d69 expref: 15 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746155648.614324:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9015 00000100:00100000:1.0:1746155648.614330:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976126203136:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155648.614340:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155648.614345:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d69 expref: 15 pid: 14234 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.614355:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d69 expref: 15 pid: 14234 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.614372:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f91a7 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d69 expref: 15 pid: 14234 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.614397:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155648.614401:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.614410:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.614415:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.614431:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155648.614467:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.614474:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:3.0:1746155648.614490:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155648.615490:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f91bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d7e expref: 16 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.615541:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d7e expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.615548:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155648.615550:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155648.615553:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a82400, rc 0) 00000100:00100000:1.0:1746155648.615786:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976126203136:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1454us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.615800:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9015 00000100:00100000:3.0:1746155648.615865:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:32588:x1830976126203008:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 6223us (6495us total) trans 8589945436 rc 0/0 00000100:00100000:3.0:1746155648.615871:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11252 00000100:00100000:2.0:1746155648.617705:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.617803:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126203264 00000100:00100000:3.0:1746155648.617810:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126203264 00000100:00100000:3.0:1746155648.617847:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11253 00000100:00100000:3.0:1746155648.617853:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:32588:x1830976126203264:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155648.617879:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.617894:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5f91d1 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d85 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.617958:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.617969:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d7e expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.617975:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155648.618000:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d7e expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.618009:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d7e expref: 15 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.618019:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125459456:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155648.618075:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.619668:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.619735:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125459456:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155648.619752:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155648.620234:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126203392 00000100:00100000:1.0:1746155648.620239:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126203392 00010000:00010000:1.0:1746155648.620258:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d7e expref: 16 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746155648.620604:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9016 00000100:00100000:1.0:1746155648.620611:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1963:x1830976126203392:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155648.620621:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155648.620626:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d7e expref: 16 pid: 14234 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.620634:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d7e expref: 16 pid: 14234 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.620650:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f91c3 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d7e expref: 16 pid: 14234 timeout: 877 lvb_type: 0 00010000:00010000:1.0:1746155648.620670:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155648.620673:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.620680:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.620685:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155648.620698:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155648.620724:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1963:x1830976126203392:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 114us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.620730:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9016 00010000:00010000:2.0:1746155648.620871:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.620877:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155648.620908:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155648.620912:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155648.620923:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.620948:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f38c00/0x844e5faceb5f91d1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d85 expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.621195:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d85 expref: 14 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.621203:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155648.621205:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155648.621207:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3f39400, rc 0) 00000100:00100000:2.0:1746155648.621398:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:32588:x1830976126203264:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3545us (3698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.621404:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11253 00000100:00100000:2.0:1746155648.625707:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.625803:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126203520 00000100:00100000:0.0:1746155648.625811:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126203520 00000100:00100000:0.0:1746155648.625845:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17564 00000100:00100000:0.0:1746155648.625851:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126203520:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155648.625878:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155648.625891:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5600/0x844e5faceb5f91df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d8c expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.625917:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5600/0x844e5faceb5f91df lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d8c expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155648.625926:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5600/0x844e5faceb5f91df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d8c expref: 9 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155648.625952:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2a5600, rc 0) 00000100:00100000:0.0:1746155648.626070:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126203520:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 218us (370us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155648.626076:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17564 00000100:00100000:0.0:1746155648.631887:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.633511:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126203776 00000100:00100000:2.0:1746155648.633521:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126203776 00000100:00100000:2.0:1746155648.633566:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11254 00000100:00100000:2.0:1746155648.633573:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:32588:x1830976126203776:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155648.633590:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.633605:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82c00/0x844e5faceb5f91e6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d93 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.633682:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82e00/0x844e5faceb5f91ed lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.633695:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82e00/0x844e5faceb5f91ed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.633703:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82e00/0x844e5faceb5f91ed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.633712:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82e00/0x844e5faceb5f91ed lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.633717:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82e00/0x844e5faceb5f91ed lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.633722:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82e00/0x844e5faceb5f91ed lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.633727:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a82e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155648.633730:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82e00/0x844e5faceb5f91ed lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.633735:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82e00/0x844e5faceb5f91ed lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.633743:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155648.633745:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155648.633748:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82e00/0x844e5faceb5f91ed lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.633752:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82e00/0x844e5faceb5f91ed lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.634692:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82c00/0x844e5faceb5f91e6 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d93 expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.634704:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82c00/0x844e5faceb5f91e6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d93 expref: 15 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.634714:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a82c00, rc 0) 00000100:00100000:2.0:1746155648.635661:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:32588:x1830976126203776:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2082us (3802us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155648.635671:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11254 00000100:00100000:0.0:1746155648.636814:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.636976:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126204032 00000100:00100000:2.0:1746155648.636982:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126204032 00000100:00100000:2.0:1746155648.637008:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11255 00000100:00100000:2.0:1746155648.637012:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+296:32591:x1830976126204032:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.637028:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.637041:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a83000/0x844e5faceb5f91f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18d9a expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.637111:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f91fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637121:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f91fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637129:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f91fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637138:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f9202 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637143:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f9202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637151:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f9202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637222:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f9209 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637228:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f9209 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637233:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f9209 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155648.637239:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155648.637302:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f91fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637307:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f91fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637312:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f91fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637316:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a82a00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155648.637319:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f91fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637324:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f91fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637332:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155648.637334:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155648.637337:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f91fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637344:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82a00/0x844e5faceb5f91fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637355:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f9202 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637359:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f9202 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637363:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f9202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637367:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a82400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155648.637369:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f9202 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637372:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f9202 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637377:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51300) 00010000:00010000:2.0:1746155648.637378:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155648.637380:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f9202 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637383:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82400/0x844e5faceb5f9202 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.637411:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a83000/0x844e5faceb5f91f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d9a expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.637421:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f9209 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d9a expref: 298 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.637431:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155648.637432:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155648.637434:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a82600, rc 0) 00000100:00100000:2.0:1746155648.637480:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:32591:x1830976126204032:12345-192.168.202.51@tcp:101:cat.0 Request processed in 466us (667us total) trans 8589945437 rc 0/0 00000100:00100000:2.0:1746155648.637486:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11255 00000100:00100000:0.0:1746155648.640094:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.640139:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.640314:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126204288 00000100:00100000:2.0:1746155648.640322:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126204288 00000100:00100000:2.0:1746155648.640358:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126204544 00000100:00100000:2.0:1746155648.640360:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126204544 00000100:00100000:3.0:1746155648.640362:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4799 00000100:00100000:3.0:1746155648.640371:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:32588:x1830976126204288:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:2.0:1746155648.640374:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4800 00000100:00100000:2.0:1746155648.640378:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea56450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+298:32591:x1830976126204544:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:0.0:1746155648.640733:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:32588:x1830976126204288:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 363us (643us total) trans 8589945439 rc 0/0 00000100:00100000:0.0:1746155648.640740:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4799 00000100:00100000:2.0:1746155648.640741:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea56450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:32591:x1830976126204544:12345-192.168.202.51@tcp:35:cat.0 Request processed in 363us (602us total) trans 8589945438 rc 0/0 00000100:00100000:2.0:1746155648.640746:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4800 00000100:00100000:0.0:1746155648.643102:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.643148:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126204672 00000100:00100000:2.0:1746155648.643155:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126204672 00000100:00100000:2.0:1746155648.643193:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17565 00000100:00100000:2.0:1746155648.643200:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976126204672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.643212:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.643224:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83a00/0x844e5faceb5f9217 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18da1 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.643248:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83a00/0x844e5faceb5f9217 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da1 expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.643262:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83a00/0x844e5faceb5f9217 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da1 expref: 18 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.643269:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a83a00, rc 0) 00000100:00100000:2.0:1746155648.643345:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976126204672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 144us (247us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155648.643350:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17565 00000100:00100000:0.0:1746155648.652550:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.653559:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126204800 00000100:00100000:0.0:1746155648.653566:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126204800 00000100:00100000:1.0:1746155648.653674:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17566 00000100:00100000:1.0:1746155648.653681:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:32584:x1830976126204800:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155648.653695:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155648.653709:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18da8 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.653736:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c046e00/0x844e5faceb5f8f85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c12 expref: 18 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155648.653745:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f9018 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c7b expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155648.653751:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8fc4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c4a expref: 7 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155648.653757:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.653759:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.653762:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1437696->2097151] (req 1437696->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 18 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.653788:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8fc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c4a expref: 7 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155648.653799:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8fc4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c4a expref: 7 pid: 20200 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746155648.653809:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125459584:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155648.654752:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f9018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c7b expref: 10 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155648.654761:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f9018 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c7b expref: 10 pid: 8437 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746155648.654768:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125459712:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155648.654849:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c046e00/0x844e5faceb5f8f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c12 expref: 18 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155648.654870:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c046e00/0x844e5faceb5f8f85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c12 expref: 18 pid: 20796 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746155648.654878:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125459840:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155648.654896:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5010c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.656056:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.656215:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125459584:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155648.656223:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125459712:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155648.656229:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125459840:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155648.656246:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1437696->2097151] (req 1437696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 18 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.656263:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c70a00, rc 0) 00000100:00100000:1.0:1746155648.656302:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:32584:x1830976126204800:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2620us (3757us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.656310:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17566 00000100:00100000:3.0:1746155648.656382:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126205056 00000100:00100000:3.0:1746155648.656388:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126205056 00002000:00100000:3.0:1746155648.656425:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009283ce00 x1830976126205056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.656432:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009283ce00 with x1830976126205056 ext(2097152->3145727) 00002000:00010000:3.0:1746155648.656436:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009283ce00 00000100:00100000:3.0:1746155648.656460:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8359 00000100:00100000:3.0:1746155648.656467:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126205056:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155648.657750:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.657921:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.657977:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.658104:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126205312 00000100:00100000:1.0:1746155648.658109:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126205312 00010000:00010000:1.0:1746155648.658131:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f9018 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c7b expref: 11 pid: 8437 timeout: 877 lvb_type: 1 00000100:00100000:3.0:1746155648.658152:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126205440 00000100:00100000:1.0:1746155648.658152:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126205184 00000100:00100000:1.0:1746155648.658154:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126205184 00000100:00100000:3.0:1746155648.658156:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126205440 00010000:00010000:1.0:1746155648.658163:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8fc4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c4a expref: 8 pid: 20200 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746155648.658170:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c046e00/0x844e5faceb5f8f85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c12 expref: 18 pid: 20796 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746155648.658185:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9017 00000100:00100000:1.0:1746155648.658190:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126205312:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155648.658195:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9018 00010000:00010000:1.0:1746155648.658200:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746155648.658201:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126205184:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155648.658207:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155648.658215:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8fc4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c4a expref: 8 pid: 20200 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746155648.658215:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f9018 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c7b expref: 11 pid: 8437 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746155648.658224:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8fc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c4a expref: 8 pid: 20200 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746155648.658257:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9019 00000100:00100000:2.0:1746155648.658262:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d75a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976126205440:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155648.658267:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155648.658409:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f9018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c7b expref: 11 pid: 8437 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746155648.658493:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c046e00/0x844e5faceb5f8f85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c12 expref: 18 pid: 20796 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746155648.658516:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c046e00/0x844e5faceb5f8f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c12 expref: 18 pid: 20796 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746155648.658533:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c046e00/0x844e5faceb5f8f85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c12 expref: 18 pid: 20796 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746155648.658546:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155648.658565:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d75a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976126205440:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 303us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.658573:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9019 00010000:00010000:3.0:1746155648.658637:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f847a00/0x844e5faceb5f8fc4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c4a expref: 8 pid: 20200 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746155648.658648:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155648.658662:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126205184:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 462us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.658667:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9018 00010000:00010000:1.0:1746155648.659063:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009fa1f600/0x844e5faceb5f9018 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c7b expref: 11 pid: 8437 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746155648.659094:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.659096:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.659101:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.659109:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.659135:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 16 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155648.659145:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125459968:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155648.659208:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5010c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155648.663412:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126205056:12345-192.168.202.51@tcp:3:cat.0 Request processed in 6938us (7350us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155648.663422:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8359 00002000:00100000:3.0:1746155648.663436:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009283ce00 x1830976126205056/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.663445:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009283ce00 with x1830976126205056 ext(2097152->3145727) 00002000:00010000:3.0:1746155648.663450:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009283ce00 00000100:00100000:1.0:1746155648.663705:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125459968:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155648.663721:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155648.663744:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126205312:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5553us (5998us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.663752:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9017 00000100:00100000:0.0:1746155648.663969:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.664023:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126205696 00000100:00100000:3.0:1746155648.664029:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126205696 00002000:00100000:3.0:1746155648.664053:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1437696->1441791) req@ffff88009283d500 x1830976126205696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.664060:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009283d500 with x1830976126205696 ext(1437696->1441791) 00002000:00010000:3.0:1746155648.664063:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009283d500 00000100:00100000:3.0:1746155648.664090:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8360 00000100:00100000:3.0:1746155648.664097:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976126205696:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155648.664347:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976126205696:12345-192.168.202.51@tcp:3:cat.0 Request processed in 249us (377us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155648.664353:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8360 00002000:00100000:3.0:1746155648.664359:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1437696->1441791) req@ffff88009283d500 x1830976126205696/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/4536 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.664441:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009283d500 with x1830976126205696 ext(1437696->1441791) 00002000:00010000:3.0:1746155648.664444:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009283d500 00000100:00100000:0.0:1746155648.667438:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.667611:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126205824 00000100:00100000:1.0:1746155648.667619:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126205824 00000100:00100000:1.0:1746155648.667651:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17567 00000100:00100000:1.0:1746155648.667659:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:32591:x1830976126205824:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155648.667674:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155648.667688:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c70c00/0x844e5faceb5f9225 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18daf expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.667718:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.667724:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155648.667726:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155648.667729:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c70c00/0x844e5faceb5f9225 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18daf expref: 18 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.667753:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 9 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.667764:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 9 pid: 10591 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746155648.667774:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125460096:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155648.668350:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.672306:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.672366:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126205952 00000100:00100000:2.0:1746155648.672376:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126205952 00000100:00100000:2.0:1746155648.672426:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17568 00000100:00100000:0.0:1746155648.672426:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.672429:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125460096:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.672437:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32584:x1830976126205952:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155648.672451:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155648.672452:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c70c00/0x844e5faceb5f9225 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18daf expref: 18 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.672464:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18db6 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.672466:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c70c00, rc 0) 00000100:00100000:3.0:1746155648.672467:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126206080 00000100:00100000:3.0:1746155648.672471:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126206080 00010000:00010000:2.0:1746155648.672484:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f8f8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c19 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746155648.672492:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2297856->2629631) req@ffff88009283df80 x1830976126206080/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746155648.672492:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a62a5800/0x844e5faceb5f901f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c82 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.672499:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa1e000/0x844e5faceb5f8fd2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c51 expref: 7 pid: 18270 timeout: 0 lvb_type: 1 00002000:00100000:3.0:1746155648.672520:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009283df80 with x1830976126206080 ext(2297856->2629631) 00010000:00010000:2.0:1746155648.672522:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.672524:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.672526:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 10 pid: 10591 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746155648.672526:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:32591:x1830976126205824:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4867us (5094us total) trans 0 rc 0/0 00010000:00010000:2.0:1746155648.672527:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1048576->1368063] (req 1048576->1368063) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.672536:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 10 pid: 10591 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746155648.672540:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17567 00002000:00010000:3.0:1746155648.672546:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009283df80 00000100:00100000:3.0:1746155648.672559:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1471 00000100:00100000:3.0:1746155648.672564:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126206080:12345-192.168.202.51@tcp:4:cat.0 00010000:00010000:2.0:1746155648.672629:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa1e000/0x844e5faceb5f8fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c51 expref: 7 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.672639:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa1e000/0x844e5faceb5f8fd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c51 expref: 7 pid: 18270 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746155648.672650:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125460224:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.672698:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a62a5800/0x844e5faceb5f901f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c82 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.672705:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a62a5800/0x844e5faceb5f901f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c82 expref: 11 pid: 8436 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746155648.672713:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125460352:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.672731:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f8f8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c19 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.672797:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f8f8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c19 expref: 23 pid: 8437 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746155648.672804:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125460480:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.672844:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338600 going to sleep for 11 seconds 00000100:00100000:2.0:1746155648.677484:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d71c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125460224:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.677497:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125460352:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.677526:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125460480:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.677550:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [1048576->1368063] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.677569:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a83c00, rc 0) 00000100:00100000:2.0:1746155648.677611:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32584:x1830976126205952:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5171us (5306us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.677618:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17568 00000100:00100000:3.0:1746155648.680161:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126206080:12345-192.168.202.51@tcp:4:cat.0 Request processed in 7589us (7727us total) trans 21474841713 rc 0/0 00000100:00100000:3.0:1746155648.680170:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1471 00002000:00100000:3.0:1746155648.680178:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2297856->2629631) req@ffff88009283df80 x1830976126206080/t21474841713(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/448 e 0 to 0 dl 1746155659 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.680186:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009283df80 with x1830976126206080 ext(2297856->2629631) 00010000:00010000:3.0:1746155648.680195:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 12 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.680205:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 12 pid: 10591 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746155648.680211:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009283df80 00000100:00100000:0.0:1746155648.680555:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.680583:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.680609:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.680709:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126206336 00000100:00100000:1.0:1746155648.680715:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126206336 00010000:00010000:1.0:1746155648.680738:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a62a5800/0x844e5faceb5f901f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c82 expref: 12 pid: 8436 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746155648.680753:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126206208 00000100:00100000:1.0:1746155648.680756:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126206208 00010000:00010000:1.0:1746155648.680764:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa1e000/0x844e5faceb5f8fd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c51 expref: 8 pid: 18270 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746155648.680773:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126206464 00000100:00100000:1.0:1746155648.680775:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126206464 00010000:00010000:1.0:1746155648.680782:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f8f8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c19 expref: 23 pid: 8437 timeout: 877 lvb_type: 1 00000100:00100000:1.0:1746155648.680793:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9020 00000100:00100000:1.0:1746155648.680798:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976126206336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746155648.680840:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9021 00000100:00100000:3.0:1746155648.680847:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126206208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155648.680865:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155648.680883:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa1e000/0x844e5faceb5f8fd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c51 expref: 8 pid: 18270 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746155648.680892:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa1e000/0x844e5faceb5f8fd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c51 expref: 8 pid: 18270 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746155648.680911:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa1e000/0x844e5faceb5f8fd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c51 expref: 8 pid: 18270 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746155648.680927:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155648.680947:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126206208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 100us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.680952:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9021 00000100:00100000:3.0:1746155648.680964:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9022 00000100:00100000:3.0:1746155648.680968:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126206464:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155648.680974:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155648.680981:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f8f8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c19 expref: 23 pid: 8437 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746155648.680988:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f8f8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c19 expref: 23 pid: 8437 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746155648.680998:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd28400/0x844e5faceb5f8f8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c19 expref: 23 pid: 8437 timeout: 877 lvb_type: 1 00010000:00010000:3.0:1746155648.681005:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155648.681019:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126206464:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 50us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.681023:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9022 00010000:00010000:1.0:1746155648.681079:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155648.681089:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a62a5800/0x844e5faceb5f901f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c82 expref: 12 pid: 8436 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746155648.681097:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a62a5800/0x844e5faceb5f901f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c82 expref: 12 pid: 8436 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746155648.681108:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a62a5800/0x844e5faceb5f901f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c82 expref: 12 pid: 8436 timeout: 877 lvb_type: 1 00010000:00010000:1.0:1746155648.681131:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.681132:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.681139:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.681146:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.681171:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155648.681180:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125460608:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155648.681995:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501900 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.682492:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.682703:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126206592 00000100:00100000:2.0:1746155648.682708:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126206592 00010000:00010000:2.0:1746155648.682729:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 12 pid: 10591 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.682760:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9023 00000100:00100000:2.0:1746155648.682767:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1963:x1830976126206592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155648.682775:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746155648.682786:0:7064:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155648 -> 1746155649 00002000:00010000:2.0:1746155648.682789:0:7064:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155648 -> 1746155649 00010000:00010000:2.0:1746155648.682793:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 12 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.682802:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 12 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.682817:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a83e00/0x844e5faceb5f917d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2297856->3145727] (req 2297856->2629631) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d54 expref: 12 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.682992:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.682994:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.683000:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c70c00/0x844e5faceb5f9225 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18daf expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.683008:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c70c00/0x844e5faceb5f9225 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18daf expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.683031:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c70c00/0x844e5faceb5f9225 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18daf expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155648.683040:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125460736:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155648.683425:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338600 going to sleep for 11 seconds 00000100:00100000:1.0:1746155648.688283:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125460608:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155648.688301:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155648.688339:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126206336:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7540us (7783us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.688348:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9020 00000100:00100000:3.0:1746155648.688427:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125460736:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155648.688441:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155648.688464:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.688480:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1963:x1830976126206592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5712us (5988us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.688487:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9023 00000100:00100000:3.0:1746155648.688684:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126207104 00000100:00100000:3.0:1746155648.688690:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126207104 00002000:00100000:3.0:1746155648.688719:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a0d73b80 x1830976126207104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.688728:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d73b80 with x1830976126207104 ext(2097152->3145727) 00002000:00010000:3.0:1746155648.688732:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d73b80 00000100:00100000:3.0:1746155648.688758:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8361 00000100:00100000:3.0:1746155648.688765:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976126207104:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155648.692578:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.693573:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126206848 00000100:00100000:1.0:1746155648.693581:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126206848 00002000:00100000:1.0:1746155648.693617:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1363968->1368063) req@ffff8800a0d71c00 x1830976126206848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.693626:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d71c00 with x1830976126206848 ext(1363968->1368063) 00002000:00010000:1.0:1746155648.693632:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d71c00 00000100:00100000:1.0:1746155648.693655:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8362 00000100:00100000:1.0:1746155648.693662:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126206848:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155648.693803:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126206848:12345-192.168.202.51@tcp:3:cat.0 Request processed in 141us (1385us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155648.693812:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8362 00002000:00100000:1.0:1746155648.693818:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1363968->1368063) req@ffff8800a0d71c00 x1830976126206848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/4536 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.693824:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d71c00 with x1830976126206848 ext(1363968->1368063) 00002000:00010000:1.0:1746155648.693827:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0d71c00 00000100:00100000:0.0:1746155648.696089:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.696139:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126207360 00000100:00100000:2.0:1746155648.696145:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126207360 00000100:00100000:2.0:1746155648.696175:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4801 00000100:00100000:2.0:1746155648.696181:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:32584:x1830976126207360:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155648.696384:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:32584:x1830976126207360:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 202us (298us total) trans 8589945440 rc 0/0 00000100:00100000:2.0:1746155648.696390:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4801 00000100:00100000:3.0:1746155648.696469:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976126207104:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7704us (8005us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155648.696476:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8361 00002000:00100000:3.0:1746155648.696484:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a0d73b80 x1830976126207104/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.696492:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d73b80 with x1830976126207104 ext(2097152->3145727) 00002000:00010000:3.0:1746155648.696496:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d73b80 00000100:00100000:0.0:1746155648.758319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.758418:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126207616 00000100:00100000:2.0:1746155648.758426:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126207616 00000100:00100000:2.0:1746155648.762211:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11256 00000100:00100000:2.0:1746155648.762225:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32597:x1830976126207616:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.762245:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.762259:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e800/0x844e5faceb5f9233 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18dbd expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.762340:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f923a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762350:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f923a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762359:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f923a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762369:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f9241 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762374:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f9241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762380:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f9241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762458:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e600/0x844e5faceb5f9248 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762466:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e600/0x844e5faceb5f9248 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762472:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e600/0x844e5faceb5f9248 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155648.762479:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155648.762554:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f923a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762561:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f923a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762569:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f923a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762574:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5f200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155648.762577:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f923a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762582:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f923a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762591:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155648.762593:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155648.762597:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f923a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762601:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5f200/0x844e5faceb5f923a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762620:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f9241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762625:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f9241 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762629:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f9241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762632:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cb5e200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155648.762634:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f9241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762638:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f9241 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762646:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51b00) 00010000:00010000:2.0:1746155648.762648:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155648.762651:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f9241 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762655:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e200/0x844e5faceb5f9241 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155648.762682:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e800/0x844e5faceb5f9233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dbd expref: 23 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.762691:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e600/0x844e5faceb5f9248 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dbd expref: 22 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.762697:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155648.762699:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155648.762701:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5e600, rc 0) 00000100:00100000:2.0:1746155648.762742:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32597:x1830976126207616:12345-192.168.202.51@tcp:101:cat.0 Request processed in 523us (4430us total) trans 8589945441 rc 0/0 00000100:00100000:2.0:1746155648.762747:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11256 00000100:00100000:0.0:1746155648.770538:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.770715:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126207872 00000100:00100000:2.0:1746155648.770723:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126207872 00000100:00100000:2.0:1746155648.770779:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4802 00000100:00100000:2.0:1746155648.770786:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:32597:x1830976126207872:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155648.770991:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:32597:x1830976126207872:12345-192.168.202.51@tcp:35:cat.0 Request processed in 205us (494us total) trans 8589945442 rc 0/0 00000100:00100000:2.0:1746155648.770998:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4802 00000100:00100000:0.0:1746155648.773064:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.773098:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.773112:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.773231:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.773295:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126208128 00000100:00100000:3.0:1746155648.773301:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126208128 00000100:00100000:3.0:1746155648.773334:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11257 00000100:00100000:3.0:1746155648.773340:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:32599:x1830976126208128:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155648.773355:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.773369:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f9256 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18dc4 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155648.773424:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126208256 00000100:00100000:2.0:1746155648.773427:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126208256 00010000:00010000:3.0:1746155648.773437:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155648.773446:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126208384 00010000:00010000:3.0:1746155648.773448:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d85 expref: 14 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155648.773448:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126208384 00010000:00010000:3.0:1746155648.773455:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f9209 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d9a expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155648.773456:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126208512 00000100:00100000:2.0:1746155648.773458:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126208512 00010000:00010000:3.0:1746155648.773461:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e600/0x844e5faceb5f9248 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dbd expref: 24 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.773467:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155648.773468:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17569 00000100:00100000:2.0:1746155648.773473:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126208256:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.773485:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.773490:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e600/0x844e5faceb5f9248 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dbd expref: 24 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.773493:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f9264 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18dcb expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.773498:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e600/0x844e5faceb5f9248 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dbd expref: 24 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.773527:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125460864:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.773539:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125460992:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155648.773582:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f9209 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d9a expref: 299 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.773589:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f9209 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d9a expref: 299 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.773600:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125461120:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.774025:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338600 going to sleep for 11 seconds 00010000:00010000:3.0:1746155648.774031:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d85 expref: 14 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.774038:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d85 expref: 14 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.774041:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17570 00000100:00100000:3.0:1746155648.774044:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125461248:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.774046:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126208384:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.774052:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746155648.774055:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949000 going to sleep for 11 seconds 00010000:00010000:2.0:1746155648.774060:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb5fc00/0x844e5faceb5f926b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18dd2 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155648.774070:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17571 00000100:00100000:3.0:1746155648.774075:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126208512:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155648.774080:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155648.774080:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125461376:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155648.774086:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f9272 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18dd9 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.774094:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.774096:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746155648.774097:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746155648.774102:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f9272 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dd9 expref: 14 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.774112:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f9272 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dd9 expref: 14 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155648.774120:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d593000, rc 0) 00000100:00100000:3.0:1746155648.774135:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126208512:12345-192.168.202.51@tcp:101:cat.0 Request processed in 61us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155648.774140:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17571 00000100:00100000:0.0:1746155648.775805:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.775817:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.775847:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.775875:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126208640 00000100:00100000:0.0:1746155648.775880:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126208640 00010000:00010000:0.0:1746155648.775899:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e600/0x844e5faceb5f9248 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dbd expref: 25 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746155648.775914:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126208768 00000100:00100000:0.0:1746155648.775916:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126208768 00010000:00010000:0.0:1746155648.775923:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f9209 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d9a expref: 300 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746155648.775933:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126208896 00000100:00100000:0.0:1746155648.775934:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126208896 00010000:00010000:0.0:1746155648.775941:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d85 expref: 15 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746155648.775953:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9024 00000100:00100000:0.0:1746155648.775959:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0954380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976126208640:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155648.775967:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155648.775972:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e600/0x844e5faceb5f9248 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dbd expref: 25 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746155648.775979:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e600/0x844e5faceb5f9248 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dbd expref: 25 pid: 20364 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746155648.775994:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155648.775998:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155648.776004:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155648.776011:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155648.776034:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0954380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1960:x1830976126208640:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155648.776039:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9024 00000100:00100000:0.0:1746155648.776051:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9025 00000100:00100000:0.0:1746155648.776056:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0954700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1961:x1830976126208768:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155648.776062:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155648.776065:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f9209 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d9a expref: 300 pid: 14234 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746155648.776072:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f9209 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d9a expref: 300 pid: 14234 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746155648.776081:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155648.776084:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155648.776088:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155648.776092:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155648.776107:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0954700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1961:x1830976126208768:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 51us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155648.776111:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9025 00000100:00100000:0.0:1746155648.776118:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9026 00000100:00100000:0.0:1746155648.776122:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d759450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976126208896:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155648.776128:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155648.776131:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d85 expref: 15 pid: 14234 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746155648.776138:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d85 expref: 15 pid: 14234 timeout: 877 lvb_type: 0 00010000:00010000:0.0:1746155648.776146:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155648.776149:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155648.776154:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155648.776159:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155648.776170:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155648.776178:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d759450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1961:x1830976126208896:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 56us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155648.776182:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9026 00002000:00010000:2.0:1746155648.776425:0:1625:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime: 1746155648 -> 1746155649 00002000:00010000:2.0:1746155648.776428:0:1625:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime: 1746155648 -> 1746155649 00002000:00010000:2.0:1746155648.776429:0:1625:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime: 1746155648 -> 1746155649 00000100:00100000:2.0:1746155648.776443:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125461376:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155648.776458:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5fc00/0x844e5faceb5f926b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dd2 expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.776467:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5fc00/0x844e5faceb5f926b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dd2 expref: 12 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.776475:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5fc00, rc 0) 00000100:00100000:2.0:1746155648.776489:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126208384:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2444us (3376us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155648.776494:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17570 00002000:00010000:2.0:1746155648.776536:0:10591:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime: 1746155648 -> 1746155649 00002000:00010000:2.0:1746155648.776538:0:10591:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime: 1746155647 -> 1746155649 00002000:00010000:2.0:1746155648.776540:0:10591:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime: 1746155648 -> 1746155649 00000100:00100000:2.0:1746155648.776550:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125460992:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155648.776563:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f9264 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dcb expref: 13 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.776570:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5ea00/0x844e5faceb5f9264 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dcb expref: 13 pid: 10591 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.776577:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5ea00, rc 0) 00000100:00100000:2.0:1746155648.776590:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126208256:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3117us (3492us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155648.776595:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17569 00010000:00010000:3.0:1746155648.776744:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cb5e600/0x844e5faceb5f9248 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dbd expref: 24 pid: 20364 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.776756:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125460864:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155648.776764:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f9209 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d9a expref: 299 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.776774:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125461120:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155648.776781:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f91d8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d85 expref: 14 pid: 14234 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.776787:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125461248:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155648.776800:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.776806:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.776810:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155648.776824:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155648.777037:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a40600/0x844e5faceb5f9256 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dc4 expref: 25 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.777047:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dc4 expref: 24 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.777057:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155648.777059:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155648.777060:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5b9da00, rc 0) 00000100:00100000:3.0:1746155648.777081:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:32599:x1830976126208128:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3741us (4023us total) trans 8589945443 rc 0/0 00000100:00100000:3.0:1746155648.777087:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11257 00000100:00100000:0.0:1746155648.784668:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.784758:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126209024 00000100:00100000:2.0:1746155648.784765:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126209024 00000100:00100000:2.0:1746155648.784800:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17572 00000100:00100000:2.0:1746155648.784806:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32597:x1830976126209024:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.784821:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.784835:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f9280 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18de0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.784870:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.784877:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.784878:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.784881:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f9280 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de0 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.784906:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.784917:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 17 pid: 8438 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.784928:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125461504:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.785864:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155648.786426:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.788010:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126209152 00000100:00100000:0.0:1746155648.788018:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126209152 00000100:00100000:0.0:1746155648.788064:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17573 00000100:00100000:0.0:1746155648.788072:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32599:x1830976126209152:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155648.788085:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155648.788100:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18de7 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.788130:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c70c00/0x844e5faceb5f9225 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18daf expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.788139:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f9272 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dd9 expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155648.788145:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155648.788147:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155648.788150:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2273280->2408447] (req 2273280->2408447) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.788173:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f9272 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dd9 expref: 15 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155648.788182:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f9272 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dd9 expref: 15 pid: 9235 timeout: 877 lvb_type: 1 00000100:00100000:0.0:1746155648.788192:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0954700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125461632:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155648.788270:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c70c00/0x844e5faceb5f9225 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18daf expref: 17 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.788277:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c70c00/0x844e5faceb5f9225 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18daf expref: 17 pid: 8438 timeout: 877 lvb_type: 0 00000100:00100000:0.0:1746155648.788285:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0954a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125461760:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155648.788301:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77180 going to sleep for 11 seconds 00000100:00100000:2.0:1746155648.790695:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125461504:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.790720:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f9280 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de0 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.790739:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5fc00, rc 0) 00000100:00100000:2.0:1746155648.791034:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32597:x1830976126209024:12345-192.168.202.51@tcp:101:cat.0 Request processed in 6225us (6371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.791043:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17572 00000100:00100000:0.0:1746155648.791954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.792013:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126209280 00000100:00100000:3.0:1746155648.792019:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126209280 00002000:00100000:3.0:1746155648.792051:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1437696->2097151) req@ffff8800a0954e00 x1830976126209280/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.792059:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0954e00 with x1830976126209280 ext(1437696->2097151) 00010000:00010000:3.0:1746155648.792066:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 18 pid: 8438 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.792076:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 18 pid: 8438 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746155648.792083:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0954e00 00000100:00100000:3.0:1746155648.792097:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1472 00000100:00100000:3.0:1746155648.792104:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1961:x1830976126209280:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155648.792540:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0954700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125461632:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.792548:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0954a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125461760:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.792571:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2273280->2408447] (req 2273280->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.792583:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2a5800, rc 0) 00000100:00100000:2.0:1746155648.792614:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32599:x1830976126209152:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 4543us (6190us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.792619:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17573 00000100:00100000:1.0:1746155648.793121:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.793529:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126209408 00000100:00100000:2.0:1746155648.793534:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126209408 00010000:00010000:2.0:1746155648.793557:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f9272 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dd9 expref: 14 pid: 9235 timeout: 877 lvb_type: 1 00000100:00100000:2.0:1746155648.793584:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9027 00000100:00100000:2.0:1746155648.793591:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126209408:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155648.793600:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155648.793617:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f9272 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dd9 expref: 14 pid: 9235 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746155648.793626:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f9272 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dd9 expref: 14 pid: 9235 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746155648.793650:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d593000/0x844e5faceb5f9272 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dd9 expref: 14 pid: 9235 timeout: 877 lvb_type: 1 00010000:00010000:2.0:1746155648.793664:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155648.793684:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126209408:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 94us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.793690:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9027 00000100:00100000:0.0:1746155648.797313:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.797849:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126209536 00000100:00100000:3.0:1746155648.797864:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126209536 00010000:00010000:3.0:1746155648.797893:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c70c00/0x844e5faceb5f9225 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18daf expref: 20 pid: 8438 timeout: 877 lvb_type: 0 00000100:00100000:3.0:1746155648.797920:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9028 00000100:00100000:3.0:1746155648.797926:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976126209536:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155648.797937:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155648.797956:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c70c00/0x844e5faceb5f9225 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18daf expref: 20 pid: 8438 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.797965:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c70c00/0x844e5faceb5f9225 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18daf expref: 20 pid: 8438 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.797983:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c70c00/0x844e5faceb5f9225 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18daf expref: 20 pid: 8438 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.798010:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.798012:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155648.798018:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.798026:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.798052:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155648.798063:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125461888:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155648.798122:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155648.800421:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125461888:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155648.800436:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155648.800479:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126209536:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2551us (3171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.800487:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9028 00000100:00100000:0.0:1746155648.802561:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.802701:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126209792 00000100:00100000:1.0:1746155648.802708:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126209792 00002000:00100000:1.0:1746155648.802738:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (2273280->2277375) req@ffff8800a0955500 x1830976126209792/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.802747:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0955500 with x1830976126209792 ext(2273280->2277375) 00002000:00010000:1.0:1746155648.802752:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0955500 00000100:00100000:1.0:1746155648.802768:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8363 00000100:00100000:1.0:1746155648.802774:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1961:x1830976126209792:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155648.802905:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1961:x1830976126209792:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 130us (348us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155648.802910:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8363 00002000:00100000:1.0:1746155648.802915:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (2273280->2277375) req@ffff8800a0955500 x1830976126209792/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/4536 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.802922:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0955500 with x1830976126209792 ext(2273280->2277375) 00002000:00010000:1.0:1746155648.802925:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0955500 00000100:00100000:3.0:1746155648.805788:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0954e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126209280:12345-192.168.202.51@tcp:4:cat.0 Request processed in 13678us (13830us total) trans 21474841714 rc 0/0 00000100:00100000:3.0:1746155648.805798:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1472 00002000:00100000:3.0:1746155648.805807:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1437696->2097151) req@ffff8800a0954e00 x1830976126209280/t21474841714(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/448 e 0 to 0 dl 1746155659 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.805815:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0954e00 with x1830976126209280 ext(1437696->2097151) 00010000:00010000:3.0:1746155648.805823:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 19 pid: 8438 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.805834:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 19 pid: 8438 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746155648.805841:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0954e00 00000100:00100000:0.0:1746155648.807246:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.807700:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126210048 00000100:00100000:3.0:1746155648.807707:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126210048 00002000:00100000:3.0:1746155648.807745:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2404352->2408447) req@ffff8800a0955880 x1830976126210048/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.807752:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0955880 with x1830976126210048 ext(2404352->2408447) 00002000:00010000:3.0:1746155648.807756:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0955880 00000100:00100000:3.0:1746155648.807996:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8364 00000100:00100000:3.0:1746155648.808004:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1963:x1830976126210048:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155648.808136:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1963:x1830976126210048:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 132us (893us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155648.808142:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8364 00002000:00100000:3.0:1746155648.808147:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2404352->2408447) req@ffff8800a0955880 x1830976126210048/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/4536 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.808154:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0955880 with x1830976126210048 ext(2404352->2408447) 00002000:00010000:3.0:1746155648.808156:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0955880 00000100:00100000:0.0:1746155648.810381:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.810456:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126210176 00000100:00100000:2.0:1746155648.810462:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126210176 00010000:00010000:2.0:1746155648.810486:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 19 pid: 8438 timeout: 877 lvb_type: 0 00000100:00100000:2.0:1746155648.810522:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9029 00000100:00100000:2.0:1746155648.810527:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0955c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976126210176:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155648.810537:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155648.810553:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 19 pid: 8438 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.810562:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 19 pid: 8438 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.810579:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c70a00/0x844e5faceb5f921e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1437696->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18da8 expref: 19 pid: 8438 timeout: 877 lvb_type: 0 00010000:00010000:2.0:1746155648.811167:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.811170:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.811176:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f9280 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de0 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.811183:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f9280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de0 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.811210:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f9280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de0 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155648.811221:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125462016:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155648.811286:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155648.815902:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125462016:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155648.815921:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155648.815966:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0955c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976126210176:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5437us (5588us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.815975:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9029 00000100:00100000:0.0:1746155648.817879:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.818201:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126210432 00000100:00100000:1.0:1746155648.818208:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126210432 00002000:00100000:1.0:1746155648.818239:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a0955f80 x1830976126210432/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.818248:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0955f80 with x1830976126210432 ext(1048576->2097151) 00002000:00010000:1.0:1746155648.818252:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0955f80 00000100:00100000:1.0:1746155648.818281:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8365 00000100:00100000:1.0:1746155648.818287:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1961:x1830976126210432:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155648.834178:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0955f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1961:x1830976126210432:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 15882us (16293us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155648.834189:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8365 00002000:00100000:2.0:1746155648.834200:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a0955f80 x1830976126210432/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.834208:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0955f80 with x1830976126210432 ext(1048576->2097151) 00002000:00010000:2.0:1746155648.834213:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0955f80 00000100:00100000:0.0:1746155648.837062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.837159:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126210560 00000100:00100000:2.0:1746155648.837166:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126210560 00000100:00100000:2.0:1746155648.837200:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17574 00000100:00100000:2.0:1746155648.837206:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1963:x1830976126210560:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.837219:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.837232:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f928e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18dee expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.837252:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.837254:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.837261:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f928e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dee expref: 19 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.837273:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f928e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dee expref: 19 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155648.837282:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5f400, rc 0) 00000100:00100000:2.0:1746155648.837329:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976126210560:12345-192.168.202.51@tcp:101:cat.0 Request processed in 123us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.837335:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17574 00000100:00100000:0.0:1746155648.842381:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.843145:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.843175:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126210688 00000100:00100000:0.0:1746155648.843181:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126210688 00000100:00100000:1.0:1746155648.843224:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126210816 00000100:00100000:1.0:1746155648.843229:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126210816 00000100:00100000:0.0:1746155648.843237:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17575 00000100:00100000:0.0:1746155648.843244:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32597:x1830976126210688:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:1.0:1746155648.843250:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17576 00000100:00100000:1.0:1746155648.843256:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976126210816:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155648.843258:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155648.843263:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155648.843272:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c70e00/0x844e5faceb5f929c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18dfc expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.843272:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f9295 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18df5 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.843293:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.843295:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c70e00/0x844e5faceb5f929c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dfc expref: 20 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155648.843300:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155648.843301:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155648.843303:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c70e00/0x844e5faceb5f929c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dfc expref: 20 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155648.843305:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f9295 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18df5 expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.843309:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c70e00, rc 0) 00010000:00010000:0.0:1746155648.843329:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155648.843344:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 21 pid: 10591 timeout: 877 lvb_type: 0 00000100:00100000:1.0:1746155648.843345:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976126210816:12345-192.168.202.51@tcp:101:cat.0 Request processed in 89us (201us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155648.843351:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17576 00000100:00100000:0.0:1746155648.843354:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0956d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125462144:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155648.843401:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.847380:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.849146:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0956d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125462144:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.849172:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f9295 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18df5 expref: 12 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.849187:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc66400, rc 0) 00000100:00100000:2.0:1746155648.849235:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0956680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32597:x1830976126210688:12345-192.168.202.51@tcp:101:cat.0 Request processed in 5991us (6861us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.849243:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17575 00000100:00100000:3.0:1746155648.849554:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126210944 00000100:00100000:3.0:1746155648.849559:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126210944 00002000:00100000:3.0:1746155648.849587:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1368063) req@ffff8800a0957100 x1830976126210944/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.849596:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0957100 with x1830976126210944 ext(1048576->1368063) 00010000:00010000:3.0:1746155648.849602:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 22 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.849612:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 22 pid: 10591 timeout: 877 lvb_type: 0 00002000:00010000:3.0:1746155648.849618:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0957100 00000100:00100000:3.0:1746155648.849641:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1473 00000100:00100000:3.0:1746155648.849646:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126210944:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155648.855959:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.855984:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126211200 00000100:00100000:0.0:1746155648.855991:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126211200 00002000:00100000:0.0:1746155648.856023:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a0957480 x1830976126211200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155648.856032:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0957480 with x1830976126211200 ext(1048576->2097151) 00002000:00010000:0.0:1746155648.856036:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0957480 00000100:00100000:0.0:1746155648.856054:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8366 00000100:00100000:0.0:1746155648.856061:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976126211200:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155648.859985:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126210944:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10330us (12605us total) trans 17179874414 rc 0/0 00000100:00100000:3.0:1746155648.859994:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1473 00002000:00100000:3.0:1746155648.860003:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->1368063) req@ffff8800a0957100 x1830976126210944/t17179874414(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/448 e 0 to 0 dl 1746155659 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.860012:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0957100 with x1830976126210944 ext(1048576->1368063) 00010000:00010000:3.0:1746155648.860020:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 24 pid: 10591 timeout: 877 lvb_type: 0 00010000:00010000:3.0:1746155648.860032:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 24 pid: 10591 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746155648.860039:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0957100 00000100:00100000:1.0:1746155648.868707:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976126211200:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12639us (12748us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155648.868721:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8366 00002000:00100000:1.0:1746155648.868730:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8800a0957480 x1830976126211200/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.868739:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0957480 with x1830976126211200 ext(1048576->2097151) 00002000:00010000:1.0:1746155648.868745:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0957480 00000100:00100000:0.0:1746155648.871569:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.871646:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126211328 00000100:00100000:2.0:1746155648.871653:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126211328 00010000:00010000:2.0:1746155648.871681:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 24 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155648.871708:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9030 00000100:00100000:2.0:1746155648.871714:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0957800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126211328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155648.871725:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155648.871742:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 24 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155648.871752:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 24 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155648.871771:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a83c00/0x844e5faceb5f922c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1368063) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18db6 expref: 24 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155648.871797:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.871803:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.871808:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f9295 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18df5 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.871816:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f9295 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18df5 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.871844:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f9295 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18df5 expref: 11 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155648.871999:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125462272:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155648.872075:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155648.874627:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.874718:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126211456 00000100:00100000:2.0:1746155648.874724:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126211456 00000100:00100000:2.0:1746155648.874764:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17577 00000100:00100000:2.0:1746155648.874771:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32603:x1830976126211456:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.874785:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.874800:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f92a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e03 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.874818:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.874820:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155648.874825:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f92a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e03 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.874837:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f92a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e03 expref: 25 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.874846:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cb5ec00, rc 0) 00000100:00100000:2.0:1746155648.874895:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32603:x1830976126211456:12345-192.168.202.51@tcp:101:cat.0 Request processed in 124us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.874900:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17577 00000100:00100000:0.0:1746155648.877626:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.877719:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126211712 00000100:00100000:2.0:1746155648.877721:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125462272:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155648.877724:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126211712 00010000:00010000:2.0:1746155648.877737:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746155648.877753:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800a0956d80 x1830976126211712/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746155648.877765:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0957800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126211328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 6052us (6203us total) trans 0 rc 0/0 00002000:00100000:1.0:1746155648.877766:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0956d80 with x1830976126211712 ext(1048576->2097151) 00002000:00010000:1.0:1746155648.877770:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0956d80 00000100:00100000:2.0:1746155648.877773:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9030 00000100:00100000:1.0:1746155648.877791:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8367 00000100:00100000:1.0:1746155648.877797:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126211712:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155648.881632:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.881710:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126211968 00000100:00100000:3.0:1746155648.881718:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126211968 00002000:00100000:3.0:1746155648.881756:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800a0954a80 x1830976126211968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.881765:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0954a80 with x1830976126211968 ext(1048576->2097151) 00002000:00010000:3.0:1746155648.881770:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0954a80 00000100:00100000:3.0:1746155648.881837:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8368 00000100:00100000:3.0:1746155648.881844:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976126211968:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155648.886922:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126211712:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 9118us (9295us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155648.886933:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8367 00002000:00100000:1.0:1746155648.886943:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800a0956d80 x1830976126211712/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.886951:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0956d80 with x1830976126211712 ext(1048576->2097151) 00002000:00010000:1.0:1746155648.886957:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0956d80 00000100:00100000:3.0:1746155648.891766:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976126211968:12345-192.168.202.51@tcp:3:cat.0 Request processed in 9913us (10131us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155648.891777:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8368 00002000:00100000:3.0:1746155648.891787:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff8800a0954a80 x1830976126211968/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.891795:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0954a80 with x1830976126211968 ext(1048576->2097151) 00002000:00010000:3.0:1746155648.891800:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0954a80 00000100:00100000:0.0:1746155648.895054:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.895155:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126212096 00000100:00100000:2.0:1746155648.895162:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126212096 00000100:00100000:2.0:1746155648.895200:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17578 00000100:00100000:2.0:1746155648.895206:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32597:x1830976126212096:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.895221:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.895233:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009460b000/0x844e5faceb5f92aa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e0a expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.895255:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.895261:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.895263:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.895265:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009460b000/0x844e5faceb5f92aa lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e0a expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.895289:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 14 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.895299:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 14 pid: 1625 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155648.895309:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125462400:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155648.895388:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155648.897465:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125462400:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155648.897491:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009460b000/0x844e5faceb5f92aa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e0a expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.897565:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009460b000, rc 0) 00000100:00100000:2.0:1746155648.897596:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32597:x1830976126212096:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2389us (2548us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.897603:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17578 00000100:00100000:0.0:1746155648.898451:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.898958:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126212224 00000100:00100000:3.0:1746155648.898964:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126212224 00002000:00100000:3.0:1746155648.898992:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2273280->2408447) req@ffff88009283e680 x1830976126212224/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.899005:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009283e680 with x1830976126212224 ext(2273280->2408447) 00010000:00010000:3.0:1746155648.899010:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 14 pid: 1625 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155648.899020:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 14 pid: 1625 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746155648.899025:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009283e680 00000100:00100000:3.0:1746155648.899043:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1474 00000100:00100000:3.0:1746155648.899049:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126212224:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155648.899538:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.899742:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126212352 00000100:00100000:2.0:1746155648.899746:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126212352 00000100:00100000:2.0:1746155648.899765:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17579 00000100:00100000:2.0:1746155648.899770:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32603:x1830976126212352:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155648.899782:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.899794:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f92b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e11 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.899810:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155648.899815:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f92b1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e11 expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.899824:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f92b1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e11 expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.900148:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c9fa00, rc 0) 00000100:00100000:2.0:1746155648.900172:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:32603:x1830976126212352:12345-192.168.202.51@tcp:101:cat.0 Request processed in 402us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155648.900178:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17579 00000100:00100000:3.0:1746155648.901812:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126212224:12345-192.168.202.51@tcp:4:cat.0 Request processed in 2760us (3360us total) trans 21474841715 rc 0/0 00000100:00100000:3.0:1746155648.901820:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1474 00002000:00100000:3.0:1746155648.901827:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2273280->2408447) req@ffff88009283e680 x1830976126212224/t21474841715(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/448 e 0 to 0 dl 1746155659 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155648.901836:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009283e680 with x1830976126212224 ext(2273280->2408447) 00010000:00010000:3.0:1746155648.901843:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 16 pid: 1625 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155648.901860:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 16 pid: 1625 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746155648.901867:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009283e680 00000100:00100000:0.0:1746155648.903272:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.903459:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126212480 00000100:00100000:2.0:1746155648.903465:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126212480 00010000:00010000:2.0:1746155648.903484:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 16 pid: 1625 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155648.903582:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9031 00000100:00100000:1.0:1746155648.903589:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976126212480:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155648.903600:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155648.903612:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 16 pid: 1625 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155648.903620:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 16 pid: 1625 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155648.903638:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9287 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [2273280->3145727] (req 2273280->2408447) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de7 expref: 16 pid: 1625 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155648.903660:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.903661:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.903666:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009460b000/0x844e5faceb5f92aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e0a expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.903673:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009460b000/0x844e5faceb5f92aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e0a expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.903824:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.903826:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155648.903830:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f92b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e11 expref: 19 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.903837:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f92b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e11 expref: 19 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155648.903871:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f92b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e11 expref: 19 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155648.903885:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125462528:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155648.903946:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009460b000/0x844e5faceb5f92aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e0a expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155648.903952:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125462656:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155648.903964:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155648.905824:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125462528:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155648.905834:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125462656:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155648.905850:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155648.905882:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1961:x1830976126212480:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2294us (2612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155648.905890:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9031 00000100:00100000:0.0:1746155648.909982:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155648.911548:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155648.911695:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126212736 00000100:00100000:1.0:1746155648.911703:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126212736 00002000:00100000:1.0:1746155648.911735:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009283ed80 x1830976126212736/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.911744:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009283ed80 with x1830976126212736 ext(2097152->3145727) 00002000:00010000:1.0:1746155648.911748:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009283ed80 00000100:00100000:1.0:1746155648.911763:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126212992 00000100:00100000:1.0:1746155648.911766:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126212992 00002000:00100000:1.0:1746155648.911775:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012b458000 x1830976126212992/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/0 e 0 to 0 dl 1746155659 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.911781:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b458000 with x1830976126212992 ext(2097152->3145727) 00002000:00010000:1.0:1746155648.911784:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b458000 00000100:00100000:1.0:1746155648.912116:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8369 00000100:00100000:1.0:1746155648.912123:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126212736:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155648.912141:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8370 00000100:00100000:0.0:1746155648.912149:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126212992:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155648.927223:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126212992:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15068us (15670us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155648.927232:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8370 00002000:00100000:2.0:1746155648.927241:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88012b458000 x1830976126212992/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155648.927250:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b458000 with x1830976126212992 ext(2097152->3145727) 00002000:00010000:2.0:1746155648.927254:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b458000 00000100:00100000:1.0:1746155648.928015:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1963:x1830976126212736:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15891us (18037us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155648.928022:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8369 00002000:00100000:1.0:1746155648.928027:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009283ed80 x1830976126212736/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:719/0 lens 488/440 e 0 to 0 dl 1746155659 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155648.928034:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009283ed80 with x1830976126212736 ext(2097152->3145727) 00002000:00010000:1.0:1746155648.928037:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009283ed80 00000100:00100000:0.0:1746155648.929812:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155648.929902:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126213248 00000100:00100000:3.0:1746155648.929908:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126213248 00000100:00100000:3.0:1746155648.929953:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11258 00000100:00100000:3.0:1746155648.929959:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+299:32606:x1830976126213248:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155648.929978:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155648.929990:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e18 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.930064:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7de800/0x844e5faceb5f92bf lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.930075:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7de800/0x844e5faceb5f92bf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155648.930086:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7de800/0x844e5faceb5f92bf lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155648.930094:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155648.930182:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e18 expref: 302 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.930212:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7de800/0x844e5faceb5f92bf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e18 expref: 301 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155648.930218:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155648.930221:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155648.930223:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7de800, rc 0) 00000100:00100000:3.0:1746155648.930251:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:32606:x1830976126213248:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 292us (444us total) trans 8589945444 rc 0/0 00000100:00100000:3.0:1746155648.930256:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11258 00000100:00100000:0.0:1746155648.942427:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.942483:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126213504 00000100:00100000:2.0:1746155648.942489:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126213504 00000100:00100000:2.0:1746155648.942541:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11259 00000100:00100000:2.0:1746155648.942547:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:32608:x1830976126213504:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155648.942565:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155648.942580:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136951e00/0x844e5faceb5f92cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e1f expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.942656:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136951800/0x844e5faceb5f92d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942666:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136951800/0x844e5faceb5f92d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942674:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136951800/0x844e5faceb5f92d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942682:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136950600/0x844e5faceb5f92db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942687:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136950600/0x844e5faceb5f92db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942692:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136950600/0x844e5faceb5f92db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942762:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136951c00/0x844e5faceb5f92e2 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942769:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136951c00/0x844e5faceb5f92e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942773:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136951c00/0x844e5faceb5f92e2 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155648.942779:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155648.942836:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136951800/0x844e5faceb5f92d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942841:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136951800/0x844e5faceb5f92d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942846:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136951800/0x844e5faceb5f92d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942851:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136951800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155648.942861:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136951800/0x844e5faceb5f92d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942867:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136951800/0x844e5faceb5f92d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942876:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155648.942879:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155648.942882:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136951800/0x844e5faceb5f92d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942886:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136951800/0x844e5faceb5f92d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942900:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136950600/0x844e5faceb5f92db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942905:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136950600/0x844e5faceb5f92db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942909:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136950600/0x844e5faceb5f92db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942912:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136950600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155648.942914:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136950600/0x844e5faceb5f92db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942918:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136950600/0x844e5faceb5f92db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942924:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51300) 00010000:00010000:2.0:1746155648.942925:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155648.942927:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136950600/0x844e5faceb5f92db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942931:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136950600/0x844e5faceb5f92db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155648.942958:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136951e00/0x844e5faceb5f92cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e1f expref: 27 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.942970:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136951c00/0x844e5faceb5f92e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e1f expref: 26 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155648.942975:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155648.942977:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155648.942979:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136951c00, rc 0) 00000100:00100000:2.0:1746155648.943027:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:32608:x1830976126213504:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 480us (605us total) trans 8589945445 rc 0/0 00000100:00100000:2.0:1746155648.943033:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11259 00000100:00100000:0.0:1746155648.945418:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155648.945499:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126213760 00000100:00100000:2.0:1746155648.945671:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126213760 00000100:00100000:0.0:1746155648.946755:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4803 00000100:00100000:0.0:1746155648.946764:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+26:32608:x1830976126213760:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:0.0:1746155648.946934:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:32608:x1830976126213760:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 172us (1519us total) trans 8589945446 rc 0/0 00000100:00100000:0.0:1746155648.946940:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4803 00000100:00100000:0.0:1746155649.000958:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.001107:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126213888 00000100:00100000:2.0:1746155649.001115:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126213888 00000100:00100000:2.0:1746155649.001150:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17580 00000100:00100000:2.0:1746155649.001157:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32608:x1830976126213888:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155649.001170:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.001184:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e26 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.001209:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c047800/0x844e5faceb5f8f7e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c0b expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.001217:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c046000/0x844e5faceb5f9011 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c74 expref: 16 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.001224:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f846600/0x844e5faceb5f8fbd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c43 expref: 6 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.001230:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.001232:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.001235:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [1835008->2097151] (req 1835008->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.001258:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f846600/0x844e5faceb5f8fbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c43 expref: 6 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.001268:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f846600/0x844e5faceb5f8fbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c43 expref: 6 pid: 20200 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746155649.001278:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125462784:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.004975:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c046000/0x844e5faceb5f9011 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c74 expref: 16 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.004988:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c046000/0x844e5faceb5f9011 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c74 expref: 16 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746155649.004999:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125462912:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.005043:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c047800/0x844e5faceb5f8f7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c0b expref: 19 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.005050:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c047800/0x844e5faceb5f8f7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c0b expref: 19 pid: 20796 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746155649.005061:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125463040:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.005072:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.006499:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.006588:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125462784:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.006595:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125462912:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.006600:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125463040:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.006621:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [1835008->2097151] (req 1835008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.006637:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136950e00, rc 0) 00000100:00100000:2.0:1746155649.006664:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32608:x1830976126213888:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5508us (5713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.006671:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17580 00000100:00100000:1.0:1746155649.006725:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126214016 00000100:00100000:1.0:1746155649.006730:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126214016 00010000:00010000:1.0:1746155649.006747:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f846600/0x844e5faceb5f8fbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c43 expref: 7 pid: 20200 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746155649.006771:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9032 00000100:00100000:1.0:1746155649.006776:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126214016:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.006783:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.006796:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f846600/0x844e5faceb5f8fbd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c43 expref: 7 pid: 20200 timeout: 878 lvb_type: 1 00010000:00010000:1.0:1746155649.006804:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f846600/0x844e5faceb5f8fbd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c43 expref: 7 pid: 20200 timeout: 878 lvb_type: 1 00010000:00010000:1.0:1746155649.006819:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f846600/0x844e5faceb5f8fbd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c43 expref: 7 pid: 20200 timeout: 878 lvb_type: 1 00010000:00010000:1.0:1746155649.006900:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.006918:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976126214016:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 141us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.006924:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9032 00000100:00100000:0.0:1746155649.007109:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.008051:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126214144 00000100:00100000:3.0:1746155649.008055:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126214144 00000100:00100000:3.0:1746155649.008073:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17581 00000100:00100000:3.0:1746155649.008077:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:32606:x1830976126214144:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155649.008087:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.008096:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e2d expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.008109:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009460b000/0x844e5faceb5f92aa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e0a expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.008116:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f92b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e11 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.008121:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a74f800/0x844e5faceb5f9042 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c97 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.008127:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009450de00/0x844e5faceb5f908f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cd6 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.008133:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746155649.008134:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746155649.008137:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 7/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3592192->4194303] (req 3592192->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.008157:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009450de00/0x844e5faceb5f908f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cd6 expref: 15 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.008166:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009450de00/0x844e5faceb5f908f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cd6 expref: 15 pid: 9235 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.008175:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125463168:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.008233:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a74f800/0x844e5faceb5f9042 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c97 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.008241:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a74f800/0x844e5faceb5f9042 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c97 expref: 21 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.008248:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125463296:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.008268:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f92b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e11 expref: 21 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.008275:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f92b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e11 expref: 21 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.008282:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125463424:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.008301:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009460b000/0x844e5faceb5f92aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e0a expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.008308:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009460b000/0x844e5faceb5f92aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e0a expref: 15 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.008314:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125463552:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.008329:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746155649.009689:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.009759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.009954:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126214272 00000100:00100000:0.0:1746155649.009959:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126214272 00010000:00010000:0.0:1746155649.009979:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c047800/0x844e5faceb5f8f7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c0b expref: 22 pid: 20796 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746155649.009998:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126214400 00000100:00100000:0.0:1746155649.010001:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126214400 00010000:00010000:0.0:1746155649.010009:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c046000/0x844e5faceb5f9011 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c74 expref: 16 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746155649.010027:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9033 00000100:00100000:0.0:1746155649.010033:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d75a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126214272:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155649.010043:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155649.010058:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c047800/0x844e5faceb5f8f7e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c0b expref: 22 pid: 20796 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.010136:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c047800/0x844e5faceb5f8f7e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c0b expref: 22 pid: 20796 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.010152:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c047800/0x844e5faceb5f8f7e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c0b expref: 22 pid: 20796 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.010166:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.010194:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9034 00000100:00100000:2.0:1746155649.010202:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126214400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746155649.010202:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d75a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976126214272:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 168us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.010208:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9033 00010000:00010000:2.0:1746155649.010209:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.010218:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c046000/0x844e5faceb5f9011 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c74 expref: 16 pid: 18270 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746155649.010233:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c046000/0x844e5faceb5f9011 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c74 expref: 16 pid: 18270 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746155649.010245:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c046000/0x844e5faceb5f9011 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c74 expref: 16 pid: 18270 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746155649.010264:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.010265:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.010270:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.010277:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.010303:0:22680:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 15 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.010313:0:22680:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125463680:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155649.010360:0:22680:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.011467:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125463168:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.011476:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125463296:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.011482:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125463424:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.011488:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125463552:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.011619:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3592192->4194303] (req 3592192->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 20 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.011630:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6041e00, rc 0) 00000100:00100000:2.0:1746155649.011660:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:32606:x1830976126214144:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3581us (4551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.011669:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17581 00000100:00100000:0.0:1746155649.012033:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.012075:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.012164:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126214656 00000100:00100000:3.0:1746155649.012168:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126214656 00010000:00010000:3.0:1746155649.012182:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f92b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e11 expref: 20 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.012196:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126214528 00000100:00100000:3.0:1746155649.012197:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126214528 00010000:00010000:3.0:1746155649.012204:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009450de00/0x844e5faceb5f908f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cd6 expref: 16 pid: 9235 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.012216:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9035 00000100:00100000:3.0:1746155649.012220:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126214656:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155649.012226:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.012238:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f92b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e11 expref: 20 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.012245:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f92b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e11 expref: 20 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.012257:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c9fa00/0x844e5faceb5f92b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e11 expref: 20 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.012267:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155649.012297:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b459180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976126214656:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 76us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.012302:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9035 00000100:00100000:3.0:1746155649.012311:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9036 00000100:00100000:3.0:1746155649.012316:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126214528:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155649.012321:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.012326:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009450de00/0x844e5faceb5f908f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cd6 expref: 16 pid: 9235 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.012332:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009450de00/0x844e5faceb5f908f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cd6 expref: 16 pid: 9235 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.012340:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009450de00/0x844e5faceb5f908f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18cd6 expref: 16 pid: 9235 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.012346:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155649.012356:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126214528:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 40us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.012360:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9036 00000100:00100000:1.0:1746155649.012743:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.012796:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.012807:0:22680:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:22680:1830976125463680:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155649.012812:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126215040 00010000:00010000:2.0:1746155649.012815:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.012816:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126215040 00000100:00100000:2.0:1746155649.012832:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126214400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2632us (3072us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.012837:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9034 00002000:00100000:1.0:1746155649.012838:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1835008->1839103) req@ffff88012bdf7100 x1830976126215040/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155649.012846:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7100 with x1830976126215040 ext(1835008->1839103) 00000100:00100000:2.0:1746155649.012848:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126214784 00002000:00010000:1.0:1746155649.012849:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf7100 00000100:00100000:2.0:1746155649.012850:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126214784 00010000:00010000:2.0:1746155649.012870:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a74f800/0x844e5faceb5f9042 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c97 expref: 19 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.012882:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9037 00000100:00100000:1.0:1746155649.012884:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8371 00000100:00100000:2.0:1746155649.012886:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976126214784:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155649.012889:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1962:x1830976126215040:12345-192.168.202.51@tcp:3:multiop.0 00010000:00010000:2.0:1746155649.012891:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.012897:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a74f800/0x844e5faceb5f9042 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c97 expref: 19 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.012904:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a74f800/0x844e5faceb5f9042 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c97 expref: 19 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.012912:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a74f800/0x844e5faceb5f9042 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c97 expref: 19 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.012919:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.012930:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976126214784:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 44us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.012935:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9037 00000100:00100000:1.0:1746155649.013470:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1962:x1830976126215040:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 580us (673us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155649.013474:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8371 00002000:00100000:1.0:1746155649.013478:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1835008->1839103) req@ffff88012bdf7100 x1830976126215040/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/4536 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155649.013483:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012bdf7100 with x1830976126215040 ext(1835008->1839103) 00002000:00010000:1.0:1746155649.013485:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012bdf7100 00000100:00100000:0.0:1746155649.013491:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.013909:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126215168 00000100:00100000:1.0:1746155649.013913:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126215168 00010000:00010000:1.0:1746155649.013928:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009460b000/0x844e5faceb5f92aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e0a expref: 14 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.013953:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9038 00000100:00100000:1.0:1746155649.013960:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1960:x1830976126215168:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.013966:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.013975:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009460b000/0x844e5faceb5f92aa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e0a expref: 14 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.013984:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009460b000/0x844e5faceb5f92aa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e0a expref: 14 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.013995:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009460b000/0x844e5faceb5f92aa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e0a expref: 14 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.014017:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.014019:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.014023:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.014030:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.014052:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 17 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.014066:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125463808:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155649.014120:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501480 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.017690:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.018375:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.018407:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126215552 00000100:00100000:0.0:1746155649.018413:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126215552 00002000:00100000:0.0:1746155649.018445:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (3592192->3596287) req@ffff88012b45a300 x1830976126215552/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155649.018454:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45a300 with x1830976126215552 ext(3592192->3596287) 00002000:00010000:0.0:1746155649.018459:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45a300 00000100:00100000:1.0:1746155649.018469:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125463808:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155649.018483:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155649.018484:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8372 00000100:00100000:0.0:1746155649.018491:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976126215552:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155649.018539:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126215168:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4577us (5047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.018547:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9038 00000100:00100000:2.0:1746155649.018934:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126215296 00000100:00100000:2.0:1746155649.018938:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126215296 00000100:00100000:2.0:1746155649.018967:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17582 00000100:00100000:2.0:1746155649.018973:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32608:x1830976126215296:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155649.018981:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.018999:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e34 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.019020:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f9280 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de0 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.019028:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f928e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dee expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.019039:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.019040:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.019043:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->1458175] (req 1048576->1458175) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.019064:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f928e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dee expref: 18 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.019075:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f928e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dee expref: 18 pid: 1625 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746155649.019085:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125463936:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.019141:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f9280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de0 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.019148:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f9280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de0 expref: 14 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.019156:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125464064:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.019173:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746155649.019760:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976126215552:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 1268us (1384us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155649.019766:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8372 00002000:00100000:1.0:1746155649.019772:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e2:0x0] (3592192->3596287) req@ffff88012b45a300 x1830976126215552/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/4536 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155649.019778:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45a300 with x1830976126215552 ext(3592192->3596287) 00002000:00010000:1.0:1746155649.019781:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45a300 00000100:00100000:2.0:1746155649.021691:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125463936:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.021700:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10591:1830976125464064:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.021719:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [1048576->1458175] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 14 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.021731:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136950600, rc 0) 00000100:00100000:2.0:1746155649.021764:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:32608:x1830976126215296:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2791us (4079us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.021769:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17582 00000100:00100000:0.0:1746155649.023047:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.023162:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126215680 00000100:00100000:1.0:1746155649.023167:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126215680 00010000:00010000:1.0:1746155649.023191:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f928e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dee expref: 18 pid: 1625 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746155649.023224:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9039 00000100:00100000:1.0:1746155649.023230:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976126215680:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.023241:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.023259:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f928e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dee expref: 18 pid: 1625 timeout: 878 lvb_type: 1 00010000:00010000:1.0:1746155649.023270:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f928e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dee expref: 18 pid: 1625 timeout: 878 lvb_type: 1 00010000:00010000:1.0:1746155649.023289:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5f400/0x844e5faceb5f928e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dee expref: 18 pid: 1625 timeout: 878 lvb_type: 1 00010000:00010000:1.0:1746155649.023315:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.023349:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976126215680:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 119us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.023354:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9039 00000100:00100000:0.0:1746155649.023565:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.023838:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126215808 00000100:00100000:2.0:1746155649.023841:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126215808 00010000:00010000:2.0:1746155649.023866:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f9280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de0 expref: 14 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.023881:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9040 00000100:00100000:2.0:1746155649.023886:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d758450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+14:1961:x1830976126215808:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.023893:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.023903:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f9280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de0 expref: 14 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.023911:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f9280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de0 expref: 14 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.023921:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cb5fc00/0x844e5faceb5f9280 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18de0 expref: 14 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.023930:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.023931:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.023936:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.023943:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.023969:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 13 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.023979:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125464192:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155649.024285:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea916c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.025368:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9789:1830976125464192:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155649.025447:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.025869:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d758450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1961:x1830976126215808:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1981us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.025877:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9040 00000100:00100000:0.0:1746155649.026234:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.026293:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126215936 00000100:00100000:2.0:1746155649.026297:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126215936 00000100:00100000:2.0:1746155649.026382:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17583 00000100:00100000:2.0:1746155649.026388:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32606:x1830976126215936:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155649.026401:0:10591:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.026412:0:10591:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e3b expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.026430:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009450c200/0x844e5faceb5f9137 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d38 expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.026437:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f000/0x844e5faceb5f91b5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d70 expref: 6 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.026445:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f913e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d3f expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.026450:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.026451:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.026454:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [4194304->4313087] (req 4194304->4313087) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 25 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.026471:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f913e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d3f expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.026480:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f913e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d3f expref: 25 pid: 9235 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.026493:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125464320:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.026936:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f000/0x844e5faceb5f91b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d70 expref: 6 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.026944:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f000/0x844e5faceb5f91b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d70 expref: 6 pid: 9235 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746155649.026952:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125464448:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.026972:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009450c200/0x844e5faceb5f9137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d38 expref: 11 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.026979:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009450c200/0x844e5faceb5f9137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d38 expref: 11 pid: 9235 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.026986:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125464576:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.026996:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.027408:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.027456:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126216192 00000100:00100000:1.0:1746155649.027460:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126216192 00002000:00100000:1.0:1746155649.027482:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1454080->1458175) req@ffff88012b45ad80 x1830976126216192/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155649.027490:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ad80 with x1830976126216192 ext(1454080->1458175) 00002000:00010000:1.0:1746155649.027494:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45ad80 00000100:00100000:1.0:1746155649.027744:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8373 00000100:00100000:1.0:1746155649.027750:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126216192:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155649.027868:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126216192:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 117us (460us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746155649.027874:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8373 00002000:00100000:1.0:1746155649.027879:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1454080->1458175) req@ffff88012b45ad80 x1830976126216192/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/4536 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155649.027892:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45ad80 with x1830976126216192 ext(1454080->1458175) 00002000:00010000:1.0:1746155649.027894:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b45ad80 00000100:00100000:2.0:1746155649.028664:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d70700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125464320:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.028671:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125464448:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.028676:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125464576:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.028695:0:10591:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [4194304->4313087] (req 4194304->4313087) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 25 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.028710:0:10591:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136951e00, rc 0) 00000100:00100000:2.0:1746155649.028728:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32606:x1830976126215936:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 2341us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.028733:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17583 00000100:00100000:0.0:1746155649.031702:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.031940:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.031970:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.032026:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126216448 00000100:00100000:3.0:1746155649.032034:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126216448 00000100:00100000:1.0:1746155649.032036:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126216320 00000100:00100000:1.0:1746155649.032039:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126216320 00010000:00010000:1.0:1746155649.032061:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f000/0x844e5faceb5f91b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d70 expref: 7 pid: 9235 timeout: 878 lvb_type: 1 00010000:00010000:3.0:1746155649.032062:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009450c200/0x844e5faceb5f9137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d38 expref: 12 pid: 9235 timeout: 878 lvb_type: 0 00000100:00080000:0.0:1746155649.032094:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746155649.032199:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126216576 00000100:00100000:1.0:1746155649.032202:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126216576 00010000:00010000:1.0:1746155649.032211:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f913e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d3f expref: 25 pid: 9235 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.032545:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9041 00000100:00100000:3.0:1746155649.032552:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9042 00000100:00100000:1.0:1746155649.032557:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9043 00000100:00100000:3.0:1746155649.032560:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976126216448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746155649.032563:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126216576:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155649.032567:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126216320:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155649.032571:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.032571:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.032572:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.032588:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f000/0x844e5faceb5f91b5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d70 expref: 7 pid: 9235 timeout: 878 lvb_type: 1 00010000:00010000:1.0:1746155649.032588:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f913e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d3f expref: 25 pid: 9235 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.032589:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009450c200/0x844e5faceb5f9137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d38 expref: 12 pid: 9235 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.032597:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f000/0x844e5faceb5f91b5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d70 expref: 7 pid: 9235 timeout: 878 lvb_type: 1 00010000:00010000:1.0:1746155649.032738:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f913e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d3f expref: 25 pid: 9235 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.032756:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013121e400/0x844e5faceb5f913e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d3f expref: 25 pid: 9235 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.032764:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009450c200/0x844e5faceb5f9137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d38 expref: 12 pid: 9235 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.032778:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fc7f000/0x844e5faceb5f91b5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d70 expref: 7 pid: 9235 timeout: 878 lvb_type: 1 00010000:00010000:3.0:1746155649.032839:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009450c200/0x844e5faceb5f9137 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d38 expref: 12 pid: 9235 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.032865:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.032867:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.032873:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.032881:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.032891:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155649.032988:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 24 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.033037:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.033042:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976126216320:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 491us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.033049:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9041 00000100:00100000:3.0:1746155649.033055:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126216448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 497us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.033061:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9042 00000100:00100000:1.0:1746155649.033118:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125464704:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155649.033169:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155649.036474:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125464704:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155649.036491:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.036558:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976126216576:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3993us (4584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.036567:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9043 00000100:00100000:0.0:1746155649.037382:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.037426:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126216832 00000100:00100000:3.0:1746155649.037433:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126216832 00002000:00100000:3.0:1746155649.037460:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (4308992->4313087) req@ffff88012b45bb80 x1830976126216832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.037469:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45bb80 with x1830976126216832 ext(4308992->4313087) 00002000:00010000:3.0:1746155649.037473:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45bb80 00000100:00100000:3.0:1746155649.037492:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8374 00000100:00100000:3.0:1746155649.037497:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976126216832:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155649.037631:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976126216832:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 133us (250us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155649.037637:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8374 00002000:00100000:3.0:1746155649.037641:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (4308992->4313087) req@ffff88012b45bb80 x1830976126216832/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/4536 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.037649:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b45bb80 with x1830976126216832 ext(4308992->4313087) 00002000:00010000:3.0:1746155649.037651:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b45bb80 00000100:00100000:0.0:1746155649.045060:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.045159:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126216960 00000100:00100000:3.0:1746155649.045168:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126216960 00000100:00100000:3.0:1746155649.045253:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11260 00000100:00100000:3.0:1746155649.045261:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:32613:x1830976126216960:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155649.045282:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.045296:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea400/0x844e5faceb5f930c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e42 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.045342:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea800/0x844e5faceb5f9313 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.045351:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea800/0x844e5faceb5f9313 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.045358:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea800/0x844e5faceb5f9313 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.045366:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f931a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.045369:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f931a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.045372:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f931a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.045447:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.045453:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dc4 expref: 26 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.045458:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7de800/0x844e5faceb5f92bf lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e18 expref: 300 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.045464:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 5/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.045485:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7de800/0x844e5faceb5f92bf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e18 expref: 300 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.045491:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7de800/0x844e5faceb5f92bf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e18 expref: 300 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.045498:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125464832:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.045588:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dc4 expref: 26 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.045594:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dc4 expref: 26 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.045601:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125464960:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.045618:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.046960:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.046988:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.047029:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125464832:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.047038:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125464960:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.047053:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155649.047057:0:16336:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126217216 00000100:00100000:1.0:1746155649.047060:0:16336:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126217216 00000100:00100000:2.0:1746155649.047062:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126217472 00000100:00100000:2.0:1746155649.047070:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126217472 00000100:00100000:1.0:1746155649.047087:0:16336:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4804 00000100:00100000:1.0:1746155649.047091:0:16336:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:27126:x1830976126217216:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746155649.047094:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4805 00000100:00100000:2.0:1746155649.047100:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:23568:x1830976126217472:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746155649.047200:0:16336:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:27126:x1830976126217216:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 108us (243us total) trans 8589945447 rc 0/0 00000100:00100000:1.0:1746155649.047205:0:16336:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4804 00000100:00100000:2.0:1746155649.047534:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:23568:x1830976126217472:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 433us (543us total) trans 8589945448 rc 0/0 00000100:00100000:2.0:1746155649.047540:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4805 00000100:00100000:0.0:1746155649.048313:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.048386:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126217600 00000100:00100000:1.0:1746155649.048390:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126217600 00010000:00010000:1.0:1746155649.048433:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7de800/0x844e5faceb5f92bf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e18 expref: 302 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.048462:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9044 00000100:00100000:1.0:1746155649.048467:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+302:1960:x1830976126217600:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.048476:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.048481:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7de800/0x844e5faceb5f92bf lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e18 expref: 302 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.048490:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7de800/0x844e5faceb5f92bf lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e18 expref: 302 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.048781:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7de800/0x844e5faceb5f92bf lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e18 expref: 302 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.048792:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.048796:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155649.048800:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155649.048803:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155649.048807:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155649.048811:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.048834:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1960:x1830976126217600:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 367us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.048838:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9044 00000100:00100000:1.0:1746155649.048848:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126217728 00000100:00100000:1.0:1746155649.048862:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126217728 00010000:00010000:1.0:1746155649.048871:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dc4 expref: 28 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.048894:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9045 00000100:00100000:1.0:1746155649.048899:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976126217728:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.048907:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.048910:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dc4 expref: 28 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.049112:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dc4 expref: 28 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.049123:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5b9da00/0x844e5faceb5f925d lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18dc4 expref: 28 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.049132:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.049134:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155649.049140:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155649.049146:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155649.049174:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.049205:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976126217728:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 305us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.049211:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9045 00010000:00010000:3.0:1746155649.049447:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049454:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155649.049480:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155649.049484:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155649.049494:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049525:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049533:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea800/0x844e5faceb5f9313 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049539:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea800/0x844e5faceb5f9313 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049544:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea800/0x844e5faceb5f9313 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049630:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801315ea800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155649.049634:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea800/0x844e5faceb5f9313 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049640:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea800/0x844e5faceb5f9313 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049648:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155649.049650:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155649.049652:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea800/0x844e5faceb5f9313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049656:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea800/0x844e5faceb5f9313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049669:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f931a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049675:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f931a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049679:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f931a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049683:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dee3e00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155649.049684:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f931a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049689:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f931a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049694:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fff0c00) 00010000:00010000:3.0:1746155649.049695:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155649.049697:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f931a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049700:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f931a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.049724:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801315ea400/0x844e5faceb5f930c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e42 expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.049734:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e42 expref: 15 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.049739:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.049741:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155649.049742:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dee3a00, rc 0) 00000100:00100000:3.0:1746155649.050791:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:32613:x1830976126216960:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5527us (5735us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.050800:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11260 00000100:00100000:0.0:1746155649.053425:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.053456:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.053477:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.053495:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126217856 00000100:00100000:2.0:1746155649.053499:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126217984 00000100:00100000:0.0:1746155649.053515:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126217856 00000100:00100000:2.0:1746155649.053521:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126217984 00000100:00100000:2.0:1746155649.053545:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126218112 00000100:00100000:2.0:1746155649.053547:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126218112 00000100:00100000:0.0:1746155649.053740:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17584 00000100:00100000:2.0:1746155649.053748:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17585 00000100:00100000:0.0:1746155649.053748:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126217984:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:2.0:1746155649.053755:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126217856:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155649.053762:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155649.053762:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.053774:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136951000/0x844e5faceb5f9328 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e49 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.053774:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f2a4800/0x844e5faceb5f932f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e50 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.053816:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125465088:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155649.053819:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17586 00000100:00100000:0.0:1746155649.053821:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0950000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125465216:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155649.053826:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1962:x1830976126218112:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155649.053834:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.053843:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0b0c00/0x844e5faceb5f9336 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e57 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.053868:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.053871:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.053877:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0b0c00/0x844e5faceb5f9336 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e57 expref: 7 pid: 9235 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155649.053884:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91600 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.053884:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77000 going to sleep for 11 seconds 00010000:00010000:3.0:1746155649.053890:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0b0c00/0x844e5faceb5f9336 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e57 expref: 7 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.053898:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0b0c00, rc 0) 00000100:00100000:0.0:1746155649.053905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.053917:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126218112:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 92us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.053923:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17586 00000100:00100000:3.0:1746155649.053939:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126218240 00000100:00100000:3.0:1746155649.053941:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126218240 00000100:00100000:3.0:1746155649.053957:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17587 00000100:00100000:3.0:1746155649.053961:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126218240:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155649.053966:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.053972:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b0b0800/0x844e5faceb5f933d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e5e expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.053998:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125465344:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155649.054030:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.054158:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.054423:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126218368 00000100:00100000:2.0:1746155649.054426:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126218368 00000100:00100000:2.0:1746155649.054450:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17588 00000100:00100000:2.0:1746155649.054455:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126218368:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155649.054461:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.054467:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136950200/0x844e5faceb5f9344 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e65 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.054489:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125465472:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155649.054554:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b6338600 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.055897:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0950000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125465216:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155649.055922:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f2a4800/0x844e5faceb5f932f lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e50 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.055932:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f2a4800/0x844e5faceb5f932f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e50 expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.055953:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f2a4800, rc 0) 00000100:00100000:2.0:1746155649.055990:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1962:x1830976126217984:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2243us (2532us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155649.055997:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17584 00002000:00010000:2.0:1746155649.056032:0:29728:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime: 1746155647 -> 1746155649 00002000:00010000:2.0:1746155649.056035:0:29728:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime: 1746155647 -> 1746155649 00002000:00010000:2.0:1746155649.056036:0:29728:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime: 1746155647 -> 1746155649 00000100:00100000:2.0:1746155649.056043:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125465088:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155649.056056:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136951000/0x844e5faceb5f9328 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e49 expref: 9 pid: 29728 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746155649.056090:0:9235:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime: 1746155648 -> 1746155649 00002000:00010000:3.0:1746155649.056091:0:9235:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime: 1746155648 -> 1746155649 00002000:00010000:3.0:1746155649.056093:0:9235:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime: 1746155648 -> 1746155649 00000100:00100000:3.0:1746155649.056103:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125465344:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.056117:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b0b0800/0x844e5faceb5f933d lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e5e expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.056125:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0b0800/0x844e5faceb5f933d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e5e expref: 8 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.056135:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b0b0800, rc 0) 00000100:00100000:3.0:1746155649.056153:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1962:x1830976126218240:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2191us (2247us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.056159:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17587 00010000:00010000:2.0:1746155649.056620:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136951000/0x844e5faceb5f9328 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e49 expref: 9 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.056630:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136951000, rc 0) 00000100:00100000:2.0:1746155649.056661:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1962:x1830976126217856:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2907us (3241us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155649.056667:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17585 00002000:00010000:2.0:1746155649.057406:0:20200:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime: 1746155648 -> 1746155649 00000100:00100000:2.0:1746155649.057419:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125465472:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155649.057438:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136950200/0x844e5faceb5f9344 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e65 expref: 7 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.057446:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136950200/0x844e5faceb5f9344 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e65 expref: 7 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.057452:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136950200, rc 0) 00000100:00100000:2.0:1746155649.057561:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1962:x1830976126218368:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3105us (3402us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155649.057567:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17588 00000100:00100000:2.0:1746155649.060041:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.060450:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126218624 00000100:00100000:3.0:1746155649.060457:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126218624 00000100:00100000:3.0:1746155649.060496:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11261 00000100:00100000:3.0:1746155649.060602:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:32613:x1830976126218624:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155649.060620:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.060635:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3400/0x844e5faceb5f934b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e6c expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.060706:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.060717:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e42 expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.060723:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.060745:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e42 expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.060755:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e42 expref: 16 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.060765:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125465600:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.061530:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.063314:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125465600:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.063332:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155649.063684:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.063812:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126218752 00000100:00100000:1.0:1746155649.063818:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126218752 00010000:00010000:1.0:1746155649.063842:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e42 expref: 17 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.063881:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9046 00000100:00100000:1.0:1746155649.063887:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0950a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:1961:x1830976126218752:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.063896:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.063901:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e42 expref: 17 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.063910:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e42 expref: 17 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.063926:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f9321 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e42 expref: 17 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.063940:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.063944:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155649.063952:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155649.063958:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155649.063978:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.064005:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0950a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976126218752:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 118us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.064013:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9046 00010000:00010000:3.0:1746155649.064440:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.064447:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155649.064463:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155649.064597:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3400/0x844e5faceb5f934b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e6c expref: 17 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.064622:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e6c expref: 16 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.064629:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.064631:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155649.064633:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dee2200, rc 0) 00000100:00100000:3.0:1746155649.064711:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:32613:x1830976126218624:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4207us (4677us total) trans 8589945449 rc 0/0 00000100:00100000:3.0:1746155649.064717:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11261 00000100:00100000:2.0:1746155649.066478:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.066591:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126218880 00000100:00100000:3.0:1746155649.066597:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126218880 00000100:00100000:3.0:1746155649.066651:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11262 00000100:00100000:3.0:1746155649.066658:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:32613:x1830976126218880:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155649.066674:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.066687:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0b0800/0x844e5faceb5f9360 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e73 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.066739:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5f9367 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.066749:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e6c expref: 17 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.066755:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5f9367 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.066775:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e6c expref: 17 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.066785:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e6c expref: 17 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.066796:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125465728:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.067210:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.068393:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125465728:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.068409:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5f9367 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155649.069014:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.069081:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126219008 00000100:00100000:2.0:1746155649.069086:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126219008 00010000:00010000:2.0:1746155649.069108:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e6c expref: 18 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.069137:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9047 00000100:00100000:2.0:1746155649.069143:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:1961:x1830976126219008:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.069151:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.069156:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e6c expref: 18 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.069164:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e6c expref: 18 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.069179:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee2200/0x844e5faceb5f9352 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e6c expref: 18 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.069194:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.069197:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5f9367 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.069204:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5f9367 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.069209:0:22680:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5f9367 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.069818:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5f9367 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.069825:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5f9367 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155649.069864:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155649.069868:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155649.069880:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5f9367 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.069904:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b0b0800/0x844e5faceb5f9360 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e73 expref: 18 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.069917:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5f9367 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e73 expref: 17 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.069923:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.069926:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155649.069928:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dee3000, rc 0) 00000100:00100000:3.0:1746155649.069967:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+17:32613:x1830976126218880:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3310us (3492us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.069977:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11262 00010000:00010000:2.0:1746155649.070024:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.070044:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:1961:x1830976126219008:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 900us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.070049:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9047 00000100:00100000:1.0:1746155649.072332:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.072369:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.072384:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126219136 00000100:00100000:2.0:1746155649.072389:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126219136 00000100:00100000:2.0:1746155649.072567:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126219264 00000100:00100000:2.0:1746155649.072570:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126219264 00000100:00100000:2.0:1746155649.072586:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17589 00000100:00100000:2.0:1746155649.072592:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126219136:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155649.072604:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.072617:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903dec00/0x844e5faceb5f936e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e7a expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.072654:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125465856:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155649.072768:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17590 00000100:00100000:3.0:1746155649.072775:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126219264:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155649.072782:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.072788:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b8da600/0x844e5faceb5f9375 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e81 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.072809:0:29728:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125465984:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155649.072907:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ea91600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.072960:0:29728:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.073287:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.073314:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.073347:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126219392 00000100:00100000:3.0:1746155649.073350:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126219392 00000100:00100000:3.0:1746155649.073367:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17591 00000100:00100000:3.0:1746155649.073372:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126219392:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155649.073378:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.073387:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dee2200/0x844e5faceb5f937c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e88 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.073410:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125466112:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155649.073432:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.073442:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126219520 00000100:00100000:2.0:1746155649.073445:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126219520 00000100:00100000:2.0:1746155649.073467:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17592 00000100:00100000:2.0:1746155649.073471:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126219520:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155649.073477:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.073482:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800903de400/0x844e5faceb5f9383 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e8f expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.073518:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125466240:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155649.073539:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129eff3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.075367:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125465856:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155649.075394:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903dec00/0x844e5faceb5f936e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e7a expref: 11 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.075404:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903dec00/0x844e5faceb5f936e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e7a expref: 11 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.075415:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903dec00, rc 0) 00000100:00100000:3.0:1746155649.075446:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125466112:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.075460:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dee2200/0x844e5faceb5f937c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e88 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.075468:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dee2200/0x844e5faceb5f937c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e88 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.075484:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dee2200, rc 0) 00000100:00100000:0.0:1746155649.075620:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:9235:1830976125466240:192.168.202.51@tcp:106: 00010000:00010000:0.0:1746155649.075635:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800903de400/0x844e5faceb5f9383 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e8f expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.075643:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800903de400/0x844e5faceb5f9383 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e8f expref: 10 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.075652:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800903de400, rc 0) 00000100:00100000:2.0:1746155649.075696:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126219136:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3102us (3367us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155649.075702:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17589 00000100:00100000:3.0:1746155649.075914:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126219392:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2541us (2627us total) trans 0 rc 301/301 00000100:00100000:0.0:1746155649.075914:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126219520:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2441us (2597us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.075919:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17591 00000100:00100000:0.0:1746155649.075922:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17592 00000100:00100000:3.0:1746155649.075950:0:29728:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:29728:1830976125465984:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.075962:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b8da600/0x844e5faceb5f9375 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e81 expref: 7 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.075970:0:29728:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b8da600/0x844e5faceb5f9375 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e81 expref: 7 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.075976:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b8da600, rc 0) 00000100:00100000:3.0:1746155649.075990:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1960:x1830976126219264:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3216us (3620us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.075994:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17590 00000100:00100000:0.0:1746155649.077903:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.077946:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126219776 00000100:00100000:3.0:1746155649.077952:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126219776 00000100:00100000:3.0:1746155649.077988:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11263 00000100:00100000:3.0:1746155649.077994:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+16:32613:x1830976126219776:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155649.078011:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.078025:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3400/0x844e5faceb5f938a lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e96 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.078099:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f9391 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.078111:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f9391 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.078119:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f9391 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155649.078128:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155649.078218:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3400/0x844e5faceb5f938a lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e96 expref: 19 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.078229:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f9391 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e96 expref: 18 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.078235:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.078238:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155649.078240:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dee3e00, rc 0) 00000100:00100000:3.0:1746155649.078279:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:32613:x1830976126219776:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 285us (379us total) trans 8589945450 rc 0/0 00000100:00100000:3.0:1746155649.078284:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11263 00000100:00100000:0.0:1746155649.079644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.079668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.079693:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.079714:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.079725:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.079738:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126219904 00000100:00100000:0.0:1746155649.079742:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126219904 00000100:00100000:0.0:1746155649.079761:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126220160 00000100:00100000:0.0:1746155649.079763:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126220160 00000100:00100000:0.0:1746155649.079771:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126220416 00000100:00100000:0.0:1746155649.079772:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126220416 00000100:00100000:0.0:1746155649.079780:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126220032 00000100:00100000:0.0:1746155649.079781:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126220032 00000100:00100000:0.0:1746155649.079787:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126220288 00000100:00100000:0.0:1746155649.079789:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126220288 00000100:00100000:0.0:1746155649.079798:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17593 00000100:00100000:0.0:1746155649.079802:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126219904:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155649.079823:0:10591:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.079835:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29c00/0x844e5faceb5f8f77 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c04 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.079841:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c046200/0x844e5faceb5f900a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c66 expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.079847:0:10591:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f400/0x844e5faceb5f8fcb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c3c expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.079863:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.079865:0:10591:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.079868:0:10591:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.079888:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f400/0x844e5faceb5f8fcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c3c expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.079897:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f400/0x844e5faceb5f8fcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c3c expref: 9 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746155649.079907:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0952680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125466368:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.079949:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17594 00000100:00100000:3.0:1746155649.079957:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126220160:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155649.079966:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c046200/0x844e5faceb5f900a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c66 expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.079974:0:20796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.079974:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c046200/0x844e5faceb5f900a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c66 expref: 10 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746155649.079982:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0952a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125466496:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.079985:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.079990:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155649.079992:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155649.079994:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.079999:0:10591:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009fd29c00/0x844e5faceb5f8f77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c04 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.080006:0:10591:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009fd29c00/0x844e5faceb5f8f77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c04 expref: 23 pid: 8437 timeout: 878 lvb_type: 1 00010000:00010000:3.0:1746155649.080009:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155649.080013:0:10591:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0952d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125466624:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.080016:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 12 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746155649.080022:0:10591:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77840 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.080024:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125466752:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.080046:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.080049:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.080058:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126220544 00000100:00100000:3.0:1746155649.080061:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126220544 00000100:00100000:0.0:1746155649.080064:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17595 00000100:00100000:0.0:1746155649.080069:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126220416:12345-192.168.202.51@tcp:1:lfs.0 00000100:00100000:3.0:1746155649.080079:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17596 00010000:00010000:0.0:1746155649.080082:0:19959:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.080084:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126220032:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:0.0:1746155649.080091:0:19959:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.080097:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.080097:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155649.080098:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746155649.080100:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.080106:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.080111:0:19959:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 23 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.080112:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155649.080113:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155649.080114:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.080117:0:19959:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 23 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746155649.080125:0:19959:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0953480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125466880:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.080129:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 12 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.080135:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 12 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746155649.080139:0:19959:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093d77780 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.080143:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125467008:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.080161:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53373c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.080174:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17597 00000100:00100000:3.0:1746155649.080179:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126220288:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155649.080192:0:4461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.080200:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f9295 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18df5 expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.080205:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b0b0c00/0x844e5faceb5f9336 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e57 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.080210:0:4461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f92a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e03 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.080215:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.080216:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.080218:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 6/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.080231:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f92a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e03 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.080239:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f92a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e03 expref: 23 pid: 1625 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.080244:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17598 00000100:00100000:3.0:1746155649.080247:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125467136:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.080250:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126220544:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155649.080265:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.080273:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.080284:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155649.080285:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155649.080287:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.080299:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 16 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.080306:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 16 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.080318:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125467264:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.080341:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff880129effc00 going to sleep for 11 seconds 00010000:00010000:3.0:1746155649.080394:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b0b0c00/0x844e5faceb5f9336 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e57 expref: 9 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.080402:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b0b0c00/0x844e5faceb5f9336 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e57 expref: 9 pid: 9235 timeout: 878 lvb_type: 1 00000100:00100000:3.0:1746155649.080409:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125467392:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.080430:0:4461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f9295 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18df5 expref: 10 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.080437:0:4461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f9295 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18df5 expref: 10 pid: 1625 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.080444:0:4461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125467520:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.080459:0:4461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.084597:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0952680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125466368:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.084608:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0952a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125466496:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.084615:0:10591:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0952d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10591:1830976125466624:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.084634:0:10591:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.084911:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125466752:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.084924:0:20796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.084988:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:18270:1830976125467008:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.085003:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155649.085289:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.085309:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.085321:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.085356:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126220800 00000100:00100000:2.0:1746155649.085362:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126220800 00010000:00010000:2.0:1746155649.085387:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c046200/0x844e5faceb5f900a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c66 expref: 11 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746155649.085459:0:19959:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0953480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:19959:1830976125466880:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155649.085474:0:19959:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155649.085491:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.085550:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126221056 00000100:00100000:1.0:1746155649.085553:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126221056 00000100:00100000:3.0:1746155649.085577:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126221312 00000100:00100000:3.0:1746155649.085579:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126221312 00002000:00100000:3.0:1746155649.085596:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->4313087) req@ffff8800a0952d80 x1830976126221312/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.085604:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0952d80 with x1830976126221312 ext(4194304->4313087) 00010000:00010000:3.0:1746155649.085609:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 24 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.085617:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 24 pid: 10591 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746155649.085623:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0952d80 00000100:00100000:3.0:1746155649.085636:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1475 00000100:00100000:3.0:1746155649.085641:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126221312:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155649.085820:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126220672 00000100:00100000:2.0:1746155649.085823:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126220672 00010000:00010000:2.0:1746155649.085834:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f400/0x844e5faceb5f8fcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c3c expref: 10 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746155649.085847:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9048 00000100:00100000:2.0:1746155649.085860:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0953b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126220800:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.085868:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.085882:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c046200/0x844e5faceb5f900a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c66 expref: 11 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746155649.085886:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:2.0:1746155649.085890:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c046200/0x844e5faceb5f900a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c66 expref: 11 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746155649.085900:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126220928 00000100:00100000:0.0:1746155649.085902:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126220928 00010000:00010000:2.0:1746155649.085907:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c046200/0x844e5faceb5f900a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c66 expref: 11 pid: 18270 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.085912:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009fd29c00/0x844e5faceb5f8f77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c04 expref: 26 pid: 8437 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746155649.085920:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155649.085932:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9049 00000100:00100000:2.0:1746155649.085936:0:15879:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9050 00000100:00100000:0.0:1746155649.085937:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126220672:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155649.085940:0:15879:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0952680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976126220928:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.085944:0:15879:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155649.085945:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.085951:0:15879:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fd29c00/0x844e5faceb5f8f77 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c04 expref: 26 pid: 8437 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.085951:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f400/0x844e5faceb5f8fcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c3c expref: 10 pid: 18270 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.085959:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f400/0x844e5faceb5f8fcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c3c expref: 10 pid: 18270 timeout: 878 lvb_type: 1 00002000:00100000:1.0:1746155649.086014:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1835008->2097151) req@ffff8800a0953800 x1830976126221056/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155649.086021:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0953800 with x1830976126221056 ext(1835008->2097151) 00010000:00010000:1.0:1746155649.086025:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 13 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.086032:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 13 pid: 10591 timeout: 878 lvb_type: 0 00002000:00010000:1.0:1746155649.086037:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0953800 00000100:00100000:1.0:1746155649.086050:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1476 00000100:00100000:1.0:1746155649.086055:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1963:x1830976126221056:12345-192.168.202.51@tcp:4:multiop.0 00010000:00010000:2.0:1746155649.086573:0:15879:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009fd29c00/0x844e5faceb5f8f77 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c04 expref: 26 pid: 8437 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746155649.086587:0:15879:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fd29c00/0x844e5faceb5f8f77 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c04 expref: 26 pid: 8437 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746155649.086594:0:15879:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.086616:0:15879:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0952680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126220928:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 675us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.086621:0:15879:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9050 00000100:00100000:2.0:1746155649.086647:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0953b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126220800:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 796us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.086651:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9048 00010000:00010000:0.0:1746155649.087117:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009fa1f400/0x844e5faceb5f8fcb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18c3c expref: 10 pid: 18270 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.087138:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.087140:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.087143:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.087149:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.087164:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155649.087179:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126220672:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1242us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.087184:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9049 00000100:00100000:2.0:1746155649.087373:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125467264:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.087392:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.087412:0:10591:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.087419:0:10591:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.087439:0:10591:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.087451:0:10591:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.087457:0:10591:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.087462:0:10591:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f2a5000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155649.087464:0:10591:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.087469:0:10591:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.087477:0:10591:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.087481:0:10591:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5000/0x844e5faceb5f939f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10591 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.087529:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126219904:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 7725us (7886us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.087536:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17593 00000100:00100000:3.0:1746155649.087976:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125467136:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.087986:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125467392:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155649.088015:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.088017:0:4461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:4461:1830976125467520:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155649.088029:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155649.088032:0:4461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.088046:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126221184 00000100:00100000:3.0:1746155649.088050:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126221184 00002000:00100000:3.0:1746155649.088071:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1458175) req@ffff8800a0950a80 x1830976126221184/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.088080:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0950a80 with x1830976126221184 ext(1048576->1458175) 00010000:00010000:3.0:1746155649.088085:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 15 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.088093:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 15 pid: 10591 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746155649.088099:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0950a80 00000100:00100000:3.0:1746155649.088119:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1477 00000100:00100000:3.0:1746155649.088125:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1960:x1830976126221184:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155649.088483:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.088546:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126221696 00000100:00100000:1.0:1746155649.088549:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126221696 00010000:00010000:1.0:1746155649.088562:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f92a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e03 expref: 25 pid: 1625 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746155649.088618:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.089133:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0952d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976126221312:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 3490us (3809us total) trans 17179874415 rc 0/0 00000100:00100000:2.0:1746155649.089139:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1475 00002000:00100000:2.0:1746155649.089146:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->4313087) req@ffff8800a0952d80 x1830976126221312/t17179874415(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/448 e 0 to 0 dl 1746155660 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.089154:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0952d80 with x1830976126221312 ext(4194304->4313087) 00010000:00010000:2.0:1746155649.089159:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 26 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.089167:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 26 pid: 10591 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746155649.089173:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a0952d80 00000100:00100000:2.0:1746155649.089187:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126221440 00000100:00100000:2.0:1746155649.089190:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126221440 00002000:00100000:2.0:1746155649.089203:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3592192->4194303) req@ffff8800a0953480 x1830976126221440/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.089210:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0953480 with x1830976126221440 ext(3592192->4194303) 00010000:00010000:2.0:1746155649.089214:0:31253:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 17 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.089221:0:31253:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 17 pid: 10591 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746155649.089226:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0953480 00000100:00100000:3.0:1746155649.089243:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1478 00000100:00100000:3.0:1746155649.089320:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976126221440:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155649.089359:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.089443:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126221568 00000100:00100000:1.0:1746155649.089447:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126221568 00010000:00010000:1.0:1746155649.089459:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b0b0c00/0x844e5faceb5f9336 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e57 expref: 8 pid: 9235 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746155649.089476:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9051 00000100:00100000:1.0:1746155649.089480:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126221696:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.089487:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.089499:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f92a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e03 expref: 25 pid: 1625 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.089522:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f92a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e03 expref: 25 pid: 1625 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.089538:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cb5ec00/0x844e5faceb5f92a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e03 expref: 25 pid: 1625 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.089552:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.089568:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126221696:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 88us (1538us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.089573:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9051 00000100:00100000:1.0:1746155649.089582:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9052 00000100:00100000:1.0:1746155649.089586:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126221568:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.089591:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.089598:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b0b0c00/0x844e5faceb5f9336 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e57 expref: 8 pid: 9235 timeout: 878 lvb_type: 1 00010000:00010000:1.0:1746155649.089604:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b0b0c00/0x844e5faceb5f9336 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e57 expref: 8 pid: 9235 timeout: 878 lvb_type: 1 00010000:00010000:1.0:1746155649.089613:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b0b0c00/0x844e5faceb5f9336 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e57 expref: 8 pid: 9235 timeout: 878 lvb_type: 1 00010000:00010000:1.0:1746155649.089620:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.089632:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126221568:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 45us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.089636:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9052 00000100:00100000:2.0:1746155649.091425:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126221824 00000100:00100000:2.0:1746155649.091431:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126221824 00010000:00010000:2.0:1746155649.091455:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f9295 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18df5 expref: 10 pid: 1625 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.091650:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9053 00000100:00100000:2.0:1746155649.091659:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126221824:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.091667:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.091678:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f9295 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18df5 expref: 10 pid: 1625 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.091686:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f9295 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18df5 expref: 10 pid: 1625 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.091700:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc66400/0x844e5faceb5f9295 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18df5 expref: 10 pid: 1625 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.091709:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.091711:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.091714:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.091721:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.091747:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155649.091766:0:4461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.091776:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1961:x1830976126221824:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 116us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.091781:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9053 00010000:00010000:3.0:1746155649.092832:0:4461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.092849:0:4461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.092864:0:4461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.092871:0:4461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.092877:0:4461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f62800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155649.092880:0:4461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.092887:0:4461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.092896:0:4461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.093131:0:4461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f62800/0x844e5faceb5f93bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.093162:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0953800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1963:x1830976126221056:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 7104us (7871us total) trans 21474841716 rc 0/0 00000100:00100000:1.0:1746155649.093170:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1476 00002000:00100000:1.0:1746155649.093177:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1835008->2097151) req@ffff8800a0953800 x1830976126221056/t21474841716(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/448 e 0 to 0 dl 1746155660 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746155649.093185:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0953800 with x1830976126221056 ext(1835008->2097151) 00010000:00010000:1.0:1746155649.093191:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 17 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.093199:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 17 pid: 10591 timeout: 878 lvb_type: 0 00002000:00010000:1.0:1746155649.093205:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0953800 00000100:00100000:3.0:1746155649.093332:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976126220288:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 12999us (13450us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.093341:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17597 00000100:00100000:0.0:1746155649.096217:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.096258:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126221952 00000100:00100000:2.0:1746155649.096265:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126221952 00010000:00010000:2.0:1746155649.096287:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 24 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.096317:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9054 00000100:00100000:2.0:1746155649.096322:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d759050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976126221952:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.096332:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.096345:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 24 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.096354:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 24 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.096370:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136951e00/0x844e5faceb5f9305 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4313087) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e3b expref: 24 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.096380:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.096381:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.096385:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.096392:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.096469:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1960:x1830976126221184:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 8342us (8452us total) trans 21474841717 rc 0/0 00000100:00100000:3.0:1746155649.096477:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1477 00002000:00100000:3.0:1746155649.096484:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->1458175) req@ffff8800a0950a80 x1830976126221184/t21474841717(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/448 e 0 to 0 dl 1746155660 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.096492:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0950a80 with x1830976126221184 ext(1048576->1458175) 00010000:00010000:3.0:1746155649.096499:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 17 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.096526:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 17 pid: 10591 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746155649.096532:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0950a80 00010000:00010000:2.0:1746155649.096654:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155649.096657:0:19959:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.096665:0:19959:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.096673:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d759050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976126221952:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 350us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.096678:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9054 00010000:00010000:0.0:1746155649.096681:0:19959:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.096688:0:19959:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.096693:0:19959:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.096699:0:19959:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f2a5c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155649.096702:0:19959:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.096708:0:19959:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.096717:0:19959:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.096723:0:19959:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f2a5c00/0x844e5faceb5f93ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155649.096985:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a387850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+5:1961:x1830976126220416:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 16915us (17290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.096992:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17595 00000100:00100000:1.0:1746155649.098219:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.098964:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126222080 00000100:00100000:2.0:1746155649.098970:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126222080 00010000:00010000:2.0:1746155649.098989:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 17 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.099021:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9055 00000100:00100000:2.0:1746155649.099030:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976126222080:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.099039:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.099051:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 17 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.099060:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 17 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.099075:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136950e00/0x844e5faceb5f92f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1835008->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e26 expref: 17 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.099086:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.099087:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.099091:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.099098:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.099114:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155649.099126:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.099137:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.099150:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.099156:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.099162:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.099168:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009048f600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155649.099170:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.099176:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.099184:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.099189:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f93b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.099236:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0951f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126220032:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 19151us (19520us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.099244:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17596 00000100:00100000:2.0:1746155649.099266:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1961:x1830976126222080:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 241us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.099271:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9055 00000100:00100000:2.0:1746155649.099329:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.099369:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126222208 00000100:00100000:2.0:1746155649.099372:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126222208 00010000:00010000:2.0:1746155649.099382:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 16 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.099405:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9056 00000100:00100000:2.0:1746155649.099410:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1963:x1830976126222208:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.099416:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.099425:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 16 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.099431:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 16 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.099441:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136950600/0x844e5faceb5f92fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e34 expref: 16 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.099448:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.099449:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.099451:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.099462:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.099479:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.099494:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:1963:x1830976126222208:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 84us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.099499:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9056 00000100:00100000:3.0:1746155649.100448:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0953480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976126221440:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 11198us (11963us total) trans 21474841718 rc 0/0 00000100:00100000:3.0:1746155649.100454:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1478 00002000:00100000:3.0:1746155649.100459:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3592192->4194303) req@ffff8800a0953480 x1830976126221440/t21474841718(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/448 e 0 to 0 dl 1746155660 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.100464:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0953480 with x1830976126221440 ext(3592192->4194303) 00010000:00010000:3.0:1746155649.100469:0:25394:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 19 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.100477:0:25394:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 19 pid: 10591 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746155649.100481:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a0953480 00010000:00010000:3.0:1746155649.100524:0:20796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.100529:0:20796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.100541:0:20796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.100545:0:20796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.100703:0:20796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.100707:0:20796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dee3a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155649.100709:0:20796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.100712:0:20796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.100719:0:20796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.100722:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dee3a00/0x844e5faceb5f93a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.100783:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1961:x1830976126220160:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 20828us (21113us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.100788:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17594 00000100:00100000:0.0:1746155649.101878:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.101914:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126222336 00000100:00100000:2.0:1746155649.101919:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126222336 00010000:00010000:2.0:1746155649.101934:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 19 pid: 10591 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.101951:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9057 00000100:00100000:2.0:1746155649.101957:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976126222336:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.101965:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.101975:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 19 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.101983:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 19 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.101994:0:22680:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f92f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e2d expref: 19 pid: 10591 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.102002:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.102004:0:22680:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.102007:0:22680:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.102013:0:22680:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.102027:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155649.102036:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.102042:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.102056:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.102063:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.102068:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.102074:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8801315ea400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155649.102076:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.102079:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1962:x1830976126222336:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 122us (203us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155649.102082:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.102084:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9057 00010000:00010000:0.0:1746155649.102095:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.102101:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801315ea400/0x844e5faceb5f93c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155649.102133:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0953100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1961:x1830976126220544:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 21882us (22082us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.102139:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17598 00000100:00100000:0.0:1746155649.102979:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.103016:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126222592 00000100:00100000:3.0:1746155649.103019:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126222592 00000100:00100000:3.0:1746155649.103048:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11264 00000100:00100000:3.0:1746155649.103053:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+18:32613:x1830976126222592:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:3.0:1746155649.103087:0:20364:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.103100:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3000/0x844e5faceb5f9367 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e73 expref: 18 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.103111:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.103114:0:20364:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155649.103135:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.103144:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b4e expref: 26 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.103150:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 26 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.103157:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b5c expref: 300 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.103162:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x844e5faceb5f911b lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d23 expref: 26 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.103168:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f916f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d4d expref: 300 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.103174:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136951c00/0x844e5faceb5f92e2 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e1f expref: 26 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.103179:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 9/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.103206:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136951c00/0x844e5faceb5f92e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e1f expref: 26 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.103215:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136951c00/0x844e5faceb5f92e2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e1f expref: 26 pid: 14234 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.103226:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125467648:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.103386:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f916f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d4d expref: 300 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.103394:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f916f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d4d expref: 300 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.103401:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125467776:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.103489:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x844e5faceb5f911b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d23 expref: 26 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.103497:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x844e5faceb5f911b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d23 expref: 26 pid: 14234 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.103525:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125467904:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.103748:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b5c expref: 300 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.103756:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b5c expref: 300 pid: 15474 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.103768:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125468032:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.103791:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 26 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.103797:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 26 pid: 27374 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.103802:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125468160:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.103815:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b4e expref: 26 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.103820:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b4e expref: 26 pid: 14234 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.103825:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125468288:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.103834:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1ece240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.105245:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.105258:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125467648:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.105266:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582a00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125467776:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155649.105269:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.105271:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580a80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125467904:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155649.105315:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.105385:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126222848 00000100:00100000:1.0:1746155649.105389:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126222848 00010000:00010000:1.0:1746155649.105582:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f916f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d4d expref: 301 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.105605:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126222720 00000100:00100000:1.0:1746155649.105607:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126222720 00010000:00010000:1.0:1746155649.105616:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136951c00/0x844e5faceb5f92e2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e1f expref: 27 pid: 14234 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.105635:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9058 00000100:00100000:0.0:1746155649.105672:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9059 00000100:00100000:0.0:1746155649.105678:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976126222720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155649.105686:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155649.105692:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136951c00/0x844e5faceb5f92e2 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e1f expref: 27 pid: 14234 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746155649.105704:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136951c00/0x844e5faceb5f92e2 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e1f expref: 27 pid: 14234 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746155649.105718:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136951c00/0x844e5faceb5f92e2 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e1f expref: 27 pid: 14234 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.105720:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126223104 00000100:00100000:2.0:1746155649.105724:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126223104 00010000:00010000:0.0:1746155649.105729:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155649.105733:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:0.0:1746155649.105740:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.105744:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4806 00000100:00100000:2.0:1746155649.105748:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea56050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:23568:x1830976126223104:12345-192.168.202.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746155649.105764:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1960:x1830976126222720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 86us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.105769:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9059 00000100:00100000:1.0:1746155649.105796:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+301:1961:x1830976126222848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.105803:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.105807:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f916f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d4d expref: 301 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.105814:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f916f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d4d expref: 301 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.105823:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7ec00/0x844e5faceb5f916f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d4d expref: 301 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.105833:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.105836:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155649.105841:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.105865:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1961:x1830976126222848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 225us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.105873:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9058 00000100:00100000:2.0:1746155649.105889:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea56050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:23568:x1830976126223104:12345-192.168.202.51@tcp:35:ldlm_bl.0 Request processed in 140us (619us total) trans 8589945451 rc 0/0 00000100:00100000:2.0:1746155649.105895:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4806 00000100:00100000:0.0:1746155649.106071:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.106089:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.106120:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.106138:0:22680:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126223488 00000100:00100000:2.0:1746155649.106141:0:22680:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126223488 00000100:00100000:1.0:1746155649.106164:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126223232 00000100:00100000:1.0:1746155649.106167:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126223232 00010000:00010000:1.0:1746155649.106176:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b5c expref: 300 pid: 15474 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.106188:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126223360 00000100:00100000:1.0:1746155649.106190:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126223360 00010000:00010000:1.0:1746155649.106197:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 28 pid: 27374 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.106210:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9060 00000100:00100000:1.0:1746155649.106215:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1960:x1830976126223232:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.106220:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.106223:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b5c expref: 300 pid: 15474 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.106234:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b5c expref: 300 pid: 15474 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.106236:0:22680:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b4e expref: 28 pid: 14234 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.106243:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.106246:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00000100:00100000:2.0:1746155649.106251:0:22680:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9061 00010000:00010000:1.0:1746155649.106251:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.106255:0:22680:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976126223360:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.106261:0:22680:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.106263:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a013b000/0x844e5faceb5f8e20 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b5c expref: 300 pid: 15474 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.106264:0:22680:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 28 pid: 27374 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.106266:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+300:1960:x1830976126223232:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 52us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.106271:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9060 00010000:00010000:2.0:1746155649.106272:0:22680:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 28 pid: 27374 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.106273:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125468032:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.106280:0:22680:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00000100:00100000:1.0:1746155649.106280:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9062 00010000:00010000:3.0:1746155649.106283:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f6e3000/0x844e5faceb5f8e19 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b55 expref: 28 pid: 27374 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.106283:0:22680:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155649.106284:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+28:1961:x1830976126223488:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.106287:0:22680:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155649.106289:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.106291:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b4e expref: 27 pid: 14234 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.106292:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125468160:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155649.106298:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b4e expref: 27 pid: 14234 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.106299:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125468288:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.106299:0:22680:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+27:1961:x1830976126223360:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 44us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.106304:0:22680:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9061 00010000:00010000:1.0:1746155649.106306:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4e3000/0x844e5faceb5f8e12 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18b4e expref: 27 pid: 14234 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.106313:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.106316:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155649.106320:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155649.106322:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155649.106330:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1961:x1830976126223488:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 46us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.106334:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9062 00000100:00100000:0.0:1746155649.107064:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.107166:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126223616 00000100:00100000:1.0:1746155649.107169:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126223616 00010000:00010000:1.0:1746155649.107181:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x844e5faceb5f911b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d23 expref: 25 pid: 14234 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.107221:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9063 00000100:00100000:1.0:1746155649.107225:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+25:1961:x1830976126223616:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.107229:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.107233:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x844e5faceb5f911b lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d23 expref: 25 pid: 14234 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.107238:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x844e5faceb5f911b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d23 expref: 25 pid: 14234 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.107245:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009450d800/0x844e5faceb5f911b lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18d23 expref: 25 pid: 14234 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.107252:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.107254:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155649.107258:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155649.107262:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:1.0:1746155649.107281:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155649.107306:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155649.107308:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1961:x1830976126223616:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 82us (245us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155649.107313:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:1.0:1746155649.107313:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9063 00000040:00080000:3.0:1746155649.107944:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3699, 88 off312440 00000004:00080000:3.0:1746155649.107950:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778257447080ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.107996:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3691, 88 off312000 00000004:00080000:3.0:1746155649.108001:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778257497759ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.108023:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3692, 88 off312088 00000004:00080000:3.0:1746155649.108027:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778257523638ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.108033:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3700, 88 off312528 00000004:00080000:3.0:1746155649.108036:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778257532870ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.108041:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3701, 88 off312616 00000004:00080000:3.0:1746155649.108043:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778257540040ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.108051:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3693, 88 off312176 00000004:00080000:3.0:1746155649.108053:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778257550572ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.108319:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3694, 88 off312264 00000004:00080000:3.0:1746155649.108324:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778257820975ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.108342:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3695, 88 off312352 00000004:00080000:3.0:1746155649.108344:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778257841308ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.108351:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3702, 88 off312704 00000004:00080000:3.0:1746155649.108354:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778257850822ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.108644:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3696, 88 off312440 00000004:00080000:3.0:1746155649.108649:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778258145633ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.108676:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3703, 88 off312792 00000004:00080000:3.0:1746155649.108679:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778258176307ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.108688:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3697, 88 off312528 00000004:00080000:3.0:1746155649.108691:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778258187925ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.108698:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3704, 88 off312880 00000004:00080000:3.0:1746155649.108701:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778258197597ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.108708:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3705, 88 off312968 00000004:00080000:3.0:1746155649.108710:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778258207158ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.108841:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3706, 88 off313056 00000004:00080000:3.0:1746155649.108845:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778258342303ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.108914:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3707, 88 off313144 00000004:00080000:3.0:1746155649.108918:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778258414697ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.108925:0:20364:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3698, 88 off312616 00000004:00080000:3.0:1746155649.108927:0:20364:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778258424440ns, next at 716011101328ns, rc = 0 00000001:00080000:0.0:1746155649.125041:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945446 is committed 00000001:00080000:0.0:1746155649.125051:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945439 is committed 00000001:00080000:0.0:1746155649.125060:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945416 is committed 00000004:00010000:2.0:1746155649.125063:0:20364:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009c28f100 reply state ffff88009afc4000 transno 8589945452 ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000001:00080000:0.0:1746155649.125067:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945447 is committed 00000100:00100000:2.0:1746155649.125073:0:20364:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1746155649.125073:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945451 is committed 00000001:00080000:0.0:1746155649.125106:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945452 is committed 00000004:00080000:0.0:1746155649.125110:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2881 committed 00000004:00080000:0.0:1746155649.125115:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2884 committed 00000004:00080000:0.0:1746155649.125120:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2883 committed 00000004:00080000:0.0:1746155649.125122:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2882 committed 00000004:00080000:0.0:1746155649.125123:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2881 committed 00000004:00080000:0.0:1746155649.125124:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2880 committed 00000004:00080000:0.0:1746155649.125125:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2880 committed 00000004:00080000:0.0:1746155649.125126:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2879 committed 00000004:00080000:0.0:1746155649.125127:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2879 committed 00000004:00080000:0.0:1746155649.125129:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2878 committed 00000004:00080000:0.0:1746155649.125130:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2877 committed 00000004:00080000:0.0:1746155649.125131:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2876 committed 00000004:00080000:0.0:1746155649.125132:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2878 committed 00000004:00080000:0.0:1746155649.125134:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2877 committed 00000004:00080000:0.0:1746155649.125136:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2875 committed 00000004:00080000:0.0:1746155649.125137:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2874 committed 00000004:00080000:0.0:1746155649.125139:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2876 committed 00010000:00080000:2.0:1746155649.125156:0:20364:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1746155649.125169:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32613:x1830976126222592:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 22111us (22186us total) trans 8589945452 rc 0/0 00000100:00100000:2.0:1746155649.125176:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11264 00000100:00100000:2.0:1746155649.125275:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125468544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.125275:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125468416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.125307:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.125322:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155649.125327:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125468928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.125333:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125469056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.125339:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.125350:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125468416 00000100:00100000:2.0:1746155649.125356:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125468416 00000100:00100000:0.0:1746155649.125358:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125468672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.125370:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155649.125378:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125469184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.125385:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125468544 00000100:00100000:2.0:1746155649.125387:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125468544 00000100:00100000:0.0:1746155649.125389:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.125396:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125468928 00000100:00100000:2.0:1746155649.125398:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125468928 00000100:00100000:0.0:1746155649.125398:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746155649.125401:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125468800:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.125408:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125468672 00000100:00100000:2.0:1746155649.125409:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125468672 00000100:00100000:0.0:1746155649.125412:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746155649.125623:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.125630:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.125635:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.125643:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009520ca00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155649.125646:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.125652:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.125663:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.125666:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155649.125669:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.125673:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009520ca00/0x844e5faceb5f93c9 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155649.125685:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125469824:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155649.125870:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125469312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.125887:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155649.126189:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125468800 00000100:00100000:3.0:1746155649.126193:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125468800 00000100:00100000:0.0:1746155649.126208:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125469696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.126209:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125469312 00000100:00100000:3.0:1746155649.126211:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125469312 00000100:00100000:3.0:1746155649.126219:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17599 00000100:00100000:3.0:1746155649.126224:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3297:x1830976125468416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.126224:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155649.126230:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125470208:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155649.126240:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155649.126256:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125469696 00000100:00100000:0.0:1746155649.126258:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125469696 00000100:00100000:0.0:1746155649.126270:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125470208 00000100:00100000:0.0:1746155649.126272:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125470208 00000100:00100000:0.0:1746155649.126279:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17600 00000100:00100000:0.0:1746155649.126283:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3298:x1830976125468544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.126371:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3298:x1830976125468544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 87us (1047us total) trans 17179874416 rc 0/0 00000100:00100000:0.0:1746155649.126376:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17600 00000100:00100000:3.0:1746155649.126384:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3297:x1830976125468416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (1077us total) trans 17179874417 rc 0/0 00000100:00100000:0.0:1746155649.126388:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17601 00000100:00100000:3.0:1746155649.126390:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17599 00000100:00100000:0.0:1746155649.126392:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3297:x1830976125468928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155649.126398:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17602 00000100:00100000:3.0:1746155649.126401:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3295:x1830976125468672:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1746155649.126444:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746155649.126447:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155649.126456:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17603 00000100:00100000:0.0:1746155649.126461:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976125468800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155649.126465:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976125468672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (1095us total) trans 17179874418 rc 0/0 00000100:00100000:3.0:1746155649.126471:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17602 00000100:00100000:3.0:1746155649.126479:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17604 00000100:00100000:3.0:1746155649.126483:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3295:x1830976125469312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.126547:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125468800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (1133us total) trans 17179874420 rc 0/0 00000100:00100000:0.0:1746155649.126552:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17603 00000100:00100000:3.0:1746155649.126557:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125469312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (669us total) trans 17179874421 rc 0/0 00000100:00100000:3.0:1746155649.126561:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17604 00000100:00100000:2.0:1746155649.126677:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125469184 00000100:00100000:2.0:1746155649.126681:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125469184 00000100:00100000:0.0:1746155649.127155:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17605 00000100:00100000:0.0:1746155649.127161:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3295:x1830976125469696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155649.127248:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3295:x1830976125469696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (1023us total) trans 21474841719 rc 0/0 00000100:00100000:0.0:1746155649.127253:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17605 00000100:00100000:0.0:1746155649.127262:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17606 00000100:00100000:0.0:1746155649.127265:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3295:x1830976125470208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155649.127325:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3295:x1830976125470208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (1084us total) trans 21474841720 rc 0/0 00000100:00100000:0.0:1746155649.127329:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17606 00000100:00100000:0.0:1746155649.127368:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125469440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155649.127383:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155649.127393:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125469952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155649.127403:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155649.127416:0:3297:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874408 gen 2 00000004:00080000:0.0:1746155649.127420:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa35180, transno 17179874298 00000004:00080000:0.0:1746155649.127424:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa35f80, transno 17179874299 00000004:00080000:0.0:1746155649.127427:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa35500, transno 17179874300 00000004:00080000:0.0:1746155649.127428:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa36300, transno 17179874301 00000004:00080000:0.0:1746155649.127430:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa36680, transno 17179874302 00000004:00080000:0.0:1746155649.127432:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa35c00, transno 17179874303 00000004:00080000:0.0:1746155649.127433:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa36a00, transno 17179874304 00000004:00080000:0.0:1746155649.127435:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094440700, transno 17179874305 00000004:00080000:0.0:1746155649.127436:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa35880, transno 17179874306 00000004:00080000:0.0:1746155649.127438:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009045c700, transno 17179874315 00000004:00080000:0.0:1746155649.127440:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1f0380, transno 17179874316 00000004:00080000:0.0:1746155649.127442:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009045e680, transno 17179874317 00000004:00080000:0.0:1746155649.127443:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009045fb80, transno 17179874318 00000004:00080000:0.0:1746155649.127445:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009045f480, transno 17179874319 00000004:00080000:0.0:1746155649.127446:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009045c000, transno 17179874320 00000004:00080000:0.0:1746155649.127448:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009045e300, transno 17179874321 00000004:00080000:0.0:1746155649.127449:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009045ca80, transno 17179874322 00000004:00080000:0.0:1746155649.127451:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f580e00, transno 17179874323 00000004:00080000:0.0:1746155649.127453:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0d9c00, transno 17179874327 00000004:00080000:0.0:1746155649.127455:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feda300, transno 17179874328 00000004:00080000:0.0:1746155649.127456:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009feda680, transno 17179874329 00000004:00080000:0.0:1746155649.127458:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fed8700, transno 17179874330 00000004:00080000:0.0:1746155649.127459:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac4380, transno 17179874331 00000004:00080000:0.0:1746155649.127461:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0d9500, transno 17179874332 00000004:00080000:0.0:1746155649.127462:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac6d80, transno 17179874333 00000004:00080000:0.0:1746155649.127464:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0dbb80, transno 17179874334 00000004:00080000:0.0:1746155649.127467:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fedbb80, transno 17179874335 00000004:00080000:0.0:1746155649.127468:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1f2300, transno 17179874336 00000004:00080000:0.0:1746155649.127470:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f581180, transno 17179874337 00000004:00080000:0.0:1746155649.127472:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f582300, transno 17179874338 00000004:00080000:0.0:1746155649.127473:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1f2a00, transno 17179874339 00000004:00080000:0.0:1746155649.127475:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f580000, transno 17179874340 00000004:00080000:0.0:1746155649.127476:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f7100, transno 17179874341 00000004:00080000:0.0:1746155649.127478:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1f0e00, transno 17179874342 00000004:00080000:0.0:1746155649.127480:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f4000, transno 17179874343 00000004:00080000:0.0:1746155649.127481:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f4700, transno 17179874344 00000004:00080000:0.0:1746155649.127483:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013089a680, transno 17179874354 00000004:00080000:0.0:1746155649.127484:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013089aa00, transno 17179874355 00000004:00080000:0.0:1746155649.127486:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130899f80, transno 17179874356 00000004:00080000:0.0:1746155649.127488:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130899c00, transno 17179874357 00000004:00080000:0.0:1746155649.127490:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013089bb80, transno 17179874358 00000004:00080000:0.0:1746155649.127491:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013089b480, transno 17179874359 00000004:00080000:0.0:1746155649.127493:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130898700, transno 17179874360 00000004:00080000:0.0:1746155649.127494:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130898a80, transno 17179874361 00000004:00080000:0.0:1746155649.127495:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013089a300, transno 17179874362 00000004:00080000:0.0:1746155649.127497:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fd500, transno 17179874363 00000004:00080000:0.0:1746155649.127499:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdee300, transno 17179874364 00000004:00080000:0.0:1746155649.127513:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdee680, transno 17179874365 00000004:00080000:0.0:1746155649.127515:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fe300, transno 17179874366 00000004:00080000:0.0:1746155649.127516:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdece00, transno 17179874367 00000004:00080000:0.0:1746155649.127518:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fc700, transno 17179874368 00000004:00080000:0.0:1746155649.127519:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdec380, transno 17179874369 00000004:00080000:0.0:1746155649.127521:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012cdec700, transno 17179874370 00000004:00080000:0.0:1746155649.127523:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc52a00, transno 17179874371 00000004:00080000:0.0:1746155649.127525:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc50000, transno 17179874379 00000004:00080000:0.0:1746155649.127526:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc53480, transno 17179874380 00000004:00080000:0.0:1746155649.127529:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc51c00, transno 17179874381 00000004:00080000:0.0:1746155649.127531:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc51180, transno 17179874382 00000004:00080000:0.0:1746155649.127532:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc52d80, transno 17179874383 00000004:00080000:0.0:1746155649.127534:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc51880, transno 17179874384 00000004:00080000:0.0:1746155649.127535:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc50a80, transno 17179874385 00000004:00080000:0.0:1746155649.127537:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc53800, transno 17179874386 00000004:00080000:0.0:1746155649.127538:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc52300, transno 17179874387 00000004:00080000:0.0:1746155649.127540:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc4000, transno 17179874391 00000004:00080000:0.0:1746155649.127541:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc4700, transno 17179874392 00000004:00080000:0.0:1746155649.127543:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc7b80, transno 17179874393 00000004:00080000:0.0:1746155649.127545:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc4380, transno 17179874394 00000004:00080000:0.0:1746155649.127547:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526a300, transno 17179874395 00000004:00080000:0.0:1746155649.127548:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc7480, transno 17179874396 00000004:00080000:0.0:1746155649.127550:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095269c00, transno 17179874397 00000004:00080000:0.0:1746155649.127552:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f581c00, transno 17179874398 00000004:00080000:0.0:1746155649.127554:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc5f80, transno 17179874399 00000004:00080000:0.0:1746155649.127555:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526aa00, transno 17179874400 00000004:00080000:0.0:1746155649.127557:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013089b100, transno 17179874401 00000004:00080000:0.0:1746155649.127559:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526a680, transno 17179874402 00000004:00080000:0.0:1746155649.127561:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095268380, transno 17179874403 00000004:00080000:0.0:1746155649.127563:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009526ad80, transno 17179874404 00000100:00100000:3.0:1746155649.127662:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125469440 00000100:00100000:3.0:1746155649.127666:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125469440 00000100:00100000:3.0:1746155649.127675:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125469952 00000100:00100000:3.0:1746155649.127677:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125469952 00000100:00100000:3.0:1746155649.127684:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17607 00000100:00100000:3.0:1746155649.127688:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3297:x1830976125469440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155649.127759:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17608 00000100:00100000:3.0:1746155649.127769:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3297:x1830976125469440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 80us (385us total) trans 21474841721 rc 0/0 00000100:00100000:1.0:1746155649.127777:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3297:x1830976125469952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.127778:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17607 00000100:00100000:3.0:1746155649.127798:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155649.127811:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125470336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.127825:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155649.127840:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125469824 00000100:00100000:3.0:1746155649.127843:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125469824 00000100:00100000:3.0:1746155649.127863:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125470336 00000100:00100000:3.0:1746155649.127865:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125470336 00000100:00100000:3.0:1746155649.127873:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17609 00000100:00100000:3.0:1746155649.127877:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976125469824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155649.127883:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:1.0:1746155649.127886:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155649.127888:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746155649.127890:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:1.0:1746155649.127891:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:1.0:1746155649.127911:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3297:x1830976125469952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (506us total) trans 21474841722 rc 0/0 00000100:00100000:1.0:1746155649.127916:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17608 00000100:00100000:1.0:1746155649.127925:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17610 00000100:00100000:1.0:1746155649.127929:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3296:x1830976125470336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.127969:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976125469824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 91us (170us total) trans 21474841723 rc 0/0 00000100:00100000:3.0:1746155649.127977:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17609 00000100:00100000:3.0:1746155649.127994:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841708 gen 2 00000100:00100000:1.0:1746155649.127995:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3296:x1830976125470336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (169us total) trans 21474841724 rc 0/0 00000004:00080000:3.0:1746155649.127997:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a5f80, transno 21474841609 00000100:00100000:1.0:1746155649.127999:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17610 00000004:00080000:3.0:1746155649.128002:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac7480, transno 21474841610 00000004:00080000:3.0:1746155649.128004:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009b880e00, transno 21474841611 00000004:00080000:3.0:1746155649.128006:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c4e00, transno 21474841612 00000004:00080000:3.0:1746155649.128008:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c4700, transno 21474841613 00000004:00080000:3.0:1746155649.128010:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094e34700, transno 21474841614 00000004:00080000:3.0:1746155649.128011:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac7800, transno 21474841615 00000004:00080000:3.0:1746155649.128013:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fac7b80, transno 21474841616 00000004:00080000:3.0:1746155649.128015:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc50380, transno 21474841617 00000004:00080000:3.0:1746155649.128017:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6061180, transno 21474841618 00000004:00080000:3.0:1746155649.128019:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa34700, transno 21474841619 00000004:00080000:3.0:1746155649.128021:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa34380, transno 21474841620 00000004:00080000:3.0:1746155649.128023:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa34a80, transno 21474841621 00000004:00080000:3.0:1746155649.128025:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa34e00, transno 21474841622 00000004:00080000:3.0:1746155649.128026:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fa34000, transno 21474841623 00000004:00080000:3.0:1746155649.128028:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a6060700, transno 21474841624 00000004:00080000:3.0:1746155649.128031:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094442680, transno 21474841632 00000004:00080000:3.0:1746155649.128033:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094440380, transno 21474841633 00000004:00080000:3.0:1746155649.128035:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094441880, transno 21474841634 00000004:00080000:3.0:1746155649.128037:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094442d80, transno 21474841635 00000004:00080000:3.0:1746155649.128038:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094443100, transno 21474841636 00000004:00080000:3.0:1746155649.128044:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094441500, transno 21474841637 00000004:00080000:3.0:1746155649.128046:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094440e00, transno 21474841638 00000004:00080000:3.0:1746155649.128048:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094441f80, transno 21474841639 00000004:00080000:3.0:1746155649.128049:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f881c00, transno 21474841643 00000004:00080000:3.0:1746155649.128051:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f883480, transno 21474841644 00000004:00080000:3.0:1746155649.128053:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f881180, transno 21474841645 00000004:00080000:3.0:1746155649.128055:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f880380, transno 21474841646 00000004:00080000:3.0:1746155649.128056:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f880700, transno 21474841647 00000004:00080000:3.0:1746155649.128058:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f883800, transno 21474841648 00000004:00080000:3.0:1746155649.128059:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f880a80, transno 21474841649 00000004:00080000:3.0:1746155649.128061:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f880000, transno 21474841650 00000004:00080000:3.0:1746155649.128062:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc5180, transno 21474841651 00000004:00080000:3.0:1746155649.128064:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc7100, transno 21474841652 00000004:00080000:3.0:1746155649.128065:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc7800, transno 21474841653 00000004:00080000:3.0:1746155649.128067:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc6a00, transno 21474841654 00000004:00080000:3.0:1746155649.128068:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc5c00, transno 21474841655 00000004:00080000:3.0:1746155649.128070:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc4a80, transno 21474841656 00000004:00080000:3.0:1746155649.128071:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc6680, transno 21474841657 00000004:00080000:3.0:1746155649.128073:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc5500, transno 21474841658 00000004:00080000:3.0:1746155649.128074:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a5c00, transno 21474841664 00000004:00080000:3.0:1746155649.128076:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a4380, transno 21474841665 00000004:00080000:3.0:1746155649.128077:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a4e00, transno 21474841666 00000004:00080000:3.0:1746155649.128079:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a6680, transno 21474841667 00000004:00080000:3.0:1746155649.128081:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130898380, transno 21474841668 00000004:00080000:3.0:1746155649.128082:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a7480, transno 21474841669 00000004:00080000:3.0:1746155649.128084:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a7100, transno 21474841670 00000004:00080000:3.0:1746155649.128085:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a4000, transno 21474841671 00000004:00080000:3.0:1746155649.128087:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a01d1180, transno 21474841672 00000004:00080000:3.0:1746155649.128088:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a6300, transno 21474841673 00000004:00080000:3.0:1746155649.128090:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a4a80, transno 21474841674 00000004:00080000:3.0:1746155649.128092:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a4700, transno 21474841675 00000004:00080000:3.0:1746155649.128093:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a7b80, transno 21474841676 00000004:00080000:3.0:1746155649.128095:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a5500, transno 21474841677 00000004:00080000:3.0:1746155649.128097:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a7800, transno 21474841678 00000004:00080000:3.0:1746155649.128099:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a06a5180, transno 21474841679 00000004:00080000:3.0:1746155649.128101:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca95180, transno 21474841682 00000004:00080000:3.0:1746155649.128102:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f6a00, transno 21474841683 00000004:00080000:3.0:1746155649.128104:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fce00, transno 21474841684 00000004:00080000:3.0:1746155649.128106:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ca94a80, transno 21474841685 00000004:00080000:3.0:1746155649.128108:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f4380, transno 21474841686 00000004:00080000:3.0:1746155649.128110:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fdc00, transno 21474841687 00000004:00080000:3.0:1746155649.128112:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f5880, transno 21474841688 00000004:00080000:3.0:1746155649.128114:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f7480, transno 21474841689 00000004:00080000:3.0:1746155649.128116:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26df80, transno 21474841693 00000004:00080000:3.0:1746155649.128118:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26ca80, transno 21474841694 00000004:00080000:3.0:1746155649.128119:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26c380, transno 21474841695 00000004:00080000:3.0:1746155649.128122:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26d180, transno 21474841696 00000004:00080000:3.0:1746155649.128124:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26f800, transno 21474841697 00000004:00080000:3.0:1746155649.128125:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26ea00, transno 21474841698 00000004:00080000:3.0:1746155649.128127:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26f480, transno 21474841699 00000004:00080000:3.0:1746155649.128129:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008e26e680, transno 21474841700 00000004:00080000:3.0:1746155649.128130:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f0d9880, transno 21474841701 00000004:00080000:3.0:1746155649.128132:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c4380, transno 21474841702 00000004:00080000:3.0:1746155649.128135:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fc53100, transno 21474841703 00000004:00080000:3.0:1746155649.128137:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c4000, transno 21474841704 00000004:00080000:3.0:1746155649.128138:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c7b80, transno 21474841705 00000004:00080000:3.0:1746155649.128140:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c5f80, transno 21474841706 00000004:00080000:3.0:1746155649.128143:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c5c00, transno 21474841707 00000004:00080000:3.0:1746155649.128144:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c6300, transno 21474841708 00000100:00100000:3.0:1746155649.128149:0:3296:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009f580a80 x1830976125469824/t21474841723(21474841723) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746155665 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746155649.128157:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f580a80/2, rc 0, transno 21474841723 00000100:00100000:3.0:1746155649.128161:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125469824:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155649.128178:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880095269f80, transno 17179874405 00000004:00080000:0.0:1746155649.128180:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880130899880, transno 17179874406 00000004:00080000:0.0:1746155649.128182:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131497800, transno 17179874407 00000004:00080000:0.0:1746155649.128184:0:3297:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a3fc6d80, transno 17179874408 00000100:00100000:0.0:1746155649.128188:0:3297:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009c28e680 x1830976125468416/t17179874417(17179874417) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746155665 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000100:00100000:2.0:1746155649.128212:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17611 00000100:00100000:2.0:1746155649.128218:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976125469184:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155649.128265:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.128284:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126223744 00000100:00100000:1.0:1746155649.128286:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126223744 00000100:00100000:1.0:1746155649.128305:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11265 00000100:00100000:1.0:1746155649.128310:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32613:x1830976126223744:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155649.128320:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155649.128329:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125469184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (2939us total) trans 17179874422 rc 0/0 00010000:00010000:1.0:1746155649.128332:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009455ca00/0x844e5faceb5f93d0 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18e9d expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.128334:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17611 00010000:00010000:1.0:1746155649.128366:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009455ca00/0x844e5faceb5f93d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e9d expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.128376:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009455ca00/0x844e5faceb5f93d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e9d expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.128389:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.128391:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155649.128393:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009455ca00, rc 0) 00000100:00100000:2.0:1746155649.128402:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155649.128414:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32613:x1830976126223744:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 104us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.128419:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11265 00000100:00100000:2.0:1746155649.128421:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125469568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.128437:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.128446:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125470080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.128459:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155649.128484:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c28e680/2, rc 0, transno 17179874417 00000100:00100000:0.0:1746155649.128488:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125468416:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155649.128521:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f583b80/2, rc 0, transno 21474841721 00000100:00100000:0.0:1746155649.128524:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125469440:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155649.128533:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f582a00/2, rc 0, transno 21474841722 00000100:00100000:0.0:1746155649.128535:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125469952:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155649.128609:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f582680/2, rc 0, transno 21474841724 00000100:00100000:3.0:1746155649.128613:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125470336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155649.128898:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976125468928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2505us (3556us total) trans 17179874419 rc 0/0 00000100:00100000:0.0:1746155649.128903:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17601 00000100:00100000:0.0:1746155649.128912:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125469056 00000100:00100000:0.0:1746155649.128914:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125469056 00000004:00080000:1.0:1746155649.128964:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366c700/2, rc 0, transno 17179874419 00000100:00100000:1.0:1746155649.128968:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125468928:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155649.129019:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c28c000/2, rc 0, transno 17179874416 00000100:00100000:2.0:1746155649.129023:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125468544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.129236:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125469568 00000100:00100000:0.0:1746155649.129239:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125469568 00000004:00080000:3.0:1746155649.129250:0:14274:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 80 done 00000004:00080000:1.0:1746155649.129300:0:14277:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 5 in flight, 81 done 00000100:00100000:1.0:1746155649.129329:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125470464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.129346:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125470080 00000100:00100000:1.0:1746155649.129347:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.129349:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125470080 00000100:00100000:2.0:1746155649.129361:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125470464 00000100:00100000:2.0:1746155649.129362:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125470464 00000100:00100000:1.0:1746155649.129365:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17612 00000100:00100000:1.0:1746155649.129370:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976125469056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.129371:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17613 00000100:00100000:2.0:1746155649.129375:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3298:x1830976125469568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.129454:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976125469568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (1017us total) trans 21474841725 rc 0/0 00000100:00100000:1.0:1746155649.129454:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3298:x1830976125469056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (1051us total) trans 17179874423 rc 0/0 00000100:00100000:2.0:1746155649.129459:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17613 00000100:00100000:1.0:1746155649.129467:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17612 00000100:00100000:2.0:1746155649.129469:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17614 00000100:00100000:2.0:1746155649.129474:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3298:x1830976125470080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155649.129475:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17615 00000100:00100000:1.0:1746155649.129479:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976125470464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.129557:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3298:x1830976125470080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 82us (1096us total) trans 21474841726 rc 0/0 00000100:00100000:1.0:1746155649.129557:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3297:x1830976125470464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (210us total) trans 17179874424 rc 0/0 00000100:00100000:2.0:1746155649.129562:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17614 00000100:00100000:1.0:1746155649.129564:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17615 00000004:00080000:1.0:1746155649.129579:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf4700/2, rc 0, transno 17179874424 00000004:00080000:2.0:1746155649.129581:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f582d80/2, rc 0, transno 21474841725 00000100:00100000:1.0:1746155649.129582:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125470464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.129583:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125469568:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155649.129589:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f581f80/2, rc 0, transno 21474841726 00000100:00100000:2.0:1746155649.129592:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125470080:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155649.129597:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009366f480/2, rc 0, transno 17179874423 00000004:00080000:1.0:1746155649.129597:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f583480/2, rc 0, transno 21474841719 00000100:00100000:2.0:1746155649.129599:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009366f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125469056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155649.129600:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125469696:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155649.129606:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f583800/2, rc 0, transno 21474841720 00000100:00100000:1.0:1746155649.129608:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125470208:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155649.129631:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800936f6d80/2, rc 0, transno 17179874420 00000100:00100000:1.0:1746155649.129634:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800936f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125468800:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155649.129640:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094441c00/2, rc 0, transno 17179874421 00000100:00100000:1.0:1746155649.129641:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125469312:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155649.129646:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c28ea00/2, rc 0, transno 17179874418 00000100:00100000:1.0:1746155649.129648:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c28ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125468672:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155649.129653:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094443480/2, rc 0, transno 17179874422 00000100:00100000:1.0:1746155649.129655:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125469184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.132670:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.132736:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126223872 00000100:00100000:1.0:1746155649.132742:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126223872 00000100:00100000:1.0:1746155649.132785:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11266 00000100:00100000:1.0:1746155649.132792:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32613:x1830976126223872:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155649.132810:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155649.132825:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c283200/0x844e5faceb5f93d7 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ea4 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.132898:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c283e00/0x844e5faceb5f93de lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155649.132908:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c283e00/0x844e5faceb5f93de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155649.132917:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c283e00/0x844e5faceb5f93de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155649.132938:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:1.0:1746155649.132941:0:14234:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746155649.132952:0:14234:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c283e00/0x844e5faceb5f93de lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155649.132973:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c283200/0x844e5faceb5f93d7 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ea4 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.132985:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c283e00/0x844e5faceb5f93de lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ea4 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.132991:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.132993:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155649.132996:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c283e00, rc 0) 00000100:00100000:1.0:1746155649.133042:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32613:x1830976126223872:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 250us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.133047:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11266 00000100:00100000:0.0:1746155649.134567:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.134589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.134607:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.134609:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126224128 00000100:00100000:1.0:1746155649.134613:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126224128 00000100:00100000:0.0:1746155649.134620:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.134631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.134635:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126224000 00000100:00100000:1.0:1746155649.134636:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126224000 00000100:00100000:1.0:1746155649.134660:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126224384 00000100:00100000:1.0:1746155649.134661:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126224384 00000100:00100000:1.0:1746155649.134671:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126224256 00000100:00100000:1.0:1746155649.134672:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126224256 00000100:00100000:1.0:1746155649.134680:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126224512 00000100:00100000:1.0:1746155649.134681:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126224512 00000100:00100000:1.0:1746155649.134697:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17616 00000100:00100000:1.0:1746155649.134703:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126224128:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155649.134715:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155649.134726:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a013b600/0x844e5faceb5f93e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18eb2 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155649.134748:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x68143881, atime: 0x6814387f, ctime: 0x68143881, blocks: 0x81f 00010000:00010000:1.0:1746155649.134760:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.134762:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.134768:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a013b600/0x844e5faceb5f93e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb2 expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155649.134780:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a013b600/0x844e5faceb5f93e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb2 expref: 8 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155649.134788:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a013b600, rc 0) 00000100:00100000:3.0:1746155649.134799:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17617 00000100:00100000:3.0:1746155649.134806:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126224000:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:1.0:1746155649.134810:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126224128:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 108us (246us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155649.134812:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155649.134815:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17616 00010000:00010000:3.0:1746155649.134821:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5f93ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18eab expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.134824:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17618 00000100:00100000:1.0:1746155649.134827:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126224384:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155649.134831:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:3.0:1746155649.134835:0:4461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e1:0x0] initial LVB size: 1048576, mtime: 0x6814387f, atime: 0x6814387f, ctime: 0x6814387f, blocks: 0x7e9 00010000:00010000:1.0:1746155649.134838:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a013a200/0x844e5faceb5f93f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ec0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.134842:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.134843:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:1.0:1746155649.134846:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e3:0x0] initial LVB size: 2097152, mtime: 0x68143881, atime: 0x68143880, ctime: 0x68143881, blocks: 0x821 00010000:00010000:3.0:1746155649.134847:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5f93ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eab expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155649.134863:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.134865:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.134868:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a013a200/0x844e5faceb5f93f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ec0 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.134870:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5f93ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eab expref: 9 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.134876:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374c400, rc 0) 00010000:00010000:1.0:1746155649.134880:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a013a200/0x844e5faceb5f93f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ec0 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155649.134886:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a013a200, rc 0) 00000100:00100000:3.0:1746155649.134891:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126224000:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 87us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.134895:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17617 00000100:00100000:1.0:1746155649.134895:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126224384:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 68us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.134899:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17618 00000100:00100000:1.0:1746155649.134907:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17619 00000100:00100000:0.0:1746155649.134928:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.134950:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126224640 00000100:00100000:2.0:1746155649.134954:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126224640 00000100:00100000:3.0:1746155649.135253:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17620 00000100:00100000:3.0:1746155649.135259:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126224512:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155649.135265:0:4461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.135272:0:4461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f93fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ec7 expref: -99 pid: 4461 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155649.135285:0:4461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e4:0x0] initial LVB size: 5079552, mtime: 0x68143881, atime: 0x68143880, ctime: 0x68143881, blocks: 0x1711 00010000:00010000:3.0:1746155649.135292:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.135293:0:4461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.135296:0:4461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f93fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ec7 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.135304:0:4461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f93fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ec7 expref: 8 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.135309:0:4461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801315ea400, rc 0) 00000100:00100000:3.0:1746155649.135326:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126224512:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 68us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.135330:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17620 00000100:00100000:0.0:1746155649.135480:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17621 00000100:00100000:0.0:1746155649.135493:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126224640:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155649.135499:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155649.135526:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f9401 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ece expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746155649.135537:0:18270:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e2:0x0] initial LVB size: 4194304, mtime: 0x68143881, atime: 0x68143880, ctime: 0x68143881, blocks: 0x1029 00010000:00010000:0.0:1746155649.135543:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.135545:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.135548:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f9401 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ece expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.135556:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f9401 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ece expref: 9 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.135562:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6ef0c00, rc 0) 00000100:00100000:0.0:1746155649.135574:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126224640:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 90us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.135773:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17621 00000100:00100000:1.0:1746155649.136197:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126224256:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155649.136204:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155649.136212:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a013ba00/0x844e5faceb5f9408 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18eb9 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155649.136222:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x68143881, atime: 0x68143881, ctime: 0x68143881, blocks: 0x81f 00010000:00010000:1.0:1746155649.136229:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.136230:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.136234:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a013ba00/0x844e5faceb5f9408 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb9 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155649.136242:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a013ba00/0x844e5faceb5f9408 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb9 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155649.136248:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a013ba00, rc 0) 00000100:00100000:1.0:1746155649.136268:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126224256:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1357us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.136276:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17619 00000100:00100000:0.0:1746155649.142194:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.142230:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.143376:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.143467:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.143820:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.143833:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.143844:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.143869:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.143890:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126225024 00000100:00100000:0.0:1746155649.143898:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126225024 00000100:00100000:0.0:1746155649.143939:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126225152 00000100:00100000:0.0:1746155649.143942:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126225152 00000100:00100000:0.0:1746155649.143956:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126225408 00000100:00100000:0.0:1746155649.143958:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126225408 00000100:00100000:0.0:1746155649.143968:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126225664 00000100:00100000:0.0:1746155649.143970:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126225664 00000100:00100000:0.0:1746155649.143979:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126226176 00000100:00100000:0.0:1746155649.143980:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126226176 00000100:00100000:2.0:1746155649.143981:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126226304 00000100:00100000:2.0:1746155649.143986:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126226304 00000100:00100000:0.0:1746155649.143990:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126226048 00000100:00100000:0.0:1746155649.143993:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126226048 00000100:00100000:0.0:1746155649.144003:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126226560 00000100:00100000:0.0:1746155649.144004:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126226560 00000100:00100000:2.0:1746155649.144008:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8375 00000100:00100000:1.0:1746155649.144014:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8376 00000100:00100000:2.0:1746155649.144015:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126225024:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:1.0:1746155649.144020:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976126225152:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155649.144041:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131004200/0x844e5faceb5f9416 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.144041:0:31249:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a013a600/0x844e5faceb5f940f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.144052:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.144052:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.144054:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.144054:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.144058:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131004200/0x844e5faceb5f9416 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.144058:0:31249:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a013a600/0x844e5faceb5f940f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.144068:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131004200/0x844e5faceb5f9416 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.144068:0:31249:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a013a600/0x844e5faceb5f940f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155649.145660:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8377 00000100:00100000:0.0:1746155649.145674:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976126225408:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155649.145708:0:31251:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f941d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.145718:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.145720:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.145723:0:31251:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f941d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.145733:0:31251:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f941d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.145889:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8378 00000100:00100000:1.0:1746155649.145898:0:25393:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8379 00000100:00100000:3.0:1746155649.145900:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976126225664:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:1.0:1746155649.145910:0:25393:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976126226176:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155649.145916:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009469ee00/0x844e5faceb5f9424 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.145923:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.145924:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.145925:0:25393:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a013b800/0x844e5faceb5f942b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.145927:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009469ee00/0x844e5faceb5f9424 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.145931:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.145932:0:25393:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.145934:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009469ee00/0x844e5faceb5f9424 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.145934:0:25393:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a013b800/0x844e5faceb5f942b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.145940:0:25393:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a013b800/0x844e5faceb5f942b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155649.147879:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8380 00000100:00100000:0.0:1746155649.147890:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126226048:12345-192.168.202.51@tcp:3:lfs.0 00000100:00100000:2.0:1746155649.147915:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8381 00010000:00010000:0.0:1746155649.147917:0:10888:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f458800/0x844e5faceb5f9432 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.147924:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976126226304:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155649.147927:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.147928:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.147932:0:10888:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f458800/0x844e5faceb5f9432 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.147940:0:31253:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131004c00/0x844e5faceb5f9439 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.147941:0:10888:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f458800/0x844e5faceb5f9432 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.147947:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.147948:0:31253:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.147951:0:31253:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131004c00/0x844e5faceb5f9439 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.147958:0:31253:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131004c00/0x844e5faceb5f9439 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.148011:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8382 00000100:00100000:2.0:1746155649.148016:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976126226560:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155649.148028:0:31250:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009455ce00/0x844e5faceb5f9440 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.148034:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.148035:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.148037:0:31250:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009455ce00/0x844e5faceb5f9440 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.148043:0:31250:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009455ce00/0x844e5faceb5f9440 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.160924:0:25393:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a013b800/0x844e5faceb5f942b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.160939:0:25393:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a013b800/0x844e5faceb5f942b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.160952:0:25393:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a013b800/0x844e5faceb5f942b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.160959:0:25393:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a013b800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155649.160962:0:25393:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a013b800/0x844e5faceb5f942b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.160969:0:25393:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a013b800/0x844e5faceb5f942b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.160990:0:25393:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a013b800/0x844e5faceb5f942b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.160996:0:25393:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a013b800/0x844e5faceb5f942b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25393 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.163203:0:25393:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+15:1960:x1830976126226176:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 17284us (19372us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155649.163214:0:25393:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8379 00010000:00010000:3.0:1746155649.164828:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131004200/0x844e5faceb5f9416 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.164841:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131004200/0x844e5faceb5f9416 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.164848:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131004200/0x844e5faceb5f9416 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.164865:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131004200 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155649.164868:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131004200/0x844e5faceb5f9416 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.164875:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131004200/0x844e5faceb5f9416 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.164890:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131004200/0x844e5faceb5f9416 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.164895:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131004200/0x844e5faceb5f9416 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.164968:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+14:1961:x1830976126225024:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 20951us (22779us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155649.164976:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8375 00010000:00010000:2.0:1746155649.166138:0:31251:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f941d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.166148:0:31251:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f941d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.166154:0:31251:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f941d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.166159:0:31251:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f458e00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155649.166161:0:31251:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f941d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.166167:0:31251:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f941d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.166179:0:31251:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f941d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.166185:0:31251:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f458e00/0x844e5faceb5f941d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.166497:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1961:x1830976126225408:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 20825us (23120us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155649.166523:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8377 00010000:00010000:2.0:1746155649.181324:0:10888:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009f458800/0x844e5faceb5f9432 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.181337:0:10888:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009f458800/0x844e5faceb5f9432 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.181349:0:10888:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009f458800/0x844e5faceb5f9432 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.181355:0:10888:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f458800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155649.181358:0:10888:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f458800/0x844e5faceb5f9432 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.181364:0:10888:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009f458800/0x844e5faceb5f9432 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.181380:0:10888:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009f458800/0x844e5faceb5f9432 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.181386:0:10888:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f458800/0x844e5faceb5f9432 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.182601:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126226048:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 34708us (38749us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155649.182610:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8380 00010000:00010000:1.0:1746155649.183838:0:25394:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009469ee00/0x844e5faceb5f9424 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.183859:0:25394:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009469ee00/0x844e5faceb5f9424 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.183867:0:25394:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009469ee00/0x844e5faceb5f9424 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.183873:0:25394:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009469ee00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155649.183876:0:25394:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009469ee00/0x844e5faceb5f9424 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.183882:0:25394:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009469ee00/0x844e5faceb5f9424 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.183896:0:25394:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009469ee00/0x844e5faceb5f9424 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.183900:0:25394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009469ee00/0x844e5faceb5f9424 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.183943:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1961:x1830976126225664:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 38046us (40475us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155649.183950:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8378 00010000:00010000:1.0:1746155649.184462:0:31253:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880131004c00/0x844e5faceb5f9439 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.184469:0:31253:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131004c00/0x844e5faceb5f9439 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.184479:0:31253:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131004c00/0x844e5faceb5f9439 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.184484:0:31253:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131004c00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155649.184486:0:31253:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131004c00/0x844e5faceb5f9439 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.184490:0:31253:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131004c00/0x844e5faceb5f9439 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.184499:0:31253:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131004c00/0x844e5faceb5f9439 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.184520:0:31253:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131004c00/0x844e5faceb5f9439 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31253 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.188072:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126226304:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 40140us (44227us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155649.188084:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8381 00010000:00010000:3.0:1746155649.192205:0:31249:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a013a600/0x844e5faceb5f940f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.192224:0:31249:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a013a600/0x844e5faceb5f940f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.192231:0:31249:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a013a600/0x844e5faceb5f940f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.192237:0:31249:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a013a600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155649.192240:0:31249:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a013a600/0x844e5faceb5f940f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.192247:0:31249:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a013a600/0x844e5faceb5f940f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.192263:0:31249:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a013a600/0x844e5faceb5f940f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.192268:0:31249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a013a600/0x844e5faceb5f940f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.192344:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126225152:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 48319us (50107us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155649.192352:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8376 00010000:00010000:1.0:1746155649.195385:0:31250:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009455ce00/0x844e5faceb5f9440 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.195398:0:31250:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009455ce00/0x844e5faceb5f9440 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.195405:0:31250:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009455ce00/0x844e5faceb5f9440 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.195411:0:31250:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009455ce00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155649.195413:0:31250:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009455ce00/0x844e5faceb5f9440 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.195420:0:31250:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009455ce00/0x844e5faceb5f9440 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.195434:0:31250:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009455ce00/0x844e5faceb5f9440 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.195440:0:31250:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009455ce00/0x844e5faceb5f9440 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.195518:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126226560:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 47484us (51630us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155649.195527:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8382 00000100:00100000:1.0:1746155649.206820:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.207066:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126226944 00000100:00100000:2.0:1746155649.207073:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126226944 00000100:00100000:2.0:1746155649.207114:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11267 00000100:00100000:2.0:1746155649.207121:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32613:x1830976126226944:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:2.0:1746155649.207157:0:14234:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.207177:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c283e00/0x844e5faceb5f93de lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ea4 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.207206:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.207209:0:14234:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155649.207238:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9447 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.207247:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9447 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.207255:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9447 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00010000:2.0:1746155649.207372:0:14234:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012bdf4a80 reply state ffff88009ae92000 transno 8589945453 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9447 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155649.207378:0:14234:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746155649.207446:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:32613:x1830976126226944:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 325us (633us total) trans 8589945453 rc 0/0 00000100:00100000:2.0:1746155649.207452:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11267 00010000:00010000:3.0:1746155649.210717:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9447 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155649.210728:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9447 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155649.210739:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9447 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155649.210744:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f0de000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155649.210747:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9447 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155649.210753:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9447 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155649.210766:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.210768:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746155649.210771:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9447 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155649.210776:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9447 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00000100:00100000:1.0:1746155649.212264:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.212299:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.212326:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.212346:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.212363:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126227200 00000100:00100000:0.0:1746155649.212366:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126227456 00000100:00100000:1.0:1746155649.212369:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126227200 00000100:00100000:0.0:1746155649.212370:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126227456 00000100:00100000:2.0:1746155649.212378:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126227712 00000100:00100000:2.0:1746155649.212382:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126227712 00000100:00100000:0.0:1746155649.212402:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126227072 00000100:00100000:0.0:1746155649.212404:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126227072 00000100:00100000:1.0:1746155649.212408:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17622 00000100:00100000:2.0:1746155649.212413:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17623 00000100:00100000:1.0:1746155649.212414:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126227200:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:2.0:1746155649.212417:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126227456:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:0.0:1746155649.212431:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17624 00000100:00100000:0.0:1746155649.212437:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126227712:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:3.0:1746155649.212456:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17625 00000100:00100000:3.0:1746155649.212463:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126227072:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:3.0:1746155649.212568:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746155649.212568:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155649.212568:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746155649.212570:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155647 -> 1746155649 00002000:00010000:2.0:1746155649.212570:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:0.0:1746155649.212570:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:3.0:1746155649.212573:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155647 -> 1746155649 00002000:00010000:2.0:1746155649.212573:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155648 -> 1746155649 00002000:00010000:0.0:1746155649.212573:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155648 -> 1746155649 00002000:00010000:3.0:1746155649.212574:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155647 -> 1746155649 00002000:00010000:0.0:1746155649.212574:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:2.0:1746155649.212575:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:3.0:1746155649.212576:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00002000:00010000:2.0:1746155649.212576:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:0.0:1746155649.212576:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746155649.212609:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126227456:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 191us (309us total) trans 17179874425 rc 0/0 00000100:00100000:2.0:1746155649.212616:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17623 00002000:00010000:1.0:1746155649.212693:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155649.212696:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.212698:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155647 -> 1746155649 00002000:00010000:1.0:1746155649.212700:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.212702:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746155649.212789:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126227072:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 326us (440us total) trans 17179874426 rc 0/0 00000100:00100000:0.0:1746155649.212792:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976126227712:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 355us (464us total) trans 21474841727 rc 0/0 00000100:00100000:3.0:1746155649.212794:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17625 00000100:00100000:0.0:1746155649.212798:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17624 00000100:00100000:3.0:1746155649.212823:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.212840:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126227328 00000100:00100000:0.0:1746155649.212843:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126227328 00000100:00100000:3.0:1746155649.212866:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.212869:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17626 00000100:00100000:0.0:1746155649.212874:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976126227328:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:1.0:1746155649.212917:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+13:1960:x1830976126227200:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 502us (657us total) trans 21474841728 rc 0/0 00000100:00100000:1.0:1746155649.212923:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17622 00002000:00010000:0.0:1746155649.212930:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155649.212933:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:0.0:1746155649.212935:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155649 -> 1746155649 00002000:00010000:0.0:1746155649.212936:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:0.0:1746155649.212938:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:0.0:1746155649.212954:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1960:x1830976126227328:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 80us (130us total) trans 21474841729 rc 0/0 00000100:00100000:0.0:1746155649.212960:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17626 00000100:00100000:1.0:1746155649.213062:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126227584 00000100:00100000:1.0:1746155649.213065:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126227584 00000100:00100000:1.0:1746155649.213080:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17627 00000100:00100000:1.0:1746155649.213084:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126227584:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155649.213143:0:1625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:1.0:1746155649.213146:0:1625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.213148:0:1625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155648 -> 1746155649 00002000:00010000:1.0:1746155649.213149:0:1625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.213151:0:1625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:1.0:1746155649.213166:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126227584:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 81us (300us total) trans 17179874427 rc 0/0 00000100:00100000:1.0:1746155649.213171:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17627 00000100:00100000:0.0:1746155649.215756:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.215837:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126227968 00000100:00100000:2.0:1746155649.215843:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126227968 00000100:00100000:2.0:1746155649.215883:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4807 00000100:00100000:2.0:1746155649.215890:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32613:x1830976126227968:12345-192.168.202.51@tcp:35:lfs.0 00000004:00010000:2.0:1746155649.215934:0:14235:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x35e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f9391 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e96 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.215970:0:14235:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14235 initiator: MDT0 00010000:00010000:2.0:1746155649.215980:0:14235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009455ca00/0x844e5faceb5f93d0 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e9d expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.215986:0:14235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14235 initiator: MDT0 00010000:00010000:2.0:1746155649.216009:0:14235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009455ca00/0x844e5faceb5f93d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e9d expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.216020:0:14235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009455ca00/0x844e5faceb5f93d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e9d expref: 9 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.216030:0:14235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14235:1830976125470592:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.216099:0:14235:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a501540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.217917:0:14235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:14235:1830976125470592:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.217937:0:14235:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00000100:00100000:0.0:1746155649.219453:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.219616:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126228096 00000100:00100000:2.0:1746155649.219621:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126228096 00010000:00010000:2.0:1746155649.219645:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009455ca00/0x844e5faceb5f93d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e9d expref: 10 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.219677:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9064 00000100:00100000:2.0:1746155649.219683:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126228096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.219695:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.219701:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009455ca00/0x844e5faceb5f93d0 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e9d expref: 10 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.219710:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009455ca00/0x844e5faceb5f93d0 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e9d expref: 10 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.219727:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009455ca00/0x844e5faceb5f93d0 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e9d expref: 10 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.219742:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.219746:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00010000:00010000:2.0:1746155649.219753:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14235 initiator: MDT0 00010000:00010000:2.0:1746155649.219758:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14235 initiator: MDT0 00010000:00010000:2.0:1746155649.219785:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.219815:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126228096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 131us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.219822:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9064 00010000:00010000:3.0:1746155649.219954:0:14235:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155649.219961:0:14235:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00000040:00080000:3.0:1746155649.220433:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3708, 88 off313232 00000004:00080000:3.0:1746155649.220438:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778369934856ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.220476:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3699, 88 off312704 00000004:00080000:3.0:1746155649.220480:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778369976879ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.220490:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3700, 88 off312792 00000004:00080000:3.0:1746155649.220492:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778369989479ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.220537:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3709, 88 off313320 00000004:00080000:3.0:1746155649.220540:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778370037459ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.221835:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3710, 88 off313408 00000004:00080000:3.0:1746155649.221843:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778371339504ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.221874:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3701, 88 off312880 00000004:00080000:3.0:1746155649.221877:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778371374512ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.221884:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3702, 88 off312968 00000004:00080000:3.0:1746155649.221887:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778371383690ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.221892:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3703, 88 off313056 00000004:00080000:3.0:1746155649.221894:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778371391502ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.222341:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3711, 88 off313496 00000004:00080000:3.0:1746155649.222345:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778371842102ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.222367:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3704, 88 off313144 00000004:00080000:3.0:1746155649.222370:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778371867418ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.222377:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3712, 88 off313584 00000004:00080000:3.0:1746155649.222380:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778371877372ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.222387:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3705, 88 off313232 00000004:00080000:3.0:1746155649.222389:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778371885827ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.222395:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3713, 88 off313672 00000004:00080000:3.0:1746155649.222397:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778371894097ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.222405:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3714, 88 off313760 00000004:00080000:3.0:1746155649.222407:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778371904025ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.222414:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3715, 88 off313848 00000004:00080000:3.0:1746155649.222416:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778371913395ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.222424:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3716, 88 off313936 00000004:00080000:3.0:1746155649.222426:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778371923345ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.222439:0:14235:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3706, 88 off313320 00000004:00080000:3.0:1746155649.222442:0:14235:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778371939062ns, next at 716011101328ns, rc = 0 00000001:00080000:0.0:1746155649.254692:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945453 is committed 00000001:00080000:0.0:1746155649.254703:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945454 is committed 00000004:00080000:0.0:1746155649.254707:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2889 committed 00000004:00010000:3.0:1746155649.255440:0:14235:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009feda300 reply state ffff8800a5c37800 transno 8589945454 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14235 initiator: MDT0 00000100:00100000:3.0:1746155649.255451:0:14235:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746155649.255459:0:14235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.255461:0:14235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155649.255469:0:14235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dee3e00/0x844e5faceb5f9391 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18e96 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1746155649.255589:0:14235:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746155649.255599:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32613:x1830976126227968:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 39709us (39848us total) trans 8589945454 rc 0/0 00000100:00100000:3.0:1746155649.255607:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4807 00010000:00010000:3.0:1746155649.255635:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155649.255644:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155649.255650:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155649.255655:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a76ec00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155649.255658:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155649.255663:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155649.255673:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.255675:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155649.255677:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14235 initiator: MDT0 00010000:00010000:3.0:1746155649.255681:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a76ec00/0x844e5faceb5f944e lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14235 initiator: MDT0 00000004:00080000:0.0:1746155649.255788:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2893 committed 00000004:00080000:0.0:1746155649.255795:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2892 committed 00000004:00080000:0.0:1746155649.255796:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2891 committed 00000004:00080000:0.0:1746155649.255798:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2890 committed 00000004:00080000:0.0:1746155649.255799:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2888 committed 00000004:00080000:0.0:1746155649.255801:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2889 committed 00000004:00080000:0.0:1746155649.255803:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2887 committed 00000004:00080000:0.0:1746155649.255804:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2888 committed 00000004:00080000:0.0:1746155649.255806:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2886 committed 00000004:00080000:0.0:1746155649.255807:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2885 committed 00000004:00080000:0.0:1746155649.255809:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2884 committed 00000004:00080000:0.0:1746155649.255810:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2887 committed 00000004:00080000:0.0:1746155649.255811:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2886 committed 00000004:00080000:0.0:1746155649.255813:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2883 committed 00000004:00080000:0.0:1746155649.255814:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2882 committed 00000004:00080000:0.0:1746155649.255816:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2885 committed 00000100:00100000:2.0:1746155649.255931:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125470848:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.255972:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155649.256012:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125470848 00000100:00100000:0.0:1746155649.256018:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125470848 00000100:00100000:0.0:1746155649.256044:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17628 00000100:00100000:0.0:1746155649.256050:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125470848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.256058:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125471360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.256076:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.256092:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746155649.256097:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125470976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.256111:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.256122:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125471488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.256135:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.256156:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125471360 00000100:00100000:2.0:1746155649.256159:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125471360 00000100:00100000:2.0:1746155649.256174:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125470976 00000100:00100000:2.0:1746155649.256176:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125470976 00002000:00010000:0.0:1746155649.256182:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746155649.256185:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125471488 00002000:00010000:0.0:1746155649.256185:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00000100:00100000:2.0:1746155649.256186:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125471488 00002000:00010000:0.0:1746155649.256187:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155649 -> 1746155649 00002000:00010000:0.0:1746155649.256189:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:0.0:1746155649.256190:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:2.0:1746155649.256197:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17629 00000100:00100000:2.0:1746155649.256201:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976125471360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155649.256216:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0950700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976125470848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (243us total) trans 21474841730 rc 0/0 00000100:00100000:0.0:1746155649.256221:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17628 00000100:00100000:0.0:1746155649.256235:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17630 00000100:00100000:0.0:1746155649.256240:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3295:x1830976125470976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.256289:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0951180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976125471360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (212us total) trans 21474841731 rc 0/0 00000100:00100000:2.0:1746155649.256294:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17629 00000100:00100000:2.0:1746155649.256304:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17631 00002000:00010000:0.0:1746155649.256307:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:2.0:1746155649.256309:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976125471488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746155649.256309:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:0.0:1746155649.256311:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155649 -> 1746155649 00002000:00010000:0.0:1746155649.256312:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:0.0:1746155649.256314:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155649.256332:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976125470976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (221us total) trans 21474841732 rc 0/0 00000100:00100000:0.0:1746155649.256337:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17630 00000004:00080000:0.0:1746155649.256371:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b458e00/2, rc 0, transno 21474841732 00000100:00100000:0.0:1746155649.256374:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125470976:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.256375:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3295:x1830976125471488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (238us total) trans 21474841733 rc 0/0 00000004:00080000:0.0:1746155649.256382:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45b100/2, rc 0, transno 21474841733 00000100:00100000:2.0:1746155649.256383:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17631 00000100:00100000:0.0:1746155649.256385:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125471488:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155649.256390:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45b480/2, rc 0, transno 21474841730 00000100:00100000:0.0:1746155649.256392:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125470848:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155649.256398:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45aa00/2, rc 0, transno 21474841731 00000100:00100000:0.0:1746155649.256400:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125471360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.256446:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125470720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.256468:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155649.256480:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125471232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.256493:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155649.256530:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746155649.256535:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125471104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.256549:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155649.256577:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125471616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.256597:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155649.256610:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125471744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.256615:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125472128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155649.256623:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155649.256633:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125472256:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.256636:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155649.256646:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155649.256650:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125472640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155649.256662:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125470720 00000100:00100000:3.0:1746155649.256664:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125470720 00000100:00100000:0.0:1746155649.256664:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155649.256678:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125471232 00000100:00100000:3.0:1746155649.256679:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125471232 00000100:00100000:0.0:1746155649.256683:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125471104 00000100:00100000:0.0:1746155649.256686:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125471104 00000100:00100000:3.0:1746155649.256687:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125471616 00000100:00100000:3.0:1746155649.256689:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125471616 00000100:00100000:0.0:1746155649.256700:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125471744 00000100:00100000:0.0:1746155649.256706:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125471744 00000100:00100000:3.0:1746155649.256840:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125472128 00000100:00100000:3.0:1746155649.256843:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125472128 00000100:00100000:3.0:1746155649.256864:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125472256 00000100:00100000:3.0:1746155649.256865:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125472256 00000100:00100000:3.0:1746155649.256871:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125472640 00000100:00100000:3.0:1746155649.256873:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125472640 00000100:00100000:3.0:1746155649.256880:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17632 00000100:00100000:3.0:1746155649.256885:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3298:x1830976125470720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155649.256956:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155649.256958:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:3.0:1746155649.256960:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155649 -> 1746155649 00002000:00010000:3.0:1746155649.256962:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:3.0:1746155649.256963:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746155649.256985:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a387450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976125470720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (517us total) trans 21474841734 rc 0/0 00000100:00100000:3.0:1746155649.256989:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17632 00000100:00100000:3.0:1746155649.257077:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17633 00000100:00100000:3.0:1746155649.257083:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3298:x1830976125471232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155649.257147:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:3.0:1746155649.257149:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:3.0:1746155649.257151:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746155649.257152:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:3.0:1746155649.257153:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:3.0:1746155649.257172:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976125471232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (678us total) trans 21474841735 rc 0/0 00000100:00100000:3.0:1746155649.257176:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17633 00000100:00100000:3.0:1746155649.257185:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17634 00000100:00100000:3.0:1746155649.257189:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3298:x1830976125471104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.257259:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976125471104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (708us total) trans 21474841736 rc 0/0 00000100:00100000:3.0:1746155649.257263:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17634 00000100:00100000:3.0:1746155649.257273:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17635 00000100:00100000:3.0:1746155649.257277:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3298:x1830976125471616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.257341:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976125471616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (742us total) trans 21474841737 rc 0/0 00000100:00100000:3.0:1746155649.257345:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17635 00000100:00100000:3.0:1746155649.257356:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17636 00000100:00100000:3.0:1746155649.257360:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3298:x1830976125471744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746155649.257439:0:8437:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746155649.257441:0:8437:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:3.0:1746155649.257442:0:8437:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155649 -> 1746155649 00002000:00010000:3.0:1746155649.257444:0:8437:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:3.0:1746155649.257446:0:8437:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00000100:00100000:3.0:1746155649.257463:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3298:x1830976125471744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (838us total) trans 17179874428 rc 0/0 00000100:00100000:2.0:1746155649.257531:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17637 00000100:00100000:2.0:1746155649.257537:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3297:x1830976125472128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.257628:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3297:x1830976125472128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 92us (991us total) trans 17179874429 rc 0/0 00000100:00100000:2.0:1746155649.257633:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17637 00000100:00100000:2.0:1746155649.257643:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17638 00000100:00100000:2.0:1746155649.257647:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3298:x1830976125472256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.257664:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fedbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125471872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.257682:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155649.257693:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125472384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.257705:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155649.257714:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746155649.257718:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125472000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.257730:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3298:x1830976125472256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (1082us total) trans 17179874430 rc 0/0 00000100:00100000:0.0:1746155649.257733:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.257734:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17638 00000100:00100000:0.0:1746155649.257740:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125472512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.257742:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125471872 00000100:00100000:2.0:1746155649.257745:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125471872 00000100:00100000:0.0:1746155649.257750:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.257754:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125472384 00000100:00100000:2.0:1746155649.257756:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125472384 00000100:00100000:2.0:1746155649.257762:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125472000 00000100:00100000:0.0:1746155649.257762:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125472512 00000100:00100000:2.0:1746155649.257763:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125472000 00000100:00100000:0.0:1746155649.257765:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125472512 00000100:00100000:2.0:1746155649.257771:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17639 00000100:00100000:2.0:1746155649.257774:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976125472640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.257843:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3297:x1830976125472640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (1177us total) trans 17179874431 rc 0/0 00000100:00100000:2.0:1746155649.257848:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17639 00000100:00100000:2.0:1746155649.257867:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17640 00000100:00100000:2.0:1746155649.257871:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976125471872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.257908:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17641 00000100:00100000:0.0:1746155649.257914:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976125472384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155649.257933:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155649.257936:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:2.0:1746155649.257937:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155649 -> 1746155649 00002000:00010000:2.0:1746155649.257939:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:2.0:1746155649.257940:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:2.0:1746155649.257961:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976125471872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (279us total) trans 17179874432 rc 0/0 00000100:00100000:2.0:1746155649.257966:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17640 00000100:00100000:2.0:1746155649.257975:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17642 00000100:00100000:2.0:1746155649.257979:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976125472000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.257994:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976125472384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (287us total) trans 17179874433 rc 0/0 00000100:00100000:0.0:1746155649.257999:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17641 00000100:00100000:0.0:1746155649.258009:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17643 00000100:00100000:0.0:1746155649.258014:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+22:3295:x1830976125472512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155649.258043:0:10591:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:2.0:1746155649.258045:0:10591:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:2.0:1746155649.258047:0:10591:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155649 -> 1746155649 00002000:00010000:2.0:1746155649.258049:0:10591:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:2.0:1746155649.258050:0:10591:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:2.0:1746155649.258068:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3295:x1830976125472000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (333us total) trans 17179874434 rc 0/0 00000100:00100000:2.0:1746155649.258072:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17642 00000100:00100000:0.0:1746155649.258092:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976125472512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 78us (340us total) trans 17179874435 rc 0/0 00000100:00100000:0.0:1746155649.258097:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17643 00000004:00080000:2.0:1746155649.258106:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fdc00/2, rc 0, transno 17179874429 00000100:00100000:2.0:1746155649.258114:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125472128:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155649.258121:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880131497800/2, rc 0, transno 17179874431 00000100:00100000:2.0:1746155649.258125:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131497800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125472640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.258155:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746155649.258159:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125472768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.258176:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746155649.258198:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fce00/2, rc 0, transno 17179874434 00000100:00100000:2.0:1746155649.258201:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125472000:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155649.258207:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fc700/2, rc 0, transno 17179874435 00000100:00100000:2.0:1746155649.258209:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125472512:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155649.258215:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fedbb80/2, rc 0, transno 17179874432 00000100:00100000:2.0:1746155649.258217:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fedbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125471872:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155649.258222:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fe300/2, rc 0, transno 17179874433 00000100:00100000:2.0:1746155649.258224:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125472384:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.258224:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.258234:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125472768 00000100:00100000:2.0:1746155649.258236:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125472768 00000100:00100000:0.0:1746155649.258240:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126228224 00000100:00100000:0.0:1746155649.258243:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126228224 00000100:00100000:2.0:1746155649.258249:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17644 00000100:00100000:2.0:1746155649.258253:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+23:3297:x1830976125472768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.258263:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11268 00000100:00100000:0.0:1746155649.258268:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32613:x1830976126228224:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:0.0:1746155649.258280:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155649.258291:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9455 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ed5 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.258325:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0952680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+24:3297:x1830976125472768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (148us total) trans 17179874436 rc 0/0 00010000:00010000:0.0:1746155649.258326:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9455 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ed5 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.258330:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17644 00010000:00010000:0.0:1746155649.258337:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9455 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ed5 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.258350:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155649.258353:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000004:00080000:2.0:1746155649.258354:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0951c00/2, rc 0, transno 17179874436 00010000:00010000:0.0:1746155649.258355:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f0de000, rc 0) 00000100:00100000:2.0:1746155649.258357:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0951c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125472768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155649.258379:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32613:x1830976126228224:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 111us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.258384:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11268 00000100:00100000:3.0:1746155649.258553:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17636 00000004:00080000:3.0:1746155649.258589:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fed8700/2, rc 0, transno 17179874428 00000100:00100000:3.0:1746155649.258592:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125471744:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155649.258598:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fd500/2, rc 0, transno 17179874430 00000100:00100000:3.0:1746155649.258600:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125472256:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155649.258606:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b459500/2, rc 0, transno 21474841736 00000100:00100000:3.0:1746155649.258609:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125471104:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155649.258615:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0950380/2, rc 0, transno 21474841737 00000100:00100000:3.0:1746155649.258617:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0950380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125471616:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155649.258623:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b45a680/2, rc 0, transno 21474841734 00000100:00100000:3.0:1746155649.258626:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125470720:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155649.258630:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b459f80/2, rc 0, transno 21474841735 00000100:00100000:3.0:1746155649.258637:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b459f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125471232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155649.261182:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.261223:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126228480 00000100:00100000:3.0:1746155649.261231:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126228480 00000100:00100000:3.0:1746155649.261263:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4808 00000100:00100000:3.0:1746155649.261268:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32613:x1830976126228480:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:3.0:1746155649.261449:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32613:x1830976126228480:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 180us (273us total) trans 8589945455 rc 0/0 00000100:00100000:3.0:1746155649.261455:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4808 00000100:00100000:0.0:1746155649.278390:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.279492:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126228736 00000100:00100000:2.0:1746155649.279521:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126228736 00000100:00100000:2.0:1746155649.279565:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11269 00000100:00100000:2.0:1746155649.279572:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32619:x1830976126228736:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155649.279591:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.279605:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2a4200/0x844e5faceb5f945c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18edc expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.279690:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9463 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279701:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9463 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279709:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9463 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279720:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a56c00/0x844e5faceb5f946a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279725:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a56c00/0x844e5faceb5f946a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279730:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a56c00/0x844e5faceb5f946a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279810:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57a00/0x844e5faceb5f9471 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279817:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57a00/0x844e5faceb5f9471 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279822:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57a00/0x844e5faceb5f9471 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155649.279829:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155649.279901:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9463 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279907:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9463 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279913:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9463 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279921:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f2a5800 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155649.279924:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9463 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279929:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9463 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279938:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155649.279941:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155649.279943:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9463 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279948:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2a5800/0x844e5faceb5f9463 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279973:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a56c00/0x844e5faceb5f946a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279978:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a56c00/0x844e5faceb5f946a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279982:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136a56c00/0x844e5faceb5f946a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279986:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136a56c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155649.279989:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a56c00/0x844e5faceb5f946a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279993:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136a56c00/0x844e5faceb5f946a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.279999:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51300) 00010000:00010000:2.0:1746155649.280001:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155649.280003:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136a56c00/0x844e5faceb5f946a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.280007:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a56c00/0x844e5faceb5f946a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.280035:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f2a4200/0x844e5faceb5f945c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18edc expref: 289 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.280045:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57a00/0x844e5faceb5f9471 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18edc expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.280051:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.280053:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155649.280055:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136a57a00, rc 0) 00000100:00100000:2.0:1746155649.280092:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32619:x1830976126228736:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 521us (1709us total) trans 8589945456 rc 0/0 00000100:00100000:2.0:1746155649.280098:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11269 00000100:00100000:0.0:1746155649.281396:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.281444:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126228992 00000100:00100000:2.0:1746155649.281448:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126228992 00000100:00100000:2.0:1746155649.281481:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11270 00000100:00100000:2.0:1746155649.281486:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:32624:x1830976126228992:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155649.281763:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.281774:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c000/0x844e5faceb5f947f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ee3 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.281828:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ac00/0x844e5faceb5f9486 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.281836:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ac00/0x844e5faceb5f9486 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.281844:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ac00/0x844e5faceb5f9486 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.281865:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593600/0x844e5faceb5f948d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.281871:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593600/0x844e5faceb5f948d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.281876:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593600/0x844e5faceb5f948d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.281934:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593200/0x844e5faceb5f9494 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.281940:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593200/0x844e5faceb5f9494 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.281946:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593200/0x844e5faceb5f9494 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:2.0:1746155649.281952:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155649.281990:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ac00/0x844e5faceb5f9486 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.281995:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ac00/0x844e5faceb5f9486 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.282000:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ac00/0x844e5faceb5f9486 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.282004:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f17ac00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155649.282007:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ac00/0x844e5faceb5f9486 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.282012:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ac00/0x844e5faceb5f9486 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.282019:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155649.282022:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155649.282024:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ac00/0x844e5faceb5f9486 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.282029:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f17ac00/0x844e5faceb5f9486 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.282037:0:14234:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593600/0x844e5faceb5f948d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.282042:0:14234:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593600/0x844e5faceb5f948d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.282046:0:14234:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593600/0x844e5faceb5f948d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.282049:0:14234:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d593600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155649.282051:0:14234:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593600/0x844e5faceb5f948d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.282056:0:14234:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593600/0x844e5faceb5f948d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.282061:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51b00) 00010000:00010000:2.0:1746155649.282063:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155649.282064:0:14234:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593600/0x844e5faceb5f948d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.282069:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593600/0x844e5faceb5f948d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.282092:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009374c000/0x844e5faceb5f947f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ee3 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.282100:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593200/0x844e5faceb5f9494 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ee3 expref: 8 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.282106:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.282108:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155649.282109:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d593200, rc 0) 00000100:00100000:2.0:1746155649.282142:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32624:x1830976126228992:12345-192.168.202.51@tcp:101:cat.0 Request processed in 656us (748us total) trans 8589945457 rc 0/0 00000100:00100000:2.0:1746155649.282148:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11270 00000100:00100000:0.0:1746155649.284039:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.284793:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126229120 00000100:00100000:3.0:1746155649.284799:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126229120 00000100:00100000:3.0:1746155649.284979:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17645 00000100:00100000:3.0:1746155649.284986:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32625:x1830976126229120:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155649.284999:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.285083:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a74b800/0x844e5faceb5f94a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18eea expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.285102:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.285103:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.285110:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a74b800/0x844e5faceb5f94a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eea expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.285122:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a74b800/0x844e5faceb5f94a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eea expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.285130:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a74b800, rc 0) 00000100:00100000:3.0:1746155649.285158:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32625:x1830976126229120:12345-192.168.202.51@tcp:101:cat.0 Request processed in 173us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.285163:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17645 00000100:00100000:0.0:1746155649.286961:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.287029:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.287102:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126229504 00000100:00100000:2.0:1746155649.287108:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126229504 00000100:00100000:2.0:1746155649.287135:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11271 00000100:00100000:2.0:1746155649.287141:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+8:32623:x1830976126229504:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155649.287156:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.287168:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592000/0x844e5faceb5f94a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ef8 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.287235:0:14234:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.287246:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57a00/0x844e5faceb5f9471 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18edc expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.287252:0:14234:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593200/0x844e5faceb5f9494 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ee3 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.287258:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 5/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14234 initiator: MDT0 00010000:00010000:2.0:1746155649.287280:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593200/0x844e5faceb5f9494 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ee3 expref: 9 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.287290:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593200/0x844e5faceb5f9494 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ee3 expref: 9 pid: 14234 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.287299:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0953b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125472896:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.287366:0:14234:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57a00/0x844e5faceb5f9471 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18edc expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.287373:0:14234:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57a00/0x844e5faceb5f9471 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18edc expref: 287 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.287379:0:14234:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0952a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125473024:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.287392:0:14234:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c240 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.287491:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126229248 00000100:00100000:3.0:1746155649.287494:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126229248 00000100:00100000:3.0:1746155649.287550:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17646 00000100:00100000:3.0:1746155649.287555:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32624:x1830976126229248:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155649.287562:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.287570:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a76ec00/0x844e5faceb5f94b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ef1 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.287583:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.287584:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.287589:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a76ec00/0x844e5faceb5f94b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef1 expref: 10 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.287598:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a76ec00/0x844e5faceb5f94b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef1 expref: 10 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.287604:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a76ec00, rc 0) 00000100:00100000:3.0:1746155649.287624:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32624:x1830976126229248:12345-192.168.202.51@tcp:101:cat.0 Request processed in 69us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.287629:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17646 00000100:00100000:0.0:1746155649.288006:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.288061:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126229760 00000100:00100000:1.0:1746155649.288065:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126229760 00002000:00100000:1.0:1746155649.288087:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff8800a3fc7480 x1830976126229760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155649.288095:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc7480 with x1830976126229760 ext(0->1048575) 00002000:00010000:1.0:1746155649.288098:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc7480 00000100:00100000:1.0:1746155649.288260:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8383 00000100:00100000:1.0:1746155649.288267:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976126229760:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155649.291811:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0953b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125472896:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.292017:0:14234:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0952a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14234:1830976125473024:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.292038:0:14234:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000100:00100000:2.0:1746155649.295113:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.295168:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.295221:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.295231:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126229888 00000100:00100000:3.0:1746155649.295239:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126229888 00010000:00010000:3.0:1746155649.295273:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593200/0x844e5faceb5f9494 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ee3 expref: 10 pid: 14234 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.295294:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126230016 00000100:00100000:3.0:1746155649.295296:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126230016 00010000:00010000:3.0:1746155649.295304:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57a00/0x844e5faceb5f9471 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18edc expref: 288 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.295315:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9065 00000100:00100000:3.0:1746155649.295321:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126229888:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155649.295333:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155649.295335:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9066 00010000:00010000:3.0:1746155649.295338:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593200/0x844e5faceb5f9494 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ee3 expref: 10 pid: 14234 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.295341:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1960:x1830976126230016:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.295346:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.295347:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593200/0x844e5faceb5f9494 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ee3 expref: 10 pid: 14234 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.295349:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57a00/0x844e5faceb5f9471 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18edc expref: 288 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.295364:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593200/0x844e5faceb5f9494 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ee3 expref: 10 pid: 14234 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.295878:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57a00/0x844e5faceb5f9471 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18edc expref: 288 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.295886:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.295890:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155649.295897:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:3.0:1746155649.295901:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155649.295907:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136a57a00/0x844e5faceb5f9471 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18edc expref: 288 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:1.0:1746155649.295918:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.295920:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155649.295925:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155649.295930:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14234 initiator: MDT0 00000100:00100000:3.0:1746155649.295934:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0950000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:1960:x1830976126229888:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 613us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.295939:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9065 00010000:00010000:1.0:1746155649.295944:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.295957:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0952a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1960:x1830976126230016:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 616us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.295962:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9066 00010000:00010000:1.0:1746155649.295977:0:14234:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00010000:00010000:1.0:1746155649.295983:0:14234:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14234 initiator: MDT0 00000004:00200000:1.0:1746155649.295997:0:14234:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000100:00100000:2.0:1746155649.296091:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126230144 00000100:00100000:2.0:1746155649.296095:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126230144 00010000:00010000:1.0:1746155649.296099:0:14234:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592000/0x844e5faceb5f94a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef8 expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.296108:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef8 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.296114:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.296116:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155649.296118:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d592800, rc 0) 00000100:00100000:1.0:1746155649.296138:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32623:x1830976126229504:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8998us (9108us total) trans 8589945458 rc 0/0 00000100:00100000:1.0:1746155649.296143:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11271 00000100:00100000:1.0:1746155649.296156:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11272 00000100:00100000:1.0:1746155649.296161:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32624:x1830976126230144:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155649.296173:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155649.296182:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610000/0x844e5faceb5f94c5 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18eff expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.296208:0:14234:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610000/0x844e5faceb5f94c5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eff expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.296216:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610000/0x844e5faceb5f94c5 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eff expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.296231:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.296233:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746155649.296235:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0610000, rc 0) 00000100:00100000:1.0:1746155649.296248:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32624:x1830976126230144:12345-192.168.202.51@tcp:101:cat.0 Request processed in 87us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.296253:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11272 00010000:00010000:3.0:1746155649.297349:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746155649.304412:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976126229760:12345-192.168.202.51@tcp:3:cat.0 Request processed in 16136us (16396us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155649.304423:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8383 00002000:00100000:1.0:1746155649.304433:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff8800a3fc7480 x1830976126229760/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155649.304441:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a3fc7480 with x1830976126229760 ext(0->1048575) 00002000:00010000:1.0:1746155649.304446:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a3fc7480 00000100:00100000:0.0:1746155649.305570:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.305624:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126230272 00000100:00100000:2.0:1746155649.305632:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126230272 00000100:00100000:2.0:1746155649.305677:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11273 00000100:00100000:2.0:1746155649.305684:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32623:x1830976126230272:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155649.305704:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.305725:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f94cc lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f06 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.305773:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f94cc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f06 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.305786:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f94cc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f06 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.305802:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.305804:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155649.305807:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc66400, rc 0) 00000100:00100000:2.0:1746155649.305860:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32623:x1830976126230272:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 167us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.305866:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11273 00000100:00100000:0.0:1746155649.309981:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.310023:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.310106:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.310246:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126230784 00000100:00100000:1.0:1746155649.310255:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126230784 00000100:00100000:3.0:1746155649.310282:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126230656 00000100:00100000:3.0:1746155649.310287:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126230656 00000100:00100000:1.0:1746155649.310299:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17647 00000100:00100000:1.0:1746155649.310306:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:32625:x1830976126230784:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155649.310313:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11274 00000100:00100000:3.0:1746155649.310319:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32623:x1830976126230656:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155649.310322:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.310328:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.310330:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746155649.310336:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0611200/0x844e5faceb5f94d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f14 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.310349:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610000/0x844e5faceb5f94c5 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eff expref: 11 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.310356:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.310358:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.310364:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0611200/0x844e5faceb5f94d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f14 expref: 19 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.310367:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.310371:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155649.310377:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593a00/0x844e5faceb5f94da lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f0d expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.310382:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0611200/0x844e5faceb5f94d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f14 expref: 19 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.310391:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0611200, rc 0) 00010000:00010000:3.0:1746155649.310418:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155649.310428:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9455 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ed5 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.310430:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32625:x1830976126230784:12345-192.168.202.51@tcp:101:cat.0 Request processed in 124us (323us total) trans 0 rc 0/0 00010000:00010000:3.0:1746155649.310435:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f94cc lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f06 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.310435:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17647 00010000:00010000:3.0:1746155649.310440:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 5/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155649.310462:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f94cc lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f06 expref: 11 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.310472:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f94cc lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f06 expref: 11 pid: 27374 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.310481:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125473152:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.310949:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126230400 00000100:00100000:2.0:1746155649.310953:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126230400 00010000:00010000:2.0:1746155649.310968:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f94cc lrc: 6/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f06 expref: 12 pid: 27374 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.310992:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9067 00000100:00100000:2.0:1746155649.310997:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976126230400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.311005:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.311009:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f94cc lrc: 6/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f06 expref: 12 pid: 27374 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.311017:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f94cc lrc: 5/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f06 expref: 12 pid: 27374 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.311028:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.311031:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.311036:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.311041:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155649.311582:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9455 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ed5 expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.311591:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9455 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ed5 expref: 7 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.311600:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125473280:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.312154:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff880133825780 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.312259:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1961:x1830976126230400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1261us (2285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.312265:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9067 00000100:00100000:2.0:1746155649.312302:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.312692:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126231040 00000100:00100000:0.0:1746155649.312697:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126231040 00002000:00100000:0.0:1746155649.312723:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff8800a0952300 x1830976126231040/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155649.312732:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0952300 with x1830976126231040 ext(0->1048575) 00002000:00010000:0.0:1746155649.312736:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0952300 00000100:00100000:0.0:1746155649.312887:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8384 00000100:00100000:0.0:1746155649.312895:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126231040:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155649.314835:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155649.315008:0:27374:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.51@tcp) returned -22 from blocking AST (req@ffff88009fed9500 x1830976125473152) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f94cc lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f06 expref: 11 pid: 27374 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.315020:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155649.315022:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc66400/0x844e5faceb5f94cc lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f06 expref: 11 pid: 27374 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.315071:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126231168 00000100:00100000:2.0:1746155649.315076:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126231168 00000100:00100000:2.0:1746155649.315102:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11275 00000100:00100000:2.0:1746155649.315108:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32625:x1830976126231168:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155649.315122:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.315133:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f94e8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f1b expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.315170:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.315176:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f94e8 lrc: 4/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f1b expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.315190:0:20364:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.315203:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f94e8 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f1b expref: 288 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.315212:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.315215:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746155649.315217:0:20364:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.315222:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc67a00, rc 0) 00000100:00100000:2.0:1746155649.315252:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32625:x1830976126231168:12345-192.168.202.51@tcp:101:cat.0 Request processed in 145us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.315257:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11275 00000100:00100000:3.0:1746155649.315459:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125473152:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.315474:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125473280:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.315486:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.315490:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155649.315495:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155649.315500:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00000100:00100000:2.0:1746155649.316734:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126231296 00000100:00100000:2.0:1746155649.316740:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126231296 00010000:00010000:2.0:1746155649.316759:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9455 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ed5 expref: 8 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.316793:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9068 00000100:00100000:2.0:1746155649.316799:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1960:x1830976126231296:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.316809:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.316813:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9455 lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ed5 expref: 8 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.316823:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9455 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ed5 expref: 8 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.316845:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0de000/0x844e5faceb5f9455 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ed5 expref: 8 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.316868:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.316872:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.316879:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.316884:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.316891:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f94e8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f1b expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.316903:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155649.317113:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155649.317120:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 27374 initiator: MDT0 00000040:00080000:3.0:1746155649.320175:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3717, 88 off314024 00000004:00080000:3.0:1746155649.320184:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778469680740ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.320318:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3707, 88 off313408 00000004:00080000:3.0:1746155649.320322:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778469818716ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.320363:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3708, 88 off313496 00000004:00080000:3.0:1746155649.320366:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778469863220ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.320378:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3718, 88 off314112 00000004:00080000:3.0:1746155649.320382:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778469878721ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.320388:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3719, 88 off314200 00000004:00080000:3.0:1746155649.320391:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778469887726ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.320397:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3709, 88 off313584 00000004:00080000:3.0:1746155649.320399:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778469896531ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.320409:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3710, 88 off313672 00000004:00080000:3.0:1746155649.320411:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778469908265ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.320420:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3711, 88 off313760 00000004:00080000:3.0:1746155649.320423:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778469919771ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.320431:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3720, 88 off314288 00000004:00080000:3.0:1746155649.320434:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778469930950ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.320439:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3712, 88 off313848 00000004:00080000:3.0:1746155649.320441:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778469938348ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.320449:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3721, 88 off314376 00000004:00080000:3.0:1746155649.320452:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778469948840ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.320457:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3713, 88 off313936 00000004:00080000:3.0:1746155649.320460:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778469956718ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155649.320468:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3722, 88 off314464 00000004:00080000:3.0:1746155649.320470:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778469967063ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.320476:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3723, 88 off314552 00000004:00080000:3.0:1746155649.320478:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778469974923ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.320484:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3724, 88 off314640 00000004:00080000:3.0:1746155649.320486:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778469983556ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.320492:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3725, 88 off314728 00000004:00080000:3.0:1746155649.320494:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 778469991339ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155649.320500:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3714, 88 off314024 00000004:00080000:3.0:1746155649.320526:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 778470023211ns, next at 716011101328ns, rc = 0 00000100:00100000:2.0:1746155649.321102:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1960:x1830976126231296:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4296us (6075us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.321112:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9068 00000100:00100000:3.0:1746155649.335493:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1961:x1830976126231040:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 22594us (23185us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155649.335518:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8384 00002000:00100000:3.0:1746155649.335527:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff8800a0952300 x1830976126231040/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.335535:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0952300 with x1830976126231040 ext(0->1048575) 00002000:00010000:3.0:1746155649.335540:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0952300 00000100:00100000:1.0:1746155649.349693:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.349712:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126231424 00000100:00100000:2.0:1746155649.349720:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126231424 00000100:00100000:2.0:1746155649.349757:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17648 00000100:00100000:2.0:1746155649.349765:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32624:x1830976126231424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155649.349778:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.349791:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130e6c200/0x844e5faceb5f94ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f22 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.349811:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.349812:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.349818:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130e6c200/0x844e5faceb5f94ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f22 expref: 16 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.349831:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130e6c200/0x844e5faceb5f94ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f22 expref: 16 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.349839:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130e6c200, rc 0) 00000100:00100000:2.0:1746155649.349883:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32624:x1830976126231424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 119us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.349888:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17648 00000100:00100000:3.0:1746155649.355428:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.355469:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126231552 00000100:00100000:1.0:1746155649.355478:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126231552 00000100:00100000:1.0:1746155649.355553:0:14234:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11276 00000100:00100000:1.0:1746155649.355561:0:14234:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32624:x1830976126231552:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155649.355599:0:14234:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155649.355616:0:14234:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131341400/0x844e5faceb5f94f6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f29 expref: -99 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.355661:0:14234:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131341400/0x844e5faceb5f94f6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f29 expref: 13 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.355672:0:14234:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131341400/0x844e5faceb5f94f6 lrc: 3/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f29 expref: 13 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.355682:0:14234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155649.355685:0:14234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746155649.355689:0:14234:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f94e8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f1b expref: 287 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.355695:0:14234:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131341400, rc 0) 00000100:00100000:0.0:1746155649.355728:0:14234:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32624:x1830976126231552:12345-192.168.202.51@tcp:101:cat.0 Request processed in 169us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.355734:0:14234:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11276 00000001:00080000:1.0:1746155649.360403:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945458 is committed 00000001:00080000:1.0:1746155649.360419:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945456 is committed 00000001:00080000:1.0:1746155649.360423:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945459 is committed 00000004:00080000:1.0:1746155649.360426:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2897 committed 00010000:00010000:3.0:1746155649.360431:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f0d expref: 10 pid: 27374 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746155649.360433:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2902 committed 00000004:00080000:1.0:1746155649.360439:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2901 committed 00000004:00080000:1.0:1746155649.360440:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2900 committed 00000004:00080000:1.0:1746155649.360441:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2899 committed 00010000:00010000:3.0:1746155649.360442:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00000004:00080000:1.0:1746155649.360442:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2896 committed 00000004:00080000:1.0:1746155649.360444:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2898 committed 00010000:00010000:3.0:1746155649.360445:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:1.0:1746155649.360445:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2895 committed 00000004:00080000:1.0:1746155649.360447:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2897 committed 00010000:00010000:3.0:1746155649.360449:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f94e8 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f1b expref: 286 pid: 20364 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746155649.360449:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2894 committed 00000004:00080000:1.0:1746155649.360450:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2893 committed 00000004:00080000:1.0:1746155649.360453:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2892 committed 00000004:00080000:1.0:1746155649.360454:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2896 committed 00000004:00080000:1.0:1746155649.360456:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2895 committed 00000004:00080000:1.0:1746155649.360457:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2891 committed 00010000:00010000:3.0:1746155649.360458:0:27374:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f94e8 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f1b expref: 286 pid: 20364 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1746155649.360459:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2890 committed 00000004:00080000:1.0:1746155649.360460:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2894 committed 00010000:00010000:3.0:1746155649.360464:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f94e8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f1b expref: 286 pid: 20364 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746155649.360464:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945455 is committed 00010000:00010000:3.0:1746155649.360474:0:27374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131341400/0x844e5faceb5f94f6 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f29 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.360479:0:27374:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131341400/0x844e5faceb5f94f6 lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f29 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.360485:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131341400/0x844e5faceb5f94f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f29 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.360519:0:27374:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131341400/0x844e5faceb5f94f6 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f29 expref: 10 pid: 14234 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.360529:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125474048:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155649.360537:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125473664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.360887:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125473408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.360975:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.361001:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125473536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155649.361013:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746155649.361018:0:27374:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f94e8 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f1b expref: 286 pid: 20364 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.361023:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125473920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155649.361026:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fedad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125475328:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155649.361031:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125474304:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.361036:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155649.361044:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1746155649.361047:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.361049:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125474688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155649.361054:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125473792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155649.361063:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125474816:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.361065:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155649.361076:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.361087:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125475072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155649.361096:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125473408 00000100:00100000:2.0:1746155649.361100:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155649.361101:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125473408 00000100:00100000:2.0:1746155649.361121:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155649.361126:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125473664 00000100:00100000:1.0:1746155649.361128:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125473664 00000100:00100000:2.0:1746155649.361132:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125474176:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155649.361138:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125473920 00000100:00100000:1.0:1746155649.361139:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125473920 00000100:00100000:2.0:1746155649.361143:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.361415:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125474560:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155649.361456:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125474304 00000100:00100000:1.0:1746155649.361459:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125474304 00000100:00100000:1.0:1746155649.361472:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125474688 00000100:00100000:1.0:1746155649.361474:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125474688 00000100:00100000:1.0:1746155649.361480:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125474816 00000100:00100000:1.0:1746155649.361482:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125474816 00000100:00100000:1.0:1746155649.361487:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125475072 00000100:00100000:1.0:1746155649.361489:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125475072 00000100:00100000:1.0:1746155649.361494:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125473536 00000100:00100000:1.0:1746155649.361496:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125473536 00000100:00100000:1.0:1746155649.361516:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125474176 00000100:00100000:1.0:1746155649.361518:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125474176 00000100:00100000:1.0:1746155649.361528:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17649 00000100:00100000:1.0:1746155649.361533:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976125473408:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.361613:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17650 00000100:00100000:2.0:1746155649.361618:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17651 00000100:00100000:3.0:1746155649.361620:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3297:x1830976125473664:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.361625:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+28:3295:x1830976125473920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155649.361667:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155649.361670:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.361672:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.361674:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.361675:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746155649.361696:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17652 00000100:00100000:1.0:1746155649.361700:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0950e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3295:x1830976125473408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 167us (727us total) trans 21474841738 rc 0/0 00000100:00100000:3.0:1746155649.361701:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3297:x1830976125474304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155649.361706:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17649 00000100:00100000:1.0:1746155649.361717:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17653 00000100:00100000:1.0:1746155649.361721:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3295:x1830976125474688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.361725:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0951880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3295:x1830976125473920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (687us total) trans 17179874437 rc 0/0 00000100:00100000:2.0:1746155649.361731:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17651 00000100:00100000:2.0:1746155649.361743:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17654 00000100:00100000:2.0:1746155649.361748:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3297:x1830976125474816:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.361776:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3297:x1830976125474304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (728us total) trans 17179874439 rc 0/0 00000100:00100000:1.0:1746155649.361776:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3295:x1830976125474688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (710us total) trans 17179874440 rc 0/0 00000100:00100000:1.0:1746155649.361781:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17653 00000100:00100000:3.0:1746155649.361783:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17652 00000100:00100000:1.0:1746155649.361790:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17655 00000100:00100000:1.0:1746155649.361794:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3295:x1830976125475072:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.361798:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17656 00000100:00100000:3.0:1746155649.361802:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3296:x1830976125473536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746155649.361818:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746155649.361820:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:2.0:1746155649.361822:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155649 -> 1746155649 00002000:00010000:2.0:1746155649.361824:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:2.0:1746155649.361826:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:2.0:1746155649.361844:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3297:x1830976125474816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 96us (767us total) trans 21474841739 rc 0/0 00000100:00100000:2.0:1746155649.361861:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17654 00002000:00010000:3.0:1746155649.361866:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155649.361866:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb size from disk: 2068480 -> 2068480 00002000:00010000:3.0:1746155649.361869:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.361869:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb mtime from disk: 1746155608 -> 1746155608 00002000:00010000:3.0:1746155649.361871:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.361871:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746155649.361872:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00000100:00100000:2.0:1746155649.361872:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17657 00002000:00010000:1.0:1746155649.361872:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb ctime from disk: 1746155608 -> 1746155608 00002000:00010000:3.0:1746155649.361874:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2025 -> 2025 00002000:00010000:1.0:1746155649.361874:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e3:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:2.0:1746155649.361876:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+30:3296:x1830976125474176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155649.361891:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a3fc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+30:3296:x1830976125473536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 89us (769us total) trans 17179874441 rc 0/0 00000100:00100000:1.0:1746155649.361891:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c28dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3295:x1830976125475072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (790us total) trans 21474841740 rc 0/0 00000100:00100000:3.0:1746155649.361896:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17656 00000100:00100000:1.0:1746155649.361898:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17655 00000100:00100000:3.0:1746155649.361912:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155649.361918:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125473792 00000100:00100000:1.0:1746155649.361921:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125473792 00000100:00100000:3.0:1746155649.361924:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012bdf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125474432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155649.361932:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17658 00000100:00100000:1.0:1746155649.361936:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3298:x1830976125473792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155649.361938:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155649.361948:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125474944:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.361949:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3296:x1830976125474176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (803us total) trans 17179874442 rc 0/0 00000100:00100000:2.0:1746155649.361954:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17657 00000100:00100000:3.0:1746155649.361960:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.361964:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125474432 00000100:00100000:2.0:1746155649.361967:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125474432 00000100:00100000:3.0:1746155649.361975:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125474944 00000100:00100000:3.0:1746155649.361978:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125474944 00000100:00100000:2.0:1746155649.361981:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17659 00000100:00100000:2.0:1746155649.361985:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009feda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+31:3298:x1830976125474432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155649.361991:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17660 00000100:00100000:3.0:1746155649.361995:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3298:x1830976125474944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155649.362002:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:1.0:1746155649.362004:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.362005:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.362007:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.362008:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:2.0:1746155649.362011:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.362023:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125475200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155649.362030:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fedb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3298:x1830976125473792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (117us total) trans 17179874443 rc 0/0 00000100:00100000:2.0:1746155649.362035:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155649.362035:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17658 00000100:00100000:1.0:1746155649.362042:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125474560 00000100:00100000:1.0:1746155649.362045:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125474560 00000100:00100000:1.0:1746155649.362054:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125475200 00000100:00100000:1.0:1746155649.362056:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125475200 00000100:00100000:1.0:1746155649.362062:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17661 00000004:00080000:2.0:1746155649.362063:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf7800/2, rc 0, transno 17179874441 00000100:00100000:1.0:1746155649.362066:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+27:3296:x1830976125474560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.362067:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3298:x1830976125474944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (105us total) trans 21474841741 rc 0/0 00000100:00100000:3.0:1746155649.362071:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17660 00000100:00100000:2.0:1746155649.362071:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125473536:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155649.362077:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf6d80/2, rc 0, transno 17179874442 00000100:00100000:3.0:1746155649.362080:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17662 00000100:00100000:2.0:1746155649.362080:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125474176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155649.362083:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3296:x1830976125475200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155649.362125:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155649.362127:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.362129:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.362130:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00002000:00010000:1.0:1746155649.362132:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746155649.362140:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3296:x1830976125475200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (104us total) trans 21474841743 rc 0/0 00000100:00100000:1.0:1746155649.362144:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3296:x1830976125474560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (133us total) trans 21474841742 rc 0/0 00000100:00100000:3.0:1746155649.362145:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17662 00000100:00100000:1.0:1746155649.362151:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17661 00000004:00080000:2.0:1746155649.362152:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0952a00/2, rc 0, transno 21474841742 00000100:00100000:2.0:1746155649.362156:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0952a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125474560:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.362159:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125475584:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155649.362162:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0951180/2, rc 0, transno 21474841743 00000100:00100000:2.0:1746155649.362164:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0951180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125475200:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.362174:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155649.362179:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125475584 00000100:00100000:1.0:1746155649.362182:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125475584 00000004:00080000:3.0:1746155649.362189:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf5500/2, rc 0, transno 17179874443 00000100:00100000:3.0:1746155649.362192:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125473792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155649.362192:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17663 00000100:00100000:2.0:1746155649.362193:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746155649.362196:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3298:x1830976125475584:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155649.362199:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0953100/2, rc 0, transno 21474841741 00000100:00100000:2.0:1746155649.362199:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125475712:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155649.362201:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0953100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125474944:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.362206:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746155649.362210:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125475456:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155649.362218:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746155649.362220:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0950000/2, rc 0, transno 21474841738 00000100:00100000:0.0:1746155649.362225:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0950000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125473408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.362227:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125475712 00000100:00100000:3.0:1746155649.362229:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125475712 00000004:00080000:0.0:1746155649.362233:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf4380/2, rc 0, transno 17179874437 00000100:00100000:0.0:1746155649.362235:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125473920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155649.362241:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17664 00000004:00080000:0.0:1746155649.362241:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf7480/2, rc 0, transno 17179874440 00000100:00100000:0.0:1746155649.362244:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125474688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746155649.362245:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3296:x1830976125475712:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155649.362249:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0950700/2, rc 0, transno 21474841740 00000100:00100000:0.0:1746155649.362252:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0950700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125475072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155649.362263:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3298:x1830976125475584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (88us total) trans 21474841744 rc 0/0 00000100:00100000:1.0:1746155649.362268:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17663 00000100:00100000:3.0:1746155649.362318:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+33:3296:x1830976125475712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (99us total) trans 17179874444 rc 0/0 00000100:00100000:3.0:1746155649.362322:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17664 00000004:00080000:2.0:1746155649.362331:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8801317c4380/2, rc 0, transno 17179874444 00000100:00100000:3.0:1746155649.362333:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155649.362334:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125475712:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155649.362348:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0956680/2, rc 0, transno 21474841744 00000100:00100000:0.0:1746155649.362348:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125475456 00000100:00100000:3.0:1746155649.362351:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125475584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155649.362351:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125475456 00002000:00010000:3.0:1746155649.362377:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155649.362379:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155649 -> 1746155649 00002000:00010000:3.0:1746155649.362380:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155649 -> 1746155649 00002000:00010000:3.0:1746155649.362382:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155649 -> 1746155649 00000100:00100000:0.0:1746155649.362383:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17665 00002000:00010000:3.0:1746155649.362384:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155649.362388:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3298:x1830976125475456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155649.362400:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3297:x1830976125473664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 782us (1387us total) trans 17179874438 rc 0/0 00000100:00100000:3.0:1746155649.362404:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17650 00000004:00080000:3.0:1746155649.362424:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0951f80/2, rc 0, transno 21474841739 00000100:00100000:3.0:1746155649.362427:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0951f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125474816:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155649.362434:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf6a00/2, rc 0, transno 17179874438 00000100:00100000:3.0:1746155649.362436:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125473664:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155649.362441:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf5880/2, rc 0, transno 17179874439 00000100:00100000:3.0:1746155649.362443:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125474304:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746155649.362457:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012bdf5c00/2, rc 0, transno 17179874445 00000100:00100000:2.0:1746155649.362458:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009feda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3298:x1830976125474432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 471us (518us total) trans 17179874445 rc 0/0 00000100:00100000:3.0:1746155649.362460:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012bdf5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125474432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155649.362464:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17659 00000100:00100000:0.0:1746155649.362476:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3298:x1830976125475456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (140us total) trans 21474841745 rc 0/0 00000100:00100000:0.0:1746155649.362482:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17665 00000004:00080000:3.0:1746155649.362485:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0956a00/2, rc 0, transno 21474841745 00000100:00100000:3.0:1746155649.362488:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125475456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155649.368344:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.368405:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9500 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125474048:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155649.368415:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fedad80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125475328:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155649.368454:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593a00/0x844e5faceb5f94da lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f0d expref: 10 pid: 27374 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746155649.368467:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:3.0:1746155649.368472:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f0d expref: 9 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.368523:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d593c00, rc 0) 00000100:00100000:2.0:1746155649.368552:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126231680 00000100:00100000:2.0:1746155649.368558:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126231680 00000100:00100000:3.0:1746155649.368618:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32623:x1830976126230656:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 58297us (58592us total) trans 8589945459 rc 0/0 00000100:00100000:1.0:1746155649.368624:0:14234:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126231808 00000100:00100000:3.0:1746155649.368626:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11274 00000100:00100000:1.0:1746155649.368628:0:14234:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126231808 00000100:00100000:3.0:1746155649.368650:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11277 00000100:00100000:3.0:1746155649.368657:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32619:x1830976126231808:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155649.368670:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.368690:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f000/0x844e5faceb5f94fd lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f30 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155649.368772:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.368789:0:16646:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126231936 00000100:00100000:0.0:1746155649.368792:0:16646:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126231936 00000100:00100000:0.0:1746155649.368811:0:16646:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4809 00000100:00100000:0.0:1746155649.368816:0:16646:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32624:x1830976126231936:12345-192.168.202.51@tcp:49:cat.0 00010000:00010000:3.0:1746155649.368821:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f000/0x844e5faceb5f94fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f30 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.368832:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f000/0x844e5faceb5f94fd lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f30 expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.368843:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.368845:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155649.368861:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009fc7f000, rc 0) 00000100:00100000:3.0:1746155649.368883:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32619:x1830976126231808:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 228us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.368884:0:16646:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32624:x1830976126231936:12345-192.168.202.51@tcp:49:cat.0 Request processed in 67us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.368888:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11277 00000100:00100000:0.0:1746155649.368890:0:16646:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4809 00000100:00100000:2.0:1746155649.369103:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4810 00000100:00100000:2.0:1746155649.369108:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32625:x1830976126231680:12345-192.168.202.51@tcp:49:cat.0 00000100:00100000:2.0:1746155649.369148:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32625:x1830976126231680:12345-192.168.202.51@tcp:49:cat.0 Request processed in 38us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.369153:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4810 00000100:00100000:0.0:1746155649.372668:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.375126:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126232064 00000100:00100000:2.0:1746155649.375136:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126232064 00000100:00100000:2.0:1746155649.375199:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 774 00000100:00100000:2.0:1746155649.375206:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1960:x1830976126232064:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.375219:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.375240:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009fc7f000/0x844e5faceb5f94fd lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f30 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.375265:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.375268:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.375322:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:1960:x1830976126232064:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 116us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.375329:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 774 00000100:00100000:0.0:1746155649.376005:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.376039:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.376087:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126232320 00000100:00100000:2.0:1746155649.376090:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126232320 00002000:00100000:2.0:1746155649.376112:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880095269f80 x1830976126232320/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.376121:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269f80 with x1830976126232320 ext(1048576->2097151) 00002000:00010000:2.0:1746155649.376124:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095269f80 00000100:00100000:2.0:1746155649.376141:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126232576 00000100:00100000:2.0:1746155649.376143:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126232576 00002000:00100000:2.0:1746155649.376152:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009526b480 x1830976126232576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.376158:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526b480 with x1830976126232576 ext(1048576->2097151) 00002000:00010000:2.0:1746155649.376161:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009526b480 00000100:00100000:2.0:1746155649.376169:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8385 00000100:00100000:2.0:1746155649.376173:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126232320:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:1.0:1746155649.377275:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8386 00000100:00100000:1.0:1746155649.377283:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976126232576:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155649.378495:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.381123:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126232704 00000100:00100000:1.0:1746155649.381133:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126232704 00000100:00100000:1.0:1746155649.381187:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17666 00000100:00100000:1.0:1746155649.381195:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32619:x1830976126232704:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:1.0:1746155649.381209:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155649.381224:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009469e400/0x844e5faceb5f9504 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f37 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.381248:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5f93ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eab expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155649.381257:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a76ec00/0x844e5faceb5f94b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef1 expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.381268:0:9235:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a74b800/0x844e5faceb5f94a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eea expref: 25 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.381274:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.381276:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.381279:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009469e400/0x844e5faceb5f9504 lrc: 6/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [770048->1048575] (req 770048->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f37 expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.381309:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a74b800/0x844e5faceb5f94a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eea expref: 25 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.381321:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a74b800/0x844e5faceb5f94a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eea expref: 25 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.381331:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125475840:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155649.381404:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a76ec00/0x844e5faceb5f94b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef1 expref: 9 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.381412:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a76ec00/0x844e5faceb5f94b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef1 expref: 9 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.381420:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125475968:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155649.381442:0:9235:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5f93ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eab expref: 10 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155649.381454:0:9235:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5f93ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eab expref: 10 pid: 4461 timeout: 878 lvb_type: 1 00000100:00100000:1.0:1746155649.381462:0:9235:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125476096:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155649.381475:0:9235:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337240 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.390190:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.390213:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.390285:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126232960 00000100:00100000:3.0:1746155649.390291:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126232960 00010000:00010000:3.0:1746155649.390315:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a76ec00/0x844e5faceb5f94b7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef1 expref: 10 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.390335:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126232832 00000100:00100000:3.0:1746155649.390336:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126232832 00010000:00010000:3.0:1746155649.390344:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a74b800/0x844e5faceb5f94a2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eea expref: 26 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.390355:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9069 00000100:00100000:3.0:1746155649.390361:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976126232960:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155649.390371:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746155649.390374:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009526b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1962:x1830976126232576:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 13090us (14331us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155649.390383:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8386 00010000:00010000:3.0:1746155649.390387:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a76ec00/0x844e5faceb5f94b7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef1 expref: 10 pid: 20796 timeout: 878 lvb_type: 0 00002000:00100000:1.0:1746155649.390390:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009526b480 x1830976126232576/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746155649.390395:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a76ec00/0x844e5faceb5f94b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef1 expref: 10 pid: 20796 timeout: 878 lvb_type: 0 00002000:00100000:1.0:1746155649.390397:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009526b480 with x1830976126232576 ext(1048576->2097151) 00002000:00010000:1.0:1746155649.390401:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009526b480 00010000:00010000:3.0:1746155649.390412:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155649.390426:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1962:x1830976126232960:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 66us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.390431:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9069 00000100:00100000:1.0:1746155649.390434:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125475840:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.390439:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9070 00000100:00100000:3.0:1746155649.390444:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976126232832:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.390444:0:9235:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a76ec00/0x844e5faceb5f94b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef1 expref: 9 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.390448:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.390453:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a74b800/0x844e5faceb5f94a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eea expref: 26 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.390459:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125475968:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.390460:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a74b800/0x844e5faceb5f94a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eea expref: 26 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.390466:0:9235:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:9235:1830976125476096:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.390469:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a74b800/0x844e5faceb5f94a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eea expref: 26 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.390484:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746155649.390487:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009469e400/0x844e5faceb5f9504 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [770048->1048575] (req 770048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f37 expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.390493:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126232832:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.390497:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9070 00010000:00010000:1.0:1746155649.390497:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009469e400, rc 0) 00000100:00100000:1.0:1746155649.390536:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32619:x1830976126232704:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 9342us (12042us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.390541:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17666 00000100:00100000:2.0:1746155649.390803:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880095269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:1960:x1830976126232320:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 14628us (14799us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155649.390809:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8385 00002000:00100000:2.0:1746155649.391260:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880095269f80 x1830976126232320/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.391267:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880095269f80 with x1830976126232320 ext(1048576->2097151) 00002000:00010000:2.0:1746155649.391271:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880095269f80 00000100:00100000:0.0:1746155649.391563:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.391639:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126233088 00000100:00100000:3.0:1746155649.391643:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126233088 00010000:00010000:3.0:1746155649.391658:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5f93ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eab expref: 11 pid: 4461 timeout: 878 lvb_type: 1 00000100:00100000:3.0:1746155649.391687:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9071 00000100:00100000:3.0:1746155649.391692:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126233088:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155649.391699:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.391708:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5f93ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eab expref: 11 pid: 4461 timeout: 878 lvb_type: 1 00010000:00010000:3.0:1746155649.391716:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5f93ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eab expref: 11 pid: 4461 timeout: 878 lvb_type: 1 00010000:00010000:3.0:1746155649.391728:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009374c400/0x844e5faceb5f93ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eab expref: 11 pid: 4461 timeout: 878 lvb_type: 1 00010000:00010000:3.0:1746155649.391736:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.391737:0:9789:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.391743:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009469e400/0x844e5faceb5f9504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f37 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.391753:0:9789:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009469e400/0x844e5faceb5f9504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f37 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.391775:0:9789:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009469e400/0x844e5faceb5f9504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f37 expref: 23 pid: 9235 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.391786:0:9789:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b45b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125476224:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155649.391857:0:9789:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.395694:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.395729:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.395759:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.395863:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126233216 00000100:00100000:3.0:1746155649.395869:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126233216 00000100:00100000:3.0:1746155649.395904:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126233344 00000100:00100000:3.0:1746155649.395906:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126233344 00000100:00100000:3.0:1746155649.395918:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126233472 00000100:00100000:3.0:1746155649.395920:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126233472 00000100:00100000:3.0:1746155649.395932:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17667 00000100:00100000:3.0:1746155649.395939:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32624:x1830976126233216:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155649.395952:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.395965:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009374c000/0x844e5faceb5f950b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f3e expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.395986:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.395987:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.395994:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009374c000/0x844e5faceb5f950b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f3e expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.396009:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009374c000/0x844e5faceb5f950b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f3e expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.396023:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374c000, rc 0) 00000100:00100000:0.0:1746155649.396024:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17668 00000100:00100000:0.0:1746155649.396031:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32625:x1830976126233344:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155649.396038:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155649.396043:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f9d800/0x844e5faceb5f9512 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f45 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.396052:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.396053:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155649.396056:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32624:x1830976126233216:12345-192.168.202.51@tcp:101:cat.0 Request processed in 119us (370us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155649.396057:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f9d800/0x844e5faceb5f9512 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f45 expref: 20 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.396062:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17667 00010000:00010000:0.0:1746155649.396070:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f9d800/0x844e5faceb5f9512 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f45 expref: 20 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.396075:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17669 00010000:00010000:0.0:1746155649.396076:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f9d800, rc 0) 00000100:00100000:3.0:1746155649.396080:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32623:x1830976126233472:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155649.396084:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.396089:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f4c expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155649.396089:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:32625:x1830976126233344:12345-192.168.202.51@tcp:101:cat.0 Request processed in 60us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.396093:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17668 00010000:00010000:3.0:1746155649.396101:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a013b600/0x844e5faceb5f93e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb2 expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.396108:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130e6c200/0x844e5faceb5f94ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f22 expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.396113:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0611200/0x844e5faceb5f94d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f14 expref: 19 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.396117:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.396118:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.396120:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [1654784->1802239] (req 1654784->1802239) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.396140:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0611200/0x844e5faceb5f94d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f14 expref: 19 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.396150:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0611200/0x844e5faceb5f94d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f14 expref: 19 pid: 8438 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.396161:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fedad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125476352:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.396229:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130e6c200/0x844e5faceb5f94ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f22 expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.396238:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130e6c200/0x844e5faceb5f94ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f22 expref: 18 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.396245:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fed9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125476480:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.396268:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a013b600/0x844e5faceb5f93e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb2 expref: 11 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.396275:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a013b600/0x844e5faceb5f93e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb2 expref: 11 pid: 1625 timeout: 878 lvb_type: 1 00000100:00100000:3.0:1746155649.396281:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125476608:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.396296:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.396325:0:9789:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b45b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9789:1830976125476224:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155649.396340:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155649.396354:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126233088:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4662us (4792us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.396365:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9071 00000100:00100000:0.0:1746155649.398175:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.398228:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126233728 00000100:00100000:2.0:1746155649.398234:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126233728 00002000:00100000:2.0:1746155649.398262:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e1:0x0] (770048->774143) req@ffff88009fac5f80 x1830976126233728/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.398271:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac5f80 with x1830976126233728 ext(770048->774143) 00002000:00010000:2.0:1746155649.398275:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac5f80 00000100:00100000:2.0:1746155649.398423:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8387 00000100:00100000:2.0:1746155649.398429:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126233728:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155649.398585:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126233728:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 155us (413us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155649.398591:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8387 00002000:00100000:2.0:1746155649.398596:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e1:0x0] (770048->774143) req@ffff88009fac5f80 x1830976126233728/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/4536 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.398602:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac5f80 with x1830976126233728 ext(770048->774143) 00002000:00010000:2.0:1746155649.398605:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac5f80 00000100:00100000:3.0:1746155649.399912:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fedad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125476352:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155649.400346:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.401915:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126233856 00000100:00100000:2.0:1746155649.401921:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126233856 00010000:00010000:2.0:1746155649.401956:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a013b600/0x844e5faceb5f93e5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb2 expref: 12 pid: 1625 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746155649.401984:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9072 00000100:00100000:2.0:1746155649.401990:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976126233856:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.402000:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.402020:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a013b600/0x844e5faceb5f93e5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb2 expref: 12 pid: 1625 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746155649.402031:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a013b600/0x844e5faceb5f93e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb2 expref: 12 pid: 1625 timeout: 878 lvb_type: 1 00010000:00010000:2.0:1746155649.402048:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.402091:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+12:1963:x1830976126233856:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 101us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.402097:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9072 00000100:00100000:3.0:1746155649.402453:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fed9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125476480:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.402469:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a013b600/0x844e5faceb5f93e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb2 expref: 11 pid: 1625 timeout: 878 lvb_type: 1 00000100:00100000:3.0:1746155649.402493:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125476608:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.402533:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1654784->1802239] (req 1654784->1802239) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 18 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.402542:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009374cc00, rc 0) 00000100:00100000:1.0:1746155649.403240:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.403275:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126233984 00000100:00100000:0.0:1746155649.403278:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126233984 00010000:00010000:0.0:1746155649.403293:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0611200/0x844e5faceb5f94d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f14 expref: 20 pid: 8438 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.403316:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a387050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32623:x1830976126233472:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7235us (7556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.403322:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17669 00000100:00100000:1.0:1746155649.403953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.404270:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126234112 00000100:00100000:0.0:1746155649.404273:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126234112 00000100:00100000:3.0:1746155649.404276:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9073 00000100:00100000:3.0:1746155649.404282:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126233984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155649.404286:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130e6c200/0x844e5faceb5f94ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f22 expref: 18 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.404290:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746155649.404301:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9074 00010000:00010000:3.0:1746155649.404303:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0611200/0x844e5faceb5f94d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f14 expref: 20 pid: 8438 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746155649.404306:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126234112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155649.404311:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.404312:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0611200/0x844e5faceb5f94d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f14 expref: 20 pid: 8438 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746155649.404318:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130e6c200/0x844e5faceb5f94ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f22 expref: 18 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.404325:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0611200/0x844e5faceb5f94d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f14 expref: 20 pid: 8438 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746155649.404329:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130e6c200/0x844e5faceb5f94ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f22 expref: 18 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.404335:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746155649.404339:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130e6c200/0x844e5faceb5f94ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f22 expref: 18 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746155649.404349:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.404351:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155649.404353:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976126233984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 73us (1115us total) trans 0 rc 0/0 00010000:00010000:0.0:1746155649.404355:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.404359:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9073 00010000:00010000:0.0:1746155649.404362:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.404384:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 17 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155649.404394:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125476736:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155649.404439:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.404466:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.404483:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126234368 00000100:00100000:2.0:1746155649.404487:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126234368 00002000:00100000:2.0:1746155649.404524:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009fac4380 x1830976126234368/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.404532:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4380 with x1830976126234368 ext(1048576->2097151) 00002000:00010000:2.0:1746155649.404536:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fac4380 00000100:00100000:2.0:1746155649.404547:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8388 00000100:00100000:2.0:1746155649.404551:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976126234368:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155649.409710:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.411559:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.411591:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.411664:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126234752 00000100:00100000:2.0:1746155649.411671:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126234752 00002000:00100000:2.0:1746155649.411702:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8801317c7b80 x1830976126234752/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.411711:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c7b80 with x1830976126234752 ext(1048576->2097151) 00002000:00010000:2.0:1746155649.411716:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c7b80 00000100:00100000:2.0:1746155649.411732:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126235008 00000100:00100000:2.0:1746155649.411734:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126235008 00002000:00100000:2.0:1746155649.411741:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1654784->1658879) req@ffff8801317c4000 x1830976126235008/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.411747:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4000 with x1830976126235008 ext(1654784->1658879) 00002000:00010000:2.0:1746155649.411749:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c4000 00000100:00100000:2.0:1746155649.411758:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8389 00000100:00100000:2.0:1746155649.411764:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976126234752:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155649.412663:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8390 00000100:00100000:2.0:1746155649.412669:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1962:x1830976126235008:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155649.412735:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1962:x1830976126235008:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 66us (1143us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155649.412740:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8390 00002000:00100000:2.0:1746155649.412745:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e0:0x0] (1654784->1658879) req@ffff8801317c4000 x1830976126235008/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/4536 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.412751:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c4000 with x1830976126235008 ext(1654784->1658879) 00002000:00010000:2.0:1746155649.412753:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c4000 00000100:00100000:2.0:1746155649.412893:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1963:x1830976126234368:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 8341us (8426us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155649.412898:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8388 00002000:00100000:2.0:1746155649.412903:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff88009fac4380 x1830976126234368/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.412909:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4380 with x1830976126234368 ext(1048576->2097151) 00002000:00010000:2.0:1746155649.412911:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fac4380 00000100:00100000:3.0:1746155649.412971:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126234496 00000100:00100000:3.0:1746155649.412975:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126234496 00000100:00100000:3.0:1746155649.413000:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17670 00000100:00100000:3.0:1746155649.413004:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:32619:x1830976126234496:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155649.413012:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.413025:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801373dc200/0x844e5faceb5f9520 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f53 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.413042:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.413048:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155649.413050:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746155649.413053:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801373dc200/0x844e5faceb5f9520 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1048576->1437695] (req 1048576->1437695) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f53 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.413072:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.413080:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 19 pid: 8436 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.413095:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125476864:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.413127:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd000 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.414563:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fac6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125476736:192.168.202.51@tcp:105: 00010000:00010000:0.0:1746155649.414579:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155649.414604:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126234112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 10298us (10652us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.414616:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9074 00000100:00100000:3.0:1746155649.421557:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125476864:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.421581:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801373dc200/0x844e5faceb5f9520 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->1437695] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f53 expref: 20 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.421595:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801373dc200, rc 0) 00000100:00100000:3.0:1746155649.421626:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:32619:x1830976126234496:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 8621us (11924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.421633:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17670 00000100:00100000:2.0:1746155649.421873:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1961:x1830976126234752:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10108us (10316us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155649.421880:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8389 00002000:00100000:2.0:1746155649.421888:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e1:0x0] (1048576->2097151) req@ffff8801317c7b80 x1830976126234752/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.421896:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c7b80 with x1830976126234752 ext(1048576->2097151) 00002000:00010000:2.0:1746155649.421900:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801317c7b80 00000100:00100000:1.0:1746155649.423285:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.423326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.423328:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126235264 00000100:00100000:3.0:1746155649.423334:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126235264 00000100:00100000:1.0:1746155649.423367:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17671 00000100:00100000:1.0:1746155649.423374:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32625:x1830976126235264:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155649.423387:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155649.423398:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c047000/0x844e5faceb5f9527 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f5a expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.423416:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.423417:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.423424:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c047000/0x844e5faceb5f9527 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f5a expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.423437:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c047000/0x844e5faceb5f9527 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f5a expref: 25 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.423444:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c047000, rc 0) 00000100:00100000:2.0:1746155649.423461:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126235392 00000100:00100000:2.0:1746155649.423464:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126235392 00002000:00100000:2.0:1746155649.423480:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1798144->1802239) req@ffff8801317c6300 x1830976126235392/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.423487:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6300 with x1830976126235392 ext(1798144->1802239) 00010000:00010000:2.0:1746155649.423492:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 17 pid: 8436 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.423532:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 17 pid: 8436 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746155649.423538:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317c6300 00000100:00100000:1.0:1746155649.423672:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:32625:x1830976126235264:12345-192.168.202.51@tcp:101:cat.0 Request processed in 298us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.423678:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17671 00000100:00100000:2.0:1746155649.423920:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1479 00000100:00100000:2.0:1746155649.423925:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976126235392:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155649.424041:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976126235392:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 115us (714us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155649.424046:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1479 00002000:00100000:2.0:1746155649.424050:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1798144->1802239) req@ffff8801317c6300 x1830976126235392/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/4536 e 0 to 0 dl 1746155660 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.424057:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801317c6300 with x1830976126235392 ext(1798144->1802239) 00010000:00010000:2.0:1746155649.424061:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 17 pid: 8436 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.424069:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 17 pid: 8436 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746155649.424074:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801317c6300 00000100:00100000:0.0:1746155649.425692:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.428069:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126235520 00000100:00100000:1.0:1746155649.428078:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126235520 00000100:00100000:1.0:1746155649.428371:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17672 00000100:00100000:1.0:1746155649.428378:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32624:x1830976126235520:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155649.428391:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155649.428404:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f952e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f61 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.428421:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.428423:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.428428:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f952e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f61 expref: 10 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.428442:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f952e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f61 expref: 10 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.428449:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c046400, rc 0) 00000100:00100000:1.0:1746155649.428489:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:32624:x1830976126235520:12345-192.168.202.51@tcp:101:cat.0 Request processed in 112us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.428495:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17672 00000100:00100000:0.0:1746155649.428626:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.428776:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126235776 00000100:00100000:2.0:1746155649.428779:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126235776 00002000:00100000:2.0:1746155649.428801:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fac7800 x1830976126235776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.428809:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7800 with x1830976126235776 ext(1048576->2097151) 00002000:00010000:2.0:1746155649.428812:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac7800 00000100:00100000:0.0:1746155649.428950:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.429272:0:31249:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126236032 00000100:00100000:2.0:1746155649.429275:0:31249:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126236032 00002000:00100000:2.0:1746155649.429290:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1654784->1802239) req@ffff88009fac7b80 x1830976126236032/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.429296:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7b80 with x1830976126236032 ext(1654784->1802239) 00010000:00010000:2.0:1746155649.429302:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 17 pid: 8436 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.429313:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 17 pid: 8436 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746155649.429318:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fac7b80 00000100:00100000:2.0:1746155649.429342:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1480 00000100:00100000:2.0:1746155649.429348:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:1962:x1830976126236032:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:0.0:1746155649.429559:0:31253:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8391 00000100:00100000:0.0:1746155649.429565:0:31253:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976126235776:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155649.437910:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.437962:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126236288 00000100:00100000:3.0:1746155649.437969:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126236288 00002000:00100000:3.0:1746155649.438006:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fac4000 x1830976126236288/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.438016:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4000 with x1830976126236288 ext(1048576->2097151) 00002000:00010000:3.0:1746155649.438021:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac4000 00000100:00100000:3.0:1746155649.438052:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8392 00000100:00100000:3.0:1746155649.438059:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126236288:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155649.439305:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976126236032:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 9954us (10351us total) trans 21474841746 rc 0/0 00000100:00100000:3.0:1746155649.439313:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1480 00002000:00100000:3.0:1746155649.439321:0:31249:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x3e0:0x0] (1654784->1802239) req@ffff88009fac7b80 x1830976126236032/t21474841746(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/448 e 0 to 0 dl 1746155660 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.439328:0:31249:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7b80 with x1830976126236032 ext(1654784->1802239) 00010000:00010000:3.0:1746155649.439335:0:31249:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 19 pid: 8436 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.439347:0:31249:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 19 pid: 8436 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746155649.439353:0:31249:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fac7b80 00000100:00100000:2.0:1746155649.439788:0:31253:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976126235776:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 10222us (11161us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155649.439795:0:31253:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8391 00002000:00100000:2.0:1746155649.439800:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fac7800 x1830976126235776/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.439806:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac7800 with x1830976126235776 ext(1048576->2097151) 00002000:00010000:2.0:1746155649.439809:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac7800 00000100:00100000:0.0:1746155649.443319:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.443390:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126236416 00000100:00100000:2.0:1746155649.443400:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126236416 00010000:00010000:2.0:1746155649.443426:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 19 pid: 8436 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.443457:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9075 00000100:00100000:2.0:1746155649.443463:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126236416:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.443474:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.443490:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 19 pid: 8436 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.443522:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 19 pid: 8436 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.443539:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009374cc00/0x844e5faceb5f9519 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1654784->1802239) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f4c expref: 19 pid: 8436 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.443553:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.443554:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.443559:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801373dc200/0x844e5faceb5f9520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f53 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.443565:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801373dc200/0x844e5faceb5f9520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f53 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.443588:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801373dc200/0x844e5faceb5f9520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f53 expref: 19 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.443598:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0954700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125476992:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155649.443646:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.450401:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.450487:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126236544 00000100:00100000:3.0:1746155649.450494:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126236544 00000100:00100000:3.0:1746155649.450573:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17673 00000100:00100000:3.0:1746155649.450581:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126236544:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155649.450595:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.450608:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca19400/0x844e5faceb5f9535 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f68 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.450653:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125477120:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155649.451430:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd000 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.452220:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0954700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125476992:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155649.452234:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.452260:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1960:x1830976126236416:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 8798us (8948us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.452269:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9075 00000100:00100000:3.0:1746155649.452697:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:c69dffb3-b3dd-4058-b066-0e541fe03f74+10:1960:x1830976126236288:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 14637us (14794us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155649.452704:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8392 00002000:00100000:3.0:1746155649.452711:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e3:0x0] (1048576->2097151) req@ffff88009fac4000 x1830976126236288/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.452724:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fac4000 with x1830976126236288 ext(1048576->2097151) 00002000:00010000:3.0:1746155649.452728:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fac4000 00000100:00100000:3.0:1746155649.453375:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125477120:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.453396:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca19400/0x844e5faceb5f9535 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f68 expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.453407:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca19400/0x844e5faceb5f9535 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f68 expref: 21 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.453802:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19400, rc 0) 00000100:00100000:3.0:1746155649.453836:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126236544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3255us (3441us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.453842:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17673 00000100:00100000:1.0:1746155649.456291:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.456330:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.456359:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126236672 00000100:00100000:0.0:1746155649.456387:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126236800 00000100:00100000:0.0:1746155649.456393:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126236800 00000100:00100000:0.0:1746155649.456433:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17674 00000100:00100000:0.0:1746155649.456439:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976126236800:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:0.0:1746155649.456451:0:9235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155649.456462:0:9235:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094f9ca00/0x844e5faceb5f953c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f76 expref: -99 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.456479:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.456480:0:9235:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.456487:0:9235:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094f9ca00/0x844e5faceb5f953c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f76 expref: 21 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.456499:0:9235:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094f9ca00/0x844e5faceb5f953c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f76 expref: 21 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.456521:0:9235:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f9ca00, rc 0) 00000100:00100000:0.0:1746155649.456546:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976126236800:12345-192.168.202.51@tcp:101:cat.0 Request processed in 108us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.456551:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17674 00000100:00100000:3.0:1746155649.456637:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126236672 00000100:00100000:3.0:1746155649.456654:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17675 00000100:00100000:3.0:1746155649.456658:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126236672:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155649.456664:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.456671:0:8436:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5f9543 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f6f expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.456680:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.456682:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.456685:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5f9543 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f6f expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.456698:0:8436:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5f9543 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f6f expref: 26 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.456704:0:8436:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca18800, rc 0) 00000100:00100000:3.0:1746155649.456720:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976126236672:12345-192.168.202.51@tcp:101:cat.0 Request processed in 62us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.456724:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17675 00000100:00100000:0.0:1746155649.468650:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.468676:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.468699:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.468714:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126237056 00000100:00100000:2.0:1746155649.468721:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126237056 00000100:00100000:0.0:1746155649.468732:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.468753:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126237184 00000100:00100000:2.0:1746155649.468755:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126237184 00000100:00100000:0.0:1746155649.468759:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126237312 00000100:00100000:0.0:1746155649.468761:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126237312 00000100:00100000:2.0:1746155649.468765:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126237440 00000100:00100000:2.0:1746155649.468766:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126237440 00000100:00100000:0.0:1746155649.468776:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17676 00000100:00100000:2.0:1746155649.468781:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17677 00000100:00100000:0.0:1746155649.468782:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126237056:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:2.0:1746155649.468785:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126237184:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155649.468796:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155649.468796:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.468809:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f954a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f84 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.468809:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f9c600/0x844e5faceb5f9551 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f7d expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.468846:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0954700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125477376:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155649.468859:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa35180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125477248:192.168.202.51@tcp:106: 00000100:00100000:1.0:1746155649.468887:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17678 00000100:00100000:1.0:1746155649.468895:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126237312:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155649.468902:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155649.468909:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a9577800/0x844e5faceb5f9558 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f8b expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.468919:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17679 00010000:00010000:1.0:1746155649.468926:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746155649.468927:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126237440:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155649.468928:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.468935:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a9577800/0x844e5faceb5f9558 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f8b expref: 13 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.468936:0:18270:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.468942:0:18270:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f955f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f92 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.468948:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a9577800/0x844e5faceb5f9558 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f8b expref: 13 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.468951:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.468952:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.468956:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a9577800, rc 0) 00010000:00010000:3.0:1746155649.468957:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f955f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f92 expref: 21 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.468966:0:18270:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f955f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f92 expref: 21 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.468972:0:18270:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca18000, rc 0) 00000100:00100000:1.0:1746155649.469189:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126237312:12345-192.168.202.51@tcp:101:cat.0 Request processed in 294us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.469195:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17678 00000100:00100000:2.0:1746155649.469208:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.469208:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.469316:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126237440:12345-192.168.202.51@tcp:101:cat.0 Request processed in 390us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.469321:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17679 00000100:00100000:0.0:1746155649.471072:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.471156:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126237568 00000100:00100000:3.0:1746155649.471161:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126237568 00002000:00100000:3.0:1746155649.471192:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1433600->1437695) req@ffff88009fa35f80 x1830976126237568/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.471200:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa35f80 with x1830976126237568 ext(1433600->1437695) 00002000:00010000:3.0:1746155649.471204:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa35f80 00000100:00100000:3.0:1746155649.471480:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8393 00000100:00100000:3.0:1746155649.471491:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976126237568:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155649.471928:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976126237568:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 441us (858us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155649.471934:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8393 00002000:00100000:3.0:1746155649.471939:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e0:0x0] (1433600->1437695) req@ffff88009fa35f80 x1830976126237568/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/4536 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.471946:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa35f80 with x1830976126237568 ext(1433600->1437695) 00002000:00010000:3.0:1746155649.471949:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa35f80 00000100:00100000:2.0:1746155649.472399:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa35180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125477248:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155649.472424:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094f9c600/0x844e5faceb5f9551 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f7d expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.472435:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f9c600/0x844e5faceb5f9551 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f7d expref: 12 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.472448:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f9c600, rc 0) 00000100:00100000:2.0:1746155649.472485:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126237056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3703us (3841us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155649.472491:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17676 00000100:00100000:3.0:1746155649.473136:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0954700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125477376:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.473152:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f954a lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f84 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.473161:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0a82600/0x844e5faceb5f954a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f84 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.473181:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a82600, rc 0) 00000100:00100000:3.0:1746155649.473201:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126237184:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4414us (4524us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.473209:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17677 00000100:00100000:0.0:1746155649.473458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.473523:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126237824 00000100:00100000:1.0:1746155649.473527:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126237824 00000100:00100000:1.0:1746155649.473565:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4811 00000100:00100000:1.0:1746155649.473571:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32619:x1830976126237824:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155649.473757:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea54850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32619:x1830976126237824:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 186us (299us total) trans 8589945460 rc 0/0 00000100:00100000:1.0:1746155649.473763:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4811 00000100:00100000:2.0:1746155649.479123:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.479155:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.479168:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.479196:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.479256:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126238080 00000100:00100000:0.0:1746155649.479263:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126238080 00000100:00100000:3.0:1746155649.479267:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126238336 00000100:00100000:3.0:1746155649.479272:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126238336 00002000:00100000:3.0:1746155649.479296:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a0955c00 x1830976126238336/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155649.479296:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a0957800 x1830976126238080/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.479304:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0955c00 with x1830976126238336 ext(3145728->4194303) 00002000:00100000:0.0:1746155649.479304:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0957800 with x1830976126238080 ext(2097152->3145727) 00002000:00010000:3.0:1746155649.479309:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0955c00 00002000:00010000:0.0:1746155649.479309:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0957800 00000100:00100000:3.0:1746155649.479331:0:31250:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126238592 00000100:00100000:3.0:1746155649.479333:0:31250:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126238592 00002000:00100000:3.0:1746155649.479343:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a0955180 x1830976126238592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746155649.479346:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126238848 00000100:00100000:1.0:1746155649.479349:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126238848 00002000:00100000:3.0:1746155649.479350:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0955180 with x1830976126238592 ext(2097152->3145727) 00002000:00010000:3.0:1746155649.479352:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0955180 00002000:00100000:1.0:1746155649.479365:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a0954700 x1830976126238848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155649.479372:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0954700 with x1830976126238848 ext(3145728->4194303) 00002000:00010000:1.0:1746155649.479374:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0954700 00000100:00100000:1.0:1746155649.479389:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8394 00000100:00100000:1.0:1746155649.479395:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976126238080:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155649.479451:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8395 00000100:00100000:3.0:1746155649.479457:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976126238336:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155649.479805:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8396 00000100:00100000:2.0:1746155649.479812:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126238848:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155649.480587:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8397 00000100:00100000:1.0:1746155649.480593:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976126238592:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155649.501345:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976126238080:12345-192.168.202.51@tcp:3:cat.0 Request processed in 21941us (22220us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155649.501355:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8394 00002000:00100000:1.0:1746155649.501365:0:25394:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff8800a0957800 x1830976126238080/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155649.501374:0:25394:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0957800 with x1830976126238080 ext(2097152->3145727) 00002000:00010000:1.0:1746155649.501379:0:25394:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0957800 00000100:00100000:0.0:1746155649.502553:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.502648:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.502661:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.502673:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.502723:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126239232 00000100:00100000:0.0:1746155649.502729:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126239232 00002000:00100000:0.0:1746155649.502757:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009fa35500 x1830976126239232/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155649.502764:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa35500 with x1830976126239232 ext(2097152->3145727) 00002000:00010000:0.0:1746155649.502767:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa35500 00000100:00100000:3.0:1746155649.502787:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126239360 00000100:00100000:0.0:1746155649.502787:0:31253:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126239744 00000100:00100000:0.0:1746155649.502789:0:31253:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126239744 00000100:00100000:3.0:1746155649.502791:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126239360 00002000:00100000:0.0:1746155649.502801:0:31253:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009fa36680 x1830976126239744/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155649.502807:0:31253:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa36680 with x1830976126239744 ext(3145728->4194303) 00002000:00100000:3.0:1746155649.502809:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009fa36300 x1830976126239360/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746155649.502810:0:31253:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa36680 00002000:00100000:3.0:1746155649.502816:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa36300 with x1830976126239360 ext(3145728->4194303) 00002000:00010000:3.0:1746155649.502819:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa36300 00000100:00100000:0.0:1746155649.502822:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126239616 00000100:00100000:0.0:1746155649.502824:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126239616 00000100:00100000:3.0:1746155649.502831:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8398 00002000:00100000:0.0:1746155649.502834:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009fa35c00 x1830976126239616/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155649.502837:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126239232:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:0.0:1746155649.502840:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa35c00 with x1830976126239616 ext(2097152->3145727) 00002000:00010000:0.0:1746155649.502842:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa35c00 00000100:00100000:0.0:1746155649.502863:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8399 00000100:00100000:0.0:1746155649.502869:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126239744:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155649.503833:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8400 00000100:00100000:0.0:1746155649.503839:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126239360:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155649.503928:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8401 00000100:00100000:3.0:1746155649.503936:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126239616:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155649.504932:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1962:x1830976126238336:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25474us (25774us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155649.504940:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8395 00002000:00100000:0.0:1746155649.504948:0:31250:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff8800a0955c00 x1830976126238336/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155649.504955:0:31250:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0955c00 with x1830976126238336 ext(3145728->4194303) 00002000:00010000:0.0:1746155649.504959:0:31250:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a0955c00 00000100:00100000:3.0:1746155649.508454:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976126238848:12345-192.168.202.51@tcp:3:cat.0 Request processed in 28635us (29248us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155649.508463:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8396 00002000:00100000:3.0:1746155649.508471:0:31251:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800a0954700 x1830976126238848/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.508480:0:31251:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0954700 with x1830976126238848 ext(3145728->4194303) 00002000:00010000:3.0:1746155649.508485:0:31251:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0954700 00000100:00100000:1.0:1746155649.515059:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0955180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1962:x1830976126238592:12345-192.168.202.51@tcp:3:cat.0 Request processed in 34458us (35880us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155649.515069:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8397 00002000:00100000:1.0:1746155649.515079:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800a0955180 x1830976126238592/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155649.515088:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0955180 with x1830976126238592 ext(2097152->3145727) 00002000:00010000:1.0:1746155649.515092:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0955180 00000100:00100000:2.0:1746155649.516334:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126239744:12345-192.168.202.51@tcp:3:cat.0 Request processed in 13462us (13668us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155649.516342:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8399 00002000:00100000:2.0:1746155649.516348:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff88009fa36680 x1830976126239744/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.516355:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa36680 with x1830976126239744 ext(3145728->4194303) 00002000:00010000:2.0:1746155649.516359:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa36680 00000100:00100000:2.0:1746155649.520330:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1960:x1830976126239232:12345-192.168.202.51@tcp:3:cat.0 Request processed in 17484us (17770us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155649.520342:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8398 00002000:00100000:2.0:1746155649.520353:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e4:0x0] (2097152->3145727) req@ffff88009fa35500 x1830976126239232/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.520361:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa35500 with x1830976126239232 ext(2097152->3145727) 00002000:00010000:2.0:1746155649.520366:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa35500 00000100:00100000:2.0:1746155649.523725:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126239360:12345-192.168.202.51@tcp:3:cat.0 Request processed in 19878us (21068us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155649.523735:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8400 00002000:00100000:2.0:1746155649.523745:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (3145728->4194303) req@ffff88009fa36300 x1830976126239360/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.523753:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa36300 with x1830976126239360 ext(3145728->4194303) 00002000:00010000:2.0:1746155649.523759:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa36300 00000100:00100000:3.0:1746155649.529631:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126239616:12345-192.168.202.51@tcp:3:cat.0 Request processed in 25688us (26948us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155649.529641:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8401 00002000:00100000:3.0:1746155649.529650:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff88009fa35c00 x1830976126239616/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.529660:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa35c00 with x1830976126239616 ext(2097152->3145727) 00002000:00010000:3.0:1746155649.529664:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa35c00 00000100:00100000:0.0:1746155649.531911:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.531968:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126240128 00000100:00100000:2.0:1746155649.531975:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126240128 00002000:00100000:2.0:1746155649.532019:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009fa36a00 x1830976126240128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.532027:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa36a00 with x1830976126240128 ext(4194304->5083135) 00002000:00010000:2.0:1746155649.532031:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa36a00 00000100:00100000:2.0:1746155649.532055:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8402 00000100:00100000:2.0:1746155649.532062:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976126240128:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155649.541539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.541785:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126240256 00000100:00100000:3.0:1746155649.541793:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126240256 00000100:00100000:1.0:1746155649.541800:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.542213:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1963:x1830976126240128:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10151us (10307us total) trans 0 rc 888832/888832 00000100:00100000:2.0:1746155649.542222:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8402 00000100:00100000:3.0:1746155649.542338:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126240384 00000100:00100000:3.0:1746155649.542342:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126240384 00000100:00100000:3.0:1746155649.542360:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17680 00000100:00100000:3.0:1746155649.542366:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126240256:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155649.542377:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.542391:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5f9566 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18f99 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.542435:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125477504:192.168.202.51@tcp:106: 00002000:00100000:2.0:1746155649.542464:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009fa36a00 x1830976126240128/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.542473:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa36a00 with x1830976126240128 ext(4194304->5083135) 00002000:00010000:2.0:1746155649.542476:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa36a00 00000100:00100000:2.0:1746155649.542497:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17681 00000100:00100000:2.0:1746155649.542524:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126240384:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155649.542532:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.542540:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f956d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18fa0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.542562:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0954000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125477632:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155649.542659:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.543144:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da600 going to sleep for 11 seconds 00002000:00010000:2.0:1746155649.543864:0:20200:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime: 1746155649 -> 1746155650 00000100:00100000:2.0:1746155649.543881:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0954000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125477632:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155649.543901:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f956d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fa0 expref: 20 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.543910:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f956d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fa0 expref: 20 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.543922:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc03c00, rc 0) 00000100:00100000:2.0:1746155649.544219:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126240384:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1715us (2422us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155649.544226:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17681 00002000:00010000:3.0:1746155649.544551:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime: 1746155649 -> 1746155650 00000100:00100000:3.0:1746155649.544564:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125477504:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.544581:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5f9566 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f99 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.544590:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca19e00/0x844e5faceb5f9566 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f99 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.544609:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ca19e00, rc 0) 00000100:00100000:3.0:1746155649.545181:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126240256:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2480us (3351us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.545189:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17680 00000100:00100000:0.0:1746155649.552143:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.552195:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.552996:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126240512 00000100:00100000:2.0:1746155649.553004:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126240512 00002000:00100000:2.0:1746155649.553037:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x3e1:0x0] (770048->1048575) req@ffff88009fa37480 x1830976126240512/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.553045:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa37480 with x1830976126240512 ext(770048->1048575) 00002000:00010000:2.0:1746155649.553050:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa37480 00000100:00100000:2.0:1746155649.553079:0:2798:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126240640 00000100:00100000:2.0:1746155649.553081:0:2798:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126240640 00002000:00100000:2.0:1746155649.553092:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1437695) req@ffff88009fa37b80 x1830976126240640/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.553099:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa37b80 with x1830976126240640 ext(1048576->1437695) 00002000:00010000:2.0:1746155649.553102:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa37b80 00000100:00100000:2.0:1746155649.553119:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8403 00000100:00100000:2.0:1746155649.553126:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1960:x1830976126240512:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155649.553137:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8404 00000100:00100000:3.0:1746155649.553146:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126240640:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:0.0:1746155649.556841:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.558952:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126240896 00000100:00100000:1.0:1746155649.558961:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126240896 00002000:00100000:1.0:1746155649.558994:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009fa36d80 x1830976126240896/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746155649.559002:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa36d80 with x1830976126240896 ext(4194304->5083135) 00002000:00010000:1.0:1746155649.559007:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa36d80 00000100:00100000:1.0:1746155649.559036:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8405 00000100:00100000:1.0:1746155649.559043:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126240896:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155649.562056:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976126240512:12345-192.168.202.51@tcp:4:cat.0 Request processed in 8922us (9913us total) trans 17179874446 rc 0/0 00000100:00100000:3.0:1746155649.562067:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8403 00002000:00100000:3.0:1746155649.562077:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x3e1:0x0] (770048->1048575) req@ffff88009fa37480 x1830976126240512/t17179874446(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/448 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.562087:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa37480 with x1830976126240512 ext(770048->1048575) 00002000:00010000:3.0:1746155649.562092:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa37480 00000100:00100000:2.0:1746155649.563526:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126240640:12345-192.168.202.51@tcp:4:cat.0 Request processed in 10378us (11327us total) trans 21474841747 rc 0/0 00000100:00100000:2.0:1746155649.563534:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8404 00002000:00100000:2.0:1746155649.563541:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1437695) req@ffff88009fa37b80 x1830976126240640/t21474841747(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/448 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.563549:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa37b80 with x1830976126240640 ext(1048576->1437695) 00002000:00010000:2.0:1746155649.563552:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009fa37b80 00000100:00100000:0.0:1746155649.566978:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1960:x1830976126240896:12345-192.168.202.51@tcp:3:cat.0 Request processed in 7928us (10137us total) trans 0 rc 888832/888832 00000100:00100000:0.0:1746155649.566988:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8405 00002000:00100000:0.0:1746155649.566998:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e4:0x0] (4194304->5083135) req@ffff88009fa36d80 x1830976126240896/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155649.567006:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fa36d80 with x1830976126240896 ext(4194304->5083135) 00002000:00010000:0.0:1746155649.567012:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009fa36d80 00000100:00100000:0.0:1746155649.567613:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.567655:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126241152 00000100:00100000:2.0:1746155649.567661:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126241152 00000100:00100000:2.0:1746155649.567988:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11278 00000100:00100000:2.0:1746155649.567995:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+9:32630:x1830976126241152:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155649.568011:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.568062:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0611200/0x844e5faceb5f9574 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18fa7 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.568140:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f957b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568151:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f957b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568159:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f957b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568169:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610c00/0x844e5faceb5f9582 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568175:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610c00/0x844e5faceb5f9582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568183:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610c00/0x844e5faceb5f9582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568258:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0611800/0x844e5faceb5f9589 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568265:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0611800/0x844e5faceb5f9589 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568270:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0611800/0x844e5faceb5f9589 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155649.568277:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155649.568338:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f957b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568345:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f957b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568350:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f957b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568355:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0610200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155649.568358:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f957b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568363:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f957b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568371:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155649.568374:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155649.568377:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f957b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568384:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f957b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568409:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610c00/0x844e5faceb5f9582 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568414:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610c00/0x844e5faceb5f9582 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568418:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610c00/0x844e5faceb5f9582 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568422:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0610c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155649.568424:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610c00/0x844e5faceb5f9582 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568429:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610c00/0x844e5faceb5f9582 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568434:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51300) 00010000:00010000:2.0:1746155649.568436:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155649.568438:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610c00/0x844e5faceb5f9582 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568442:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610c00/0x844e5faceb5f9582 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.568470:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0611200/0x844e5faceb5f9574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fa7 expref: 12 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.568479:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0611800/0x844e5faceb5f9589 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fa7 expref: 11 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.568489:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.568491:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746155649.568493:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0611800, rc 0) 00000100:00100000:2.0:1746155649.568546:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32630:x1830976126241152:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 551us (933us total) trans 8589945461 rc 0/0 00000100:00100000:2.0:1746155649.568551:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11278 00000100:00100000:0.0:1746155649.569784:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.569819:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.569878:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126241280 00000100:00100000:3.0:1746155649.569883:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126241280 00000100:00100000:3.0:1746155649.569916:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126241408 00000100:00100000:3.0:1746155649.569919:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126241408 00000100:00100000:3.0:1746155649.569935:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17682 00000100:00100000:3.0:1746155649.569940:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126241280:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155649.569948:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17683 00010000:00010000:3.0:1746155649.569950:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155649.569957:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976126241408:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155649.569960:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5f9597 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18fae expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.569965:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155649.569974:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f959e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18fb5 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.569996:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125477760:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155649.569997:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125477888:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155649.570051:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.570079:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.571950:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125477888:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155649.571971:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f959e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fb5 expref: 20 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.571981:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5a37a00/0x844e5faceb5f959e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fb5 expref: 20 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.571990:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5a37a00, rc 0) 00000100:00100000:3.0:1746155649.571991:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125477760:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.572006:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5f9597 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fae expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.572014:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc03c00/0x844e5faceb5f9597 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fae expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746155649.572024:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1962:x1830976126241408:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2069us (2204us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155649.572031:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17683 00010000:00010000:3.0:1746155649.572033:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc03c00, rc 0) 00000100:00100000:3.0:1746155649.572046:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126241280:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2107us (2265us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.572051:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17682 00000100:00100000:0.0:1746155649.572210:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.572227:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126241664 00000100:00100000:1.0:1746155649.572232:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126241664 00000100:00100000:1.0:1746155649.572269:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4812 00000100:00100000:1.0:1746155649.572276:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32630:x1830976126241664:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155649.572441:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32630:x1830976126241664:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 165us (230us total) trans 8589945462 rc 0/0 00000100:00100000:1.0:1746155649.572447:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4812 00000100:00100000:0.0:1746155649.576351:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.576644:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.576699:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126241792 00000100:00100000:2.0:1746155649.576706:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126241792 00000100:00100000:2.0:1746155649.576735:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126241920 00000100:00100000:2.0:1746155649.576737:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126241920 00000100:00100000:2.0:1746155649.576751:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17684 00000100:00100000:2.0:1746155649.576758:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126241792:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155649.576772:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.576787:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dc02000/0x844e5faceb5f95a5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18fbc expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.576828:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0954000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125478016:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155649.576917:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17685 00000100:00100000:3.0:1746155649.576925:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1963:x1830976126241920:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155649.576932:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.576940:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f95ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18fc3 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.576961:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125478144:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155649.577406:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da600 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.577409:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.578608:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0954000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125478016:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.578629:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dc02000/0x844e5faceb5f95a5 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fbc expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.578641:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dc02000/0x844e5faceb5f95a5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fbc expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.578661:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dc02000, rc 0) 00000100:00100000:3.0:1746155649.578813:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126241792:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1939us (2353us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.578820:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17684 00000100:00100000:3.0:1746155649.578865:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125478144:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.578879:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f95ac lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fc3 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.578888:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f95ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fc3 expref: 20 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.578896:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0e200, rc 0) 00000100:00100000:3.0:1746155649.580091:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1963:x1830976126241920:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3164us (3444us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.580104:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17685 00000100:00100000:0.0:1746155649.584759:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.584803:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126242176 00000100:00100000:2.0:1746155649.584811:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126242176 00000100:00100000:2.0:1746155649.584864:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4813 00000100:00100000:2.0:1746155649.584870:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32624:x1830976126242176:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155649.585043:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32624:x1830976126242176:12345-192.168.202.51@tcp:35:cat.0 Request processed in 172us (291us total) trans 8589945463 rc 0/0 00000100:00100000:2.0:1746155649.585049:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4813 00000100:00100000:0.0:1746155649.586034:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.586624:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126242304 00000100:00100000:2.0:1746155649.586628:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126242304 00000100:00100000:2.0:1746155649.586667:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11279 00000100:00100000:2.0:1746155649.586673:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:32632:x1830976126242304:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155649.586686:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.586699:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095243400/0x844e5faceb5f95b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18fca expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.586741:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f95ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.586752:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f95ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.586761:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f95ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.586772:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f95c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.586779:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f95c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.586784:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f95c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.586876:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.586885:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef8 expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.586894:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.586918:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef8 expref: 12 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.586926:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef8 expref: 12 pid: 14234 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.586936:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125478272:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.587000:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.590247:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.590282:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125478272:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.590301:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155649.592035:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126242432 00000100:00100000:3.0:1746155649.592042:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126242432 00010000:00010000:3.0:1746155649.592071:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef8 expref: 13 pid: 14234 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.592095:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9076 00000100:00100000:3.0:1746155649.592101:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976126242432:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155649.592113:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.592118:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef8 expref: 13 pid: 14234 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.592127:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef8 expref: 13 pid: 14234 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.592144:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f94b0 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ef8 expref: 13 pid: 14234 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.592171:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.592175:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.592183:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.592189:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.592205:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155649.592211:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592219:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:3.0:1746155649.592240:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976126242432:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 139us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.592246:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9076 00000004:00200000:2.0:1746155649.592250:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155649.592254:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155649.592266:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592274:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592282:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f95ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592288:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f95ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592294:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f95ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592298:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc02000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155649.592302:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f95ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592306:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f95ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592314:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155649.592316:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155649.592319:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f95ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592323:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc02000/0x844e5faceb5f95ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592349:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f95c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592354:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f95c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592359:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f95c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592362:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dc03c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155649.592365:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f95c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592369:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f95c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592375:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51300) 00010000:00010000:2.0:1746155649.592377:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155649.592379:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f95c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592383:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc03c00/0x844e5faceb5f95c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.592492:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095243400/0x844e5faceb5f95b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fca expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.592519:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fca expref: 7 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.592526:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.592529:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155649.592531:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c052400, rc 0) 00000100:00100000:2.0:1746155649.592554:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32632:x1830976126242304:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5882us (6521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.592561:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11279 00000100:00100000:0.0:1746155649.597589:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.597631:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.597687:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126242560 00000100:00100000:2.0:1746155649.597694:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126242560 00000100:00100000:3.0:1746155649.597698:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126242688 00000100:00100000:3.0:1746155649.597701:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126242688 00000100:00100000:3.0:1746155649.597729:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17686 00000100:00100000:3.0:1746155649.597735:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126242688:12345-192.168.202.51@tcp:101:lfs.0 00000100:00100000:2.0:1746155649.597735:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17687 00000100:00100000:2.0:1746155649.597739:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126242560:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155649.597749:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.597749:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.597763:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f95cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18fd8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.597763:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095243800/0x844e5faceb5f95d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18fd1 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.597802:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125478400:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155649.597802:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125478528:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155649.597921:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.598200:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.599788:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125478400:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.599810:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f95cf lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fd8 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.599819:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f95cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fd8 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.600023:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0e200, rc 0) 00000100:00100000:3.0:1746155649.600065:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1960:x1830976126242688:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2329us (2431us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.600072:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17686 00000100:00100000:2.0:1746155649.601542:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125478528:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155649.601564:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095243800/0x844e5faceb5f95d6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fd1 expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.601575:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095243800/0x844e5faceb5f95d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fd1 expref: 11 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.601584:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095243800, rc 0) 00000100:00100000:2.0:1746155649.601629:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126242560:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3887us (4047us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155649.601635:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17687 00000100:00100000:0.0:1746155649.609676:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.609737:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126242944 00000100:00100000:2.0:1746155649.609744:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126242944 00000100:00100000:2.0:1746155649.609792:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11280 00000100:00100000:2.0:1746155649.609799:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:32632:x1830976126242944:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155649.609815:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.609830:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f95dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18fdf expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.609914:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.609925:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fca expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.609931:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.609956:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fca expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.609966:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fca expref: 8 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.609977:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125478656:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.610053:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.628091:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125478656:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.628114:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155649.628269:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.628419:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126243072 00000100:00100000:2.0:1746155649.628424:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126243072 00010000:00010000:2.0:1746155649.628448:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fca expref: 9 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.628481:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9077 00000100:00100000:2.0:1746155649.628488:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1961:x1830976126243072:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.628499:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.628532:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fca expref: 9 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.628541:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fca expref: 9 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.628557:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c052400/0x844e5faceb5f95c8 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fca expref: 9 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.628570:0:9789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.628574:0:9789:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.628581:0:9789:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.628587:0:9789:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.628600:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.628641:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1961:x1830976126243072:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 153us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.628647:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9077 00010000:00010000:2.0:1746155649.628663:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.628668:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:2.0:1746155649.628681:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155649.628784:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3f39400/0x844e5faceb5f95dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fdf expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.628795:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fdf expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.628800:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.628802:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155649.628804:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d592800, rc 0) 00000100:00100000:2.0:1746155649.628832:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32632:x1830976126242944:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 19034us (19163us total) trans 8589945464 rc 0/0 00000100:00100000:2.0:1746155649.628841:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11280 00000100:00100000:0.0:1746155649.639463:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.640500:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126243200 00000100:00100000:2.0:1746155649.640623:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126243200 00000100:00100000:2.0:1746155649.640672:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11281 00000100:00100000:2.0:1746155649.640679:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32632:x1830976126243200:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155649.640698:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.640713:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9c00/0x844e5faceb5f95f2 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18fe6 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.640783:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.640798:0:20364:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fdf expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.640804:0:20364:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:2.0:1746155649.640829:0:20364:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fdf expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.640838:0:20364:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fdf expref: 9 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.640857:0:20364:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125478784:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.640938:0:20364:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.643766:0:20364:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:20364:1830976125478784:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.643784:0:20364:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000100:00100000:0.0:1746155649.644021:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.645912:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126243328 00000100:00100000:3.0:1746155649.645921:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126243328 00010000:00010000:3.0:1746155649.645952:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fdf expref: 10 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.645991:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9078 00000100:00100000:3.0:1746155649.645998:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126243328:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155649.646010:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.646015:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fdf expref: 10 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.646024:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fdf expref: 10 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.646040:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d592800/0x844e5faceb5f95e4 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fdf expref: 10 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.646066:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.646070:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.646078:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.646082:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.646097:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155649.646145:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126243328:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 147us (2124us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.646150:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9078 00010000:00010000:3.0:1746155649.646180:0:20364:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.646185:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00000004:00200000:3.0:1746155649.646215:0:20364:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155649.646219:0:20364:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155649.646230:0:20364:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.646252:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d9c00/0x844e5faceb5f95f2 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fe6 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.646262:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fe6 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.646268:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.646270:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155649.646272:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d8600, rc 0) 00000100:00100000:3.0:1746155649.646293:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32632:x1830976126243200:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 5615us (6838us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.646299:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11281 00000100:00100000:0.0:1746155649.649691:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.650700:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126243584 00000100:00100000:2.0:1746155649.650708:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126243584 00000100:00100000:2.0:1746155649.650758:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17688 00000100:00100000:2.0:1746155649.650767:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126243584:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155649.650781:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.650794:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9000/0x844e5faceb5f9600 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ff4 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.650838:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125478912:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155649.651043:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.651088:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126243456 00000100:00100000:3.0:1746155649.651093:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126243456 00000100:00100000:3.0:1746155649.651114:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17689 00000100:00100000:3.0:1746155649.651119:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126243456:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155649.651131:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.651141:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0610200/0x844e5faceb5f9607 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18fed expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.651168:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125479040:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155649.651816:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.651926:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.657646:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125479040:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.657674:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0610200/0x844e5faceb5f9607 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fed expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.657686:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0610200/0x844e5faceb5f9607 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fed expref: 11 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.657712:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0610200, rc 0) 00000100:00100000:2.0:1746155649.657866:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125478912:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155649.657884:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9000/0x844e5faceb5f9600 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ff4 expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.657893:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d9000/0x844e5faceb5f9600 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ff4 expref: 12 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.657916:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d9000, rc 0) 00000100:00100000:3.0:1746155649.658451:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1961:x1830976126243456:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 7325us (7402us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.658459:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17689 00000100:00100000:2.0:1746155649.658658:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126243584:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 7892us (8972us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155649.658663:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17688 00000100:00100000:0.0:1746155649.662029:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.662113:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126243712 00000100:00100000:2.0:1746155649.662121:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126243712 00000100:00100000:2.0:1746155649.662168:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17690 00000100:00100000:2.0:1746155649.662175:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32630:x1830976126243712:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155649.662189:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.662203:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f18ffb expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.662227:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f9401 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ece expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.662234:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f955f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f92 expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.662245:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f9ca00/0x844e5faceb5f953c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f76 expref: 22 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.662251:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.662253:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.662255:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [2248704->2961407] (req 2248704->2961407) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 20 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.662280:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094f9ca00/0x844e5faceb5f953c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f76 expref: 22 pid: 9235 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.662291:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094f9ca00/0x844e5faceb5f953c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f76 expref: 22 pid: 9235 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746155649.662301:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125479168:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.662378:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f955f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f92 expref: 20 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.662386:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f955f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f92 expref: 20 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746155649.662393:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0954380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125479296:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.662416:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f9401 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ece expref: 10 pid: 18270 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.662426:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f9401 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ece expref: 10 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746155649.662433:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125479424:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.664977:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.665328:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.665391:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126243968 00000100:00100000:3.0:1746155649.665397:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126243968 00000100:00100000:3.0:1746155649.665441:0:20364:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11282 00000100:00100000:3.0:1746155649.665447:0:20364:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32632:x1830976126243968:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155649.665464:0:20364:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.665480:0:20364:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095243400/0x844e5faceb5f9615 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19002 expref: -99 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.665572:0:20364:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f961c lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.665585:0:20364:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f961c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.665594:0:20364:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f961c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.665603:0:20364:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f961c lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.665608:0:20364:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f961c lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.665618:0:20364:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f961c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.665623:0:20364:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0610200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155649.665626:0:20364:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f961c lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.665631:0:20364:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f961c lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.665638:0:20364:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155649.665641:0:20364:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155649.665644:0:20364:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f961c lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.665648:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0610200/0x844e5faceb5f961c lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 20364 initiator: MDT0 00010000:00010000:3.0:1746155649.665673:0:20364:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095243400/0x844e5faceb5f9615 lrc: 1/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19002 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.665679:0:20364:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095243400/0x844e5faceb5f9615 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19002 expref: 9 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.665689:0:20364:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095243400, rc 0) 00000100:00100000:3.0:1746155649.665724:0:20364:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32632:x1830976126243968:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 277us (400us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.665729:0:20364:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11282 00000100:00100000:0.0:1746155649.671021:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.671047:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.671112:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.671143:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126244224 00000100:00100000:0.0:1746155649.671149:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126244224 00010000:00010000:0.0:1746155649.671177:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f9401 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ece expref: 11 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746155649.671202:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126244096 00000100:00100000:0.0:1746155649.671204:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126244096 00010000:00010000:0.0:1746155649.671212:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f955f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f92 expref: 21 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746155649.671224:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9079 00000100:00100000:0.0:1746155649.671230:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126244224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155649.671241:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155649.671259:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f9401 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ece expref: 11 pid: 18270 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.671268:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f9401 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ece expref: 11 pid: 18270 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.671289:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155649.671333:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+11:1961:x1830976126244224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 102us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.671338:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9079 00000100:00100000:0.0:1746155649.671353:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9080 00000100:00100000:0.0:1746155649.671357:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126244096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155649.671364:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155649.671371:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f955f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f92 expref: 21 pid: 18270 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.671382:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f955f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f92 expref: 21 pid: 18270 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.671393:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155649.671406:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1960:x1830976126244096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 49us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.671411:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9080 00000100:00100000:0.0:1746155649.671427:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126244608 00000100:00100000:0.0:1746155649.671429:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126244608 00000100:00100000:0.0:1746155649.671445:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4814 00000100:00100000:0.0:1746155649.671450:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ff68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:32632:x1830976126244608:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:0.0:1746155649.671604:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:32632:x1830976126244608:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 153us (491us total) trans 8589945465 rc 0/0 00000100:00100000:0.0:1746155649.671609:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4814 00000100:00100000:2.0:1746155649.681807:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125479168:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.681824:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ca18000/0x844e5faceb5f955f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f92 expref: 20 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746155649.681857:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0954380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125479296:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.681868:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a6ef0c00/0x844e5faceb5f9401 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ece expref: 10 pid: 18270 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746155649.681877:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125479424:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.681901:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2248704->2961407] (req 2248704->2961407) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.681915:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f4d8400, rc 0) 00000100:00100000:2.0:1746155649.681961:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ff69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32630:x1830976126243712:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 19787us (19939us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.681968:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17690 00000100:00100000:2.0:1746155649.682533:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.682583:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126244352 00000100:00100000:0.0:1746155649.682589:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126244352 00010000:00010000:0.0:1746155649.682610:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f9ca00/0x844e5faceb5f953c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f76 expref: 23 pid: 9235 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746155649.682636:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9081 00000100:00100000:0.0:1746155649.682642:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126244352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155649.682650:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155649.682666:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f9ca00/0x844e5faceb5f953c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f76 expref: 23 pid: 9235 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.682679:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f9ca00/0x844e5faceb5f953c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f76 expref: 23 pid: 9235 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.682694:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f9ca00/0x844e5faceb5f953c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f76 expref: 23 pid: 9235 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.682701:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.682703:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.682708:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.682714:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.682734:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 18 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155649.682791:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125479552:192.168.202.51@tcp:105: 00000100:00100000:0.0:1746155649.682855:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2c240 going to sleep for 11 seconds 00000100:00100000:2.0:1746155649.685300:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125479552:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155649.685316:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.685353:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8d08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126244352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2709us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.685361:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9081 00000100:00100000:0.0:1746155649.685762:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.685813:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126244864 00000100:00100000:2.0:1746155649.685817:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126244864 00002000:00100000:2.0:1746155649.685853:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2248704->2252799) req@ffff88013089a680 x1830976126244864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.685862:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089a680 with x1830976126244864 ext(2248704->2252799) 00002000:00010000:2.0:1746155649.685866:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089a680 00000100:00100000:2.0:1746155649.685878:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8406 00000100:00100000:2.0:1746155649.685883:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126244864:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155649.686006:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1960:x1830976126244864:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 122us (244us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155649.686011:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8406 00002000:00100000:2.0:1746155649.686015:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2248704->2252799) req@ffff88013089a680 x1830976126244864/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/4536 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.686021:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089a680 with x1830976126244864 ext(2248704->2252799) 00002000:00010000:2.0:1746155649.686024:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089a680 00000100:00100000:0.0:1746155649.700338:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.700427:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126245120 00000100:00100000:2.0:1746155649.700436:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126245120 00002000:00100000:2.0:1746155649.700472:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (2957312->2961407) req@ffff88013089aa00 x1830976126245120/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.700481:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089aa00 with x1830976126245120 ext(2957312->2961407) 00002000:00010000:2.0:1746155649.700486:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089aa00 00000100:00100000:2.0:1746155649.700525:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8407 00000100:00100000:2.0:1746155649.700532:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1963:x1830976126245120:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155649.700687:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1963:x1830976126245120:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 154us (355us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746155649.700694:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8407 00002000:00100000:2.0:1746155649.700699:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x3e2:0x0] (2957312->2961407) req@ffff88013089aa00 x1830976126245120/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/4536 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.700705:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089aa00 with x1830976126245120 ext(2957312->2961407) 00002000:00010000:2.0:1746155649.700708:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013089aa00 00000100:00100000:0.0:1746155649.713196:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.713274:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126245376 00000100:00100000:2.0:1746155649.713281:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126245376 00000100:00100000:2.0:1746155649.713313:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4815 00000100:00100000:2.0:1746155649.713319:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32630:x1830976126245376:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:2.0:1746155649.713565:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32630:x1830976126245376:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 245us (375us total) trans 8589945466 rc 0/0 00000100:00100000:2.0:1746155649.713571:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4815 00000100:00100000:0.0:1746155649.716948:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.716993:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.717009:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126245632 00000100:00100000:0.0:1746155649.717014:0:20364:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126245888 00000100:00100000:2.0:1746155649.717017:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126245632 00000100:00100000:0.0:1746155649.717017:0:20364:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126245888 00000100:00100000:2.0:1746155649.717064:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11283 00000100:00100000:0.0:1746155649.717069:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11284 00000100:00100000:2.0:1746155649.717071:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:32639:x1830976126245632:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:0.0:1746155649.717074:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32638:x1830976126245888:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:2.0:1746155649.717086:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155649.717086:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.717099:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f962a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19009 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.717099:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37200/0x844e5faceb5f9623 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19010 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.717184:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d000/0x844e5faceb5f9631 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717195:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d000/0x844e5faceb5f9631 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717205:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d000/0x844e5faceb5f9631 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717217:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c600/0x844e5faceb5f9638 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717222:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c600/0x844e5faceb5f9638 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717227:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c600/0x844e5faceb5f9638 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717309:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131340200/0x844e5faceb5f963f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717316:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131340200/0x844e5faceb5f963f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717321:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131340200/0x844e5faceb5f963f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155649.717327:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155649.717379:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d000/0x844e5faceb5f9631 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717385:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d000/0x844e5faceb5f9631 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717393:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d000/0x844e5faceb5f9631 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717397:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff7d000 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155649.717400:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d000/0x844e5faceb5f9631 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717405:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d000/0x844e5faceb5f9631 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717412:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155649.717415:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155649.717417:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d000/0x844e5faceb5f9631 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717421:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7d000/0x844e5faceb5f9631 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717428:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c600/0x844e5faceb5f9638 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717432:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c600/0x844e5faceb5f9638 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717436:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c600/0x844e5faceb5f9638 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717439:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ff7c600 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155649.717441:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c600/0x844e5faceb5f9638 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717444:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c600/0x844e5faceb5f9638 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717452:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51b00) 00010000:00010000:2.0:1746155649.717454:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155649.717455:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c600/0x844e5faceb5f9638 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717459:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7c600/0x844e5faceb5f9638 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155649.717483:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ff7dc00/0x844e5faceb5f962a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19009 expref: 16 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.717491:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131340200/0x844e5faceb5f963f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19009 expref: 15 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.717495:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.717497:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155649.717498:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131340200, rc 0) 00000100:00100000:2.0:1746155649.717549:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32639:x1830976126245632:12345-192.168.202.51@tcp:101:cat.0 Request processed in 479us (609us total) trans 8589945467 rc 0/0 00000100:00100000:2.0:1746155649.717554:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11283 00010000:00010000:1.0:1746155649.718603:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5f964d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718612:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5f964d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718620:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5f964d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718629:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbada00/0x844e5faceb5f9654 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718634:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbada00/0x844e5faceb5f9654 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718639:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbada00/0x844e5faceb5f9654 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718690:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbade00/0x844e5faceb5f965b lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718700:0:15474:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbade00/0x844e5faceb5f965b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718705:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbade00/0x844e5faceb5f965b lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000004:00200000:1.0:1746155649.718711:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:1.0:1746155649.718750:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5f964d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718756:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5f964d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718760:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5f964d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718765:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cbac200 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155649.718767:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5f964d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718772:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5f964d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718779:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:1.0:1746155649.718781:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155649.718783:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5f964d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.718788:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbac200/0x844e5faceb5f964d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.720747:0:15474:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbada00/0x844e5faceb5f9654 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.720759:0:15474:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbada00/0x844e5faceb5f9654 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.720765:0:15474:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbada00/0x844e5faceb5f9654 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.720769:0:15474:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cbada00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155649.720772:0:15474:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbada00/0x844e5faceb5f9654 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.720777:0:15474:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbada00/0x844e5faceb5f9654 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.720786:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009c823600) 00010000:00010000:1.0:1746155649.720789:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155649.720792:0:15474:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbada00/0x844e5faceb5f9654 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.720796:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbada00/0x844e5faceb5f9654 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.720837:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5a37200/0x844e5faceb5f9623 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19010 expref: 291 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.720860:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbade00/0x844e5faceb5f965b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19010 expref: 290 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.720867:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.720869:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746155649.720871:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbade00, rc 0) 00000100:00100000:1.0:1746155649.720926:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32638:x1830976126245888:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3850us (3931us total) trans 8589945468 rc 0/0 00000100:00100000:1.0:1746155649.720934:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11284 00000100:00100000:0.0:1746155649.721915:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.722216:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.722261:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126246016 00000100:00100000:3.0:1746155649.722267:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126246016 00000100:00100000:3.0:1746155649.722290:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126246144 00000100:00100000:3.0:1746155649.722292:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126246144 00000100:00100000:3.0:1746155649.722312:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17691 00000100:00100000:3.0:1746155649.722317:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126246016:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155649.722329:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.722340:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0611200/0x844e5faceb5f9669 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19017 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.722374:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125479680:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155649.722409:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17692 00000100:00100000:2.0:1746155649.722417:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976126246144:12345-192.168.202.51@tcp:101:cat.0 00000100:00100000:3.0:1746155649.722422:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00010000:00010000:2.0:1746155649.722427:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.722435:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131340e00/0x844e5faceb5f9670 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1901e expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.722460:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125479808:192.168.202.51@tcp:106: 00000100:00100000:2.0:1746155649.722488:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da300 going to sleep for 11 seconds 00002000:00010000:3.0:1746155649.725392:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime: 1746155649 -> 1746155650 00002000:00010000:3.0:1746155649.725398:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime: 1746155649 -> 1746155650 00000100:00100000:3.0:1746155649.725417:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125479680:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.725442:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0611200/0x844e5faceb5f9669 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19017 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.725453:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0611200/0x844e5faceb5f9669 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19017 expref: 12 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.725482:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0611200, rc 0) 00000100:00100000:3.0:1746155649.725535:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1961:x1830976126246016:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3216us (3621us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.725542:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17691 00002000:00010000:2.0:1746155649.726596:0:20796:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime: 1746155649 -> 1746155650 00002000:00010000:2.0:1746155649.726599:0:20796:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime: 1746155649 -> 1746155650 00000100:00100000:2.0:1746155649.726610:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125479808:192.168.202.51@tcp:106: 00010000:00010000:2.0:1746155649.726626:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131340e00/0x844e5faceb5f9670 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1901e expref: 20 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.726635:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131340e00/0x844e5faceb5f9670 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1901e expref: 20 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155649.726642:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131340e00, rc 0) 00000100:00100000:2.0:1746155649.726662:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:1961:x1830976126246144:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4246us (4447us total) trans 0 rc 301/301 00000100:00100000:2.0:1746155649.726667:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17692 00000100:00100000:0.0:1746155649.731382:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.732232:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126246272 00000100:00100000:2.0:1746155649.732241:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126246272 00000100:00100000:2.0:1746155649.732285:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17693 00000100:00100000:2.0:1746155649.732292:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:32639:x1830976126246272:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155649.732306:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.732319:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17000/0x844e5faceb5f9677 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19025 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.732344:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009469e400/0x844e5faceb5f9504 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f37 expref: 27 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.732351:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155649.732353:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155649.732356:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17000/0x844e5faceb5f9677 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19025 expref: 12 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.732380:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009469e400/0x844e5faceb5f9504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f37 expref: 27 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.732390:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009469e400/0x844e5faceb5f9504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f37 expref: 27 pid: 9235 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.732399:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125479936:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.732474:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.734000:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.734017:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125479936:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.734071:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126246400 00000100:00100000:3.0:1746155649.734076:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126246400 00010000:00010000:3.0:1746155649.734094:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009469e400/0x844e5faceb5f9504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f37 expref: 28 pid: 9235 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.734130:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9082 00000100:00100000:3.0:1746155649.734137:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976126246400:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155649.734146:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.734167:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009469e400/0x844e5faceb5f9504 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f37 expref: 28 pid: 9235 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.734176:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009469e400/0x844e5faceb5f9504 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f37 expref: 28 pid: 9235 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.734194:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009469e400/0x844e5faceb5f9504 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 770048->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f37 expref: 28 pid: 9235 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.734204:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.734206:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.734211:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17000/0x844e5faceb5f9677 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19025 expref: 12 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.734221:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17000/0x844e5faceb5f9677 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19025 expref: 12 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.734247:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17000/0x844e5faceb5f9677 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19025 expref: 12 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.734255:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125480064:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155649.734310:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00010000:00010000:2.0:1746155649.734339:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17000/0x844e5faceb5f9677 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19025 expref: 12 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.734349:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e17000, rc 0) 00000100:00100000:2.0:1746155649.734370:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:32639:x1830976126246272:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2079us (2996us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.734376:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17693 00000100:00100000:3.0:1746155649.736597:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125480064:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155649.736611:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155649.736651:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1960:x1830976126246400:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2513us (2653us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.736659:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9082 00000100:00100000:0.0:1746155649.737598:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.738294:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126246656 00000100:00100000:2.0:1746155649.738300:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126246656 00002000:00100000:2.0:1746155649.738329:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88013089b100 x1830976126246656/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.738339:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089b100 with x1830976126246656 ext(0->1048575) 00002000:00010000:2.0:1746155649.738343:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013089b100 00000100:00100000:2.0:1746155649.738365:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8408 00000100:00100000:2.0:1746155649.738371:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126246656:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155649.750348:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1960:x1830976126246656:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11968us (12744us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155649.750358:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8408 00002000:00100000:2.0:1746155649.750367:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88013089b100 x1830976126246656/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.750376:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013089b100 with x1830976126246656 ext(0->1048575) 00002000:00010000:2.0:1746155649.750380:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013089b100 00000100:00100000:0.0:1746155649.761801:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.762270:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126246784 00000100:00100000:2.0:1746155649.762278:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126246784 00000100:00100000:2.0:1746155649.762327:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17694 00000100:00100000:2.0:1746155649.762334:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+19:32639:x1830976126246784:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:2.0:1746155649.762351:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155649.762364:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5f967e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1902c expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.762390:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801373dc200/0x844e5faceb5f9520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f53 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.762397:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155649.762399:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155649.762402:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5f967e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1902c expref: 20 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.762427:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801373dc200/0x844e5faceb5f9520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f53 expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.762443:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801373dc200/0x844e5faceb5f9520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f53 expref: 21 pid: 8436 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.762453:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125480192:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.762874:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155649.764132:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.764219:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125480192:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.764239:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5f967e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1902c expref: 20 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.764290:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126246912 00000100:00100000:3.0:1746155649.764294:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126246912 00010000:00010000:3.0:1746155649.764321:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801373dc200/0x844e5faceb5f9520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f53 expref: 22 pid: 8436 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.764342:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9083 00000100:00100000:3.0:1746155649.764348:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126246912:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155649.764356:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.764374:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801373dc200/0x844e5faceb5f9520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f53 expref: 22 pid: 8436 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.764388:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801373dc200/0x844e5faceb5f9520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f53 expref: 22 pid: 8436 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.764404:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801373dc200/0x844e5faceb5f9520 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1437695) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f53 expref: 22 pid: 8436 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.764462:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.764464:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.764470:0:20796:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5f967e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1902c expref: 20 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.764477:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5f967e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1902c expref: 20 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.764499:0:20796:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5f967e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1902c expref: 20 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.764530:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125480320:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155649.764567:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da300 going to sleep for 11 seconds 00010000:00010000:3.0:1746155649.765014:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155649.765043:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126246912:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 694us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.765050:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9083 00000100:00100000:2.0:1746155649.766632:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0957b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:20796:1830976125480320:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155649.766642:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801353a2000, rc 0) 00000100:00100000:2.0:1746155649.766886:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32639:x1830976126246784:12345-192.168.202.51@tcp:101:cat.0 Request processed in 4550us (5090us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.766893:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17694 00000100:00100000:0.0:1746155649.778625:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.778688:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.778755:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.778794:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.778867:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126247296 00000100:00100000:0.0:1746155649.778876:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126247296 00000100:00100000:1.0:1746155649.778901:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126247424 00000100:00100000:1.0:1746155649.778906:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126247424 00000100:00100000:0.0:1746155649.778917:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126247552 00000100:00100000:0.0:1746155649.778921:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126247552 00000100:00100000:1.0:1746155649.778928:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17695 00000100:00100000:1.0:1746155649.778935:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1962:x1830976126247296:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155649.778950:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746155649.778952:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17696 00000100:00100000:0.0:1746155649.778960:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126247424:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155649.778964:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5f9685 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19033 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.778971:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746155649.778974:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126247168 00000100:00100000:2.0:1746155649.778978:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126247168 00010000:00010000:0.0:1746155649.778982:0:8438:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094c9f800/0x844e5faceb5f968c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1903a expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.778985:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.778986:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.778993:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5f9685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19033 expref: 28 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.778997:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.778999:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:2.0:1746155649.779003:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880130898380 x1830976126247168/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746155649.779005:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094c9f800/0x844e5faceb5f968c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1903a expref: 23 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155649.779008:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5f9685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19033 expref: 28 pid: 20200 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746155649.779012:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898380 with x1830976126247168 ext(1048576->2097151) 00010000:00010000:1.0:1746155649.779016:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbace00, rc 0) 00002000:00010000:2.0:1746155649.779017:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130898380 00010000:00010000:0.0:1746155649.779017:0:8438:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094c9f800/0x844e5faceb5f968c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1903a expref: 23 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.779025:0:8438:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094c9f800, rc 0) 00000100:00100000:2.0:1746155649.779031:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8409 00000100:00100000:2.0:1746155649.779037:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976126247168:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:1.0:1746155649.779052:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976126247296:12345-192.168.202.51@tcp:101:cat.0 Request processed in 117us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.779057:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17695 00000100:00100000:1.0:1746155649.779072:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17697 00000100:00100000:1.0:1746155649.779076:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976126247552:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155649.779081:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155649.779086:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cbac000/0x844e5faceb5f9693 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19041 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.779119:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125480448:192.168.202.51@tcp:106: 00000100:00100000:0.0:1746155649.779401:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976126247424:12345-192.168.202.51@tcp:101:cat.0 Request processed in 438us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.779407:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17696 00000100:00100000:1.0:1746155649.779411:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00002000:00010000:1.0:1746155649.781829:0:20200:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime: 1746155649 -> 1746155650 00002000:00010000:1.0:1746155649.781835:0:20200:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime: 1746155649 -> 1746155650 00002000:00010000:1.0:1746155649.781837:0:20200:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime: 1746155649 -> 1746155650 00000100:00100000:1.0:1746155649.781865:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125480448:192.168.202.51@tcp:106: 00010000:00010000:1.0:1746155649.781892:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cbac000/0x844e5faceb5f9693 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19041 expref: 23 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155649.781904:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cbac000/0x844e5faceb5f9693 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19041 expref: 23 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155649.781918:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cbac000, rc 0) 00000100:00100000:1.0:1746155649.781958:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126247552:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2880us (3163us total) trans 0 rc 301/301 00000100:00100000:1.0:1746155649.781964:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17697 00000100:00100000:2.0:1746155649.790109:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976126247168:12345-192.168.202.51@tcp:3:cat.0 Request processed in 11064us (11486us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155649.790119:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8409 00002000:00100000:2.0:1746155649.790128:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff880130898380 x1830976126247168/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.790137:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880130898380 with x1830976126247168 ext(1048576->2097151) 00002000:00010000:2.0:1746155649.790142:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880130898380 00000100:00100000:0.0:1746155649.794242:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.794358:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.794425:0:10888:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126247808 00000100:00100000:3.0:1746155649.794433:0:10888:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126247808 00002000:00100000:3.0:1746155649.794474:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f580380 x1830976126247808/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.794484:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580380 with x1830976126247808 ext(0->1048575) 00000100:00100000:2.0:1746155649.794485:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126248064 00002000:00010000:3.0:1746155649.794489:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f580380 00000100:00100000:2.0:1746155649.794489:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126248064 00000100:00100000:3.0:1746155649.794524:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8410 00002000:00100000:2.0:1746155649.794526:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f583100 x1830976126248064/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746155649.794531:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976126247808:12345-192.168.202.51@tcp:3:cat.0 00002000:00100000:2.0:1746155649.794533:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f583100 with x1830976126248064 ext(1048576->2097151) 00002000:00010000:2.0:1746155649.794536:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f583100 00000100:00100000:2.0:1746155649.794554:0:2798:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8411 00000100:00100000:2.0:1746155649.794560:0:2798:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126248064:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:0.0:1746155649.804937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.805286:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.805323:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126248320 00000100:00100000:0.0:1746155649.805331:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126248320 00002000:00100000:0.0:1746155649.805365:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3858431) req@ffff88009f581880 x1830976126248320/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 504/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155649.805374:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f581880 with x1830976126248320 ext(2097152->3858431) 00002000:00010000:0.0:1746155649.805378:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f581880 00000100:00100000:0.0:1746155649.805407:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126248576 00000100:00100000:0.0:1746155649.805409:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126248576 00002000:00100000:0.0:1746155649.805420:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3858432->4194303) req@ffff88009f580e00 x1830976126248576/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155649.805426:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580e00 with x1830976126248576 ext(3858432->4194303) 00002000:00010000:0.0:1746155649.805429:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f580e00 00000100:00100000:0.0:1746155649.805442:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8412 00000100:00100000:0.0:1746155649.805448:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1961:x1830976126248320:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:2.0:1746155649.806101:0:25391:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8413 00000100:00100000:2.0:1746155649.806110:0:25391:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976126248576:12345-192.168.202.51@tcp:3:cat.0 00000100:00100000:3.0:1746155649.806869:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1962:x1830976126247808:12345-192.168.202.51@tcp:3:cat.0 Request processed in 12337us (12634us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155649.806876:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8410 00002000:00100000:3.0:1746155649.806882:0:10888:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x3e1:0x0] (0->1048575) req@ffff88009f580380 x1830976126247808/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.806889:0:10888:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580380 with x1830976126247808 ext(0->1048575) 00002000:00010000:3.0:1746155649.806893:0:10888:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009f580380 00000100:00100000:2.0:1746155649.810375:0:2798:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126248064:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15806us (16008us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155649.810385:0:2798:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8411 00002000:00100000:2.0:1746155649.810394:0:2798:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->2097151) req@ffff88009f583100 x1830976126248064/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.810403:0:2798:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f583100 with x1830976126248064 ext(1048576->2097151) 00002000:00010000:2.0:1746155649.810408:0:2798:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f583100 00000100:00100000:2.0:1746155649.816719:0:25391:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1961:x1830976126248576:12345-192.168.202.51@tcp:3:cat.0 Request processed in 10600us (11423us total) trans 0 rc 335872/335872 00000100:00100000:2.0:1746155649.816730:0:25391:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8413 00002000:00100000:2.0:1746155649.816741:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3858432->4194303) req@ffff88009f580e00 x1830976126248576/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 335872/335872 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.816750:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f580e00 with x1830976126248576 ext(3858432->4194303) 00002000:00010000:2.0:1746155649.816755:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f580e00 00000100:00100000:3.0:1746155649.820727:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976126248320:12345-192.168.202.51@tcp:3:cat.0 Request processed in 15271us (15788us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155649.820738:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8412 00002000:00100000:3.0:1746155649.820747:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3858431) req@ffff88009f581880 x1830976126248320/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 504/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.820755:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f581880 with x1830976126248320 ext(2097152->3858431) 00002000:00010000:3.0:1746155649.820760:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f581880 00000100:00100000:0.0:1746155649.828119:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.828813:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126248704 00000100:00100000:1.0:1746155649.828820:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126248704 00000100:00100000:1.0:1746155649.828871:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17698 00000100:00100000:1.0:1746155649.828877:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32643:x1830976126248704:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:1.0:1746155649.828891:0:20200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155649.828906:0:20200:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f969a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19048 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.828932:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.828938:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155649.828939:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746155649.828942:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f969a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19048 expref: 23 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.828968:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 19 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.828979:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 19 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.828989:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125480576:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155649.829329:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.829359:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.829442:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126248832 00000100:00100000:0.0:1746155649.829445:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126248832 00000100:00100000:0.0:1746155649.829473:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17699 00000100:00100000:0.0:1746155649.829479:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:32638:x1830976126248832:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:0.0:1746155649.829486:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746155649.829495:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1904f expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.829529:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17000/0x844e5faceb5f9677 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19025 expref: 11 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.829537:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5f9685 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19033 expref: 29 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.829541:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.829543:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155649.829545:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [458752->1048575] (req 458752->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.829561:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5f9685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19033 expref: 29 pid: 20200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155649.829569:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5f9685 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19033 expref: 29 pid: 20200 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746155649.829581:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125480704:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155649.829635:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17000/0x844e5faceb5f9677 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19025 expref: 11 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155649.829642:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17000/0x844e5faceb5f9677 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19025 expref: 11 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746155649.829650:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125480832:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155649.829914:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3e2cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155649.831368:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:20200:1830976125480576:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155649.831389:0:20200:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f969a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19048 expref: 23 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.831400:0:20200:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009048f600, rc 0) 00000100:00100000:0.0:1746155649.831650:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.831665:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32643:x1830976126248704:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2786us (3553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.831671:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17698 00000100:00100000:3.0:1746155649.831681:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126248960 00000100:00100000:3.0:1746155649.831686:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126248960 00002000:00100000:3.0:1746155649.831713:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2248704->2961407) req@ffff8800936f6a00 x1830976126248960/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.831720:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6a00 with x1830976126248960 ext(2248704->2961407) 00010000:00010000:3.0:1746155649.831726:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 20 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.831733:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 20 pid: 20796 timeout: 878 lvb_type: 0 00002000:00010000:3.0:1746155649.831738:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936f6a00 00000100:00100000:3.0:1746155649.831751:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1481 00000100:00100000:3.0:1746155649.831756:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1962:x1830976126248960:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:2.0:1746155649.832423:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca95180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125480704:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155649.832432:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8437:1830976125480832:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155649.832452:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [458752->1048575] (req 458752->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 29 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.832462:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009048b400, rc 0) 00000100:00100000:2.0:1746155649.832479:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:32638:x1830976126248832:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 3000us (3121us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.832484:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17699 00000100:00100000:0.0:1746155649.833585:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.833625:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.833635:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126249216 00000100:00100000:1.0:1746155649.833641:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126249216 00000100:00100000:2.0:1746155649.833973:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126249344 00000100:00100000:2.0:1746155649.833980:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126249344 00000100:00100000:1.0:1746155649.833993:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4816 00010000:00010000:2.0:1746155649.833998:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17000/0x844e5faceb5f9677 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19025 expref: 12 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.834001:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+15:32639:x1830976126249216:12345-192.168.202.51@tcp:35:cat.0 00000100:00100000:2.0:1746155649.834021:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9084 00000100:00100000:2.0:1746155649.834026:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976126249344:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.834034:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.834047:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17000/0x844e5faceb5f9677 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19025 expref: 12 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.834056:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17000/0x844e5faceb5f9677 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19025 expref: 12 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.834073:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a3e17000/0x844e5faceb5f9677 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19025 expref: 12 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.834086:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.834108:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126249344:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 81us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.834113:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9084 00000100:00100000:1.0:1746155649.834138:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32639:x1830976126249216:12345-192.168.202.51@tcp:35:cat.0 Request processed in 137us (553us total) trans 8589945469 rc 0/0 00000100:00100000:1.0:1746155649.834144:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4816 00000100:00100000:1.0:1746155649.834815:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.834867:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126249472 00000100:00100000:3.0:1746155649.834870:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126249472 00010000:00010000:3.0:1746155649.834887:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5f9685 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19033 expref: 29 pid: 20200 timeout: 878 lvb_type: 1 00000100:00100000:3.0:1746155649.834902:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9085 00000100:00100000:3.0:1746155649.834908:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+29:1960:x1830976126249472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155649.834914:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.834923:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5f9685 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19033 expref: 29 pid: 20200 timeout: 878 lvb_type: 1 00010000:00010000:3.0:1746155649.834931:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5f9685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19033 expref: 29 pid: 20200 timeout: 878 lvb_type: 1 00010000:00010000:3.0:1746155649.834942:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cbace00/0x844e5faceb5f9685 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19033 expref: 29 pid: 20200 timeout: 878 lvb_type: 1 00010000:00010000:3.0:1746155649.834967:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.834969:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.834975:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.834982:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.835007:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 28 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.835017:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125480960:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155649.835067:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.842011:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7063:1830976125480960:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155649.842028:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155649.842064:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801317c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1960:x1830976126249472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 7155us (7247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.842073:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9085 00000100:00100000:2.0:1746155649.846592:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976126248960:12345-192.168.202.51@tcp:4:cat.0 Request processed in 14827us (14935us total) trans 21474841748 rc 0/0 00000100:00100000:2.0:1746155649.846604:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1481 00002000:00100000:2.0:1746155649.846614:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (2248704->2961407) req@ffff8800936f6a00 x1830976126248960/t21474841748(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/448 e 0 to 0 dl 1746155660 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155649.846622:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f6a00 with x1830976126248960 ext(2248704->2961407) 00010000:00010000:2.0:1746155649.846631:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 22 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.846646:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 22 pid: 20796 timeout: 878 lvb_type: 0 00002000:00010000:2.0:1746155649.846652:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800936f6a00 00000100:00100000:0.0:1746155649.847798:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.847824:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.847882:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126249856 00000100:00100000:3.0:1746155649.847890:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126249856 00000100:00100000:3.0:1746155649.847924:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17700 00000100:00100000:3.0:1746155649.847930:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32638:x1830976126249856:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155649.847943:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155649.847946:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126249728 00000100:00100000:1.0:1746155649.847950:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126249728 00010000:00010000:3.0:1746155649.847955:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1905d expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.847972:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11285 00010000:00010000:3.0:1746155649.847977:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5f967e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1902c expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.847977:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+16:32645:x1830976126249728:12345-192.168.202.51@tcp:101:multiop.0 00010000:00010000:3.0:1746155649.847985:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094c9f800/0x844e5faceb5f968c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1903a expref: 24 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155649.847988:0:15474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.847991:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.847992:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.847995:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 5/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [1048576->1220607] (req 1048576->1220607) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.847997:0:15474:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f96af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19056 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.848018:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094c9f800/0x844e5faceb5f968c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1903a expref: 24 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.848031:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094c9f800/0x844e5faceb5f968c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1903a expref: 24 pid: 8438 timeout: 878 lvb_type: 1 00000100:00100000:3.0:1746155649.848040:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125481088:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155649.848061:0:15474:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.848071:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fe6 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.848077:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131340200/0x844e5faceb5f963f lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19009 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.848082:0:15474:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbade00/0x844e5faceb5f965b lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19010 expref: 289 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.848086:0:15474:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 6/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:3.0:1746155649.848102:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5f967e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1902c expref: 21 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.848102:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbade00/0x844e5faceb5f965b lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19010 expref: 289 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.848108:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbade00/0x844e5faceb5f965b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19010 expref: 289 pid: 15474 timeout: 878 lvb_type: 0 00010000:00010000:3.0:1746155649.848110:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5f967e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1902c expref: 21 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.848115:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801317c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125481344:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.848117:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125481216:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155649.848534:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131340200/0x844e5faceb5f963f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19009 expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.848541:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131340200/0x844e5faceb5f963f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19009 expref: 17 pid: 27374 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.848548:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a091bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125481472:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.849123:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd540 going to sleep for 11 seconds 00010000:00010000:1.0:1746155649.849312:0:15474:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fe6 expref: 8 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.849320:0:15474:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fe6 expref: 8 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.849327:0:15474:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0918000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125481600:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155649.849345:0:15474:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337000 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.852190:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125481088:192.168.202.51@tcp:104: 00000100:00100000:0.0:1746155649.852270:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.852301:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.852321:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126250240 00000100:00100000:0.0:1746155649.852325:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126250240 00010000:00010000:0.0:1746155649.852351:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fe6 expref: 9 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746155649.852373:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126250112 00000100:00100000:0.0:1746155649.852375:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126250112 00010000:00010000:0.0:1746155649.852384:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131340200/0x844e5faceb5f963f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19009 expref: 18 pid: 27374 timeout: 878 lvb_type: 0 00000100:00100000:0.0:1746155649.852403:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9086 00000100:00100000:0.0:1746155649.852409:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976126250240:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155649.852418:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155649.852424:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fe6 expref: 9 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746155649.852433:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fe6 expref: 9 pid: 20364 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746155649.852452:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155649.852457:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155649.852464:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155649.852468:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155649.852497:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1963:x1830976126250240:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 88us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.852529:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9086 00000100:00100000:0.0:1746155649.852545:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9087 00000100:00100000:0.0:1746155649.852550:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1963:x1830976126250112:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155649.852556:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155649.852561:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff880131340200/0x844e5faceb5f963f lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19009 expref: 18 pid: 27374 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746155649.852573:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131340200/0x844e5faceb5f963f lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19009 expref: 18 pid: 27374 timeout: 878 lvb_type: 0 00010000:00010000:0.0:1746155649.852583:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:0.0:1746155649.852586:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155649.852591:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:0.0:1746155649.852594:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155649.852607:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1963:x1830976126250112:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 57us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.852612:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9087 00000100:00100000:0.0:1746155649.852645:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.852658:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126250368 00000100:00100000:0.0:1746155649.852661:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126250368 00010000:00010000:0.0:1746155649.852672:0:9789:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094c9f800/0x844e5faceb5f968c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1903a expref: 25 pid: 8438 timeout: 878 lvb_type: 1 00000100:00100000:0.0:1746155649.852684:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9088 00000100:00100000:0.0:1746155649.852688:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1961:x1830976126250368:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155649.852694:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155649.852710:0:9789:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880094c9f800/0x844e5faceb5f968c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1903a expref: 25 pid: 8438 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.852717:0:9789:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094c9f800/0x844e5faceb5f968c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1903a expref: 25 pid: 8438 timeout: 878 lvb_type: 1 00010000:00010000:0.0:1746155649.852731:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094c9f800/0x844e5faceb5f968c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1903a expref: 25 pid: 8438 timeout: 878 lvb_type: 1 00000100:00100000:2.0:1746155649.852801:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.852813:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126249984 00000100:00100000:2.0:1746155649.852815:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126249984 00010000:00010000:2.0:1746155649.852828:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbade00/0x844e5faceb5f965b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19010 expref: 290 pid: 15474 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.852840:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9089 00000100:00100000:2.0:1746155649.852856:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1961:x1830976126249984:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.852862:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.852865:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbade00/0x844e5faceb5f965b lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19010 expref: 290 pid: 15474 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.852873:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbade00/0x844e5faceb5f965b lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19010 expref: 290 pid: 15474 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.852882:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155649.852885:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155649.852892:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155649.852897:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 15474 initiator: MDT0 00010000:00010000:2.0:1746155649.852910:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.852924:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0957b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:1961:x1830976126249984:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 79us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.852929:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9089 00000100:00100000:2.0:1746155649.852953:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155649.852962:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126250496 00000100:00100000:2.0:1746155649.852964:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126250496 00010000:00010000:2.0:1746155649.852973:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5f967e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1902c expref: 22 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.852986:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9090 00000100:00100000:2.0:1746155649.852990:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0954380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1960:x1830976126250496:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.852997:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.853004:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5f967e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1902c expref: 22 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.853016:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5f967e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1902c expref: 22 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.853028:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.853030:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.853035:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.853042:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.853060:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cbade00/0x844e5faceb5f965b lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19010 expref: 289 pid: 15474 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.853062:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.853072:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125481728:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155649.853076:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801317c4700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125481344:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155649.853086:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131340200/0x844e5faceb5f963f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19009 expref: 17 pid: 27374 timeout: 878 lvb_type: 0 00000100:00100000:1.0:1746155649.853094:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a091bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125481472:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155649.853102:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f4d8600/0x844e5faceb5f95f9 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fe6 expref: 8 pid: 20364 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.853107:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da300 going to sleep for 11 seconds 00000100:00100000:1.0:1746155649.853109:0:15474:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0918000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15474:1830976125481600:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155649.853133:0:15474:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00010000:00010000:1.0:1746155649.853139:0:15474:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155649.853141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00010000:00010000:1.0:1746155649.853144:0:15474:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 15474 initiator: MDT0 00000100:00100000:2.0:1746155649.853152:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126250624 00000100:00100000:2.0:1746155649.853155:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126250624 00000004:00200000:1.0:1746155649.853159:0:15474:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:2.0:1746155649.853167:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 23 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:2.0:1746155649.853180:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9091 00000100:00100000:2.0:1746155649.853184:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1963:x1830976126250624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155649.853190:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155649.853198:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 23 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.853205:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 23 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.853214:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009f4d8400/0x844e5faceb5f960e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2248704->2961407) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ffb expref: 23 pid: 20796 timeout: 878 lvb_type: 0 00010000:00010000:2.0:1746155649.853228:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.853229:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155649.853232:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f969a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19048 expref: 24 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.853238:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f969a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19048 expref: 24 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155649.853253:0:7063:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f969a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19048 expref: 24 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.853260:0:7063:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125481856:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155649.853267:0:15474:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6041e00/0x844e5faceb5f96af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19056 expref: 18 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.853277:0:15474:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19056 expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155649.853278:0:7063:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da600 going to sleep for 11 seconds 00010000:00010000:1.0:1746155649.853283:0:15474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155649.853286:0:15474:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746155649.853288:0:15474:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009048fe00, rc 0) 00000100:00100000:1.0:1746155649.853311:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32645:x1830976126249728:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5334us (5515us total) trans 8589945470 rc 0/0 00000100:00100000:1.0:1746155649.853320:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11285 00010000:00010000:3.0:1746155649.853347:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801353a2000/0x844e5faceb5f967e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1902c expref: 22 pid: 20796 timeout: 878 lvb_type: 0 00000100:00100000:3.0:1746155649.853359:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125481216:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.853378:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 24 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.853385:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0fe00, rc 0) 00000100:00100000:3.0:1746155649.853402:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:32638:x1830976126249856:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 5473us (5577us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.853411:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17700 00010000:00010000:0.0:1746155649.853471:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.853541:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976126250368:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 851us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.853547:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9088 00000100:00100000:3.0:1746155649.856671:0:7063:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7063:1830976125481856:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155649.856688:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155649.856733:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0954000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1963:x1830976126250624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 3547us (3590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.856740:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9091 00000100:00100000:0.0:1746155649.857123:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.857166:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126250880 00000100:00100000:3.0:1746155649.857171:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126250880 00002000:00100000:3.0:1746155649.857198:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e0:0x0] (1216512->1220607) req@ffff8800936f4380 x1830976126250880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.857205:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4380 with x1830976126250880 ext(1216512->1220607) 00002000:00010000:3.0:1746155649.857209:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f4380 00000100:00100000:3.0:1746155649.857232:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8414 00000100:00100000:3.0:1746155649.857237:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976126250880:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:2.0:1746155649.857269:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125481728:192.168.202.51@tcp:105: 00010000:00010000:2.0:1746155649.857279:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155649.857299:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0954380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126250496:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4307us (4345us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155649.857305:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9090 00000100:00100000:3.0:1746155649.857359:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976126250880:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 121us (236us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155649.857364:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8414 00002000:00100000:3.0:1746155649.857369:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e0:0x0] (1216512->1220607) req@ffff8800936f4380 x1830976126250880/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/4536 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.857375:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4380 with x1830976126250880 ext(1216512->1220607) 00002000:00010000:3.0:1746155649.857377:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f4380 00000100:00100000:0.0:1746155649.860864:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.861062:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.861181:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.861423:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126251520 00000100:00100000:3.0:1746155649.861430:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126251520 00000100:00100000:1.0:1746155649.861430:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126251264 00000100:00100000:1.0:1746155649.861435:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126251264 00000100:00100000:3.0:1746155649.861466:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17701 00002000:00100000:1.0:1746155649.861467:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800936f4700 x1830976126251264/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746155649.861472:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:32645:x1830976126251520:12345-192.168.202.51@tcp:101:multiop.0 00002000:00100000:1.0:1746155649.861475:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4700 with x1830976126251264 ext(2097152->3145727) 00002000:00010000:1.0:1746155649.861480:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f4700 00010000:00010000:3.0:1746155649.861484:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746155649.861492:0:25391:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126251392 00000100:00100000:1.0:1746155649.861494:0:25391:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126251392 00010000:00010000:3.0:1746155649.861496:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009455d600/0x844e5faceb5f96c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19064 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746155649.861527:0:25391:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800936f7480 x1830976126251392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746155649.861528:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a013ba00/0x844e5faceb5f9408 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb9 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746155649.861533:0:25391:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f7480 with x1830976126251392 ext(3145728->4194303) 00010000:00010000:3.0:1746155649.861536:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094f9d800/0x844e5faceb5f9512 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f45 expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155649.861536:0:25391:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f7480 00010000:00010000:3.0:1746155649.861543:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009374c000/0x844e5faceb5f950b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f3e expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.861549:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155649.861551:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746155649.861551:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8415 00010000:00010000:3.0:1746155649.861554:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009455d600/0x844e5faceb5f96c4 lrc: 6/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1458176->1712127] (req 1458176->1712127) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19064 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.861557:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976126251264:12345-192.168.202.51@tcp:3:multiop.0 00010000:00010000:3.0:1746155649.861576:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009374c000/0x844e5faceb5f950b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f3e expref: 21 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.861586:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009374c000/0x844e5faceb5f950b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f3e expref: 21 pid: 8436 timeout: 879 lvb_type: 0 00000100:00100000:3.0:1746155649.861596:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125481984:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.861651:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094f9d800/0x844e5faceb5f9512 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f45 expref: 24 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.861659:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094f9d800/0x844e5faceb5f9512 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f45 expref: 24 pid: 20796 timeout: 879 lvb_type: 0 00000100:00100000:3.0:1746155649.861666:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125482112:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.861685:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a013ba00/0x844e5faceb5f9408 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb9 expref: 9 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.861692:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a013ba00/0x844e5faceb5f9408 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb9 expref: 9 pid: 1625 timeout: 879 lvb_type: 1 00000100:00100000:3.0:1746155649.861699:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125482240:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.861710:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909ddc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.861726:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8416 00000100:00100000:3.0:1746155649.861731:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1963:x1830976126251392:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155649.862419:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.862539:0:14235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126251776 00000100:00100000:1.0:1746155649.862543:0:14235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126251776 00000100:00100000:1.0:1746155649.862564:0:14235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4817 00000100:00100000:1.0:1746155649.862569:0:14235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea55c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32638:x1830976126251776:12345-192.168.202.51@tcp:35:multiop.0 00000100:00100000:1.0:1746155649.862705:0:14235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea55c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32638:x1830976126251776:12345-192.168.202.51@tcp:35:multiop.0 Request processed in 135us (286us total) trans 8589945471 rc 0/0 00000100:00100000:1.0:1746155649.862715:0:14235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4817 00000100:00100000:0.0:1746155649.868086:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976126251264:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 6521us (7220us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746155649.868097:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8415 00002000:00100000:0.0:1746155649.868107:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e2:0x0] (2097152->3145727) req@ffff8800936f4700 x1830976126251264/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155649.868116:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f4700 with x1830976126251264 ext(2097152->3145727) 00002000:00010000:0.0:1746155649.868120:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f4700 00000100:00100000:3.0:1746155649.868796:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125481984:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.868806:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125482112:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155649.868813:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125482240:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155649.868841:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009455d600/0x844e5faceb5f96c4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [1458176->1712127] (req 1458176->1712127) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19064 expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155649.868865:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009455d600, rc 0) 00000100:00100000:3.0:1746155649.868895:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:32645:x1830976126251520:12345-192.168.202.51@tcp:101:multiop.0 Request processed in 7422us (7713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.868902:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17701 00000100:00100000:0.0:1746155649.869179:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.869365:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126251904 00000100:00100000:3.0:1746155649.869371:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126251904 00010000:00010000:3.0:1746155649.869392:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a013ba00/0x844e5faceb5f9408 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb9 expref: 10 pid: 1625 timeout: 879 lvb_type: 1 00000100:00100000:3.0:1746155649.869411:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9092 00000100:00100000:3.0:1746155649.869417:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126251904:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155649.869426:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155649.869443:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a013ba00/0x844e5faceb5f9408 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb9 expref: 10 pid: 1625 timeout: 879 lvb_type: 1 00010000:00010000:3.0:1746155649.869453:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a013ba00/0x844e5faceb5f9408 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb9 expref: 10 pid: 1625 timeout: 879 lvb_type: 1 00010000:00010000:3.0:1746155649.869471:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a013ba00/0x844e5faceb5f9408 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18eb9 expref: 10 pid: 1625 timeout: 879 lvb_type: 1 00010000:00010000:3.0:1746155649.869484:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155649.869518:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+9:1960:x1830976126251904:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 84us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155649.869524:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9092 00000100:00100000:1.0:1746155649.870395:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.870421:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155649.870443:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126252032 00000100:00100000:1.0:1746155649.870447:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126252032 00010000:00010000:1.0:1746155649.870462:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094f9d800/0x844e5faceb5f9512 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f45 expref: 25 pid: 20796 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746155649.870478:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126252160 00000100:00100000:1.0:1746155649.870480:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126252160 00010000:00010000:1.0:1746155649.870489:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009374c000/0x844e5faceb5f950b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f3e expref: 21 pid: 8436 timeout: 879 lvb_type: 0 00000100:00100000:1.0:1746155649.870529:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9093 00000100:00100000:1.0:1746155649.870535:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1962:x1830976126252032:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.870543:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.870558:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094f9d800/0x844e5faceb5f9512 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f45 expref: 25 pid: 20796 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746155649.870566:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094f9d800/0x844e5faceb5f9512 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f45 expref: 25 pid: 20796 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746155649.870579:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094f9d800/0x844e5faceb5f9512 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f45 expref: 25 pid: 20796 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746155649.870589:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.870610:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1962:x1830976126252032:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.870615:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9093 00000100:00100000:1.0:1746155649.870627:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9094 00000100:00100000:1.0:1746155649.870631:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+21:1961:x1830976126252160:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155649.870637:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155649.870643:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009374c000/0x844e5faceb5f950b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f3e expref: 21 pid: 8436 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746155649.870652:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009374c000/0x844e5faceb5f950b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f3e expref: 21 pid: 8436 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746155649.870662:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009374c000/0x844e5faceb5f950b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f3e expref: 21 pid: 8436 timeout: 879 lvb_type: 0 00010000:00010000:1.0:1746155649.870670:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.870671:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155649.870677:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009455d600/0x844e5faceb5f96c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->1712127) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19064 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.870684:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009455d600/0x844e5faceb5f96c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->1712127) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19064 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155649.870707:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009455d600/0x844e5faceb5f96c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->1712127) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19064 expref: 20 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155649.870718:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a091b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125482368:192.168.202.51@tcp:105: 00000100:00100000:1.0:1746155649.870755:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5337900 going to sleep for 11 seconds 00000100:00100000:1.0:1746155649.872960:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a091b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125482368:192.168.202.51@tcp:105: 00010000:00010000:1.0:1746155649.872976:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155649.873013:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976126252160:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2380us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.873020:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9094 00000100:00100000:3.0:1746155649.874444:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976126251392:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 12710us (13379us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155649.874453:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8416 00002000:00100000:3.0:1746155649.874461:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e2:0x0] (3145728->4194303) req@ffff8800936f7480 x1830976126251392/t0(0) o3->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:720/0 lens 488/440 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.874469:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800936f7480 with x1830976126251392 ext(3145728->4194303) 00002000:00010000:3.0:1746155649.874474:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800936f7480 00000100:00100000:0.0:1746155649.877672:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.877745:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126252416 00000100:00100000:3.0:1746155649.877753:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126252416 00002000:00100000:3.0:1746155649.877787:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1458176->1462271) req@ffff88009f0dbb80 x1830976126252416/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.877796:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0dbb80 with x1830976126252416 ext(1458176->1462271) 00002000:00010000:3.0:1746155649.877801:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0dbb80 00000100:00100000:3.0:1746155649.877816:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8417 00000100:00100000:3.0:1746155649.877822:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126252416:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:3.0:1746155649.877978:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1960:x1830976126252416:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 155us (311us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746155649.877984:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8417 00002000:00100000:3.0:1746155649.877989:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1458176->1462271) req@ffff88009f0dbb80 x1830976126252416/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/4536 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746155649.877995:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f0dbb80 with x1830976126252416 ext(1458176->1462271) 00002000:00010000:3.0:1746155649.877998:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009f0dbb80 00000100:00100000:0.0:1746155649.878488:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.878616:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126252544 00000100:00100000:3.0:1746155649.878620:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126252544 00000100:00100000:3.0:1746155649.878641:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17702 00000100:00100000:3.0:1746155649.878647:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126252544:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155649.878655:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.878668:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f96cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1906b expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.878706:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125482496:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155649.878772:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd6c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746155649.879932:0:8437:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime: 1746155649 -> 1746155650 00002000:00010000:3.0:1746155649.879936:0:8437:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime: 1746155649 -> 1746155650 00002000:00010000:3.0:1746155649.879937:0:8437:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime: 1746155649 -> 1746155650 00000100:00100000:3.0:1746155649.879951:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125482496:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.879970:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f96cb lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1906b expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.879980:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0e200/0x844e5faceb5f96cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1906b expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.880004:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0e200, rc 0) 00000100:00100000:3.0:1746155649.880035:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126252544:12345-192.168.202.51@tcp:101:cat.0 Request processed in 1388us (1548us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.880041:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17702 00000100:00100000:2.0:1746155649.883552:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155649.883596:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126252800 00000100:00100000:0.0:1746155649.883603:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126252800 00002000:00100000:0.0:1746155649.883639:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1708032->1712127) req@ffff88009ca95180 x1830976126252800/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/0 e 0 to 0 dl 1746155660 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746155649.883647:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00002000:00100000:0.0:1746155649.883648:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95180 with x1830976126252800 ext(1708032->1712127) 00002000:00010000:0.0:1746155649.883652:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca95180 00000100:00100000:0.0:1746155649.883670:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8418 00000100:00100000:0.0:1746155649.883677:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976126252800:12345-192.168.202.51@tcp:3:multiop.0 00000100:00100000:0.0:1746155649.883832:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1961:x1830976126252800:12345-192.168.202.51@tcp:3:multiop.0 Request processed in 155us (287us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746155649.883841:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8418 00002000:00100000:0.0:1746155649.883855:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3e1:0x0] (1708032->1712127) req@ffff88009ca95180 x1830976126252800/t0(0) o3->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:720/0 lens 488/4536 e 0 to 0 dl 1746155660 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746155649.883861:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ca95180 with x1830976126252800 ext(1708032->1712127) 00002000:00010000:0.0:1746155649.883864:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ca95180 00000100:00100000:3.0:1746155649.884529:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126252928 00000100:00100000:3.0:1746155649.884534:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126252928 00000100:00100000:3.0:1746155649.884565:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17703 00000100:00100000:3.0:1746155649.884571:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126252928:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155649.884579:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.884591:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009455ce00/0x844e5faceb5f96d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19072 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.884628:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125482624:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155649.884689:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.887473:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125482624:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.887498:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009455ce00/0x844e5faceb5f96d2 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19072 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.887525:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009455ce00/0x844e5faceb5f96d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19072 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.887537:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009455ce00, rc 0) 00000100:00100000:3.0:1746155649.887581:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ca94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126252928:12345-192.168.202.51@tcp:101:cat.0 Request processed in 3009us (3932us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.887588:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17703 00000100:00100000:1.0:1746155649.894551:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.894659:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126253056 00000100:00100000:3.0:1746155649.894668:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126253056 00000100:00100000:3.0:1746155649.894705:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17704 00000100:00100000:3.0:1746155649.894711:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976126253056:12345-192.168.202.51@tcp:101:cat.0 00010000:00010000:3.0:1746155649.894725:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155649.894738:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009455dc00/0x844e5faceb5f96d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19079 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155649.894779:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125482752:192.168.202.51@tcp:106: 00000100:00100000:3.0:1746155649.894853:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800909dd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746155649.896778:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094443b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125482752:192.168.202.51@tcp:106: 00010000:00010000:3.0:1746155649.896802:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009455dc00/0x844e5faceb5f96d9 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19079 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.896819:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009455dc00/0x844e5faceb5f96d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19079 expref: 23 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155649.896831:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009455dc00, rc 0) 00000100:00100000:3.0:1746155649.897679:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976126253056:12345-192.168.202.51@tcp:101:cat.0 Request processed in 2966us (3132us total) trans 0 rc 301/301 00000100:00100000:3.0:1746155649.897686:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17704 00000100:00100000:0.0:1746155649.903298:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.903354:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126253312 00000100:00100000:3.0:1746155649.903362:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126253312 00000100:00100000:3.0:1746155649.903491:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 383 00000100:00100000:3.0:1746155649.903499:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126253312:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:3.0:1746155649.903663:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+10:1960:x1830976126253312:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 165us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155649.903839:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155649.903910:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 383 00000100:00100000:1.0:1746155649.903939:0:14230:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126253184 00000100:00100000:1.0:1746155649.903943:0:14230:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126253184 00000100:00100000:1.0:1746155649.903972:0:14230:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 223 00000100:00100000:1.0:1746155649.903978:0:14230:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06793f43-a06c-4add-b66d-476e36bacde6+15:1960:x1830976126253184:12345-192.168.202.51@tcp:400:kworker.0 00000100:00100000:1.0:1746155649.904003:0:14230:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06793f43-a06c-4add-b66d-476e36bacde6+15:1960:x1830976126253184:12345-192.168.202.51@tcp:400:kworker.0 Request processed in 26us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155649.904008:0:14230:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 223 00000100:00100000:0.0:1746155650.223418:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155650.223750:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126253440 00000100:00100000:2.0:1746155650.223760:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126253440 00000100:00080000:0.0:1746155650.223993:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1746155650.224016:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1458176->1712127) req@ffff8800a0d71880 x1830976126253440/t0(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:721/0 lens 488/0 e 0 to 0 dl 1746155661 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155650.224025:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d71880 with x1830976126253440 ext(1458176->1712127) 00002000:00010000:2.0:1746155650.224031:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d71880 00000100:00100000:2.0:1746155650.224048:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8419 00000100:00100000:2.0:1746155650.224056:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+20:1962:x1830976126253440:12345-192.168.202.51@tcp:4:multiop.0 00000100:00100000:2.0:1746155650.230045:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+22:1962:x1830976126253440:12345-192.168.202.51@tcp:4:multiop.0 Request processed in 5983us (6627us total) trans 21474841749 rc 0/0 00000100:00100000:2.0:1746155650.230056:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8419 00002000:00100000:2.0:1746155650.230066:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e1:0x0] (1458176->1712127) req@ffff8800a0d71880 x1830976126253440/t21474841749(0) o4->c69dffb3-b3dd-4058-b066-0e541fe03f74@192.168.202.51@tcp:721/0 lens 488/448 e 0 to 0 dl 1746155661 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746155650.230074:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a0d71880 with x1830976126253440 ext(1458176->1712127) 00002000:00010000:2.0:1746155650.230078:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a0d71880 00010000:00010000:3.0:1746155650.300092:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155650.885458:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155650.885496:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155650.886523:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126253568 00000100:00100000:1.0:1746155650.886531:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126253568 00000100:00100000:0.0:1746155650.886542:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00080000:0.0:1746155650.886558:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155650.886573:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155650.886578:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126253824 00000100:00100000:1.0:1746155650.886580:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126253824 00000100:00100000:0.0:1746155650.886584:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126254080 00000100:00100000:0.0:1746155650.886587:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126254080 00000100:00100000:1.0:1746155650.886603:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126253696 00000100:00100000:1.0:1746155650.886942:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126253696 00000100:00100000:0.0:1746155650.887014:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17705 00000100:00100000:0.0:1746155650.887022:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976126253568:12345-192.168.202.51@tcp:16:kworker.0 00000100:00100000:3.0:1746155650.887637:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17706 00000100:00100000:3.0:1746155650.887648:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1962:x1830976126253824:12345-192.168.202.51@tcp:16:kworker.0 00000100:00100000:2.0:1746155650.888181:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17707 00000100:00100000:2.0:1746155650.888200:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17708 00000100:00100000:2.0:1746155650.888205:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+23:1962:x1830976126253696:12345-192.168.202.51@tcp:16:kworker.0 00000100:00100000:2.0:1746155650.888225:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976126254080:12345-192.168.202.51@tcp:16:kworker.0 00000100:00100000:2.0:1746155650.889271:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155650.889283:0:9235:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126253952 00000100:00100000:2.0:1746155650.889287:0:9235:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126253952 00000100:00100000:2.0:1746155650.891025:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17709 00000100:00100000:2.0:1746155650.891034:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976126253952:12345-192.168.202.51@tcp:16:kworker.0 00000100:00100000:2.0:1746155650.891107:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155650.892172:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126254208 00000100:00100000:1.0:1746155650.892178:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126254208 00000100:00100000:1.0:1746155650.892204:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17710 00000100:00100000:1.0:1746155650.892209:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1962:x1830976126254208:12345-192.168.202.51@tcp:16:kworker.0 00000100:00100000:2.0:1746155650.975051:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:c69dffb3-b3dd-4058-b066-0e541fe03f74+13:1962:x1830976126253952:12345-192.168.202.51@tcp:16:kworker.0 Request processed in 84012us (85775us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155650.975061:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17709 00000100:00100000:1.0:1746155650.975921:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c69dffb3-b3dd-4058-b066-0e541fe03f74+12:1962:x1830976126253568:12345-192.168.202.51@tcp:16:kworker.0 Request processed in 88898us (90468us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155650.975928:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17705 00000100:00100000:1.0:1746155650.975970:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1962:x1830976126254080:12345-192.168.202.51@tcp:16:kworker.0 Request processed in 87782us (89428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155650.975975:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17707 00000001:00080000:1.0:1746155650.975994:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874435 is committed 00000001:00080000:1.0:1746155650.976005:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874443 is committed 00000001:00080000:1.0:1746155650.976011:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874427 is committed 00000001:00080000:1.0:1746155650.976017:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874412 is committed 00000001:00080000:1.0:1746155650.976022:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874445 is committed 00000001:00080000:1.0:1746155650.976040:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874415 is committed 00000001:00080000:1.0:1746155650.976832:0:2148:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874446 is committed 00000100:00100000:2.0:1746155650.979083:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125483008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746155650.979131:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155650.979180:0:8440:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125483008 00000100:00100000:2.0:1746155650.979186:0:8440:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125483008 00000100:00100000:2.0:1746155650.979211:0:8440:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1746155650.979216:0:8440:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976125483008:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746155650.979234:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125482880:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746155650.979234:0:8440:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 710213632 pending 22151168 free 3850371072 avail 3848273920 00000100:00100000:3.0:1746155650.979260:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155650.979270:0:21354:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125482880 00000100:00100000:2.0:1746155650.979272:0:21354:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125482880 00000100:00100000:2.0:1746155650.979286:0:21354:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1746155650.979290:0:21354:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830976125482880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746155650.979306:0:21354:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 725417984 pending 0 free 3849322496 avail 3847225344 00000100:00100000:2.0:1746155650.979334:0:21354:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094443b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1830976125482880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (74us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155650.979339:0:21354:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1746155650.979347:0:3296:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874445 gen 2 00000004:00080000:3.0:1746155650.979352:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28c000, transno 17179874416 00000004:00080000:3.0:1746155650.979368:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28e680, transno 17179874417 00000004:00080000:3.0:1746155650.979370:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c28ea00, transno 17179874418 00000004:00080000:3.0:1746155650.979372:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366c700, transno 17179874419 00000004:00080000:3.0:1746155650.979375:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800936f6d80, transno 17179874420 00000004:00080000:3.0:1746155650.979377:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094441c00, transno 17179874421 00000004:00080000:3.0:1746155650.979379:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880094443480, transno 17179874422 00000004:00080000:3.0:1746155650.979380:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009366f480, transno 17179874423 00000004:00080000:3.0:1746155650.979383:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf4700, transno 17179874424 00000004:00080000:3.0:1746155650.979384:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fed8700, transno 17179874428 00000004:00080000:3.0:1746155650.979386:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fdc00, transno 17179874429 00000004:00080000:3.0:1746155650.979388:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fd500, transno 17179874430 00000004:00080000:3.0:1746155650.979390:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880131497800, transno 17179874431 00000004:00080000:3.0:1746155650.979392:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009fedbb80, transno 17179874432 00000004:00080000:3.0:1746155650.979394:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fe300, transno 17179874433 00000004:00080000:3.0:1746155650.979396:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fce00, transno 17179874434 00000004:00080000:3.0:1746155650.979398:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f4fc700, transno 17179874435 00000004:00080000:3.0:1746155650.979400:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0951c00, transno 17179874436 00000004:00080000:3.0:1746155650.979401:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf4380, transno 17179874437 00000004:00080000:3.0:1746155650.979403:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf6a00, transno 17179874438 00000004:00080000:3.0:1746155650.979404:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf5880, transno 17179874439 00000004:00080000:3.0:1746155650.979406:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf7480, transno 17179874440 00000004:00080000:3.0:1746155650.979408:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf7800, transno 17179874441 00000004:00080000:3.0:1746155650.979409:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf6d80, transno 17179874442 00000004:00080000:3.0:1746155650.979411:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf5500, transno 17179874443 00000004:00080000:3.0:1746155650.979413:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8801317c4380, transno 17179874444 00000004:00080000:3.0:1746155650.979417:0:3296:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012bdf5c00, transno 17179874445 00000100:00100000:3.0:1746155650.979424:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125482880:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1746155650.979574:0:14277:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 20 in progress, 0 in flight, 7 done 00000004:00080000:1.0:1746155650.979678:0:14277:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 20 done 00000100:00100000:2.0:1746155650.979777:0:8440:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3297:x1830976125483008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 559us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155650.979782:0:8440:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1746155650.979859:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125483008:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1746155650.992859:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841745 is committed 00000001:00080000:1.0:1746155650.992871:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841729 is committed 00000100:00100000:2.0:1746155650.992912:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1962:x1830976126253696:12345-192.168.202.51@tcp:16:kworker.0 Request processed in 104704us (106334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155650.992920:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17708 00000100:00100000:3.0:1746155650.992928:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+24:1962:x1830976126253824:12345-192.168.202.51@tcp:16:kworker.0 Request processed in 105282us (107429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155650.992935:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17706 00000001:00080000:1.0:1746155650.992975:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841716 is committed 00000001:00080000:1.0:1746155650.992984:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841710 is committed 00000001:00080000:1.0:1746155650.992990:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841749 is committed 00000001:00080000:1.0:1746155650.993002:0:316:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841747 is committed 00000100:00100000:0.0:1746155650.993183:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1962:x1830976126254208:12345-192.168.202.51@tcp:16:kworker.0 Request processed in 100972us (102075us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155650.993189:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17710 00000100:00100000:0.0:1746155650.999432:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155650.999535:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126254464 00000100:00100000:1.0:1746155650.999543:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126254464 00000100:00100000:1.0:1746155650.999588:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4818 00000100:00100000:1.0:1746155650.999596:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+17:32670:x1830976126254464:12345-192.168.202.51@tcp:35:umount.0 00000100:00080000:0.0:1746155650.999754:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746155650.999764:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:32670:x1830976126254464:12345-192.168.202.51@tcp:35:umount.0 Request processed in 169us (338us total) trans 8589945472 rc 0/0 00000100:00100000:1.0:1746155650.999770:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4818 00000100:00100000:0.0:1746155651.001902:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.002357:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126254592 00000100:00100000:1.0:1746155651.002363:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126254592 00000100:00100000:1.0:1746155651.002410:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 775 00000100:00100000:1.0:1746155651.002418:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06793f43-a06c-4add-b66d-476e36bacde6+15:1961:x1830976126254592:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155651.002430:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155651.002445:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009a236400/0x844e5faceb5eda8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f121c9 expref: 15 pid: 14230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.002458:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155651.002490:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06793f43-a06c-4add-b66d-476e36bacde6+14:1961:x1830976126254592:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 72us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155651.002496:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 775 00000100:00100000:0.0:1746155651.002571:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.002586:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126254720 00000100:00100000:1.0:1746155651.002589:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126254720 00000100:00100000:1.0:1746155651.002606:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 776 00000100:00100000:1.0:1746155651.002611:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06793f43-a06c-4add-b66d-476e36bacde6+14:1961:x1830976126254720:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155651.002617:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155651.002624:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009fd10000/0x844e5faceb5eda96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f121f3 expref: 14 pid: 14231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.002631:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155651.002632:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.002651:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06793f43-a06c-4add-b66d-476e36bacde6+13:1961:x1830976126254720:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 39us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155651.002656:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 776 00000100:00100000:1.0:1746155651.002664:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126254848 00000100:00100000:1.0:1746155651.002666:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126254848 00000100:00100000:1.0:1746155651.002679:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 777 00000100:00100000:1.0:1746155651.002683:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06793f43-a06c-4add-b66d-476e36bacde6+13:1960:x1830976126254848:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155651.002687:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155651.002694:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009ca59000/0x844e5faceb5eda9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f121fa expref: 13 pid: 14230 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.002700:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155651.003128:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:06793f43-a06c-4add-b66d-476e36bacde6+12:1960:x1830976126254848:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 443us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155651.003134:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 777 00000100:00100000:0.0:1746155651.003786:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.003928:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126255232 00000100:00100000:2.0:1746155651.003932:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126255232 00000100:00100000:2.0:1746155651.003963:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17711 00000100:00100000:2.0:1746155651.003968:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+7:1959:x1830976126255232:12345-192.168.202.51@tcp:9:umount.0 00000020:00000080:2.0:1746155651.003985:0:20200:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x844e5faceb5edab2 00000020:00010000:2.0:1746155651.003991:0:20200:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a0604000: total 0 00000100:00080000:2.0:1746155651.003994:0:20200:0:(import.c:66:import_set_state_nolock()) ffff8800a0601000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746155651.004026:0:20200:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874446 00000100:00100000:2.0:1746155651.004219:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:c69dffb3-b3dd-4058-b066-0e541fe03f74+5:1959:x1830976126255232:12345-192.168.202.51@tcp:9:umount.0 Request processed in 250us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155651.004225:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17711 00000020:00010000:0.0:1746155651.004312:0:7065:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a0604000: total 0 00010000:00010000:0.0:1746155651.004332:0:7065:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a0604000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1746155651.004365:0:7065:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c046400/0x844e5faceb5f952e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f61 expref: 4 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.004383:0:7065:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a9577800/0x844e5faceb5f9558 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f8b expref: 3 pid: 8438 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746155651.004391:0:7065:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a0604000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1746155651.004398:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746155651.004400:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746155651.004402:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155651.013957:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.014036:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126255488 00000100:00100000:3.0:1746155651.014043:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126255488 00000100:00100000:3.0:1746155651.014078:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17712 00000100:00100000:3.0:1746155651.014083:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+6:1959:x1830976126255488:12345-192.168.202.51@tcp:9:umount.0 00000020:00000080:3.0:1746155651.014104:0:8437:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x844e5faceb5edaab 00000020:00010000:3.0:1746155651.014110:0:8437:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a0600800: total 0 00000100:00080000:3.0:1746155651.014112:0:8437:0:(import.c:66:import_set_state_nolock()) ffff8800a0607000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746155651.014141:0:8437:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841749 00000100:00100000:3.0:1746155651.014317:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c69dffb3-b3dd-4058-b066-0e541fe03f74+4:1959:x1830976126255488:12345-192.168.202.51@tcp:9:umount.0 Request processed in 233us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.014321:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17712 00000020:00010000:0.0:1746155651.014385:0:7066:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a0600800: total 0 00010000:00010000:0.0:1746155651.014387:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746155651.014403:0:7066:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a0600800, canceled 0 locks, left on hash table 1. 00002000:00010000:0.0:1746155651.014421:0:7066:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2079 -> 2081 00010000:00010000:0.0:1746155651.014438:0:7066:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009455d600/0x844e5faceb5f96c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1458176->1712127) gid 0 flags: 0x44801000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19064 expref: 3 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.014456:0:7066:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a0600800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1746155651.014460:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746155651.014461:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746155651.014462:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155651.018945:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.019219:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126255872 00000100:00100000:1.0:1746155651.019225:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126255872 00000100:00100000:1.0:1746155651.019274:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11286 00000100:00100000:1.0:1746155651.019282:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+18:1959:x1830976126255872:12345-192.168.202.51@tcp:39:umount.0 00000020:00000080:1.0:1746155651.019308:0:15474:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x844e5faceb5edaa4 00000020:00010000:1.0:1746155651.019313:0:15474:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88013554f000: total 0 00000100:00080000:1.0:1746155651.019317:0:15474:0:(import.c:66:import_set_state_nolock()) ffff880135549800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746155651.019343:0:15474:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589945472 00000020:00010000:3.0:1746155651.019418:0:20797:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88013554f000: total 0 00010000:00010000:3.0:1746155651.019450:0:20797:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88013554f000, canceled 0 locks, left on hash table 5. 00010000:00010000:3.0:1746155651.019474:0:20797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.019477:0:20797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746155651.019482:0:20797:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d593c00/0x844e5faceb5f94e1 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f0d expref: 17 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.019531:0:20797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.019534:0:20797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746155651.019537:0:20797:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009048fe00/0x844e5faceb5f96b6 lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19056 expref: 17 pid: 15474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.019547:0:20797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.019549:0:20797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155651.019552:0:20797:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131341400/0x844e5faceb5f94f6 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f29 expref: 16 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.019562:0:20797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.019565:0:20797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746155651.019568:0:20797:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a0611800/0x844e5faceb5f9589 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18fa7 expref: 15 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.019582:0:20797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155651.019583:0:20797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746155651.019586:0:20797:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ca58800/0x844e5faceb5edb45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1229b expref: 13 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.019596:0:20797:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88013554f000, canceled 5 locks, left on hash table 0. 00010000:00010000:3.0:1746155651.019605:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746155651.019607:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746155651.019608:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746155651.019616:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c69dffb3-b3dd-4058-b066-0e541fe03f74+11:1959:x1830976126255872:12345-192.168.202.51@tcp:39:umount.0 Request processed in 333us (676us total) trans 8589945473 rc 0/0 00000100:00100000:1.0:1746155651.019623:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11286 00010000:00010000:3.0:1746155651.302778:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155651.333036:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.333069:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.333098:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.333134:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.333157:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126256640 00000100:00100000:0.0:1746155651.333162:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126256000 00000100:00100000:2.0:1746155651.333164:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126256640 00000100:00100000:0.0:1746155651.333166:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126256000 00000100:00100000:0.0:1746155651.333197:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126256128 00000100:00100000:0.0:1746155651.333199:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126256128 00000100:00100000:2.0:1746155651.333201:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17713 00000100:00100000:2.0:1746155651.333207:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1959:x1830976126256640:12345-192.168.202.51@tcp:9:umount.0 00000100:00100000:0.0:1746155651.333211:0:9789:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126256256 00000100:00100000:0.0:1746155651.333212:0:9789:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126256256 00000100:00100000:0.0:1746155651.333223:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 778 00000100:00100000:0.0:1746155651.333228:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06793f43-a06c-4add-b66d-476e36bacde6+14:1960:x1830976126256000:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000020:00000080:2.0:1746155651.333230:0:20200:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x844e5faceb5edad5 00000020:00010000:2.0:1746155651.333235:0:20200:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800a0cee800: total 0 00000100:00080000:2.0:1746155651.333238:0:20200:0:(import.c:66:import_set_state_nolock()) ffff8800a0cef000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1746155651.333238:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155651.333253:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88009a237c00/0x844e5faceb5edab9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12224 expref: 14 pid: 14231 timeout: 0 lvb_type: 0 00000001:00000004:2.0:1746155651.333264:0:20200:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874446 00010000:00010000:0.0:1746155651.333268:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155651.333300:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06793f43-a06c-4add-b66d-476e36bacde6+13:1960:x1830976126256000:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155651.333306:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 778 00000100:00100000:0.0:1746155651.333319:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 779 00000100:00100000:0.0:1746155651.333324:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06793f43-a06c-4add-b66d-476e36bacde6+12:1961:x1830976126256128:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746155651.333329:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155651.333336:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88012db87400/0x844e5faceb5edac0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1224e expref: 12 pid: 14231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.333346:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155651.333357:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06793f43-a06c-4add-b66d-476e36bacde6+11:1961:x1830976126256128:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 33us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155651.333361:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 779 00000100:00100000:0.0:1746155651.333370:0:9789:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 780 00000100:00100000:2.0:1746155651.333374:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+5:1959:x1830976126256640:12345-192.168.202.51@tcp:9:umount.0 Request processed in 167us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155651.333374:0:9789:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06793f43-a06c-4add-b66d-476e36bacde6+10:1962:x1830976126256256:12345-192.168.202.51@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746155651.333379:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17713 00010000:00010000:0.0:1746155651.333379:0:9789:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746155651.333385:0:9789:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880095179400/0x844e5faceb5edac7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f12255 expref: 10 pid: 14231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.333392:0:9789:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155651.333404:0:9789:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:06793f43-a06c-4add-b66d-476e36bacde6+9:1962:x1830976126256256:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 30us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155651.333414:0:9789:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 780 00000020:00010000:2.0:1746155651.333423:0:7065:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800a0cee800: total 0 00000100:00080000:0.0:1746155651.333427:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746155651.333436:0:7065:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800a0cee800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1746155651.333465:0:7065:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a013a200/0x844e5faceb5f93f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ec0 expref: 4 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155651.333485:0:7065:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801315ea400/0x844e5faceb5f93fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18ec7 expref: 3 pid: 4461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155651.333497:0:7065:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800a0cee800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1746155651.333528:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746155651.333530:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746155651.333532:0:7065:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746155651.341938:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.342012:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126256896 00000100:00100000:2.0:1746155651.342020:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126256896 00000100:00100000:2.0:1746155651.342079:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17714 00000100:00100000:2.0:1746155651.342087:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009283e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+6:1959:x1830976126256896:12345-192.168.202.51@tcp:9:umount.0 00000020:00000080:2.0:1746155651.342110:0:8437:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x844e5faceb5edadc 00000020:00010000:2.0:1746155651.342116:0:8437:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88013554b800: total 0 00000100:00080000:2.0:1746155651.342120:0:8437:0:(import.c:66:import_set_state_nolock()) ffff88009fec4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746155651.342159:0:8437:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841749 00000020:00010000:1.0:1746155651.342171:0:7066:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88013554b800: total 0 00010000:00010000:1.0:1746155651.342205:0:7066:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88013554b800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1746155651.342246:0:7066:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ceccc00/0x844e5faceb5f0e60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f13ea9 expref: 6 pid: 10591 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.342269:0:7066:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88013554b800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1746155651.342277:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746155651.342278:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746155651.342280:0:7066:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746155651.342298:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009283e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+2:1959:x1830976126256896:12345-192.168.202.51@tcp:9:umount.0 Request processed in 211us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155651.342305:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17714 00000100:00080000:0.0:1746155651.342363:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746155651.354072:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.354136:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126257152 00000100:00100000:1.0:1746155651.354143:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126257152 00000100:00100000:1.0:1746155651.354209:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11287 00000100:00100000:1.0:1746155651.354216:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+8:1959:x1830976126257152:12345-192.168.202.51@tcp:39:umount.0 00000020:00000080:1.0:1746155651.354240:0:15474:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x844e5faceb5edace 00000020:00010000:1.0:1746155651.354246:0:15474:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88013554f800: total 0 00000100:00080000:1.0:1746155651.354249:0:15474:0:(import.c:66:import_set_state_nolock()) ffff880135548800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746155651.354272:0:15474:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589945473 00000100:00100000:1.0:1746155651.354404:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:46ce2338-cbb3-40fc-97a4-5b0420b1b7f8+7:1959:x1830976126257152:12345-192.168.202.51@tcp:39:umount.0 Request processed in 188us (340us total) trans 8589945474 rc 0/0 00000100:00100000:1.0:1746155651.354410:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11287 00000020:00010000:3.0:1746155651.354536:0:20797:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88013554f800: total 0 00010000:00010000:3.0:1746155651.354539:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746155651.354570:0:20797:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88013554f800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1746155651.354592:0:20797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:3.0:1746155651.354595:0:20797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746155651.354605:0:20797:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a27d200/0x844e5faceb5edaea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1227f expref: 6 pid: 14234 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.354633:0:20797:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88013554f800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1746155651.354640:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746155651.354642:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746155651.354643:0:20797:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1746155651.357577:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746155651.381898:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.381977:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126257280 00000100:00100000:2.0:1746155651.381984:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126257280 00000100:00080000:0.0:1746155651.382062:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746155651.382147:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11288 00000100:00100000:2.0:1746155651.382154:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+290:32691:x1830976126257280:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155651.382174:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155651.382189:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e301600/0x844e5faceb5f96e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19080 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.382233:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18d400/0x844e5faceb5f96e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382248:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18d400/0x844e5faceb5f96e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382257:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18d400/0x844e5faceb5f96e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382267:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18ca00/0x844e5faceb5f96ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382273:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18ca00/0x844e5faceb5f96ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382278:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18ca00/0x844e5faceb5f96ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382357:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7c00/0x844e5faceb5f96f5 lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382362:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7c00/0x844e5faceb5f96f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382367:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7c00/0x844e5faceb5f96f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155651.382390:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:2.0:1746155651.382393:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746155651.382403:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7c00/0x844e5faceb5f96f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382410:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7c00/0x844e5faceb5f96f5 lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382415:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18d400/0x844e5faceb5f96e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382420:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18d400/0x844e5faceb5f96e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382425:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18d400/0x844e5faceb5f96e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382430:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b18d400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155651.382433:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18d400/0x844e5faceb5f96e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382438:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18d400/0x844e5faceb5f96e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382447:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009fe51500) 00010000:00010000:2.0:1746155651.382449:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155651.382452:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18d400/0x844e5faceb5f96e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.382456:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18d400/0x844e5faceb5f96e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.383696:0:27374:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18ca00/0x844e5faceb5f96ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.383703:0:27374:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18ca00/0x844e5faceb5f96ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.383707:0:27374:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18ca00/0x844e5faceb5f96ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.383711:0:27374:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b18ca00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:2.0:1746155651.383713:0:27374:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18ca00/0x844e5faceb5f96ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.383718:0:27374:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18ca00/0x844e5faceb5f96ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.383726:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009fe51400) 00010000:00010000:2.0:1746155651.383728:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746155651.383730:0:27374:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18ca00/0x844e5faceb5f96ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.383734:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b18ca00/0x844e5faceb5f96ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.383765:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e301600/0x844e5faceb5f96e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19080 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.383774:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7c00/0x844e5faceb5f96f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19080 expref: 291 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.383780:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155651.383782:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746155651.383784:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a01d7c00, rc 0) 00000100:00100000:2.0:1746155651.384435:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32691:x1830976126257280:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2280us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155651.384443:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11288 00000100:00100000:0.0:1746155651.391444:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.391642:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126257408 00000100:00100000:2.0:1746155651.391650:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126257408 00000100:00080000:0.0:1746155651.391857:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746155651.391931:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17715 00000100:00100000:2.0:1746155651.391939:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1961:x1830976126257408:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155651.391955:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155651.391970:0:8437:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e301600/0x844e5faceb5f96fc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19087 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155651.391990:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x68143882, atime: 0x68143881, ctime: 0x68143882, blocks: 0x821 00010000:00010000:2.0:1746155651.392006:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.392007:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.392020:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e301600/0x844e5faceb5f96fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19087 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155651.392034:0:8437:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e301600/0x844e5faceb5f96fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19087 expref: 13 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155651.392044:0:8437:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e301600, rc 0) 00000100:00100000:2.0:1746155651.392141:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a386c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976126257408:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 202us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155651.392147:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17715 00000100:00100000:0.0:1746155651.395313:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.395745:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126257664 00000100:00100000:2.0:1746155651.395753:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126257664 00000100:00100000:2.0:1746155651.395805:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11289 00000100:00100000:2.0:1746155651.395811:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+291:32691:x1830976126257664:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155651.395827:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155651.395851:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6c00/0x844e5faceb5f9703 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1908e expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.395929:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.395940:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7c00/0x844e5faceb5f96f5 lrc: 2/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19080 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.395946:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 4/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.395971:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7c00/0x844e5faceb5f96f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19080 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.395980:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7c00/0x844e5faceb5f96f5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19080 expref: 292 pid: 27374 timeout: 880 lvb_type: 0 00000100:00100000:2.0:1746155651.395993:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125483136:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155651.396066:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155651.403217:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.403301:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126257792 00000100:00100000:3.0:1746155651.403308:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126257792 00010000:00010000:3.0:1746155651.403337:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7c00/0x844e5faceb5f96f5 lrc: 5/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19080 expref: 293 pid: 27374 timeout: 880 lvb_type: 0 00000100:00100000:2.0:1746155651.403343:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125483136:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155651.403361:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155651.403376:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9095 00000100:00100000:3.0:1746155651.403382:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1960:x1830976126257792:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155651.403392:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155651.403397:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7c00/0x844e5faceb5f96f5 lrc: 4/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19080 expref: 293 pid: 27374 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746155651.403406:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7c00/0x844e5faceb5f96f5 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19080 expref: 293 pid: 27374 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746155651.403423:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d7c00/0x844e5faceb5f96f5 lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19080 expref: 293 pid: 27374 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746155651.403438:0:7063:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.403443:0:7063:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 3/0,1 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.403450:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.403455:0:7063:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 4/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.403480:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746155651.403493:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.403499:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 3/0,1 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:2.0:1746155651.403532:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000100:00100000:3.0:1746155651.403533:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:1960:x1830976126257792:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 150us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.403539:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9095 00010000:00010000:2.0:1746155651.403640:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a01d6c00/0x844e5faceb5f9703 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1908e expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.403655:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1908e expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.403661:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155651.403663:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746155651.403666:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094f9aa00, rc 0) 00000100:00100000:2.0:1746155651.403688:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32691:x1830976126257664:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 7877us (8382us total) trans 8589945475 rc 0/0 00000100:00100000:2.0:1746155651.403694:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11289 00000100:00100000:0.0:1746155651.405893:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.405948:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126257920 00000100:00100000:2.0:1746155651.405956:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126257920 00000100:00100000:2.0:1746155651.405999:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11290 00000100:00100000:2.0:1746155651.406005:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32691:x1830976126257920:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155651.406024:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155651.406037:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51b200/0x844e5faceb5f9718 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19095 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.406096:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51ac00/0x844e5faceb5f971f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.406107:0:27374:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 2/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1908e expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.406113:0:27374:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51ac00/0x844e5faceb5f971f lrc: 4/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:2.0:1746155651.406133:0:27374:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1908e expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.406143:0:27374:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1908e expref: 293 pid: 27374 timeout: 880 lvb_type: 0 00000100:00100000:2.0:1746155651.406152:0:27374:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125483264:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155651.406221:0:27374:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da300 going to sleep for 11 seconds 00000100:00100000:0.0:1746155651.409403:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.409566:0:27374:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:27374:1830976125483264:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155651.409584:0:27374:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51ac00/0x844e5faceb5f971f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:1.0:1746155651.409639:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126258048 00000100:00100000:1.0:1746155651.409644:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126258048 00010000:00010000:1.0:1746155651.409667:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1908e expref: 294 pid: 27374 timeout: 880 lvb_type: 0 00000100:00100000:1.0:1746155651.409698:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9096 00000100:00100000:1.0:1746155651.409704:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:1960:x1830976126258048:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155651.409716:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155651.409720:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 4/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1908e expref: 294 pid: 27374 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746155651.409729:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 3/0,0 mode: CW/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1908e expref: 294 pid: 27374 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746155651.409746:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094f9aa00/0x844e5faceb5f970a lrc: 0/0,0 mode: --/CW res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1908e expref: 294 pid: 27374 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746155651.409761:0:7062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155651.409765:0:7062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51ac00/0x844e5faceb5f971f lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155651.409772:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51ac00/0x844e5faceb5f971f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155651.409777:0:7062:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51ac00/0x844e5faceb5f971f lrc: 4/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155651.409802:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155651.409841:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:1960:x1830976126258048:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 137us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155651.409847:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9096 00010000:00010000:3.0:1746155651.409922:0:27374:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51ac00/0x844e5faceb5f971f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.409934:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51ac00/0x844e5faceb5f971f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155651.409968:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155651.409972:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155651.409984:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51ac00/0x844e5faceb5f971f lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.410008:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51b200/0x844e5faceb5f9718 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19095 expref: 293 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.410019:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51ac00/0x844e5faceb5f971f lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19095 expref: 292 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.410025:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.410027:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155651.410029:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c51ac00, rc 0) 00000100:00100000:3.0:1746155651.410054:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32691:x1830976126257920:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 4049us (4165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.410060:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11290 00000100:00100000:0.0:1746155651.414485:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.415518:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126258304 00000100:00100000:1.0:1746155651.415525:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126258304 00000100:00100000:1.0:1746155651.415568:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4819 00000100:00100000:1.0:1746155651.415574:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+292:32691:x1830976126258304:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:1.0:1746155651.415907:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32691:x1830976126258304:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 332us (1427us total) trans 8589945476 rc 0/0 00000100:00100000:1.0:1746155651.415913:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4819 00000100:00100000:0.0:1746155651.417062:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.417218:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126258560 00000100:00100000:3.0:1746155651.417222:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126258560 00000100:00100000:3.0:1746155651.417252:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11291 00000100:00100000:3.0:1746155651.417257:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+293:32691:x1830976126258560:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155651.417268:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155651.417271:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746155651.417290:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3d14200/0x844e5faceb5f2d4d lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f151aa expref: 293 pid: 19870 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.417307:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.417310:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155651.417319:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f9726 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f1909c expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.417375:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7df600/0x844e5faceb5f972d lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.417384:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7df600/0x844e5faceb5f972d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.417390:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7df600/0x844e5faceb5f972d lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155651.417397:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00010000:00010000:3.0:1746155651.417461:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dfa00/0x844e5faceb5f9726 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1909c expref: 295 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.417471:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7df600/0x844e5faceb5f972d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1909c expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.417476:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.417479:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746155651.417480:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009f7df600, rc 0) 00000100:00100000:3.0:1746155651.417526:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32691:x1830976126258560:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 267us (465us total) trans 8589945477 rc 0/0 00000100:00100000:3.0:1746155651.417532:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11291 00000100:00100000:0.0:1746155651.419189:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.419749:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.419767:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126258816 00000100:00100000:2.0:1746155651.419772:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126258816 00000100:00100000:2.0:1746155651.419807:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17716 00000100:00100000:2.0:1746155651.419813:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976126258816:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155651.419847:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.419860:0:8437:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.419867:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155651.419868:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155651.419871:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.419892:0:8437:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 13 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.419902:0:8437:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 13 pid: 8437 timeout: 880 lvb_type: 0 00000100:00100000:2.0:1746155651.419911:0:8437:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125483392:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155651.420032:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126259072 00000100:00100000:3.0:1746155651.420036:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126259072 00000100:00100000:3.0:1746155651.420065:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17717 00000100:00100000:3.0:1746155651.420070:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126259072:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:3.0:1746155651.420086:0:20200:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.420096:0:20200:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c047000/0x844e5faceb5f9527 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f5a expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.420101:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.420103:0:20200:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.420104:0:20200:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.420118:0:20200:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c047000/0x844e5faceb5f9527 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f5a expref: 20 pid: 9235 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.420125:0:20200:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c047000/0x844e5faceb5f9527 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f5a expref: 20 pid: 9235 timeout: 880 lvb_type: 0 00000100:00100000:3.0:1746155651.420134:0:20200:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125483520:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155651.420346:0:8437:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da300 going to sleep for 11 seconds 00000100:00080000:2.0:1746155651.420364:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746155651.420453:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.420466:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.420635:0:20200:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009bf25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746155651.420818:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.421021:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.421160:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126259328 00000100:00100000:2.0:1746155651.421164:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126259328 00000100:00100000:2.0:1746155651.421191:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126258688 00000100:00100000:2.0:1746155651.421193:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126258688 00000100:00100000:2.0:1746155651.421203:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126258944 00000100:00100000:2.0:1746155651.421205:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126258944 00000100:00100000:2.0:1746155651.421217:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17718 00000100:00100000:2.0:1746155651.421222:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976126259328:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155651.421246:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.421256:0:8436:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f969a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19048 expref: 15 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.421261:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.421262:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.421264:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.421279:0:8436:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f969a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19048 expref: 15 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.421287:0:8436:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f969a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19048 expref: 15 pid: 20200 timeout: 880 lvb_type: 0 00000100:00100000:2.0:1746155651.421294:0:8436:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125483648:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155651.421329:0:8436:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5dad80 going to sleep for 11 seconds 00000100:00100000:2.0:1746155651.421345:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17719 00000100:00100000:2.0:1746155651.421350:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126258688:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155651.421364:0:18270:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.421373:0:18270:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.421382:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155651.421384:0:18270:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746155651.421386:0:18270:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.421400:0:18270:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 21 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.421407:0:18270:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 21 pid: 8437 timeout: 880 lvb_type: 0 00000100:00100000:2.0:1746155651.421415:0:18270:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125483776:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155651.421434:0:18270:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da600 going to sleep for 11 seconds 00000100:00100000:2.0:1746155651.421522:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17720 00000100:00100000:2.0:1746155651.421529:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976126258944:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:2.0:1746155651.421543:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.421552:0:8438:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e301600/0x844e5faceb5f96fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19087 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155651.421556:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.421557:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.421559:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.421575:0:8438:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e301600/0x844e5faceb5f96fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19087 expref: 15 pid: 8437 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155651.421582:0:8438:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e301600/0x844e5faceb5f96fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19087 expref: 15 pid: 8437 timeout: 880 lvb_type: 1 00000100:00100000:2.0:1746155651.421589:0:8438:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125483904:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155651.421610:0:8438:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da840 going to sleep for 11 seconds 00000100:00100000:1.0:1746155651.422031:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126259200 00000100:00100000:1.0:1746155651.422035:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126259200 00000100:00100000:1.0:1746155651.422063:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17721 00000100:00100000:1.0:1746155651.422068:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126259200:12345-192.168.202.51@tcp:1:lfs.0 00010000:00010000:1.0:1746155651.422083:0:20796:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.422092:0:20796:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5f9543 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f6f expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155651.422101:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.422102:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.422104:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.422116:0:20796:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5f9543 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f6f expref: 22 pid: 8436 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155651.422122:0:20796:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5f9543 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f6f expref: 22 pid: 8436 timeout: 880 lvb_type: 1 00000100:00100000:1.0:1746155651.422130:0:20796:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0918000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125484032:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155651.422176:0:20796:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949540 going to sleep for 11 seconds 00000100:00100000:3.0:1746155651.423638:0:8437:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8437:1830976125483392:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155651.423655:0:8437:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.423676:0:20200:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:20200:1830976125483520:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155651.423687:0:20200:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155651.426262:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.426326:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.426393:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126259456 00000100:00100000:2.0:1746155651.426400:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126259456 00002000:00100000:2.0:1746155651.426435:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1220607) req@ffff88009fc51500 x1830976126259456/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:722/0 lens 488/0 e 0 to 0 dl 1746155662 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155651.426444:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc51500 with x1830976126259456 ext(1048576->1220607) 00010000:00010000:2.0:1746155651.426452:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 16 pid: 8437 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746155651.426462:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 16 pid: 8437 timeout: 880 lvb_type: 0 00002000:00010000:2.0:1746155651.426468:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc51500 00000100:00100000:2.0:1746155651.426494:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1482 00000100:00100000:2.0:1746155651.426500:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976126259456:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:1.0:1746155651.426954:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126259584 00000100:00100000:1.0:1746155651.426958:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126259584 00010000:00010000:1.0:1746155651.426976:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c047000/0x844e5faceb5f9527 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f5a expref: 23 pid: 9235 timeout: 880 lvb_type: 0 00000100:00100000:1.0:1746155651.426993:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9097 00000100:00100000:1.0:1746155651.426998:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fc50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1961:x1830976126259584:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155651.427005:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155651.427019:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c047000/0x844e5faceb5f9527 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f5a expref: 23 pid: 9235 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746155651.427027:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c047000/0x844e5faceb5f9527 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f5a expref: 23 pid: 9235 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746155651.427043:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c047000/0x844e5faceb5f9527 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f5a expref: 23 pid: 9235 timeout: 880 lvb_type: 0 00010000:00010000:1.0:1746155651.427055:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.427057:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.427060:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.427067:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.427083:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155651.427103:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976126259584:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 105us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155651.427109:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9097 00010000:00010000:1.0:1746155651.427135:0:20200:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.427141:0:20200:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.427157:0:20200:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.427163:0:20200:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.427173:0:20200:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.427179:0:20200:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7dec00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155651.427182:0:20200:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.427189:0:20200:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.427197:0:20200:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.427203:0:20200:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009f7dec00/0x844e5faceb5f9742 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155651.428354:0:8438:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8438:1830976125483904:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155651.428367:0:18270:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:18270:1830976125483776:192.168.202.51@tcp:104: 00010000:00010000:0.0:1746155651.428370:0:8438:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.428377:0:18270:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155651.428671:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.428686:0:8441:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126259712 00000100:00100000:0.0:1746155651.428689:0:8441:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126259712 00002000:00100000:0.0:1746155651.428711:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e1:0x0] (458752->1048575) req@ffff88009f881c00 x1830976126259712/t0(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:722/0 lens 488/0 e 0 to 0 dl 1746155662 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746155651.428719:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881c00 with x1830976126259712 ext(458752->1048575) 00010000:00010000:0.0:1746155651.428723:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 22 pid: 8437 timeout: 880 lvb_type: 0 00010000:00010000:0.0:1746155651.428732:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 22 pid: 8437 timeout: 880 lvb_type: 0 00002000:00010000:0.0:1746155651.428738:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f881c00 00000100:00100000:0.0:1746155651.428758:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 1483 00000100:00100000:0.0:1746155651.428764:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1963:x1830976126259712:12345-192.168.202.51@tcp:4:cat.0 00000100:00100000:3.0:1746155651.429260:0:20796:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0918000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:20796:1830976125484032:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155651.429272:0:20796:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155651.429326:0:8436:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8436:1830976125483648:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155651.429338:0:8436:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155651.430108:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126259072:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 10036us (10357us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155651.430116:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17717 00000100:00100000:2.0:1746155651.433637:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.433740:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126259968 00000100:00100000:3.0:1746155651.433748:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126259968 00010000:00010000:3.0:1746155651.433773:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f969a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19048 expref: 18 pid: 20200 timeout: 880 lvb_type: 0 00000100:00100000:3.0:1746155651.433809:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9098 00000100:00100000:3.0:1746155651.433816:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976126259968:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155651.433827:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155651.433853:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f969a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19048 expref: 18 pid: 20200 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746155651.433864:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f969a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19048 expref: 18 pid: 20200 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746155651.433879:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009048f600/0x844e5faceb5f969a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19048 expref: 18 pid: 20200 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746155651.433890:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.433892:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.433895:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.433901:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.433918:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155651.433946:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1960:x1830976126259968:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 130us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.433951:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9098 00010000:00010000:3.0:1746155651.433970:0:8436:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.433976:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.433989:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.433995:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434001:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434010:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c51aa00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155651.434013:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434019:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434027:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434032:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c51aa00/0x844e5faceb5f9749 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.434062:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976126259328:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 12839us (13609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.434068:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17718 00000100:00100000:3.0:1746155651.434107:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.434253:0:7063:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126259840 00000100:00100000:3.0:1746155651.434257:0:7063:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126259840 00010000:00010000:3.0:1746155651.434266:0:7063:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e301600/0x844e5faceb5f96fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19087 expref: 16 pid: 8437 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746155651.434280:0:7063:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9099 00000100:00100000:3.0:1746155651.434284:0:7063:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094440a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1963:x1830976126259840:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155651.434290:0:7063:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155651.434299:0:7063:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e301600/0x844e5faceb5f96fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19087 expref: 16 pid: 8437 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.434306:0:7063:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e301600/0x844e5faceb5f96fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19087 expref: 16 pid: 8437 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.434315:0:7063:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e301600/0x844e5faceb5f96fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19087 expref: 16 pid: 8437 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.434322:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.434323:0:7063:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.434326:0:7063:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434331:0:7063:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434342:0:7063:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155651.434355:0:7063:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094440a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1963:x1830976126259840:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 71us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.434360:0:7063:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9099 00010000:00010000:3.0:1746155651.434374:0:8438:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434380:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434390:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434395:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434400:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434405:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cf0fc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155651.434407:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434412:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434419:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.434425:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fc00/0x844e5faceb5f9757 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.434448:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976126258944:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 12919us (13630us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.434452:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17720 00000100:00100000:2.0:1746155651.438664:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976126259456:12345-192.168.202.51@tcp:4:cat.0 Request processed in 12155us (12400us total) trans 21474841750 rc 0/0 00000100:00100000:2.0:1746155651.438673:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1482 00002000:00100000:2.0:1746155651.438682:0:8443:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3e0:0x0] (1048576->1220607) req@ffff88009fc51500 x1830976126259456/t21474841750(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:722/0 lens 488/448 e 0 to 0 dl 1746155662 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155651.438690:0:8443:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009fc51500 with x1830976126259456 ext(1048576->1220607) 00010000:00010000:2.0:1746155651.438697:0:8443:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 14 pid: 8437 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746155651.438708:0:8443:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 14 pid: 8437 timeout: 880 lvb_type: 0 00002000:00010000:2.0:1746155651.438713:0:8443:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009fc51500 00000100:00100000:1.0:1746155651.438822:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.438855:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126260096 00000100:00100000:1.0:1746155651.438860:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126260096 00010000:00010000:1.0:1746155651.438880:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5f9543 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f6f expref: 23 pid: 8436 timeout: 880 lvb_type: 1 00000100:00100000:1.0:1746155651.438898:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9100 00000100:00100000:1.0:1746155651.438904:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a091bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1962:x1830976126260096:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746155651.438914:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746155651.438928:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5f9543 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f6f expref: 23 pid: 8436 timeout: 880 lvb_type: 1 00010000:00010000:1.0:1746155651.438936:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5f9543 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f6f expref: 23 pid: 8436 timeout: 880 lvb_type: 1 00010000:00010000:1.0:1746155651.438953:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ca18800/0x844e5faceb5f9543 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f6f expref: 23 pid: 8436 timeout: 880 lvb_type: 1 00010000:00010000:1.0:1746155651.439392:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.439395:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.439399:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.439406:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.439424:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746155651.439447:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a091bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1962:x1830976126260096:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 542us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155651.439452:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9100 00010000:00010000:3.0:1746155651.439705:0:20796:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.439714:0:20796:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.439731:0:20796:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.439737:0:20796:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.439744:0:20796:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.439750:0:20796:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009cecdc00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155651.439753:0:20796:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.439760:0:20796:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.439769:0:20796:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.439775:0:20796:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009cecdc00/0x844e5faceb5f975e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.439825:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126259200:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 17756us (18804us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.439841:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17721 00000100:00100000:2.0:1746155651.446780:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1963:x1830976126259712:12345-192.168.202.51@tcp:4:cat.0 Request processed in 18006us (18098us total) trans 17179874447 rc 0/0 00000100:00100000:2.0:1746155651.446792:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 1483 00002000:00100000:2.0:1746155651.446802:0:8441:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3e1:0x0] (458752->1048575) req@ffff88009f881c00 x1830976126259712/t17179874447(0) o4->8066b3b8-f397-4fc0-a5d7-9a18bc891e5b@192.168.202.51@tcp:722/0 lens 488/448 e 0 to 0 dl 1746155662 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746155651.446812:0:8441:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009f881c00 with x1830976126259712 ext(458752->1048575) 00010000:00010000:2.0:1746155651.446820:0:8441:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 21 pid: 8437 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746155651.446847:0:8441:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 21 pid: 8437 timeout: 880 lvb_type: 0 00002000:00010000:2.0:1746155651.446854:0:8441:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009f881c00 00000100:00100000:1.0:1746155651.449795:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.450809:0:7062:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126260224 00000100:00100000:2.0:1746155651.450818:0:7062:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126260224 00010000:00010000:2.0:1746155651.450863:0:7062:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 14 pid: 8437 timeout: 880 lvb_type: 0 00000100:00100000:2.0:1746155651.450893:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9101 00000100:00100000:2.0:1746155651.450900:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1963:x1830976126260224:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155651.450912:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155651.450928:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 14 pid: 8437 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746155651.450939:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 14 pid: 8437 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746155651.450957:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f96a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1905d expref: 14 pid: 8437 timeout: 880 lvb_type: 0 00010000:00010000:2.0:1746155651.450987:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.450989:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.450992:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.451000:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.451035:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746155651.451074:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0918380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1963:x1830976126260224:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 174us (4034us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155651.451080:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9101 00010000:00010000:3.0:1746155651.451864:0:8437:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.451873:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.451890:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.451895:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.451901:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.451906:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c51a600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155651.451909:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.451915:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.451925:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.451930:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c51a600/0x844e5faceb5f973b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.451977:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+12:1960:x1830976126258816:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 32163us (32790us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.451984:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17716 00000100:00100000:0.0:1746155651.452226:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.452308:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126260352 00000100:00100000:2.0:1746155651.452312:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126260352 00010000:00010000:2.0:1746155651.452327:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 21 pid: 8437 timeout: 880 lvb_type: 0 00000100:00100000:3.0:1746155651.453226:0:7062:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9102 00000100:00100000:3.0:1746155651.453234:0:7062:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126260352:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155651.453243:0:7062:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155651.453259:0:7062:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 21 pid: 8437 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746155651.453268:0:7062:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 21 pid: 8437 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746155651.453282:0:7062:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009048b400/0x844e5faceb5f96a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1904f expref: 21 pid: 8437 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746155651.453292:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.453294:0:7062:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.453296:0:7062:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.453303:0:7062:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.453318:0:7062:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155651.453352:0:7062:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126260352:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 119us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.453358:0:7062:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9102 00010000:00010000:0.0:1746155651.453449:0:18270:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.453457:0:18270:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.453471:0:18270:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.453477:0:18270:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.453483:0:18270:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.453488:0:18270:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094f9b000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:0.0:1746155651.453491:0:18270:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.453497:0:18270:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.453519:0:18270:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.453529:0:18270:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094f9b000/0x844e5faceb5f9750 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18270 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155651.453564:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fc53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976126258688:12345-192.168.202.51@tcp:1:lfs.0 Request processed in 32214us (33097us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155651.453570:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17719 00000100:00100000:0.0:1746155651.461724:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.462416:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126260608 00000100:00100000:0.0:1746155651.462424:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126260608 00000100:00100000:3.0:1746155651.462615:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11292 00000100:00100000:3.0:1746155651.462625:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+294:32691:x1830976126260608:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:3.0:1746155651.462666:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1746155651.462687:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c51ac00/0x844e5faceb5f971f lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19095 expref: 294 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.462703:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dc67a00/0x844e5faceb5f94e8 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f18f1b expref: 293 pid: 20364 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.462711:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.462715:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155651.462740:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dec00/0x844e5faceb5f9765 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.462750:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dec00/0x844e5faceb5f9765 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.462758:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dec00/0x844e5faceb5f9765 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000040:00080000:3.0:1746155651.464452:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3726, 88 off314816 00000004:00080000:3.0:1746155651.464462:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780613957929ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155651.464536:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3715, 88 off314112 00000004:00080000:3.0:1746155651.464540:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780614037419ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155651.464563:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3716, 88 off314200 00000004:00080000:3.0:1746155651.464566:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780614063493ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155651.464573:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3727, 88 off314904 00000004:00080000:3.0:1746155651.464576:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780614073043ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155651.464582:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3728, 88 off314992 00000004:00080000:3.0:1746155651.464584:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780614081041ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155651.464591:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3717, 88 off314288 00000004:00080000:3.0:1746155651.464593:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780614090123ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155651.464599:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3718, 88 off314376 00000004:00080000:3.0:1746155651.464601:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780614098021ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155651.464607:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3719, 88 off314464 00000004:00080000:3.0:1746155651.464609:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780614106144ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155651.464615:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3729, 88 off315080 00000004:00080000:3.0:1746155651.464618:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780614114612ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155651.464623:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3720, 88 off314552 00000004:00080000:3.0:1746155651.464627:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780614123599ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155651.464632:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3730, 88 off315168 00000004:00080000:3.0:1746155651.464635:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780614131614ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155651.464641:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3721, 88 off314640 00000004:00080000:3.0:1746155651.464643:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780614140212ns, next at 716011101328ns, rc = 0 00000040:00080000:3.0:1746155651.464649:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3731, 88 off315256 00000004:00080000:3.0:1746155651.464651:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780614148462ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155651.464657:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3732, 88 off315344 00000004:00080000:3.0:1746155651.464660:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780614156729ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155651.464665:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3733, 88 off315432 00000004:00080000:3.0:1746155651.464668:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780614164889ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155651.464673:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3734, 88 off315520 00000004:00080000:3.0:1746155651.464676:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780614173262ns, next at 716024381471ns, rc = 0 00000040:00080000:3.0:1746155651.464682:0:27374:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3722, 88 off314728 00000004:00080000:3.0:1746155651.464684:0:27374:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780614180866ns, next at 716011101328ns, rc = 0 00000001:00080000:1.0:1746155651.487895:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945465 is committed 00000001:00080000:1.0:1746155651.487907:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945476 is committed 00000001:00100000:1.0:1746155651.487912:0:14318:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 46ce2338-cbb3-40fc-97a4-5b0420b1b7f8 00000001:00080000:1.0:1746155651.487915:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945474 is committed 00000001:00100000:1.0:1746155651.487919:0:14318:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c69dffb3-b3dd-4058-b066-0e541fe03f74 00000001:00080000:1.0:1746155651.487923:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945473 is committed 00000020:00000080:1.0:1746155651.487949:0:14318:0:(genops.c:904:class_export_put()) final put ffff88013554f800/46ce2338-cbb3-40fc-97a4-5b0420b1b7f8 00000020:00000080:1.0:1746155651.487971:0:14318:0:(genops.c:904:class_export_put()) final put ffff88013554f000/c69dffb3-b3dd-4058-b066-0e541fe03f74 00000001:00080000:1.0:1746155651.487976:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945478 is committed 00000004:00080000:1.0:1746155651.487979:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2905 committed 00000004:00080000:1.0:1746155651.487985:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2911 committed 00000004:00080000:1.0:1746155651.487990:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2910 committed 00000004:00080000:1.0:1746155651.487992:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2909 committed 00000004:00080000:1.0:1746155651.487994:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2908 committed 00000004:00080000:1.0:1746155651.487995:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2904 committed 00000004:00080000:1.0:1746155651.487996:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2907 committed 00000004:00080000:1.0:1746155651.487997:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2903 committed 00000004:00080000:1.0:1746155651.487999:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2906 committed 00000004:00080000:1.0:1746155651.488000:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2902 committed 00000004:00080000:1.0:1746155651.488002:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2901 committed 00000004:00080000:1.0:1746155651.488003:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2900 committed 00000004:00080000:1.0:1746155651.488004:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2905 committed 00000004:00080000:1.0:1746155651.488005:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2904 committed 00000004:00080000:1.0:1746155651.488007:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2899 committed 00000004:00080000:1.0:1746155651.488008:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2898 committed 00000004:00080000:1.0:1746155651.488009:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2903 committed 00000100:00100000:1.0:1746155651.488100:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125484544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.488147:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155651.488191:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125485056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.488208:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155651.488223:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746155651.488227:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a091ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125484160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.488241:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155651.488253:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125484672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.488265:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155651.488279:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125484288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.488293:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155651.488303:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125484800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.488314:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155651.488324:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746155651.488328:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a091b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125484416:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.488339:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155651.488349:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125484928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.488359:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155651.488378:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125484544 00000100:00100000:1.0:1746155651.488383:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125484544 00000100:00100000:1.0:1746155651.488414:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125485056 00000100:00100000:1.0:1746155651.488416:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125485056 00000100:00100000:1.0:1746155651.488426:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125484160 00000100:00100000:1.0:1746155651.488428:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125484160 00000100:00100000:1.0:1746155651.488436:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125484672 00000100:00100000:1.0:1746155651.488437:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125484672 00000100:00100000:1.0:1746155651.488446:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125484288 00000100:00100000:1.0:1746155651.488447:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125484288 00000100:00100000:1.0:1746155651.488453:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125484800 00000100:00100000:1.0:1746155651.488454:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125484800 00000100:00100000:1.0:1746155651.488459:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125484416 00000100:00100000:1.0:1746155651.488460:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125484416 00000100:00100000:1.0:1746155651.488466:0:18270:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125484928 00000100:00100000:1.0:1746155651.488467:0:18270:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125484928 00000100:00100000:1.0:1746155651.488476:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17722 00000100:00100000:1.0:1746155651.488482:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976125484544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.488670:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976125484544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 188us (522us total) trans 17179874448 rc 0/0 00000100:00100000:1.0:1746155651.488677:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17722 00000100:00100000:1.0:1746155651.488690:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17723 00000100:00100000:1.0:1746155651.488694:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976125485056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.488772:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976125485056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (563us total) trans 17179874449 rc 0/0 00000100:00100000:1.0:1746155651.488777:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17723 00000100:00100000:1.0:1746155651.488787:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17724 00000100:00100000:1.0:1746155651.488791:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976125484160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.488883:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976125484160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (640us total) trans 17179874450 rc 0/0 00000100:00100000:1.0:1746155651.488887:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17724 00000100:00100000:1.0:1746155651.488897:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17725 00000100:00100000:1.0:1746155651.488901:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976125484672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.488972:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976125484672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 70us (705us total) trans 17179874451 rc 0/0 00000100:00100000:1.0:1746155651.488976:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17725 00000100:00100000:1.0:1746155651.488985:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17726 00000100:00100000:1.0:1746155651.488989:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976125484288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.489070:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125484288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (775us total) trans 17179874452 rc 0/0 00000100:00100000:1.0:1746155651.489074:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17726 00000100:00100000:1.0:1746155651.489082:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17727 00000100:00100000:1.0:1746155651.489086:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976125484800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.489146:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125484800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (830us total) trans 17179874453 rc 0/0 00000100:00100000:1.0:1746155651.489150:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17727 00000100:00100000:1.0:1746155651.489156:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17728 00000100:00100000:1.0:1746155651.489159:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976125484416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.489222:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125484416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (881us total) trans 17179874454 rc 0/0 00000100:00100000:1.0:1746155651.489226:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17728 00000100:00100000:1.0:1746155651.489233:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17729 00000100:00100000:1.0:1746155651.489236:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3295:x1830976125484928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.489303:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3295:x1830976125484928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (943us total) trans 17179874455 rc 0/0 00000100:00100000:1.0:1746155651.489307:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17729 00000004:00080000:1.0:1746155651.489341:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a091b480/2, rc 0, transno 17179874454 00000100:00100000:1.0:1746155651.489347:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a091b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125484416:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155651.489352:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0954000/2, rc 0, transno 17179874455 00000100:00100000:1.0:1746155651.489354:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125484928:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155651.489359:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0918000/2, rc 0, transno 17179874452 00000100:00100000:1.0:1746155651.489366:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0918000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125484288:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155651.489370:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0957b80/2, rc 0, transno 17179874453 00000100:00100000:1.0:1746155651.489372:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0957b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125484800:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155651.489396:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a091ad80/2, rc 0, transno 17179874450 00000100:00100000:1.0:1746155651.489399:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a091ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125484160:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155651.489403:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0956300/2, rc 0, transno 17179874451 00000100:00100000:1.0:1746155651.489405:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125484672:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155651.489424:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0919f80/2, rc 0, transno 17179874448 00000100:00100000:1.0:1746155651.489426:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125484544:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746155651.489430:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0954380/2, rc 0, transno 17179874449 00000100:00100000:1.0:1746155651.489432:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125485056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.489436:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1746155651.489439:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f4fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125485184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.489453:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155651.489479:0:10591:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125485184 00000100:00100000:1.0:1746155651.489481:0:10591:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125485184 00000100:00100000:1.0:1746155651.489496:0:10591:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17730 00000100:00100000:1.0:1746155651.489516:0:10591:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976125485184:12345-0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746155651.489581:0:27374:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009f881180 reply state ffff88008e3b6800 transno 8589945478 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dec00/0x844e5faceb5f9765 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155651.489593:0:27374:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746155651.489652:0:27374:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746155651.489661:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32691:x1830976126260608:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 27037us (27943us total) trans 8589945478 rc 0/0 00000100:00100000:3.0:1746155651.489667:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11292 00010000:00010000:3.0:1746155651.489765:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dec00/0x844e5faceb5f9765 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.489772:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dec00/0x844e5faceb5f9765 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.489777:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dec00/0x844e5faceb5f9765 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.489782:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009f7dec00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155651.489785:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dec00/0x844e5faceb5f9765 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.489790:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dec00/0x844e5faceb5f9765 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.489802:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.489804:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155651.489807:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dec00/0x844e5faceb5f9765 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.489811:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7dec00/0x844e5faceb5f9765 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00000020:00000080:2.0:1746155651.489878:0:5:0:(genops.c:863:class_export_destroy()) destroying export ffff88013554f800/46ce2338-cbb3-40fc-97a4-5b0420b1b7f8 for lustre-MDT0000 00000020:00000080:2.0:1746155651.489914:0:5:0:(genops.c:863:class_export_destroy()) destroying export ffff88013554f000/c69dffb3-b3dd-4058-b066-0e541fe03f74 for lustre-MDT0000 00000020:00000080:2.0:1746155651.489935:0:5:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880135548800 for lustre-MDT0000 00000020:00000080:2.0:1746155651.489938:0:5:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880135549800 for lustre-MDT0000 00000100:00080000:2.0:1746155651.489991:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746155651.490003:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125485312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155651.490021:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155651.490034:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125485824:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155651.490043:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155651.490050:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746155651.490053:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125485440:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155651.490062:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155651.490068:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125485952:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155651.490077:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155651.490087:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125485312 00000100:00100000:2.0:1746155651.490089:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125485312 00000100:00100000:2.0:1746155651.490111:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125485824 00000100:00100000:2.0:1746155651.490113:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125485824 00000100:00100000:2.0:1746155651.490119:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125485440 00000100:00100000:2.0:1746155651.490120:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125485440 00000100:00100000:2.0:1746155651.490125:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125485952 00000100:00100000:2.0:1746155651.490127:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125485952 00000100:00100000:2.0:1746155651.490134:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17731 00000100:00100000:2.0:1746155651.490137:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3295:x1830976125485312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155651.490146:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17732 00000100:00100000:0.0:1746155651.490154:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3295:x1830976125485824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155651.490248:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3295:x1830976125485312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (225us total) trans 21474841751 rc 0/0 00000100:00100000:2.0:1746155651.490253:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17731 00000100:00100000:2.0:1746155651.490262:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17733 00000100:00100000:2.0:1746155651.490266:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3295:x1830976125485440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155651.490277:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3295:x1830976125485824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (232us total) trans 21474841752 rc 0/0 00000100:00100000:0.0:1746155651.490282:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17732 00000100:00100000:0.0:1746155651.490298:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17734 00000100:00100000:0.0:1746155651.490303:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3295:x1830976125485952:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155651.490348:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3295:x1830976125485440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (284us total) trans 21474841753 rc 0/0 00000100:00100000:2.0:1746155651.490353:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17733 00000100:00080000:2.0:1746155651.490367:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746155651.490380:0:3295:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841745 gen 2 00000004:00080000:2.0:1746155651.490383:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f583480, transno 21474841719 00000004:00080000:2.0:1746155651.490387:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f583800, transno 21474841720 00000004:00080000:2.0:1746155651.490390:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f583b80, transno 21474841721 00000004:00080000:2.0:1746155651.490391:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f582a00, transno 21474841722 00000004:00080000:2.0:1746155651.490393:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f580a80, transno 21474841723 00000004:00080000:2.0:1746155651.490395:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f582680, transno 21474841724 00000004:00080000:2.0:1746155651.490396:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f582d80, transno 21474841725 00000004:00080000:2.0:1746155651.490398:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009f581f80, transno 21474841726 00000004:00080000:2.0:1746155651.490400:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45b480, transno 21474841730 00000004:00080000:2.0:1746155651.490402:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45aa00, transno 21474841731 00000004:00080000:2.0:1746155651.490404:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b458e00, transno 21474841732 00000100:00100000:0.0:1746155651.490405:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3295:x1830976125485952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (299us total) trans 21474841754 rc 0/0 00000004:00080000:2.0:1746155651.490406:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45b100, transno 21474841733 00000004:00080000:2.0:1746155651.490409:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b45a680, transno 21474841734 00000100:00100000:0.0:1746155651.490410:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17734 00000004:00080000:2.0:1746155651.490411:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b459f80, transno 21474841735 00000004:00080000:2.0:1746155651.490412:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b459500, transno 21474841736 00000004:00080000:2.0:1746155651.490414:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0950380, transno 21474841737 00000004:00080000:2.0:1746155651.490415:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0950000, transno 21474841738 00000004:00080000:2.0:1746155651.490417:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0951f80, transno 21474841739 00000004:00080000:2.0:1746155651.490419:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0950700, transno 21474841740 00000004:00080000:2.0:1746155651.490421:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0953100, transno 21474841741 00000004:00080000:2.0:1746155651.490422:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0952a00, transno 21474841742 00000004:00080000:2.0:1746155651.490424:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0951180, transno 21474841743 00000004:00080000:2.0:1746155651.490425:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0956680, transno 21474841744 00000004:00080000:2.0:1746155651.490427:0:3295:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a0956a00, transno 21474841745 00000100:00100000:2.0:1746155651.490431:0:3295:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012cdee680 x1830976125485440/t21474841753(21474841753) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746155667 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:2.0:1746155651.490444:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdee680/2, rc 0, transno 21474841753 00000100:00100000:2.0:1746155651.490447:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125485440:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155651.490458:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa34e00/2, rc 0, transno 21474841754 00000100:00100000:2.0:1746155651.490461:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125485952:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155651.490466:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdec700/2, rc 0, transno 21474841751 00000100:00100000:2.0:1746155651.490468:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125485312:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155651.490473:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa34700/2, rc 0, transno 21474841752 00000100:00100000:2.0:1746155651.490479:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125485824:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155651.490671:0:14274:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 24 done 00000100:00100000:2.0:1746155651.490683:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125485568:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155651.490700:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155651.490714:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125486080:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155651.490715:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125485568 00000100:00100000:0.0:1746155651.490719:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125485568 00000100:00100000:2.0:1746155651.490725:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155651.490734:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125486080 00000100:00100000:2.0:1746155651.490735:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746155651.490736:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125486080 00000100:00100000:2.0:1746155651.490739:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125485696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155651.490748:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17735 00000100:00100000:2.0:1746155651.490749:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155651.490753:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3297:x1830976125485568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155651.490757:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009fa34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125486208:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155651.490766:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155651.490779:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125485696 00000100:00100000:2.0:1746155651.490782:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125485696 00000100:00100000:2.0:1746155651.490794:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125486208 00000100:00100000:2.0:1746155651.490795:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125486208 00000100:00100000:2.0:1746155651.490804:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17736 00000100:00100000:2.0:1746155651.490808:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976125486080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155651.490861:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976125485568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (160us total) trans 21474841755 rc 0/0 00000100:00100000:0.0:1746155651.490866:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17735 00000100:00100000:0.0:1746155651.490876:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17737 00000100:00100000:0.0:1746155651.490880:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976125485696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155651.490899:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976125486080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 90us (173us total) trans 21474841756 rc 0/0 00000100:00100000:2.0:1746155651.490905:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17736 00000100:00100000:2.0:1746155651.490915:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17738 00000100:00100000:2.0:1746155651.490919:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3297:x1830976125486208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155651.490957:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f583b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976125485696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 77us (207us total) trans 21474841757 rc 0/0 00000100:00100000:0.0:1746155651.490962:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17737 00000004:00080000:0.0:1746155651.490985:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdece00/2, rc 0, transno 21474841757 00000100:00100000:0.0:1746155651.490988:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125485696:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155651.491222:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012cdee300/2, rc 0, transno 21474841755 00000100:00100000:0.0:1746155651.491225:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cdee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125485568:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746155651.491231:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa34000/2, rc 0, transno 21474841756 00000100:00100000:2.0:1746155651.491232:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3297:x1830976125486208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 312us (464us total) trans 21474841758 rc 0/0 00000100:00100000:0.0:1746155651.491233:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125486080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155651.491237:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17738 00000004:00080000:0.0:1746155651.491239:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009fa34380/2, rc 0, transno 21474841758 00000100:00100000:0.0:1746155651.491241:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009fa34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125486208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155651.491362:0:10591:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3297:x1830976125485184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1861us (1907us total) trans 17179874456 rc 0/0 00000100:00100000:1.0:1746155651.491367:0:10591:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17730 00000004:00080000:0.0:1746155651.491368:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f4fc700/2, rc 0, transno 17179874456 00000100:00100000:0.0:1746155651.491371:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f4fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125485184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155651.492162:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.492202:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126260736 00000100:00100000:3.0:1746155651.492206:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126260736 00000100:00100000:3.0:1746155651.492231:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11293 00000100:00100000:3.0:1746155651.492238:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32691:x1830976126260736:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155651.492250:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155651.492263:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f86600/0x844e5faceb5f976c lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190a3 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.492300:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f86600/0x844e5faceb5f976c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190a3 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.492310:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f86600/0x844e5faceb5f976c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190a3 expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.492324:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.492326:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155651.492328:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f86600, rc 0) 00000100:00100000:3.0:1746155651.492353:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32691:x1830976126260736:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 116us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.492358:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11293 00000100:00100000:0.0:1746155651.496841:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.496926:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126260864 00000100:00100000:3.0:1746155651.496933:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126260864 00000100:00100000:3.0:1746155651.497812:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11294 00000100:00100000:3.0:1746155651.497821:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32691:x1830976126260864:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155651.497846:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155651.497860:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f87c00/0x844e5faceb5f9773 lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190aa expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.497924:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cecc600/0x844e5faceb5f977a lrc: 3/1,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.497938:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009cecc600/0x844e5faceb5f977a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.497945:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009cecc600/0x844e5faceb5f977a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00200000:3.0:1746155651.497966:0:27374:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000403:0x35e:0x0]: returning size 9273856 00000004:00200000:3.0:1746155651.497969:0:27374:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746155651.497980:0:27374:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009cecc600/0x844e5faceb5f977a lrc: 3/1,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.497998:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f87c00/0x844e5faceb5f9773 lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190aa expref: 289 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.498010:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009cecc600/0x844e5faceb5f977a lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190aa expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.498017:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.498019:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746155651.498021:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cecc600, rc 0) 00000100:00100000:3.0:1746155651.498672:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32691:x1830976126260864:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 852us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.498677:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11294 00000100:00100000:2.0:1746155651.502747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.502763:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.502819:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.502873:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126260992 00000100:00100000:1.0:1746155651.502880:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126260992 00000100:00100000:1.0:1746155651.502904:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126261120 00000100:00100000:1.0:1746155651.502905:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126261120 00000100:00100000:1.0:1746155651.502913:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126261248 00000100:00100000:1.0:1746155651.502915:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126261248 00000100:00100000:1.0:1746155651.502925:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17739 00000100:00100000:1.0:1746155651.502931:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976126260992:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155651.502946:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155651.502960:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5f9781 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190b1 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155651.502978:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e1:0x0] initial LVB size: 1048576, mtime: 0x68143882, atime: 0x68143882, ctime: 0x68143882, blocks: 0x7e7 00010000:00010000:1.0:1746155651.502993:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.502994:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.503000:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5f9781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b1 expref: 20 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155651.503011:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5f9781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b1 expref: 20 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155651.503019:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4e28a00, rc 0) 00000100:00100000:1.0:1746155651.503048:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126260992:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 118us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155651.503053:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17739 00000100:00100000:1.0:1746155651.503065:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17740 00000100:00100000:1.0:1746155651.503068:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1960:x1830976126261120:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155651.503073:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155651.503080:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f9788 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190b8 expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155651.503090:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e0:0x0] initial LVB size: 2097152, mtime: 0x68143882, atime: 0x68143882, ctime: 0x68143882, blocks: 0x81f 00010000:00010000:1.0:1746155651.503096:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.503097:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.503100:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f9788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b8 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155651.503107:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f9788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b8 expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155651.503113:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009cf0fe00, rc 0) 00000100:00100000:1.0:1746155651.503125:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1960:x1830976126261120:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 56us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155651.503129:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17740 00000100:00100000:1.0:1746155651.503138:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17741 00000100:00100000:1.0:1746155651.503142:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+13:1961:x1830976126261248:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:1.0:1746155651.503146:0:20796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746155651.503152:0:20796:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5f978f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190bf expref: -99 pid: 20796 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746155651.503160:0:20796:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e1:0x0] initial LVB size: 2097152, mtime: 0x68143882, atime: 0x68143881, ctime: 0x68143882, blocks: 0x821 00010000:00010000:1.0:1746155651.503167:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.503168:0:20796:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.503171:0:20796:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5f978f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190bf expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155651.503179:0:20796:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5f978f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190bf expref: 14 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746155651.503185:0:20796:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009048b400, rc 0) 00000100:00100000:1.0:1746155651.503198:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976126261248:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 56us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155651.503202:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17741 00000100:00100000:0.0:1746155651.503365:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.503423:0:29728:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126261376 00000100:00100000:2.0:1746155651.503426:0:29728:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126261376 00000100:00100000:2.0:1746155651.503448:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17742 00000100:00100000:2.0:1746155651.503453:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126261376:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155651.503459:0:29728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155651.503465:0:29728:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82e00/0x844e5faceb5f9796 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190c6 expref: -99 pid: 29728 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155651.503476:0:29728:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e3:0x0] initial LVB size: 2097152, mtime: 0x68143881, atime: 0x68143881, ctime: 0x68143881, blocks: 0x821 00010000:00010000:2.0:1746155651.503483:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.503484:0:29728:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.503488:0:29728:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82e00/0x844e5faceb5f9796 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190c6 expref: 21 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155651.503496:0:29728:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82e00/0x844e5faceb5f9796 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190c6 expref: 21 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155651.503530:0:29728:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a82e00, rc 0) 00000100:00100000:2.0:1746155651.503560:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1960:x1830976126261376:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 106us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155651.503565:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17742 00000100:00100000:0.0:1746155651.503954:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.503983:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.504033:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126261504 00000100:00100000:2.0:1746155651.504036:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126261504 00000100:00100000:2.0:1746155651.504048:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126261632 00000100:00100000:2.0:1746155651.504049:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126261632 00000100:00100000:2.0:1746155651.504069:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17743 00000100:00100000:2.0:1746155651.504074:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976126261504:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155651.504080:0:19959:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155651.504088:0:19959:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c173600/0x844e5faceb5f979d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190cd expref: -99 pid: 19959 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746155651.504104:0:19959:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x3e4:0x0] initial LVB size: 5079552, mtime: 0x68143881, atime: 0x68143881, ctime: 0x68143881, blocks: 0x1711 00010000:00010000:2.0:1746155651.504111:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.504112:0:19959:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.504116:0:19959:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c173600/0x844e5faceb5f979d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190cd expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155651.504125:0:19959:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c173600/0x844e5faceb5f979d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190cd expref: 22 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155651.504136:0:19959:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c173600, rc 0) 00000100:00100000:3.0:1746155651.504153:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17744 00000100:00100000:2.0:1746155651.504154:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976126261504:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155651.504158:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17743 00000100:00100000:3.0:1746155651.504159:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+14:1961:x1830976126261632:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155651.504165:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155651.504173:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a0610800/0x844e5faceb5f97a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190d4 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746155651.504187:0:1625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x3e2:0x0] initial LVB size: 4194304, mtime: 0x68143882, atime: 0x68143882, ctime: 0x68143882, blocks: 0x1029 00010000:00010000:3.0:1746155651.504195:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.504196:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.504200:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0610800/0x844e5faceb5f97a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190d4 expref: 15 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155651.504209:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a0610800/0x844e5faceb5f97a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190d4 expref: 15 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155651.504215:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0610800, rc 0) 00000100:00100000:3.0:1746155651.504231:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976126261632:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 72us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.504235:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17744 00000100:00100000:0.0:1746155651.510564:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.510599:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.510635:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.510705:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126262016 00000100:00100000:3.0:1746155651.510713:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126262016 00000100:00100000:3.0:1746155651.510758:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126262272 00000100:00100000:3.0:1746155651.510760:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126262272 00000100:00100000:3.0:1746155651.510775:0:8443:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126262144 00000100:00100000:3.0:1746155651.510777:0:8443:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126262144 00000100:00100000:3.0:1746155651.510792:0:8443:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8420 00000100:00100000:3.0:1746155651.510799:0:8443:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976126262016:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155651.510827:0:8443:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f97ab lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.510850:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.510852:0:8443:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.510857:0:8443:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f97ab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.510870:0:8443:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f97ab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.511990:0:10888:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8421 00000100:00100000:3.0:1746155651.511998:0:10888:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976126262272:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:3.0:1746155651.512017:0:10888:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136ab2800/0x844e5faceb5f97b2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.512025:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.512026:0:10888:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.512029:0:10888:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136ab2800/0x844e5faceb5f97b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.512036:0:10888:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136ab2800/0x844e5faceb5f97b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155651.513174:0:8441:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8422 00000100:00100000:2.0:1746155651.513183:0:8441:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976126262144:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155651.513204:0:8441:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5f97b9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.513212:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.513213:0:8441:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.513216:0:8441:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5f97b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.513225:0:8441:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5f97b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155651.515020:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.515036:0:31251:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126262656 00000100:00100000:2.0:1746155651.515042:0:31251:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126262656 00000100:00100000:2.0:1746155651.515082:0:31251:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8423 00000100:00100000:2.0:1746155651.515088:0:31251:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976126262656:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155651.515109:0:31251:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c172400/0x844e5faceb5f97c0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.515119:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.515121:0:31251:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.515124:0:31251:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c172400/0x844e5faceb5f97c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.515134:0:31251:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c172400/0x844e5faceb5f97c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155651.515604:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.515619:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.515631:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.515649:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.515663:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126263040 00000100:00100000:1.0:1746155651.515666:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126263040 00000100:00100000:1.0:1746155651.515687:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126263168 00000100:00100000:1.0:1746155651.515688:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126263168 00000100:00100000:1.0:1746155651.515701:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126263424 00000100:00100000:1.0:1746155651.515702:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126263424 00000100:00100000:1.0:1746155651.515712:0:25394:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126263680 00000100:00100000:1.0:1746155651.515713:0:25394:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126263680 00000100:00100000:1.0:1746155651.515723:0:25394:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8424 00000100:00100000:1.0:1746155651.515727:0:25394:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976126263040:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:1.0:1746155651.515741:0:25394:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129f64800/0x844e5faceb5f97c7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.515749:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.515751:0:25394:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746155651.515753:0:25394:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f64800/0x844e5faceb5f97c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.515761:0:25394:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f64800/0x844e5faceb5f97c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155651.516996:0:31249:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8425 00000100:00100000:0.0:1746155651.517005:0:31249:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976126263168:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155651.517024:0:31249:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14a00/0x844e5faceb5f97ce lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.517033:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155651.517035:0:31249:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155651.517041:0:31249:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14a00/0x844e5faceb5f97ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.517050:0:31249:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14a00/0x844e5faceb5f97ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155651.518415:0:31252:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8426 00000100:00100000:2.0:1746155651.518423:0:31252:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800936f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+27:1961:x1830976126263424:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:2.0:1746155651.518442:0:31252:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82800/0x844e5faceb5f97d5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.518451:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.518452:0:31252:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.518455:0:31252:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82800/0x844e5faceb5f97d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.518463:0:31252:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82800/0x844e5faceb5f97d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746155651.518522:0:31250:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 8427 00000100:00100000:0.0:1746155651.518530:0:31250:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1961:x1830976126263680:12345-192.168.202.51@tcp:3:lfs.0 00010000:00010000:0.0:1746155651.518545:0:31250:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5f97dc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.518552:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155651.518553:0:31250:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746155651.518556:0:31250:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5f97dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746155651.518563:0:31250:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5f97dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.537085:0:8443:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f97ab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.537099:0:8443:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f97ab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.537106:0:8443:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f97ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.537112:0:8443:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136ab3600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155651.537115:0:8443:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f97ab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.537122:0:8443:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f97ab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.537136:0:8443:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f97ab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.537141:0:8443:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136ab3600/0x844e5faceb5f97ab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8443 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.537222:0:8443:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+28:1961:x1830976126262016:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 26420us (26666us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155651.537232:0:8443:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8420 00010000:00010000:2.0:1746155651.546252:0:8441:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5f97b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.546264:0:8441:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5f97b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.546271:0:8441:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5f97b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.546278:0:8441:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c173000 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155651.546281:0:8441:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5f97b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.546287:0:8441:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5f97b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.546302:0:8441:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5f97b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.546307:0:8441:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c173000/0x844e5faceb5f97b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155651.546381:0:8441:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+21:1961:x1830976126262144:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 33195us (35741us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155651.546389:0:8441:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8422 00010000:00010000:3.0:1746155651.551913:0:10888:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880136ab2800/0x844e5faceb5f97b2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.552000:0:10888:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136ab2800/0x844e5faceb5f97b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.552007:0:10888:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136ab2800/0x844e5faceb5f97b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.552013:0:10888:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136ab2800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155651.552017:0:10888:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136ab2800/0x844e5faceb5f97b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.552024:0:10888:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136ab2800/0x844e5faceb5f97b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.552045:0:10888:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136ab2800/0x844e5faceb5f97b2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.552051:0:10888:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136ab2800/0x844e5faceb5f97b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10888 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.552137:0:10888:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1961:x1830976126262272:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 40137us (41533us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155651.552145:0:10888:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8421 00010000:00010000:3.0:1746155651.561773:0:31249:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14a00/0x844e5faceb5f97ce lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.561788:0:31249:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14a00/0x844e5faceb5f97ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.561795:0:31249:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14a00/0x844e5faceb5f97ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.561802:0:31249:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3d14a00 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:3.0:1746155651.561805:0:31249:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14a00/0x844e5faceb5f97ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.561812:0:31249:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14a00/0x844e5faceb5f97ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.561827:0:31249:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14a00/0x844e5faceb5f97ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.561848:0:31249:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3d14a00/0x844e5faceb5f97ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31249 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.561912:0:31249:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+17:1961:x1830976126263168:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 44904us (46287us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746155651.561920:0:31249:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8425 00010000:00010000:2.0:1746155651.562474:0:31251:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c172400/0x844e5faceb5f97c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.562483:0:31251:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c172400/0x844e5faceb5f97c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.562488:0:31251:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c172400/0x844e5faceb5f97c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.562493:0:31251:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c172400 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155651.562495:0:31251:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c172400/0x844e5faceb5f97c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.562500:0:31251:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c172400/0x844e5faceb5f97c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.562523:0:31251:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c172400/0x844e5faceb5f97c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.562528:0:31251:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c172400/0x844e5faceb5f97c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31251 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155651.562565:0:31251:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009366c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+26:1961:x1830976126262656:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 47477us (47551us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155651.562571:0:31251:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8423 00010000:00010000:1.0:1746155651.565480:0:31250:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5f97dc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.565495:0:31250:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5f97dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.568651:0:31250:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5f97dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.568657:0:31250:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3d15600 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155651.568661:0:31250:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5f97dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.568668:0:31250:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5f97dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.568686:0:31250:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5f97dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.568692:0:31250:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a3d15600/0x844e5faceb5f97dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31250 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155651.568797:0:31250:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976126263680:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 50257us (53136us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155651.568807:0:31250:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8427 00010000:00010000:2.0:1746155651.570862:0:31252:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82800/0x844e5faceb5f97d5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.570872:0:31252:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82800/0x844e5faceb5f97d5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.570883:0:31252:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82800/0x844e5faceb5f97d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.570888:0:31252:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a0a82800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:2.0:1746155651.570891:0:31252:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82800/0x844e5faceb5f97d5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.570896:0:31252:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82800/0x844e5faceb5f97d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.570910:0:31252:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82800/0x844e5faceb5f97d5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.570915:0:31252:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82800/0x844e5faceb5f97d5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31252 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155651.571413:0:31252:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1961:x1830976126263424:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 52988us (55777us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746155651.571422:0:31252:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8426 00010000:00010000:1.0:1746155651.572236:0:25394:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880129f64800/0x844e5faceb5f97c7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.572244:0:25394:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129f64800/0x844e5faceb5f97c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.572250:0:25394:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129f64800/0x844e5faceb5f97c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.572256:0:25394:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f64800 already unused, calling callback (ffffffffa0879d70) 00010000:00010000:1.0:1746155651.572259:0:25394:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f64800/0x844e5faceb5f97c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.572264:0:25394:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f64800/0x844e5faceb5f97c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.572273:0:25394:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129f64800/0x844e5faceb5f97c7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.572278:0:25394:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f64800/0x844e5faceb5f97c7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25394 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746155651.572328:0:25394:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800936f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1961:x1830976126263040:12345-192.168.202.51@tcp:3:lfs.0 Request processed in 56599us (56723us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746155651.572334:0:25394:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 8424 00000100:00100000:0.0:1746155651.578377:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.578433:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126263936 00000100:00100000:3.0:1746155651.578440:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126263936 00000100:00100000:3.0:1746155651.578488:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11295 00000100:00100000:3.0:1746155651.578495:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32691:x1830976126263936:12345-192.168.202.51@tcp:36:lfs.0 00010000:00010000:3.0:1746155651.578647:0:27374:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155651.578672:0:27374:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cecc600/0x844e5faceb5f977a lrc: 0/0,0 mode: --/PR res: [0x200000403:0x35e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190aa expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.578899:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.578903:0:27374:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746155651.578929:0:27374:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97e3 lrc: 3/0,1 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.578938:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97e3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:3.0:1746155651.578944:0:27374:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97e3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000004:00010000:3.0:1746155651.579385:0:27374:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008e26ca80 reply state ffff88012e160000 transno 8589945479 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97e3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27374 initiator: MDT0 00000100:00100000:3.0:1746155651.579397:0:27374:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746155651.579586:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:32691:x1830976126263936:12345-192.168.202.51@tcp:36:lfs.0 Request processed in 1090us (1214us total) trans 8589945479 rc 0/0 00000100:00100000:3.0:1746155651.579592:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11295 00000100:00100000:0.0:1746155651.581632:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.582103:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126264064 00000100:00100000:3.0:1746155651.582110:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126264064 00000100:00100000:3.0:1746155651.582146:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17745 00000100:00100000:3.0:1746155651.582152:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32691:x1830976126264064:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155651.582163:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155651.582176:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a74f800/0x844e5faceb5f97ea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190db expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.582198:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5f9781 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b1 expref: 23 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155651.582204:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.582206:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.582208:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a74f800/0x844e5faceb5f97ea lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190db expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.582230:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5f9781 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b1 expref: 23 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155651.582240:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5f9781 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b1 expref: 23 pid: 20796 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746155651.582248:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125486336:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155651.582320:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851540 going to sleep for 11 seconds 00010000:00010000:1.0:1746155651.582427:0:3281:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97e3 lrc: 3/0,1 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155651.582435:0:3281:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97e3 lrc: 2/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155651.582440:0:3281:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97e3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155651.582445:0:3281:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a3e34c00 already unused, calling callback (ffffffffa135a690) 00010000:00010000:1.0:1746155651.582448:0:3281:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97e3 lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155651.582458:0:3281:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97e3 lrc: 4/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155651.582469:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:1.0:1746155651.582472:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746155651.582475:0:3281:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97e3 lrc: 2/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00010000:00010000:1.0:1746155651.582479:0:3281:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97e3 lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27374 initiator: MDT0 00000100:00100000:0.0:1746155651.589937:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.590037:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126264192 00000100:00100000:2.0:1746155651.590045:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126264192 00010000:00010000:2.0:1746155651.590075:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5f9781 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b1 expref: 24 pid: 20796 timeout: 880 lvb_type: 1 00000100:00100000:2.0:1746155651.590100:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9103 00000100:00100000:2.0:1746155651.590107:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f82c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126264192:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746155651.590122:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746155651.590140:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5f9781 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b1 expref: 24 pid: 20796 timeout: 880 lvb_type: 1 00010000:00010000:2.0:1746155651.590150:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5f9781 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b1 expref: 24 pid: 20796 timeout: 880 lvb_type: 1 00010000:00010000:2.0:1746155651.590169:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.590171:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.590177:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a74f800/0x844e5faceb5f97ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190db expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.590184:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a74f800/0x844e5faceb5f97ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190db expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.590211:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a74f800/0x844e5faceb5f97ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190db expref: 24 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746155651.590222:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125486464:192.168.202.51@tcp:105: 00000100:00100000:2.0:1746155651.590296:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da840 going to sleep for 11 seconds 00010000:00010000:3.0:1746155651.591026:0:1625:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4e28a00/0x844e5faceb5f9781 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b1 expref: 24 pid: 20796 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746155651.591056:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125486336:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155651.591080:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a74f800/0x844e5faceb5f97ea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190db expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.591088:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a74f800, rc 0) 00000100:00100000:3.0:1746155651.592597:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32691:x1830976126264064:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 10441us (10965us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.592606:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17745 00000100:00100000:3.0:1746155651.593046:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125486464:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155651.593058:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155651.593081:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f82c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126264192:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 2975us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.593088:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9103 00000100:00100000:0.0:1746155651.594220:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.594341:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126264320 00000100:00100000:3.0:1746155651.594346:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126264320 00000100:00100000:3.0:1746155651.594373:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17746 00000100:00100000:3.0:1746155651.594379:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:32691:x1830976126264320:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155651.594394:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155651.594408:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190e2 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.594427:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f9788 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b8 expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155651.594434:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.594435:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.594437:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97f1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190e2 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.594465:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f9788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b8 expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155651.594475:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f9788 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b8 expref: 16 pid: 20796 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746155651.594484:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125486592:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155651.595011:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155651.596098:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125486592:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155651.596116:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97f1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190e2 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.596127:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a3e34c00, rc 0) 00000100:00100000:3.0:1746155651.596147:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32691:x1830976126264320:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1769us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.596153:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17746 00000100:00100000:0.0:1746155651.599735:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.599827:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126264448 00000100:00100000:3.0:1746155651.599847:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126264448 00010000:00010000:3.0:1746155651.599874:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f9788 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b8 expref: 16 pid: 20796 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746155651.599901:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9104 00000100:00100000:3.0:1746155651.599907:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976126264448:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155651.599917:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155651.599934:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f9788 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b8 expref: 16 pid: 20796 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.599943:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f9788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b8 expref: 16 pid: 20796 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.599961:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009cf0fe00/0x844e5faceb5f9788 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190b8 expref: 16 pid: 20796 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.599989:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.599991:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.599997:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190e2 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.600005:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190e2 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.600030:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a3e34c00/0x844e5faceb5f97f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190e2 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.600040:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125486720:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155651.600106:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155651.601246:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125486720:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155651.601266:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155651.601291:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1960:x1830976126264448:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1383us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.601298:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9104 00000100:00100000:0.0:1746155651.601747:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.601817:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126264576 00000100:00100000:3.0:1746155651.601820:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126264576 00000100:00100000:3.0:1746155651.602303:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17747 00000100:00100000:3.0:1746155651.602310:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:32691:x1830976126264576:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155651.602321:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155651.602334:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a74e600/0x844e5faceb5f97f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190e9 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.602353:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5f978f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190bf expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155651.602359:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.602360:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.602363:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a74e600/0x844e5faceb5f97f8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190e9 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.602381:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5f978f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190bf expref: 16 pid: 20796 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155651.602391:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5f978f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190bf expref: 16 pid: 20796 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746155651.602400:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125486848:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155651.602926:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155651.604538:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125486848:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155651.604558:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a74e600/0x844e5faceb5f97f8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190e9 expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.604572:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a74e600, rc 0) 00000100:00100000:3.0:1746155651.604600:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32691:x1830976126264576:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 2291us (2853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.604607:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17747 00000100:00100000:0.0:1746155651.605576:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.606036:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126264704 00000100:00100000:3.0:1746155651.606042:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126264704 00010000:00010000:3.0:1746155651.606068:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5f978f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190bf expref: 16 pid: 20796 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746155651.606129:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9105 00000100:00100000:3.0:1746155651.606137:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1961:x1830976126264704:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155651.606147:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155651.606166:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5f978f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190bf expref: 16 pid: 20796 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.606177:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5f978f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190bf expref: 16 pid: 20796 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.606194:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009048b400/0x844e5faceb5f978f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190bf expref: 16 pid: 20796 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.606347:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.606349:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.606355:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a74e600/0x844e5faceb5f97f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190e9 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.606362:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a74e600/0x844e5faceb5f97f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190e9 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.606388:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a74e600/0x844e5faceb5f97f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190e9 expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.606399:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125486976:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155651.606989:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155651.611132:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125486976:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155651.611153:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746155651.611196:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.611313:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126264832 00000100:00100000:2.0:1746155651.611319:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126264832 00000100:00100000:2.0:1746155651.611349:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17748 00000100:00100000:2.0:1746155651.611355:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32691:x1830976126264832:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:2.0:1746155651.611367:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746155651.611380:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82400/0x844e5faceb5f97ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190f0 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.611396:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:1961:x1830976126264704:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 5260us (5822us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.611403:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9105 00010000:00010000:2.0:1746155651.611546:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82e00/0x844e5faceb5f9796 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190c6 expref: 23 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155651.611552:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.611554:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746155651.611557:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82400/0x844e5faceb5f97ff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190f0 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.611578:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82e00/0x844e5faceb5f9796 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190c6 expref: 23 pid: 29728 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746155651.611588:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82e00/0x844e5faceb5f9796 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190c6 expref: 23 pid: 29728 timeout: 880 lvb_type: 1 00000100:00100000:2.0:1746155651.611597:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125487104:192.168.202.51@tcp:104: 00000100:00100000:2.0:1746155651.611705:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c5da840 going to sleep for 11 seconds 00000100:00100000:2.0:1746155651.614658:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125487104:192.168.202.51@tcp:104: 00010000:00010000:2.0:1746155651.614680:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82400/0x844e5faceb5f97ff lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190f0 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746155651.614694:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a0a82400, rc 0) 00000100:00100000:2.0:1746155651.614923:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32691:x1830976126264832:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3566us (3726us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155651.614931:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17748 00000100:00100000:0.0:1746155651.615380:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.615780:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126264960 00000100:00100000:3.0:1746155651.615786:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126264960 00010000:00010000:3.0:1746155651.615811:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82e00/0x844e5faceb5f9796 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190c6 expref: 23 pid: 29728 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746155651.615840:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9106 00000100:00100000:3.0:1746155651.615846:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126264960:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155651.615857:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155651.615873:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82e00/0x844e5faceb5f9796 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190c6 expref: 23 pid: 29728 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.615883:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82e00/0x844e5faceb5f9796 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190c6 expref: 23 pid: 29728 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.615901:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82e00/0x844e5faceb5f9796 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190c6 expref: 23 pid: 29728 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.615913:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.615915:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.615920:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82400/0x844e5faceb5f97ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190f0 expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.615926:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82400/0x844e5faceb5f97ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190f0 expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.615948:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a0a82400/0x844e5faceb5f97ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190f0 expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.615958:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125487232:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155651.616006:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155651.617412:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125487232:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155651.617427:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155651.617466:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e26d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126264960:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1619us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.617474:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9106 00000100:00100000:0.0:1746155651.617801:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.617974:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126265088 00000100:00100000:3.0:1746155651.617978:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126265088 00000100:00100000:3.0:1746155651.618002:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17749 00000100:00100000:3.0:1746155651.618008:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:32691:x1830976126265088:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155651.618212:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155651.618229:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f9806 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190f7 expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.618252:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c173600/0x844e5faceb5f979d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190cd expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155651.618258:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.618260:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.618262:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f9806 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190f7 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.619655:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c173600/0x844e5faceb5f979d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190cd expref: 23 pid: 19959 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155651.619668:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c173600/0x844e5faceb5f979d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190cd expref: 23 pid: 19959 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746155651.619679:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125487360:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155651.619751:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155651.621849:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:1625:1830976125487360:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155651.621872:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f9806 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190f7 expref: 23 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.621885:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a626f000, rc 0) 00000100:00100000:3.0:1746155651.621925:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:32691:x1830976126265088:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 3916us (4124us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.621932:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17749 00000100:00100000:0.0:1746155651.622317:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.622371:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126265216 00000100:00100000:3.0:1746155651.622376:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126265216 00010000:00010000:3.0:1746155651.622398:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c173600/0x844e5faceb5f979d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190cd expref: 23 pid: 19959 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746155651.622422:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9107 00000100:00100000:3.0:1746155651.622428:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+23:1960:x1830976126265216:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155651.622438:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155651.622456:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c173600/0x844e5faceb5f979d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190cd expref: 23 pid: 19959 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.622466:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c173600/0x844e5faceb5f979d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190cd expref: 23 pid: 19959 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.622483:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c173600/0x844e5faceb5f979d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190cd expref: 23 pid: 19959 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.622521:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.622523:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.622528:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f9806 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190f7 expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.622535:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f9806 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190f7 expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.622554:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a626f000/0x844e5faceb5f9806 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190f7 expref: 22 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.622561:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125487488:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155651.622611:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155651.624271:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7064:1830976125487488:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155651.624284:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155651.624320:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+22:1960:x1830976126265216:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 1891us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.624328:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9107 00000100:00100000:0.0:1746155651.625653:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.625741:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126265344 00000100:00100000:3.0:1746155651.625746:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126265344 00000100:00100000:3.0:1746155651.625780:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17750 00000100:00100000:3.0:1746155651.625787:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+15:32691:x1830976126265344:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155651.625799:0:1625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155651.625812:0:1625:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f980d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f190fe expref: -99 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.625846:0:1625:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a0610800/0x844e5faceb5f97a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190d4 expref: 16 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155651.625852:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.625855:0:1625:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.625857:0:1625:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f980d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190fe expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.625878:0:1625:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a0610800/0x844e5faceb5f97a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190d4 expref: 16 pid: 1625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746155651.625888:0:1625:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a0610800/0x844e5faceb5f97a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190d4 expref: 16 pid: 1625 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746155651.625898:0:1625:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125487616:192.168.202.51@tcp:104: 00000100:00100000:3.0:1746155651.625957:0:1625:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851180 going to sleep for 11 seconds 00000100:00100000:3.0:1746155651.626792:0:1625:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:1625:1830976125487616:192.168.202.51@tcp:104: 00010000:00010000:3.0:1746155651.626808:0:1625:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f980d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190fe expref: 16 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.626818:0:1625:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a626f200, rc 0) 00000100:00100000:3.0:1746155651.627045:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:32691:x1830976126265344:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 1257us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.627052:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17750 00000100:00100000:0.0:1746155651.627539:0:3290:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.627885:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126265472 00000100:00100000:3.0:1746155651.627890:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126265472 00010000:00010000:3.0:1746155651.627908:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a0610800/0x844e5faceb5f97a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190d4 expref: 16 pid: 1625 timeout: 880 lvb_type: 1 00000100:00100000:3.0:1746155651.627925:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9108 00000100:00100000:3.0:1746155651.627930:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+16:1960:x1830976126265472:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155651.627938:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155651.627954:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a0610800/0x844e5faceb5f97a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190d4 expref: 16 pid: 1625 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.627964:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a0610800/0x844e5faceb5f97a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190d4 expref: 16 pid: 1625 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.627980:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a0610800/0x844e5faceb5f97a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190d4 expref: 16 pid: 1625 timeout: 880 lvb_type: 1 00010000:00010000:3.0:1746155651.628006:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.628007:0:7064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746155651.628012:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f980d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190fe expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.628019:0:7064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f980d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190fe expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.628097:0:7064:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a626f200/0x844e5faceb5f980d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190fe expref: 15 pid: 1625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746155651.628107:0:7064:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125487744:192.168.202.51@tcp:105: 00000100:00100000:3.0:1746155651.628151:0:7064:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c851180 going to sleep for 11 seconds 00000100:00100000:0.0:1746155651.631077:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.631108:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.631141:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:0.0:1746155651.631154:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.631160:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126265600 00000100:00100000:0.0:1746155651.631165:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.631166:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126265600 00000100:00100000:0.0:1746155651.631190:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.631196:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126265728 00000100:00100000:1.0:1746155651.631199:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126265728 00000100:00100000:0.0:1746155651.631207:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126265856 00000100:00100000:1.0:1746155651.631210:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126265984 00000100:00100000:0.0:1746155651.631211:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126265856 00000100:00100000:1.0:1746155651.631212:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126265984 00000100:00100000:1.0:1746155651.631220:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126266112 00000100:00100000:1.0:1746155651.631222:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126266112 00000100:00100000:0.0:1746155651.631228:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126266240 00000100:00100000:0.0:1746155651.631230:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126266240 00000100:00100000:1.0:1746155651.631236:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17751 00000100:00100000:1.0:1746155651.631243:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126265600:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:0.0:1746155651.631328:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17752 00000100:00100000:0.0:1746155651.631334:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976126265728:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:2.0:1746155651.631348:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17753 00000100:00100000:2.0:1746155651.631356:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126265984:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:2.0:1746155651.631444:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155651.631444:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746155651.631447:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155649 -> 1746155650 00002000:00010000:0.0:1746155651.631447:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155650 -> 1746155650 00002000:00010000:2.0:1746155651.631449:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155649 -> 1746155650 00002000:00010000:0.0:1746155651.631449:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155650 -> 1746155650 00002000:00010000:2.0:1746155651.631451:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155649 -> 1746155652 00002000:00010000:0.0:1746155651.631451:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155650 -> 1746155652 00002000:00010000:2.0:1746155651.631453:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00002000:00010000:0.0:1746155651.631453:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746155651.631488:0:9235:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17754 00000100:00100000:2.0:1746155651.631489:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126265984:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 133us (332us total) trans 17179874457 rc 0/0 00000100:00100000:2.0:1746155651.631495:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17753 00000100:00100000:3.0:1746155651.631497:0:9235:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976126265856:12345-192.168.202.51@tcp:2:lfs.0 00000100:00100000:2.0:1746155651.631525:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17755 00000100:00100000:2.0:1746155651.631530:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+24:1960:x1830976126266112:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:1.0:1746155651.631551:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746155651.631554:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155650 -> 1746155650 00002000:00010000:1.0:1746155651.631555:0:8436:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155650 -> 1746155650 00002000:00010000:1.0:1746155651.631557:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155650 -> 1746155652 00002000:00010000:1.0:1746155651.631558:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2023 -> 2023 00002000:00010000:3.0:1746155651.631605:0:9235:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155651.631866:0:9235:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155650 -> 1746155650 00002000:00010000:3.0:1746155651.631870:0:9235:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155649 -> 1746155650 00002000:00010000:3.0:1746155651.631871:0:9235:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155650 -> 1746155652 00002000:00010000:3.0:1746155651.631873:0:9235:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155651.632138:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126265728:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 803us (1028us total) trans 21474841759 rc 0/0 00000100:00100000:0.0:1746155651.632144:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17752 00000100:00100000:0.0:1746155651.632155:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 17756 00000100:00100000:0.0:1746155651.632159:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976126266240:12345-192.168.202.51@tcp:2:lfs.0 00002000:00010000:0.0:1746155651.632219:0:20200:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155651.632221:0:20200:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155650 -> 1746155650 00002000:00010000:0.0:1746155651.632223:0:20200:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155650 -> 1746155650 00002000:00010000:0.0:1746155651.632225:0:20200:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155650 -> 1746155652 00002000:00010000:0.0:1746155651.632226:0:20200:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155651.632240:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+20:1960:x1830976126266240:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 80us (1049us total) trans 21474841761 rc 0/0 00000100:00100000:0.0:1746155651.632244:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17756 00000100:00100000:1.0:1746155651.632302:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126265600:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 1059us (1232us total) trans 17179874458 rc 0/0 00000100:00100000:1.0:1746155651.632308:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17751 00000100:00100000:3.0:1746155651.632350:0:9235:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a386850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+19:1960:x1830976126265856:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 855us (1208us total) trans 21474841760 rc 0/0 00000100:00100000:3.0:1746155651.632355:0:9235:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17754 00002000:00010000:2.0:1746155651.632393:0:19959:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:2.0:1746155651.632396:0:19959:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155649 -> 1746155650 00002000:00010000:2.0:1746155651.632398:0:19959:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155649 -> 1746155650 00002000:00010000:2.0:1746155651.632399:0:19959:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155649 -> 1746155652 00002000:00010000:2.0:1746155651.632401:0:19959:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:2.0:1746155651.632417:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+25:1960:x1830976126266112:12345-192.168.202.51@tcp:2:lfs.0 Request processed in 886us (1250us total) trans 17179874459 rc 0/0 00000100:00100000:2.0:1746155651.632422:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 17755 00000100:00100000:3.0:1746155651.632582:0:7064:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7064:1830976125487744:192.168.202.51@tcp:105: 00010000:00010000:3.0:1746155651.632595:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155651.632611:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+18:1960:x1830976126265472:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 4681us (5110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.632621:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9108 00000100:00100000:0.0:1746155651.635179:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.635301:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126266496 00000100:00100000:1.0:1746155651.635307:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126266496 00000100:00100000:1.0:1746155651.635347:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4820 00000100:00100000:1.0:1746155651.635353:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:32691:x1830976126266496:12345-192.168.202.51@tcp:35:lfs.0 00000004:00010000:1.0:1746155651.635394:0:14236:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000403:0x35e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7df600/0x844e5faceb5f972d lrc: 3/0,0 mode: PW/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1909c expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.635427:0:14236:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14236 initiator: MDT0 00010000:00010000:1.0:1746155651.635437:0:14236:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f86600/0x844e5faceb5f976c lrc: 2/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190a3 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.635443:0:14236:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 4/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 00010000:00010000:1.0:1746155651.635464:0:14236:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f86600/0x844e5faceb5f976c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190a3 expref: 288 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746155651.635473:0:14236:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f86600/0x844e5faceb5f976c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190a3 expref: 288 pid: 27374 timeout: 880 lvb_type: 0 00000100:00100000:1.0:1746155651.635482:0:14236:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880130898700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14236:1830976125487872:192.168.202.51@tcp:104: 00000100:00100000:1.0:1746155651.635571:0:14236:0:(client.c:2553:ptlrpc_set_wait()) set ffff880130949a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746155651.637594:0:14236:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880130898700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:14236:1830976125487872:192.168.202.51@tcp:104: 00010000:00010000:1.0:1746155651.637610:0:14236:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00000100:00100000:0.0:1746155651.638178:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:3.0:1746155651.638225:0:7064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126266624 00000100:00100000:3.0:1746155651.638230:0:7064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126266624 00010000:00010000:3.0:1746155651.638253:0:7064:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f86600/0x844e5faceb5f976c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190a3 expref: 289 pid: 27374 timeout: 880 lvb_type: 0 00000100:00100000:3.0:1746155651.638286:0:7064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 9109 00000100:00100000:3.0:1746155651.638292:0:7064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+289:1961:x1830976126266624:12345-192.168.202.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746155651.638301:0:7064:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746155651.638306:0:7064:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f86600/0x844e5faceb5f976c lrc: 4/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190a3 expref: 289 pid: 27374 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746155651.638314:0:7064:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f86600/0x844e5faceb5f976c lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190a3 expref: 289 pid: 27374 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746155651.638329:0:7064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f86600/0x844e5faceb5f976c lrc: 0/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f190a3 expref: 289 pid: 27374 timeout: 880 lvb_type: 0 00010000:00010000:3.0:1746155651.638354:0:7064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.638359:0:7064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 3/0,1 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155651.638366:0:7064:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155651.638371:0:7064:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 4/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155651.638386:0:7064:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746155651.638432:0:7064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+288:1961:x1830976126266624:12345-192.168.202.51@tcp:103:ldlm_bl.0 Request processed in 139us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.638437:0:7064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 9109 00010000:00010000:1.0:1746155651.638906:0:14236:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00010000:00010000:1.0:1746155651.638913:0:14236:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00000040:00080000:1.0:1746155651.640066:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3735, 88 off315608 00000004:00080000:1.0:1746155651.640072:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780789568995ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155651.640118:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3723, 88 off314816 00000004:00080000:1.0:1746155651.640121:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780789618387ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155651.640146:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3724, 88 off314904 00000004:00080000:1.0:1746155651.640149:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780789646152ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155651.640156:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3736, 88 off315696 00000004:00080000:1.0:1746155651.640158:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780789655355ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155651.640164:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3737, 88 off315784 00000004:00080000:1.0:1746155651.640166:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780789663314ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155651.640172:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3725, 88 off314992 00000004:00080000:1.0:1746155651.640174:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780789671172ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155651.640180:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3726, 88 off315080 00000004:00080000:1.0:1746155651.640182:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780789679082ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155651.640188:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3727, 88 off315168 00000004:00080000:1.0:1746155651.640191:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780789688095ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155651.640197:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3738, 88 off315872 00000004:00080000:1.0:1746155651.640199:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780789696512ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155651.640205:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3728, 88 off315256 00000004:00080000:1.0:1746155651.640207:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780789704302ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155651.640213:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3739, 88 off315960 00000004:00080000:1.0:1746155651.640215:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780789712035ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155651.640221:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3729, 88 off315344 00000004:00080000:1.0:1746155651.640223:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780789720417ns, next at 716011101328ns, rc = 0 00000040:00080000:1.0:1746155651.640229:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3740, 88 off316048 00000004:00080000:1.0:1746155651.640231:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780789728165ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155651.640237:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3741, 88 off316136 00000004:00080000:1.0:1746155651.640239:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780789736077ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155651.640245:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3742, 88 off316224 00000004:00080000:1.0:1746155651.640247:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780789743749ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155651.640252:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].3743, 88 off316312 00000004:00080000:1.0:1746155651.640254:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 780789751139ns, next at 716024381471ns, rc = 0 00000040:00080000:1.0:1746155651.640259:0:14236:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].3730, 88 off315432 00000004:00080000:1.0:1746155651.640261:0:14236:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 780789758532ns, next at 716011101328ns, rc = 0 00000001:00080000:1.0:1746155651.659609:0:14318:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589945480 is committed 00000004:00080000:1.0:1746155651.659618:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2913 committed 00000004:00010000:2.0:1746155651.659690:0:14236:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800910db800 reply state ffff88009f6e9400 transno 8589945480 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14236 initiator: MDT0 00000100:00100000:2.0:1746155651.659700:0:14236:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746155651.659707:0:14236:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:2.0:1746155651.659710:0:14236:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746155651.659717:0:14236:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009f7df600/0x844e5faceb5f972d lrc: 0/0,0 mode: --/PW res: [0x200000403:0x35e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f1909c expref: 287 pid: 27374 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1746155651.659798:0:14236:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000004:00080000:1.0:1746155651.659818:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2920 committed 00000004:00080000:1.0:1746155651.659824:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2919 committed 00000004:00080000:1.0:1746155651.659825:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2918 committed 00000004:00080000:1.0:1746155651.659827:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2917 committed 00000004:00080000:1.0:1746155651.659841:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2912 committed 00000004:00080000:1.0:1746155651.659843:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2916 committed 00000004:00080000:1.0:1746155651.659844:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2911 committed 00000004:00080000:1.0:1746155651.659846:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2915 committed 00000004:00080000:1.0:1746155651.659847:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2910 committed 00000004:00080000:1.0:1746155651.659848:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2909 committed 00000004:00080000:1.0:1746155651.659850:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2908 committed 00000004:00080000:1.0:1746155651.659851:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2914 committed 00000004:00080000:1.0:1746155651.659852:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2913 committed 00000004:00080000:1.0:1746155651.659854:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2907 committed 00000004:00080000:1.0:1746155651.659855:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2906 committed 00000004:00080000:1.0:1746155651.659857:0:14318:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2912 committed 00000100:00100000:3.0:1746155651.659975:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125488000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155651.660011:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155651.660029:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125488512:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155651.660040:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155651.660052:0:3295:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746155651.660056:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125488128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155651.660067:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155651.660074:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125488640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155651.660093:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155651.660108:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125488384:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155651.660119:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155651.660127:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f0d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125488896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155651.660138:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155651.660146:0:3298:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746155651.660148:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125488256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155651.660159:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155651.660165:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880094443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125488768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746155651.660175:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155651.660191:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125488000 00000100:00100000:3.0:1746155651.660195:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125488000 00000100:00100000:3.0:1746155651.660216:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125488512 00000100:00100000:3.0:1746155651.660218:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125488512 00000100:00100000:3.0:1746155651.660226:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125488128 00000100:00100000:3.0:1746155651.660227:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125488128 00000100:00100000:3.0:1746155651.660235:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125488640 00000100:00100000:3.0:1746155651.660236:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125488640 00000100:00100000:3.0:1746155651.660244:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125488384 00000100:00100000:3.0:1746155651.660245:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125488384 00000100:00100000:3.0:1746155651.660250:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125488896 00000100:00100000:3.0:1746155651.660252:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125488896 00000100:00100000:3.0:1746155651.660258:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125488256 00000100:00100000:3.0:1746155651.660259:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125488256 00000100:00100000:3.0:1746155651.660265:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125488768 00000100:00100000:3.0:1746155651.660266:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125488768 00000100:00100000:3.0:1746155651.660274:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17757 00000100:00100000:3.0:1746155651.660279:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976125488000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155651.660324:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17758 00000100:00100000:1.0:1746155651.660329:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976125488512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155651.660474:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976125488512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 144us (432us total) trans 21474841762 rc 0/0 00000100:00100000:1.0:1746155651.660479:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17758 00000100:00100000:1.0:1746155651.660494:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17759 00000100:00100000:1.0:1746155651.660497:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976125488128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746155651.660579:0:29728:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746155651.660583:0:29728:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb mtime from disk: 1746155650 -> 1746155650 00002000:00010000:1.0:1746155651.660585:0:29728:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb atime from disk: 1746155650 -> 1746155650 00002000:00010000:1.0:1746155651.660587:0:29728:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb ctime from disk: 1746155652 -> 1746155652 00002000:00010000:1.0:1746155651.660588:0:29728:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e1:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:1.0:1746155651.660605:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131497800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976125488128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (536us total) trans 21474841763 rc 0/0 00000100:00100000:1.0:1746155651.660609:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17759 00000100:00100000:1.0:1746155651.660619:0:29728:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17760 00000100:00100000:0.0:1746155651.660894:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17761 00000100:00100000:0.0:1746155651.660901:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3298:x1830976125488384:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155651.660911:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32691:x1830976126266496:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 25556us (25734us total) trans 8589945480 rc 0/0 00000100:00100000:2.0:1746155651.660918:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4820 00000100:00100000:2.0:1746155651.660995:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17762 00000100:00100000:0.0:1746155651.660995:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976125488384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (874us total) trans 21474841764 rc 0/0 00000100:00100000:2.0:1746155651.661000:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976125488896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155651.661001:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17761 00000100:00100000:0.0:1746155651.661012:0:18270:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17763 00000100:00100000:0.0:1746155651.661016:0:18270:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3298:x1830976125488256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746155651.661067:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17764 00000100:00100000:0.0:1746155651.661070:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976125488768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746155651.661097:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976125488896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (957us total) trans 21474841765 rc 0/0 00000100:00100000:2.0:1746155651.661103:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17762 00000100:00100000:2.0:1746155651.661118:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125489152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155651.661126:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3298:x1830976125488768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (949us total) trans 21474841767 rc 0/0 00000100:00100000:0.0:1746155651.661131:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17764 00000100:00100000:2.0:1746155651.661136:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155651.661140:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125489152 00000100:00100000:0.0:1746155651.661143:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125489152 00000100:00100000:2.0:1746155651.661146:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125489664:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155651.661156:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155651.661158:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17765 00000100:00100000:0.0:1746155651.661161:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3296:x1830976125489152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155651.661163:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746155651.661166:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125489024:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155651.661176:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155651.661181:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125489536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155651.661190:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155651.661200:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125489664 00000100:00100000:2.0:1746155651.661202:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125489664 00000100:00100000:2.0:1746155651.661211:0:19959:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125489024 00000100:00100000:2.0:1746155651.661212:0:19959:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125489024 00000100:00100000:2.0:1746155651.661217:0:19959:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17766 00000100:00100000:2.0:1746155651.661220:0:19959:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3296:x1830976125489664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155651.661242:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746155651.661245:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb mtime from disk: 1746155650 -> 1746155650 00002000:00010000:0.0:1746155651.661247:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb atime from disk: 1746155650 -> 1746155650 00002000:00010000:0.0:1746155651.661248:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb ctime from disk: 1746155652 -> 1746155652 00002000:00010000:0.0:1746155651.661250:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e3:0x0] updating lvb blocks from disk: 2081 -> 2081 00000100:00100000:0.0:1746155651.661270:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3296:x1830976125489152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (133us total) trans 17179874460 rc 0/0 00000100:00100000:0.0:1746155651.661275:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17765 00000100:00100000:0.0:1746155651.661283:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125489536 00000100:00100000:0.0:1746155651.661285:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125489536 00000100:00100000:0.0:1746155651.661294:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17767 00000100:00100000:0.0:1746155651.661297:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3296:x1830976125489024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155651.661331:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17768 00000100:00100000:0.0:1746155651.661336:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3296:x1830976125489536:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155651.661352:0:19959:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3296:x1830976125489664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (194us total) trans 17179874461 rc 0/0 00000100:00100000:2.0:1746155651.661357:0:19959:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17766 00000004:00080000:2.0:1746155651.661380:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f581c00/2, rc 0, transno 17179874460 00000100:00100000:2.0:1746155651.661386:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125489152:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746155651.661390:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f583800/2, rc 0, transno 17179874461 00000100:00100000:2.0:1746155651.661392:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125489664:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155651.661412:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3296:x1830976125489536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 76us (220us total) trans 17179874462 rc 0/0 00000004:00080000:2.0:1746155651.661415:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f583480/2, rc 0, transno 17179874462 00000100:00100000:0.0:1746155651.661417:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17768 00000100:00100000:2.0:1746155651.661418:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125489536:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155651.661420:0:3296:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1746155651.661426:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125490048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746155651.661442:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155651.661459:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125490048 00000100:00100000:2.0:1746155651.661462:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125490048 00000100:00100000:2.0:1746155651.661476:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17769 00000100:00100000:2.0:1746155651.661480:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a0956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3296:x1830976125490048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746155651.661487:0:18270:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746155651.661491:0:18270:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb mtime from disk: 1746155650 -> 1746155650 00002000:00010000:0.0:1746155651.661492:0:18270:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb atime from disk: 1746155650 -> 1746155650 00002000:00010000:0.0:1746155651.661494:0:18270:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb ctime from disk: 1746155652 -> 1746155652 00002000:00010000:0.0:1746155651.661495:0:18270:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e2:0x0] updating lvb blocks from disk: 4137 -> 4137 00000100:00100000:0.0:1746155651.661524:0:18270:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3298:x1830976125488256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 508us (1365us total) trans 21474841766 rc 0/0 00000100:00100000:0.0:1746155651.661528:0:18270:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17763 00002000:00010000:0.0:1746155651.661570:0:4461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746155651.661572:0:4461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb mtime from disk: 1746155650 -> 1746155650 00002000:00010000:0.0:1746155651.661573:0:4461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb atime from disk: 1746155650 -> 1746155650 00002000:00010000:0.0:1746155651.661574:0:4461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb ctime from disk: 1746155652 -> 1746155652 00002000:00010000:0.0:1746155651.661575:0:4461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e1:0x0] updating lvb blocks from disk: 2023 -> 2023 00000100:00100000:2.0:1746155651.661579:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a0956a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976125490048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (135us total) trans 17179874463 rc 0/0 00000100:00100000:2.0:1746155651.661584:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17769 00000100:00100000:0.0:1746155651.661587:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f582d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3296:x1830976125489024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 289us (410us total) trans 17179874464 rc 0/0 00000100:00100000:0.0:1746155651.661589:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17767 00000004:00080000:2.0:1746155651.661606:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a0956680/2, rc 0, transno 17179874463 00000100:00100000:2.0:1746155651.661610:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125490048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.661811:0:29728:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3295:x1830976125488640:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155651.661856:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094442300/2, rc 0, transno 21474841763 00000100:00100000:1.0:1746155651.661859:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125488128:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746155651.661866:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094441180/2, rc 0, transno 21474841762 00000100:00100000:1.0:1746155651.661868:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125488512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746155651.661877:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125489280:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.661895:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155651.661905:0:3289:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:1.0:1746155651.661906:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125489792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.661919:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155651.661929:0:3297:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1746155651.661932:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125489408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.661944:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155651.661952:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009f582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125489920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.661963:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746155651.661976:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125489280 00000100:00100000:1.0:1746155651.661978:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125489280 00000100:00100000:1.0:1746155651.661991:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125489792 00000100:00100000:1.0:1746155651.661992:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125489792 00000100:00100000:0.0:1746155651.661999:0:4461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125489408 00000100:00100000:1.0:1746155651.662000:0:20796:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125489920 00000100:00100000:1.0:1746155651.662001:0:20796:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125489920 00000100:00100000:0.0:1746155651.662003:0:4461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125489408 00000100:00100000:1.0:1746155651.662010:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17770 00000100:00100000:1.0:1746155651.662014:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976125489280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155651.662016:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17771 00000100:00100000:0.0:1746155651.662020:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976125489792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746155651.662085:0:20796:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb size from disk: 5079552 -> 5079552 00002000:00010000:1.0:1746155651.662087:0:20796:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb mtime from disk: 1746155650 -> 1746155650 00002000:00010000:1.0:1746155651.662089:0:20796:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb atime from disk: 1746155650 -> 1746155650 00002000:00010000:1.0:1746155651.662091:0:20796:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb ctime from disk: 1746155652 -> 1746155652 00002000:00010000:1.0:1746155651.662092:0:20796:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x3e4:0x0] updating lvb blocks from disk: 5905 -> 5905 00000100:00100000:0.0:1746155651.662111:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3297:x1830976125489792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (191us total) trans 17179874466 rc 0/0 00000100:00100000:1.0:1746155651.662114:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3297:x1830976125489280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 99us (217us total) trans 17179874465 rc 0/0 00000100:00100000:0.0:1746155651.662116:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17771 00000100:00100000:1.0:1746155651.662119:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17770 00000100:00100000:0.0:1746155651.662125:0:4461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17772 00000100:00100000:0.0:1746155651.662129:0:4461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976125489920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.662130:0:20796:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17773 00000100:00100000:1.0:1746155651.662135:0:20796:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3297:x1830976125489408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155651.662199:0:4461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3297:x1830976125489920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (235us total) trans 17179874467 rc 0/0 00000100:00100000:0.0:1746155651.662204:0:4461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17772 00000100:00100000:1.0:1746155651.662207:0:20796:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3297:x1830976125489408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (261us total) trans 17179874468 rc 0/0 00000100:00100000:1.0:1746155651.662211:0:20796:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17773 00000004:00080000:0.0:1746155651.662223:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f582300/2, rc 0, transno 17179874468 00000100:00100000:0.0:1746155651.662226:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125489408:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155651.662232:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f582a00/2, rc 0, transno 17179874467 00000100:00100000:0.0:1746155651.662233:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125489920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155651.662238:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f581180/2, rc 0, transno 17179874465 00000100:00100000:0.0:1746155651.662241:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125489280:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746155651.662245:0:3297:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f583b80/2, rc 0, transno 17179874466 00000100:00100000:0.0:1746155651.662247:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1830976125489792:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746155651.662289:0:29728:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f4fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976125488640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1665us (2194us total) trans 21474841768 rc 0/0 00000100:00100000:1.0:1746155651.662294:0:29728:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17760 00000004:00080000:0.0:1746155651.662541:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094441c00/2, rc 0, transno 21474841768 00000100:00100000:0.0:1746155651.662545:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094441c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125488640:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746155651.662585:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746155651.662590:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb mtime from disk: 1746155650 -> 1746155650 00002000:00010000:3.0:1746155651.662592:0:8438:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb atime from disk: 1746155650 -> 1746155650 00002000:00010000:3.0:1746155651.662594:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb ctime from disk: 1746155652 -> 1746155652 00002000:00010000:3.0:1746155651.662595:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x3e0:0x0] updating lvb blocks from disk: 2079 -> 2079 00000100:00100000:3.0:1746155651.662624:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009f0d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976125488000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2344us (2613us total) trans 21474841769 rc 0/0 00000100:00100000:3.0:1746155651.662629:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17757 00000004:00080000:0.0:1746155651.662631:0:3295:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094440a80/2, rc 0, transno 21474841769 00000100:00100000:0.0:1746155651.662634:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125488000:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746155651.662662:0:3282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 3/0,1 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155651.662670:0:3282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 2/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155651.662676:0:3282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155651.662681:0:3282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a6040400 already unused, calling callback (ffffffffa135a690) 00010000:00010000:3.0:1746155651.662685:0:3282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 3/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155651.662690:0:3282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 4/0,0 mode: EX/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155651.662702:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff8800942dc500) 00010000:00010000:3.0:1746155651.662704:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155651.662707:0:3282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 2/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 00010000:00010000:3.0:1746155651.662712:0:3282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6040400/0x844e5faceb5f9814 lrc: 0/0,0 mode: --/EX res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14236 initiator: MDT0 00000100:00100000:3.0:1746155651.662735:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126266752 00000100:00100000:3.0:1746155651.662738:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126266752 00000100:00100000:3.0:1746155651.662756:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 11296 00000100:00100000:3.0:1746155651.662760:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+285:32691:x1830976126266752:12345-192.168.202.51@tcp:101:lfs.0 00010000:00010000:3.0:1746155651.662771:0:27374:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746155651.662780:0:27374:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74fc00/0x844e5faceb5f981b lrc: 2/0,0 mode: --/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f2a536e86f19105 expref: -99 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.662812:0:27374:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74fc00/0x844e5faceb5f981b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19105 expref: 286 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.662820:0:27374:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a74fc00/0x844e5faceb5f981b lrc: 3/0,0 mode: CR/CR res: [0x200000403:0x35e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.51@tcp remote: 0x1f2a536e86f19105 expref: 286 pid: 27374 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746155651.662859:0:27374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000403:0x35e:0x0].0x0 (ffff88009fff0100) 00010000:00010000:3.0:1746155651.662861:0:27374:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746155651.662863:0:27374:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a74fc00, rc 0) 00000100:00100000:3.0:1746155651.662890:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32691:x1830976126266752:12345-192.168.202.51@tcp:101:lfs.0 Request processed in 129us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1746155651.662894:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 11296 00000004:00080000:3.0:1746155651.662957:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094440000/2, rc 0, transno 21474841766 00000100:00100000:3.0:1746155651.662960:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094440000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125488256:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155651.662966:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094443480/2, rc 0, transno 21474841767 00000100:00100000:3.0:1746155651.662968:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125488768:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155651.662974:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880094442680/2, rc 0, transno 21474841764 00000100:00100000:3.0:1746155651.662976:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880094442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125488384:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746155651.662980:0:3298:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f0d9c00/2, rc 0, transno 21474841765 00000100:00100000:3.0:1746155651.662982:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f0d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1830976125488896:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746155651.663155:0:3296:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009f580000/2, rc 0, transno 17179874464 00000100:00100000:2.0:1746155651.663161:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009f580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125489024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746155651.664658:0:3288:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.51@tcp (source: 12345-192.168.202.51@tcp) 00000100:00100000:2.0:1746155651.664738:0:14236:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976126267008 00000100:00100000:2.0:1746155651.664744:0:14236:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976126267008 00000100:00100000:2.0:1746155651.664782:0:14236:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.51@tcp, seq: 4821 00000100:00100000:2.0:1746155651.664788:0:14236:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+286:32691:x1830976126267008:12345-192.168.202.51@tcp:35:lfs.0 00000100:00100000:2.0:1746155651.665201:0:14236:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8066b3b8-f397-4fc0-a5d7-9a18bc891e5b+287:32691:x1830976126267008:12345-192.168.202.51@tcp:35:lfs.0 Request processed in 411us (545us total) trans 8589945481 rc 0/0 00000100:00100000:2.0:1746155651.665207:0:14236:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.51@tcp, seq: 4821 00000100:00100000:2.0:1746155651.906898:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1830976125490304:0@lo:400:kworker.0 00000100:00100000:0.0:1746155651.906905:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3296:1830976125490176:0@lo:400:kworker.0 00000100:00100000:3.0:1746155651.907069:0:3298:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1830976125490432:0@lo:400:kworker.0 00000100:00100000:1.0:1746155651.907137:0:3295:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125490560:0@lo:400:kworker.0 00000100:00100000:2.0:1746155651.907183:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155651.907220:0:3297:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830976125490816:0@lo:400:kworker.0 00000100:00100000:2.0:1746155651.907237:0:3297:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155651.907269:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125490304 00000100:00100000:2.0:1746155651.907275:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125490304 00000100:00100000:2.0:1746155651.907307:0:27374:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125490816 00000100:00100000:2.0:1746155651.907309:0:27374:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125490816 00000100:00100000:2.0:1746155651.907322:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1746155651.907328:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830976125490304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746155651.907363:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1830976125490304:12345-0@lo:400:kworker.0 Request processed in 35us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155651.907368:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1746155651.907379:0:27374:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1746155651.907383:0:27374:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830976125490816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746155651.907399:0:27374:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1830976125490816:12345-0@lo:400:kworker.0 Request processed in 16us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155651.907403:0:27374:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:2.0:1746155651.907419:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746155651.907438:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1830976125490304:0@lo:400:kworker.0 00000100:00100000:2.0:1746155651.907445:0:3297:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1830976125490816:0@lo:400:kworker.0 00000100:00100000:0.0:1746155651.907692:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746155651.907694:0:3298:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155651.907711:0:15474:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125490432 00000100:00100000:2.0:1746155651.907714:0:15474:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125490432 00000100:00100000:0.0:1746155651.907717:0:3296:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a0d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125490688:0@lo:400:kworker.0 00000100:00100000:3.0:1746155651.907719:0:14231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125490176 00000100:00100000:3.0:1746155651.907722:0:14231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125490176 00000100:00100000:2.0:1746155651.907732:0:15474:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1746155651.907735:0:3296:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746155651.907736:0:15474:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009fa35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830976125490432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746155651.907741:0:14231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1746155651.907746:0:14231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880094e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3296:x1830976125490176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746155651.907758:0:15474:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009fa35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1830976125490432:12345-0@lo:400:kworker.0 Request processed in 21us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1746155651.907759:0:20200:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125490688 00000100:00100000:2.0:1746155651.907763:0:15474:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1746155651.907768:0:20200:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125490688 00000100:00100000:3.0:1746155651.907770:0:14231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880094e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:10e37917-1d68-4ee4-bb3b-d964343b4e1f+18:3296:x1830976125490176:12345-0@lo:400:kworker.0 Request processed in 24us (78us total) trans 0 rc 0/0 00000100:00080000:2.0:1746155651.907771:0:7074:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746155651.907775:0:14231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1746155651.907798:0:3298:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1830976125490432:0@lo:400:kworker.0 00000100:00100000:0.0:1746155651.907855:0:20200:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1746155651.907860:0:20200:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3296:x1830976125490688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746155651.907882:0:3295:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746155651.908061:0:20200:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800910d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3296:x1830976125490688:12345-0@lo:400:kworker.0 Request processed in 200us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746155651.908449:0:1625:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830976125490560 00000100:00100000:2.0:1746155651.908453:0:1625:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830976125490560 00000100:00100000:1.0:1746155651.908475:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ca94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:10e37917-1d68-4ee4-bb3b-d964343b4e1f:3296:1830976125490176:0@lo:400:kworker.0 00000100:00100000:1.0:1746155651.908484:0:3296:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1830976125490688:0@lo:400:kworker.0 00000100:00100000:0.0:1746155651.908535:0:20200:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1746155651.908549:0:1625:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1746155651.908555:0:1625:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976125490560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746155651.908583:0:1625:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013089a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+21:3295:x1830976125490560:12345-0@lo:400:kworker.0 Request processed in 29us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1746155651.908862:0:3295:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a0d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1830976125490560:0@lo:400:kworker.0 00000100:00100000:2.0:1746155651.908912:0:1625:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000001:02000400:1.0:1746155652.277879:0:7378:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed 00010000:00010000:2.0:1746155652.305647:0:884:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 70282 lines, 70282 kept, 0 dropped, 0 bad.